Llama-3.1-8B-Instruct
Other Providers $0.20/M tokens (Input/Output)
Our Price $0.05/M tokens (Input/Output)
Save 75%!
from openai import OpenAI
client = OpenAI(
base_url='https://api.novita.ai/v3/openai',
api_key='<YOUR Novita AI API Key>',
# Get the Novita AI API Key by referring: https://novita.ai/docs/get-started/quickstart.html#_2-manage-api-key
)
completion_res = client.completions.create(
model='meta-llama/llama-3.1-8b-instruct',
prompt='A chat between a curious user and an artificial intelligence assistant',
stream=True,
max_tokens=512,
)
Refer a friend to Novita and both earn $10 in LLM API credits—up to $500 in total.
Build Free