Llama 3.3 70B Instruct
meta-llama/llama-3.3-70b-instruct
The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimized for multilingual dialogue use cases and outperforms many of the available open source and closed chat models on common industry benchmarks.
Supported languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.
功能
Serverless API
文档
meta-llama/llama-3.3-70b-instruct is available via Novita's serverless API, where you pay per token. There are several ways to call the API, including OpenAI-compatible endpoints with exceptional reasoning performance.
按需部署
文档
On-demand deployments allow you to use meta-llama/llama-3.3-70b-instruct on dedicated GPUs with high-performance serving stack with high reliability and no rate limits.
可用的 Serverless
立即运行查询，仅按用量付费
输入$0.135 / M Tokens
输出$0.4 / M Tokens
使用以下代码示例与我们的 API 集成：
1from openai import OpenAI
2
3client = OpenAI(
4 api_key="<Your API Key>",
5 base_url="https://api.novita.ai/openai"
6)
7
8response = client.chat.completions.create(
9 model="meta-llama/llama-3.3-70b-instruct",
10 messages=[
11 {"role": "system", "content": "You are a helpful assistant."},
12 {"role": "user", "content": "Hello, how are you?"}
13 ],
14 max_tokens=120000,
15 temperature=0.7
16)
17
18print(response.choices[0].message.content)信息
提供商
Llama
量化
bf16
支持的功能
上下文长度
131072
最大输出
120000
Serverless
支持
Function Calling
支持
Structured Output
支持
输入能力
text
输出能力
text
构建生产级 AI 所需的一切。
200+ 个模型、按需 GPUs 和安全的智能体运行时——统一在一个 API 下。免费开始，随业务增长灵活扩展。