Qwen 2.5 72B Instruct
qwen/qwen-2.5-72b-instruct
Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters.
功能
Serverless API
文档
qwen/qwen-2.5-72b-instruct is available via Novita's serverless API, where you pay per token. There are several ways to call the API, including OpenAI-compatible endpoints with exceptional reasoning performance.
按需部署
文档
On-demand deployments allow you to use qwen/qwen-2.5-72b-instruct on dedicated GPUs with high-performance serving stack with high reliability and no rate limits.
可用的 Serverless
立即运行查询，仅按用量付费
输入$0.38 / M Tokens
输出$0.4 / M Tokens
使用以下代码示例与我们的 API 集成：
1from openai import OpenAI
2
3client = OpenAI(
4 api_key="<Your API Key>",
5 base_url="https://api.novita.ai/openai"
6)
7
8response = client.chat.completions.create(
9 model="qwen/qwen-2.5-72b-instruct",
10 messages=[
11 {"role": "system", "content": "You are a helpful assistant."},
12 {"role": "user", "content": "Hello, how are you?"}
13 ],
14 max_tokens=8192,
15 temperature=0.7
16)
17
18print(response.choices[0].message.content)信息
提供商
Qwen
量化
bf16
支持的功能
上下文长度
32000
最大输出
8192
Serverless
支持
Function Calling
支持
Structured Output
支持
输入能力
text
输出能力
text