Qwen 2.5 72B Instruct
qwen/qwen-2.5-72b-instruct
Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters.
Features
Serverless API
Docs
qwen/qwen-2.5-72b-instruct is available via Novita's serverless API, where you pay per token. There are several ways to call the API, including OpenAI-compatible endpoints with exceptional reasoning performance.
On-demand Deployments
Docs
On-demand deployments allow you to use qwen/qwen-2.5-72b-instruct on dedicated GPUs with high-performance serving stack with high reliability and no rate limits.
Available Serverless
Run queries immediately, pay only for usage
Input$0.38 / M Tokens
Output$0.4 / M Tokens
Use the following code examples to integrate with our API:
1from openai import OpenAI
2
3client = OpenAI(
4 api_key="<Your API Key>",
5 base_url="https://api.novita.ai/openai"
6)
7
8response = client.chat.completions.create(
9 model="qwen/qwen-2.5-72b-instruct",
10 messages=[
11 {"role": "system", "content": "You are a helpful assistant."},
12 {"role": "user", "content": "Hello, how are you?"}
13 ],
14 max_tokens=8192,
15 temperature=0.7
16)
17
18print(response.choices[0].message.content)Info
Provider
Qwen
Quantization
bf16
Supported Functionality
Context Length
32000
Max Output
8192
Serverless
Supported
Function Calling
Supported
Structured Output
Supported
Input Capabilities
text
Output Capabilities
text
Everything you need to build production AI.
200+ models, on-demand GPUs, and secure agent runtimes — unified under one API. Free to start, scales as you grow.