DeepSeek R1 Distill LLama 70B
deepseek/deepseek-r1-distill-llama-70b
DeepSeek R1 Distill LLama 70B
Features
Serverless API
Docs
deepseek/deepseek-r1-distill-llama-70b is available via Novita's serverless API, where you pay per token. There are several ways to call the API, including OpenAI-compatible endpoints with exceptional reasoning performance.
On-demand Deployments
Docs
On-demand deployments allow you to use deepseek/deepseek-r1-distill-llama-70b on dedicated GPUs with high-performance serving stack with high reliability and no rate limits.
Available Serverless
Run queries immediately, pay only for usage
Input$0.8 / M Tokens
Output$0.8 / M Tokens
Use the following code examples to integrate with our API:
1from openai import OpenAI
2
3client = OpenAI(
4 api_key="<Your API Key>",
5 base_url="https://api.novita.ai/openai"
6)
7
8response = client.chat.completions.create(
9 model="deepseek/deepseek-r1-distill-llama-70b",
10 messages=[
11 {"role": "system", "content": "You are a helpful assistant."},
12 {"role": "user", "content": "Hello, how are you?"}
13 ],
14 max_tokens=8192,
15 temperature=0.7
16)
17
18print(response.choices[0].message.content)Info
Provider
DeepSeek
Quantization
bf16
Supported Functionality
Context Length
8192
Max Output
8192
Serverless
Supported
Reasoning
Supported
Input Capabilities
text
Output Capabilities
text
Everything you need to build production AI.
200+ models, on-demand GPUs, and secure agent runtimes — unified under one API. Free to start, scales as you grow.