Don't show again
Llama 3.2 3B Instruct
meta-llama/llama-3.2-3b-instruct
The Meta Llama 3.2 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction-tuned generative models in 1B and 3B sizes (text in/text out)
Features
Serverless API
Docs
meta-llama/llama-3.2-3b-instruct is available via Novita's serverless API, where you pay per token. There are several ways to call the API, including OpenAI-compatible endpoints with exceptional reasoning performance.
On-demand Deployments
Docs
On-demand deployments allow you to use meta-llama/llama-3.2-3b-instruct on dedicated GPUs with high-performance serving stack with high reliability and no rate limits.
Available Serverless
Run queries immediately, pay only for usage
Input$0.03 / M Tokens
Output$0.05 / M Tokens
Use the following code examples to integrate with our API:
1from openai import OpenAI
2
3client = OpenAI(
4 api_key="<Your API Key>",
5 base_url="https://api.novita.ai/openai"
6)
7
8response = client.chat.completions.create(
9 model="meta-llama/llama-3.2-3b-instruct",
10 messages=[
11 {"role": "system", "content": "You are a helpful assistant."},
12 {"role": "user", "content": "Hello, how are you?"}
13 ],
14 max_tokens=32000,
15 temperature=0.7
16)
17
18print(response.choices[0].message.content)Info
Provider
Llama
Quantization
bf16
Supported Functionality
Context Length
32768
Max Output
32000
Function Calling
Supported
Input Capabilities
text
Output Capabilities
text