Hermes 2 Pro Llama 3 8B
nousresearch/hermes-2-pro-llama-3-8b
Hermes 2 Pro is an upgraded, retrained version of Nous Hermes 2, consisting of an updated and cleaned version of the OpenHermes 2.5 Dataset, as well as a newly introduced Function Calling and JSON Mode dataset developed in-house.
Features
Serverless API
Docs
nousresearch/hermes-2-pro-llama-3-8b is available via Novita's serverless API, where you pay per token. There are several ways to call the API, including OpenAI-compatible endpoints with exceptional reasoning performance.
Available Serverless
Run queries immediately, pay only for usage
Input$0.14 / M Tokens
Output$0.14 / M Tokens
Use the following code examples to integrate with our API:
1from openai import OpenAI
2
3client = OpenAI(
4 api_key="<Your API Key>",
5 base_url="https://api.novita.ai/openai"
6)
7
8response = client.chat.completions.create(
9 model="nousresearch/hermes-2-pro-llama-3-8b",
10 messages=[
11 {"role": "system", "content": "You are a helpful assistant."},
12 {"role": "user", "content": "Hello, how are you?"}
13 ],
14 max_tokens=8192,
15 temperature=0.7
16)
17
18print(response.choices[0].message.content)Info
Provider
Others
Quantization
fp16
Supported Functionality
Context Length
8192
Max Output
8192
Serverless
Supported
Structured Output
Supported
Input Capabilities
text
Output Capabilities
text
Everything you need to build production AI.
200+ models, on-demand GPUs, and secure agent runtimes — unified under one API. Free to start, scales as you grow.