L3 8B Stheno V3.2

Sao10K/L3-8B-Stheno-v3.2

Sao10K/L3-8B-Stheno-v3.2 is a highly skilled actor that excels at fully immersing itself in any role assigned.

Características

API serverless

Documentación

Sao10K/L3-8B-Stheno-v3.2 is available via Novita's serverless API, where you pay per token. There are several ways to call the API, including OpenAI-compatible endpoints with exceptional reasoning performance.

Implementaciones bajo demanda

Documentación

On-demand deployments allow you to use Sao10K/L3-8B-Stheno-v3.2 on dedicated GPUs with high-performance serving stack with high reliability and no rate limits.

Serverless disponible

Ejecuta consultas de inmediato, paga solo por el uso

Entrada$0.05 / M Tokens

Salida$0.05 / M Tokens

Usa los siguientes ejemplos de código para integrarte con nuestra API:

1from openai import OpenAI
2
3client = OpenAI(
4    api_key="<Your API Key>",
5    base_url="https://api.novita.ai/openai"
6)
7
8response = client.chat.completions.create(
9    model="Sao10K/L3-8B-Stheno-v3.2",
10    messages=[
11        {"role": "system", "content": "You are a helpful assistant."},
12        {"role": "user", "content": "Hello, how are you?"}
13    ],
14    max_tokens=32000,
15    temperature=0.7
16)
17
18print(response.choices[0].message.content)

Información

Proveedor

Sao10K

Cuantización

bf16

Funcionalidad compatible

Longitud del contexto

8192

Salida máxima

32000

Serverless

Compatible

Function Calling

Compatible

Capacidades de entrada

text

Capacidades de salida

text