What is Novita Agent Runtime?
Novita Agent Runtime is a lightweight framework for deploying AI Agents that enables you to deploy AI Agents quickly and cost-effectively.
No need to worry about infrastructure configuration, container orchestration, service exposure, or other complex details—just focus on developing your Agent’s business logic.
Core Components
Novita Agent Runtime is included in the Novita Sandbox SDK and CLI tools:
| Component | Description |
|---|
| Novita Sandbox SDK | Provides decorator-based APIs to expose your Agent as a standard HTTP service, and methods to invoke Agents |
| Novita Sandbox CLI | One-click configuration and deployment of Agents to the Novita Agent Sandbox ecosystem |
Deployment Workflow
The complete deployment and usage workflow consists of three steps:
Step 1: Develop and Integrate Your Agent
Integrate the SDK into your Agent code by adding decorators:
from novita_sandbox.agent_runtime import AgentRuntimeApp
app = AgentRuntimeApp()
@app.entrypoint
def my_agent(request: dict):
# Agent business logic
return {"result": "..."}
# Configure Agent
novita-sandbox-cli agent configure
# Deploy to cloud
novita-sandbox-cli agent launch
- Generates
Dockerfile and .novita-agent.yaml configuration files
- Builds sandbox template and uploads it
- Generates Agent ID (format:
agent_<name>_v<version>)
Step 3: Invoke Agent
After successful deployment, you can invoke your Agent via CLI or SDK:
Option 1: Quick test with CLI
novita-sandbox-cli agent invoke "Hello, Agent!"
import json
from novita_sandbox.agent_runtime import AgentRuntimeClient
client = AgentRuntimeClient(api_key="your-api-key")
# Prepare request data (converted to a JSON string and encoded as bytes)
payload = json.dumps({"prompt": "Hello, Agent!"}).encode()
response = await client.invoke_agent_runtime(
agentId="agent-xxxxx",
payload=payload
)
- Creates an isolated sandbox instance from the sandbox template
- Executes the Agent in an isolated environment
- Returns the processed result
Key Benefits
SDK:
- ✅ Minimal Changes: Just modify a few lines of code with decorators
- ✅ Framework Agnostic: Supports LangChain, LangGraph, CrewAI, and other popular AI frameworks
- ✅ Streaming Support: Native streaming responses for real-time LLM generation scenarios
- ✅ Health Checks: Built-in health check endpoint with customizable health status
CLI:
- ✅ Smart Detection: Auto-detects project structure, entry files, and dependency management files
- ✅ Auto Build: Automatically generates Dockerfile and project configuration
- ✅ Version Management: Supports multiple versions coexisting with independent deployments
- ✅ Quick Testing: Built-in invoke command for rapid deployment verification
Runtime:
- ✅ Environment Isolation: Each sandbox instance runs independently without interference
- ✅ Session Persistence: Multiple invocations to the same sandbox instance, supporting multi-turn interactive Agents
- ✅ Secure Sandbox: Securely isolated sandbox environment with restricted filesystem access
Last modified on November 27, 2025
