LlamaIndex - Documentation

How to Integrate Novita AI API with LlamaIndex

Designed for optimal indexing and retrieval, LlamaIndex excels in delivering high efficiency for applications requiring precise and fast data access. By combining Novita AI with LlamaIndex, you will unlock key benefits such as superior data retrieval accuracy, unmatched scalability, and cost-effective performance. This guide will walk you through how to use LlamaIndex with Novita AI based on the OpenAl APl, offering smarter, scalable, and highly efficient AI solutions that drive innovation and deliver exceptional results for developers.

How to Integrate Novita AI API with LlamaIndex

Step 1: Visit Model Library on Novita AI and select a model of interest.

images/Step1VisitModelLibraryonNovitaAIandselectamodelofinterest.png

Step 2: Navigate to the demo page of the chosen model and click the Code button on the right.

images/Step2NavigatetothedemopageofthechosenmodelandclicktheCodebuttonontheright.png

Step 3: Copy the model’s name and make a note of it.

images/Step3Copythemodel’snameandmakeanoteofit.png

Step 4: Log in to the Novita platform.

images/Step4LogintotheNovitaplatform.png

Step 5: After logging in, go to the platform’s settings page.

images/Step5Afterloggingin,gototheplatform’ssettingspage.png

Step 6: Create a new API key and copy it for service authentication.

images/Step6CreateanewAPIkeyandcopyitforserviceauthentication.png

Step 7: Install llama_index and related Python libraries by running:

images/Step7Installllama_indexandrelatedPythonlibrariesbyrunning.png

Step 8: Write Python code and set the model name and API key as parameters in the NovitaAI class.

images/Step8WritePythoncodeandsetthemodelnameandAPIkeyasparametersintheNovitaAIclass.png

Step 9: Run the code to get the output.

For more examples, refer to the documentation: llama_index/llama-index-integrations/llms/llama-index-llms-novita at main · run-llama/llama_index.

DocsGPT LoLLMS WebUI

⌘I