LoLLMS WebUI

​

How to Leverage Novita AI with LoLLMS WebUI

​

Obtain Your Novita AI API Key

1. Log in to your Novita AI account.
2. Navigate to the Key Management page.
3. Generate a new API Key and copy it.

​

Install LoLLMS WebUI

1. Automatic Installation:
   • Download the installation script from the scripts folder and run it:
     • lollms_installer.bat for Windows.
     • lollms_installer.sh for Linux.
     • lollms_installer_macos.sh for Mac.
2. Manual Installation:
   • Ensure Python 3.11 is installed. Check your version with python --version.
   • If needed, download Python 3.11 from Python.org.

git clone --recursive https://github.com/ParisNeo/lollms-webui.git
cd lollms-webui
git submodule update --init --recursive

• Create a Virtual Environment:

python -m venv venv

• Activate the Virtual Environment:
  • On Windows:
    .\venv\Scripts\activate
    
  • On Linux/Mac:
    source venv/bin/activate
    

pip install -r requirements.txt
pip install -e ./lollms_core

mkdir -p $HOME/.lollms_personal_data

cat > global_paths_cfg.yaml << EOL
lollms_path: $(pwd)/lollms_core/lollms
lollms_personal_path: $HOME/.lollms_personal_data
EOL

​

Configure Novita AI in LoLLMS WebUI

1. Install Novita AI Binding

• Set environment variables for Novita AI binding. For example:
  • On Windows:
  set NOVITA_AI_API_KEY="your_api_key_here"
  set NOVITA_AI_MODEL_NAME="your_model_name_here"
  
  • On Linux/Mac:
  export NOVITA_AI_API_KEY="your_api_key_here"
  export NOVITA_AI_MODEL_NAME="your_model_name_here"
  
• Run the script to finalize the setup:
  python zoos/bindings_zoo/novita_ai/__init__.py
  

2. Run the Server

python app.py

3. Use Novita AI in LoLLMS WebUI

• Open your browser and navigate to http://localhost:9600 (or the port shown in the terminal).
• Select Novita AI from the available bindings.
• Enter your Novita AI API key.
• Select your desired Novita AI model.