Skip to main content

Adding Custom Models in ConsoleX AI

ConsoleX AI allows you to integrate your own AI model endpoints. This guide explains how to set up and use custom model endpoints.

Supported Model Types​

ConsoleX AI supports integrating model endpoints from the following model providers and cloud service providers:

Steps to Set Up Custom Models​

To integrate your own model endpoints, follow these steps:

  1. Click the "Model Hub" link in the bottom left corner of the page.
  2. Click the "Add Custom Model" button in the top right corner of the page.
  3. Select a model provider from the list.
  4. Enter the necessary information for the model endpoint, such as API key, base URL, etc.
  5. Click the "Save" button.

Usage Limitations​

  • When using custom private model endpoints, you do not need to consume balance on ConsoleX AI.
  • Free users can integrate up to 3 private models, while paid subscription users can integrate unlimited private model endpoints.

Cache Application​

When users call custom model endpoints, ConsoleX AI will try to include cache request parameters in each call to help users use caching to save on calling costs.