Skip to main content

Ollama

ConsoleX can connect to any model served through Ollama, whether it runs on your own computer or on a remote machine. Calls to your Ollama model don't use your ConsoleX plan allowance or credits.

Prerequisites​

  1. Make sure your Ollama endpoint is deployed and reachable over the network.
  2. If the model runs locally, expose it to the internet through a tunnel such as Cloudflare Tunnel, Ngrok or a similar solution.

Add an Ollama model in ConsoleX​

  1. Click … (More) in the left rail, then Models.
  2. In the Model Hub, click Add Custom Model and choose Ollama.
  3. Fill in:
    • Model Name: the Ollama model name
    • Base URL: the endpoint URL
  4. Save. The model appears in the Model Hub under Private.

The Select Model Provider dialog with Ollama in the list

After saving, test the connection from the Model Hub to make sure ConsoleX can reach your endpoint.

Checks and ConsoleX's built-in tools still use your plan's usage. See Custom models.

References​