Skip to main content

Custom LLM Providers

Genum supports custom providers that implement an OpenAI-like API. This lets you connect any compatible service and manage models alongside native providers. Custom models are added at the organization level and become available in all projects within that organization.

Add a Custom Provider​

  1. Open Organization Settings.
  2. Go to LLM API Keys and select the Custom tab.
  3. Click Add Provider.
  4. Fill in the connection details:
    • Base URL of your provider
    • API Key (optional)
  5. Click Test Connection.

If the connection is successful, Genum will display the list of available models from your provider.

Configure Models​

After adding a provider, the same page shows all discovered models. For each model you can:

  • Rename the model for easier identification
  • Tune parameters (temperature, max tokens, and other supported settings)

These settings are stored per model and used in prompt executions.

Delete a Provider​

You can remove a provider from the same LLM API Keys page. Deletion is allowed only when no prompts or productive commits reference any model from that provider.

If deletion is blocked, first update prompts and commits to use a different model, then try again.