Skip to main content

Connect a custom AI provider

Configure your custom AI provider for Retool AI.

You can get started with Retool AI without needing any API credentials using the Retool-managed OpenAI connection, which enables you to evaluate and test AI queries before using them in production. When you're ready to use Retool AI in production, add and configure your custom AI provider.

Connecting a custom AI provider is helpful when:

  • You want to use a third-party AI provider like Mistral, Fireworks AI, Together AI, or OpenRouter.
  • You want to connect a custom LLM.
  • You have increased security and compliance requirements and need to route traffic through your own proxies.

You can connect any AI provider that adheres to the OpenAI, Anthropic, Google, or Cohere schema.

Set up your AI platform credentials​

To configure a custom AI provider in Retool:

  1. Navigate to the Resources tab and select Retool AI.
  2. Scroll down to the Custom providers section and click Add.
  3. Supply the requested information about your custom provider.
  4. Click Add.

Where possible, create API credentials for each service you use to interact with your chosen AI platform. This allows you to best manage and revoke access without disruption. All API credentials used with Retool are encrypted and stored securely.