Skip to main content

Retool AI platforms and models

Learn about the different AI platforms and models that Retool supports.

AI platforms use models that are trained on specific types of data to make relevant decisions and perform tasks. For example, you would interact with one type of model to generate chat responses and a different model to generate images. AI models are also known as LLMs (large language models).

Retool supports a number of AI platforms and their models:

Retool interacts with an AI platform using its API. You provide an API key for your AI platform account so that Retool can perform AI queries. You can get started with Retool AI without needing any API credentials using the Retool-managed OpenAI connection. This enables you to evaluate and test AI queries before using them in production.

You configure AI platform API keys in the Resources tab of your organization settings.


Provide an API key for production use

The Retool-managed OpenAI connection provides a limited number of tokens to each organization per day. If you use Vectors in Retool AI, you can reach this limit very quickly. You can configure AI platforms in Retool AI to use your own API credentials for production use.

Retool provides two options for interacting with OpenAI:

OptionUse caseDescription
Retool-managedGetting started with Retool AI.Use a Retool-managed OpenAI key when performing requests.
Using your API keysUsing Retool AI in production.Use your own OpenAI key when performing requests.

The following OpenAI models are supported by Retool AI:

ModelData typeDescription
gpt-4Text, ChatMore capable than GPT-3.5 models, able to do more complex tasks, and optimized for chat.
gpt-4-1106-previewText, ChatThe latest GPT-4 model with improved instruction following, JSON mode, reproducible outputs, parallel function calling, and more.
gpt-3.5-turboText, ChatMost capable GPT-3.5 model and optimized for chat.
gpt-3.5-turbo-16kText, ChatSame capabilities as gpt-3.5-turbo but with 4x context.
dall-e-2ImagesGenerate images from natural language descriptions.
dall-e-3ImagesThe latest DALL·E model released in Nov 2023.

Azure OpenAI

Retool supports Azure OpenAI models. Rather than a predefined set of models from which you select, you create and deploy an Azure OpenAI service with a specific model. You then provide the endpoint and model name when configuring the API credentials.


The following Anthropic models are supported by Retool AI:

ModelData typeDescription
ClaudeTextSupports sophisticated dialogue and creative content generation to detailed instruction.


The following Cohere models are supported by Retool AI:

ModelData typeDescription
commandTextAn instruction-following conversational model that performs language tasks with high quality and more reliability.
command-lightTextA smaller, faster version of command. Almost as capable, but a lot faster.

AI tokens

Estimate token usage

Use OpenAI's tokenizer tool to calculate how many tokens would result from a passage of text.

AI models use tokens, rather than characters or bytes, to represent the commonality of sequences and usage. In general, a single token can equate to approximately four characters.

The text you provide in an AI query is converted by the model into tokens, after which it can generate the necessary response.

Billing and usage

AI platforms calculate billing costs based on token usage. Refer to each AI platform to find out pricing information and how to monitor usage.