Skip to main content

Configure AI services

Last updated: November 2026

Use AI Services to control which AI features are available in your account and choose how Katalon routes AI requests. If you configure your own provider keys, each key covers three capability tiers: Mini, Standard, and Frontier. Katalon routes requests to the appropriate tier automatically.

Supported providers include OpenAI, Azure OpenAI, AWS Bedrock, OpenAI Compatible, and Gemini.

Requirements
  • You must be an Account Admin or System Admin.

Enable or disable AI features​

Katalon enables AI features by default.

  1. Go to Administration > System > Configurations > AI SERVICES.
  2. Toggle the Enable AI Features switch.
Add Account AI Key page with provider credentials and model per capability tier fields

Choose which AI features are available​

note

This page rolls out to accounts over time. If your AI Services page does not show the AI features section, your account still uses the single Enable AI Features switch.

Enable AI Features turns AI on or off for the whole account, in Katalon True and Katalon Studio. The five cards under AI features group the capabilities available to everyone in your account.

  1. Go to Administration > System > Configurations > AI SERVICES.
  2. Review the five feature groups: Katalon AI, Test Design, Test Execution, Analysis and Reporting, and Katalon Studio. Each card shows which features and how many are on.
  3. Select a card to see which capabilities it contains and whether each is enabled. In the drawer, select or clear a feature's checkbox to change its availability. For example, Test Design includes Test case generation, Requirement quality score, and Clarifying questions.

Project pages that depend on a feature follow your choice. See AI settings for the project-level settings.

View the change history​

Select History next to Enable AI Features. The Change history drawer lists recent changes to AI settings and keys, newest first.

  • Filter by Date, which defaults to Last 30 days, and by Category, which defaults to All categories.
  • Each row shows who made the change and what changed, such as <name> turned on AI feature Test case generation. It also shows the path, such as Test Design > Test case generation, and the time.

Choose how Katalon uses AI keys​

Under AI provider on the AI Services page, choose where AI requests get their key. The flow diagram shows the routes for your current settings.

  • Under True Platform, select Use default Katalon AI key to use Katalon's key, or Use your own AI keys to route requests through keys configured for your account or organizations.
  • Under Katalon Studio, select Use True Platform setting key to use the account's AI provider setting. Select Allow users to set a local key if users may enter their own provider key in Studio preferences. When this option is off, Katalon Studio ignores saved local keys.

When Use your own AI keys is selected, requests that use an account or organization key route through your configured provider.

note

If a configured key runs out of quota or becomes unavailable, the AI feature returns an error instead of routing to Katalon's provider. To avoid unavailable tiers, make sure your keys cover Mini, Standard, and Frontier.

Configure account-level AI keys​

Account AI keys are the default fallback for AI requests across your account. Any organization without its own configured key uses the account key.

  1. In Account AI Key Settings, click + Add AI Key for Account.
Add Account AI Key page with provider credentials and model per capability tier fields
  1. In AI Key Name, enter a name for the key.
  2. In Provider, select a provider: OpenAI, Azure OpenAI, AWS Bedrock, or OpenAI Compatible.
  3. In API Key, enter the provider key.
  4. Optional: In Organization, enter the organization value required by your provider.
  5. Click Validate Key.
note

Validating a key confirms that the provider accepts the credentials. It does not verify model availability. Check your provider console for model-level access.

  1. In Model per Capability Tier, choose the model for each tier:
    • Mini: Fast, lower-cost models for high-volume tasks.
    • Standard: Balanced models for everyday AI features.
    • Frontier: Best-available models for complex reasoning.

You can select Auto pick to use the recommended model for the selected provider and tier.

  1. When you're done, click Add.

After you add an account key, it appears in the Account AI Key Settings table. The table shows the provider, masked key, and configured model for each capability tier. If a tier does not have a selected model, the table displays Not Configured.

Configure organization-specific AI keys​

Organization-specific AI keys apply to a selected organization. You can also choose whether the organization can fall back to parent organization or account keys when a tier is not covered.

  1. In Organization-Specific AI Key, click + Add AI Key.
  2. In Organization, select an organization.
  3. Toggle Allow fallback to parent keys when a tier is uncovered.

When this option is on, if the organization's keys do not cover a tier, Katalon escalates the request to parent organization or account keys.

  1. Click + Add AI Key.
  2. Enter the key name, provider, API key, optional organization value, and model per capability tier.
  3. Click Validate Key.
  4. Click Add.

After you add an organization-specific key, it appears in the organization's AI Keys table.

On the main AI Services page, the Organization-Specific AI Key table shows each organization's fallback setting:

  • Allow: The organization can use parent organization or account keys when its own keys do not cover a tier.
  • Strict: The organization must use its own configured keys.
Restrict AI access to organizations with their own keys

Use the Restrict AI access to organizations with their own configured key only option to prevent organizations without their own AI key from using account-level keys.

Under Organization-Specific AI Key, toggle Restrict AI access to organizations with their own configured key only.

When this option is enabled, organizations must use their own configured keys for AI requests. Organizations without configured keys cannot fall back to account-level keys.

Manage AI keys​

  1. Go to Administration > System > Configurations > AI SERVICES.
  2. To edit a key, click the Edit icon in the key row.
  3. To delete a key, click the Delete icon in the key row.

TrueTest compatibility​

Your organization’s AI Services configuration determines which Katalon features, including TrueTest, are available:

AI Services settingsTrueTest behavior
AI features disabledTracking pauses. You can still access existing maps, flows, and test cases, run gap analysis, and generate test cases for existing flows. You cannot track new data or generate new journey maps.
AI features enabled, supported provider (Katalon Default, OpenAI, or Azure OpenAI)TrueTest operates normally.
AI features enabled, unsupported providerTrueTest displays a warning. Tracking data remains accessible but new tracking is unavailable.
Was this page helpful?