AI settings
Project Settings > AI controls the project context that Katalon AI uses before it answers or acts. The settings include the Knowledge Base, Agent Rules, Project Memory, and MCP & Skills.
- An account administrator must enable AI in System > Configuration > AI Service.
- Your role must have the project AI permission to view and use these settings.
- A project administrator is required to enable Agent Rules and Project Memory.
How the settings workβ
- Knowledge Base provides project data and uploaded documents as reference material.
- Agent Rules define project-wide standards that Katalon AI must follow. Rules take precedence over conflicting project memories.
- Project Memory stores your personal, durable preferences for the project. Other project members cannot see your memories.
- MCP & Skills provides the MCP endpoint and setup instructions for connecting external AI clients and Katalon True Platform skills.
Changes to these settings are recorded in a backend audit stream. There is no in-product audit view.
Knowledge Baseβ
The Knowledge Base combines project data with documents uploaded to the project. After indexing, Katalon AI Assistant and connected agents can use the content within your existing permissions.
A project's knowledge base gets its information from two sources:
| Source | What it holds | How it gets there |
|---|---|---|
| Project data | Test cases, test suites, test folders, and requirements already in the project | Synced automatically when ingestion is on |
| Your documents | Files you upload, such as PRDs and specs | Uploaded by you |
Both sources are available through the same knowledge base. Katalon AI Assistant and agents connected through the MCP server can access only what you already have permission to access. Turning on the knowledge base does not grant anyone additional access.
Set up the Knowledge Baseβ
Knowledge Base ingestion is Off by default for new projects. Turn on Enable Knowledge Base before uploading documents.
- Go to Project Settings > AI > Knowledge Base.
- Switch on Enable Knowledge Base. The page displays the current status, last update time, and counts for synced test cases, test suites, test folders, and requirements.
- In Your documents, select Upload files, or drag files onto the upload area.
- Wait until each document shows Completed. It is then available to Katalon AI Assistant and connected agents.
After the initial sync, changes to the project are synced automatically about every 15 minutes.
Use this interactive walkthrough to see the complete setup:
Turning ingestion off stops future syncing, but does not delete data that is already in the knowledge base.
Manage documentsβ
- Supported file types and size:
.pdf,.docx,.xlsx,.pptx,.txt,.csv,.md,.png,.jpg,.jpeg. Each file can be up to 100.0 MB. - Each filename must be unique within the project. Rename a duplicate file, or use Replace on the existing document's row.
- Use the Search filename field to find a document. The dropdowns next to it let you filter by file type and status.
- Ingest status: Documents go through several processing stages. Only documents marked Completed are available to Katalon AI Assistant. If processing fails, hover over the status to see why.
- Select Clear all to remove all uploaded documents and synced project data from the knowledge base.
Deleting cannot be undone. You must upload your documents again, and project data must go through a new full sync.
Conflict checksβ
When Katalon AI Assistant generates test cases or analyzes a requirement, it checks the requirement against the documents and project data in the knowledge base and ends its response with a Potential conflicts section. If the knowledge base is empty, rebuilding, failed, or out of date, the response says it could not check. To learn more, see Review potential conflicts.
Known limitationsβ
- If you permanently delete a project item, it may remain in the knowledge base until the next full sync.
- When generating test cases, the knowledge base does not yet help prevent duplicate test cases.
Agent Rulesβ
Agent Rules define standards for all members' agents in the project. Turn on Enable Agent Rules to enforce them. If a rule conflicts with something a member asked Katalon AI to remember, the rule takes precedence.
To add a rule, select Add the first rule when the list is empty, or Add rule when rules already exist. Enter a required Rule, optional Details, and a Tag. Available tags include constraint, convention, correction, environment, preference, and verdict.
The rule list includes the rule text, tag, who added it, and when it was modified. Use the search field to find a rule, Edit or Delete to manage an existing rule, and Export to download the rules.
To import rules, select Import and upload a CSV file. You can drag and drop the file or browse for it, and download a sample CSV from the import dialog. The CSV must include Rule and Tag columns; Details is optional and other columns are ignored.
Active rules are applied before an agent acts, and Katalon AI identifies the rules it applied in its response.
Project Memoryβ
Project Memory stores your own durable preferences for the project. Turn on Enable Project Memory, then ask Katalon AI to remember a preference, such as βRemember that our checkout tests use the staging environment.β You can also manage memories from ... > Project memory in the Katalon AI header.
Project memories are personal and are not visible to other project members. Agent Rules take precedence if a rule conflicts with a memory.
MCP & Skillsβ
Your MCP serverβ
The Your MCP server section provides one endpoint for the whole account. The same endpoint works for every project in the account. Select Copy to copy the endpoint. On first use, your agent signs you in through the browser and asks you to choose a workspace.
Set up your agentβ
Setup varies by client. Select your client to view its setup command or configuration, then select Copy and run it in the client. The available clients are Claude Code, GitHub Copilot, Codex, Cursor, Claude Desktop, and ChatGPT. For Claude Code and Codex, the skills and MCP server are installed together.
After setup, the client signs you in through the browser on first use and asks which workspace to use.
True Platform skillsβ
The page links to the Katalon True Platform skills repository. It provides 18 reusable skills covering the testing lifecycle, including planning, design, management, review, execution, analysis, and maintenance. The skills help agents use your test assets, requirements, and runs according to your project conventions.