How TrueTest generate test data
TrueTest can automatically populate test data for generated test cases. This feature helps testers execute and validate tests without manually providing every input value, especially for test cases they did not author themselves.
- The data captured and used by TrueTest does not include PII; captured values are non-PII only. Fields that may contain PII will not be populated.
- Additionally, some captured values may be further analyzed to detect potential personal information. Any value flagged as PII is automatically redacted before use.
- Learn more about how we handle data privacy at Protect user data privacy.
Overview​
TrueTest supports four data generation modes: Disabled, Raw, Raw with PII mocked values, and Synthetic.
| Mode | Data Used | Recommended For |
|---|---|---|
| Disabled | None | Manual test, strict data control enivronment |
| Raw with PII mocked values | Captured non-PII values, with optional predefined replacements for PII fields | Non-production environments requiring realistic but private data |
| Raw | Captured non-PII values | QA, Staging, Pre-prod |
| Synthetic | AI-generated non-PII synthetic values | Production, privacy-sensitive environments |
Test data generation modes​
Test data generation is configured per data tracking environment. This means each environment (e.g., Production, Staging, QA) can use a different mode depending on its privacy policies and testing needs.
Disabled is the default mode for all data tracking environment. If you want to switch to Raw, Raw with PII mocked values or Synthetic, contact the TrueTest team for support.
Disabled (default)​
- What it does: TrueTest does not populate any captured data into the generated test case. All input fields require manual test-data entry.
- Recommended use: Use the Disabled mode when you do not want TrueTest to inject any captured inputs into generated tests for full control over test data.
Raw​
- What it does: TrueTest populates test data using the raw captured non-PII values from user interactions.
- Recommended use: Environments where testers need realistic values to reproduce production-like behavior while keeping privacy risks controlled (for example, Staging/QA/Pre-prod lower environments).
Raw with PII mocked values​
- What it does: TrueTest replaces any PII fields with dummy values from a validated dataset. Non-PII fields continue to use raw captured values.
- If the dataset is not predefined, the input values are redacted to
{{data_field}}format. - If the dataset is predefined, TrueTest uses the the dummy data as test data.
- If the dataset is not predefined, the input values are redacted to
- Recommended use: Choose this mode when you want the generated test cases are always complete and ready to run, with no empty placeholders or manual intervention required.
Synthetic​
- What it does: TrueTest generates synthetic test data derived from captured patterns (i.e., realistic but not actual captured values). This option leverages a AI-based model to produce the synthetic values.
- Recommended use: For privacy-sensitive environments (such as Production) where you are required to avoid using any real captured values. Synthetic data provides realistic inputs without using actual captured values, making it suitable for high-security environments.
Test data example​
-
When a user interacts with the AUT (Application Under Test) and inputs
street=Main Standproduct_code=PROD-X-745, TrueTest captures this interaction into test steps of the generated test case. The value entered differs by mode. -
For the Input Address step:
- In Raw mode: The PII data is not captured
- In Raw with PII mocked values mode: The data is captured as
{{address}}orNorthern Rdis used as test data depending on whether the dummy value is predefined - In Synthetic mode: The AI-model generates a value with similar pattern, e.g.
Oak Ave
-
For the Input Product Code step:
- In Raw mode:
PROD-X-745is used as test data for that step - In Raw with PII mocked values mode:
PROD-X-745is used as test data for that step - In Synthetic mode:
ITEM-Z-221is used as test data for that step
- In Raw mode: