
Service 09 · AI Test Automation
Know what your green build is worth
Tests get cut when they are a separate task. So we fold them into the change.
- A change without passing tests does not exist
- No separate test task left to defer
- AI writes the mechanical suite with the work
- People who know your domain do the exploratory testing
Example record
A release the gate stopped
So a model that got worse stays out of your release. The suite runs on each change, and a score below the baseline blocks it.
The failed cases arrive by name, with the diff.
- Pass
Characterisation tests
behaviour recorded before the change
- Pass
Tests against the spec
written from the acceptance criteria
- Flagged
A mock around the thing under test
flagged by review
- Blocked
Evaluation suite against the baseline
score dropped on 6 named cases

What the suite measures
Tests run against the real thing
Your tests exercise the code they name, with no mock standing in for it.
Why your tests survive the deadline
A separate task with its own estimate can be deferred, and a date cannot. So the tests live inside the task.
The estimate includes the tests, so there is nothing separate to cut
The unit closes when its tests pass in your pipeline, not on a laptop
Exploratory testing is a session per release by a tester who knows your domain
A unit without passing tests shows in the record as a gap with an owner
Capabilities
What we look for in your suite
Tests that pass and check the wrong thing
What you hold after the first pass. AI writes the tests fast, and our test lead checks them against the requirement.

- A
Coverage measured against the specification, not the code
- B
Every mocked subject, listed with its owner
- C
The end-to-end suite running on the deployed environment
- D
A scored gate on each model in the product
Model
What we fix, and what you decide
What we fix
- F1Tests land with the unit, so there is no test task to cut
- F2Verification is written against the specification
- F3AI-written tests are reviewed for the anti-patterns they are prone to
- F4A model in the product has an evaluation harness with a gate
- F5Change old code, keep what works
What you decide
- C1Coverage targets, and which environments the end-to-end suite runs against
- C2Our pipeline, or work inside yours
- C3The scoring method and threshold for a model gate
Next step
Send us the suite and the spec.
We measure one against the other, gap by gap. What you get is coverage you can defend at the release meeting.

