Create a Regression Suite
Vibe Shield explores your app, generates tests for every flow it finds, and saves them as a reusable suite. On subsequent runs, it re-executes the suite and reports regressions.
Prerequisites
- FastTest Agent installed (Quick Start)
- Cloud auth completed (
setuptool) — required for persistent suites
Generate Your First Suite
-
Run Vibe Shield
Vibe shield my app at http://localhost:3000
On the first run, FastTest performs a breadth-first exploration of your app — discovering pages, forms, and flows — then generates test cases for each.
-
Watch the exploration
Your AI assistant navigates through your app, building a map of pages and interactions. It then generates and executes tests:
✓ login flow 4/4✓ checkout 6/6✓ profile settings 3/3✓ search 5/5✓ … 8 more passed18/18 PASSED · suite saved · CI ready -
Suite is auto-saved
The suite is saved to the cloud with the name
Vibe Shield: localhost:3000(derived from your app’s URL). Test cases include steps, assertions, and intent descriptions.
Check for Regressions
After making code changes, run Vibe Shield again:
Vibe shield my app at http://localhost:3000
This time, FastTest detects the existing suite and re-runs it as a regression check. The report shows:
- Regressions — tests that previously passed but now fail
- Fixes — tests that previously failed but now pass
- Healed — selectors that broke but were auto-repaired
- Unchanged — tests that still pass
Set Up Environments
Configure an environment so you never have to pass a URL:
Set up a “dev” environment for my project at http://localhost:3000
Then just say:
Vibe shield my app
FastTest resolves the URL from your environment config.
Customize Your Suite
Add individual tests to an existing suite:
Save a test called “admin can delete users” to the Vibe Shield suite
Test cases are upserted by name — existing tests are updated, new ones are added, unmentioned tests are kept.
Next Steps
- Run your suite in CI with GitHub PR comments
- Find security bugs with security auditing
- See the full vibe_shield tool reference for all parameters