Running Tests
Bug0 provides multiple ways to run your tests, from interactive preview to automated CI/CD execution.
Running Methods
Live Preview
Run tests interactively from the editor with real-time browser preview.
Best for:
- Developing and debugging tests
- Verifying step changes
- Seeing exactly what the AI does
CI/CD Execution
Trigger tests automatically from your deployment pipeline.
Best for:
- Pull request validation
- Deployment verification
- Scheduled monitoring
Scheduled Runs
Run tests on a schedule (hourly, daily, weekly).
Best for:
- Production monitoring
- Regression detection
- Regular health checks
Execution Flow
When tests run, Bug0:
1. Login Suites → Execute first, save auth state
2. Regular Suites → Execute in order, use saved state
3. Each Test Case → Run steps sequentially
4. Assertions → Verify after steps complete
5. Cleanup Suites → Execute last
6. Report Results → Send notifications
Test Settings
Before running, ensure these are configured:
Project Level
- Base URL - Where tests navigate
- Auth credentials - Default email/password
- Storage state - Saved login cookies
Suite Level (optional overrides)
- Suite base URL - Override project URL
- Suite credentials - Different auth for this suite
- Login/Cleanup flags - Special suite types
Understanding Results
Each test run provides:
- Step status - Pass/fail for each step
- Assertions status - Pass/fail with confidence
- AI reasoning - Why decisions were made
- Screenshots - Visual state at key points
- Report URL - Full HTML report