Test Plans
The Test Plan step is where you organize, manage, and execute all your tests.
Overview
Test Plan provides a unified view of all tests:
- Automated scenario tests (primary)
- Manual tests
- Custom folders for organization
- Drag-and-drop management
- AI-powered organization
- Execute plans via Test Runs
Test Plan Interface
Layout
The interface has two main panels:
- Left Panel: Test tree with folders and tests
- Right Panel: Details for selected test
You can drag the divider to resize panels.
Test Tree
Shows all tests in a hierarchical structure:
- Root level shows pages and custom folders
- Tests are nested under their source page
- Custom folders can contain any tests
- Drag and drop to reorganize
Viewing Tests
Test Types
Tests are marked by type:
- Element: Individual element tests
- Scenario: User journey tests
- Manual: Human-executable tests
Test Statuses
| Status | Icon | Meaning |
|---|---|---|
| Passing | Green ✓ | Test passed last run |
| Failing | Red ✗ | Test failed last run |
| Pending | Gray ○ | Not yet executed |
| Suggested | Blue ◇ | AI suggested, not confirmed |
| Generating | Spinner | Currently being generated |
Test Details
Click a test to see:
- Name and Description
- Priority: Critical, High, Medium, Low
- Status: With last run timestamp
- Test Code: The Playwright script
- Execution Results: Detailed results
- Mapped Elements: Elements used in test
- Missing Elements: Elements not found
Organizing Tests
Creating Folders
- Click "New Folder" button
- Enter folder name
- Folder is created at root level
- Drag tests into the folder
Renaming Folders
- Right-click or click menu on folder
- Select "Rename"
- Enter new name
- Press Enter to save
Deleting Folders
- Right-click or click menu on folder
- Select "Delete"
- Confirm deletion
Note: Tests in the folder move to root level, not deleted.
Drag and Drop
- Drag tests between folders
- Drag tests to root level
- Drag folders to reorder
- Visual indicators show drop targets
AI Organize
QAID can automatically organize tests into logical groups.
Using AI Organize
- Click "AI Organize" button
- Select organization strategy
- Confirm if tests are already organized
- Tests are reorganized automatically
Organization Strategies
| Strategy | Description |
|---|---|
| By Priority | Groups tests by Critical, High, Medium, Low |
| By Page | Groups tests by their source page |
| By Feature | AI groups by detected feature area |
| By Journey | AI groups by user journey/flow |
What AI Organize Does
- Examines all tests (assigned and unassigned)
- Clears existing folders
- Creates new folders based on strategy
- Assigns tests to appropriate folders
- Preserves test-plan assignments
Confirmation Required
If your test plan already has organized tests:
- You'll see a confirmation dialog
- Existing organization will be replaced
- Confirm to proceed
Filtering and Search
Search
- Enter text in search box
- Matches against test names
- Results filter in real-time
Status Filter
Filter by test status:
- All
- Passing
- Failing
- Pending
- Suggested
- Generating
Type Filter
Filter by test type:
- All
- Element
- Scenario
- Manual
Sorting
Sort tests by:
- Name: Alphabetical
- Status: Grouped by pass/fail
- Date: By last execution or creation
Toggle ascending/descending order.
Running Tests
Run Selected Tests
- Select tests (checkbox or Ctrl+click)
- Click "Run Selected"
- Tests execute in sequence
- Watch progress indicators
- View results when complete
Run All Tests
- Click "Run All"
- All tests in the plan execute
- Progress shown in real-time
- Summary at completion
Viewing Results
After execution:
- Status badges update immediately
- Click test for detailed results
- View Playwright HTML report
- See screenshots and traces
Playwright Report
Access the full Playwright report:
- Click "View Report"
- Opens in new tab
- Detailed test results
- Screenshots and traces
- Downloadable as ZIP
Test Details Panel
Code View
See the generated Playwright code:
test('should submit contact form', async ({ page }) => {
await page.goto('/contact');
await page.getByLabel('Name').fill('Test User');
await page.getByLabel('Email').fill('test@example.com');
await page.getByRole('button', { name: 'Submit' }).click();
await expect(page.getByText('Thank you')).toBeVisible();
});Execution Results
View results from the last run:
- Pass/Fail status
- Duration
- Error message (if failed)
- Stack trace (if failed)
- Screenshots at each step
Element Mapping
See how the test maps to your site:
- Mapped Elements: Elements used successfully
- Selector Confidence: How reliable each selector is
- Missing Elements: Elements the test wanted but couldn't find
Library View
Access tests not yet in any plan:
- Click "Library" tab
- See unassigned tests
- Drag tests from library to plan
- Or use AI Organize to include all
Best Practices
Organization
- Group related tests together
- Use meaningful folder names
- Keep folder hierarchy shallow (2-3 levels max)
- Review organization periodically
Execution
- Run critical tests most frequently
- Use status filters to focus on failures
- Review failing tests promptly
- Keep test suite maintainable
Maintenance
- Remove obsolete tests
- Update tests after site changes
- Re-organize as features evolve
- Keep test names descriptive
Troubleshooting
Tests Not Appearing
Possible causes:
- Tests not yet generated
- Filter excluding tests
- Tests in different plan
Solutions:
- Generate tests in respective steps
- Clear filters
- Check Library tab
Drag and Drop Not Working
Check:
- Browser compatibility
- JavaScript enabled
- No overlapping elements
Tests Failing Unexpectedly
Common causes:
- Site changed since test creation
- Timing issues
- Authentication problems
- Network issues
Solutions:
- Regenerate affected tests
- Check site changes
- Verify authentication
- Increase timeouts
AI Organize Results Unexpected
The AI strategies work as follows:
- Priority/Page: Deterministic grouping
- Feature/Journey: AI-based categorization
If results aren't helpful:
- Try a different strategy
- Manually adjust organization
- Create custom folders
Test Plan Runs
Test Plans are executed via the Test Run page:
- Go to Test Run in the sidebar
- Click "Start Run"
- Select the test plan to execute
- Configure parallel tests (1-5 concurrent)
- Optionally name the run (e.g., "Sprint 12 Regression")
- Click "Start"
Each run tracks:
- Pass/fail results per test
- Overall pass rate
- Duration
- AI failure classification (if Auto AI Analysis is enabled)
See Test Runs for detailed documentation.
Related Topics
- Automated Tests - Create scenario tests
- Manual Tests - Generate manual test cases
- Test Runs - Execute test plans
- Analysis - Review run results and trends
- Dashboard - View test metrics