test-code-conventions
Pure-reference catalog of test-code conventions: AAA structure (Arrange / Act / Assert), per-test single-responsibility, descriptive naming (`{sut}_{scenario}_{expected}`), assertion specificity, mocking rationale (state vs behavior, fake vs mock), fixture-coupling rules, and the magic-number / hard-coded-string anti-patterns; the E2E selector-priority and web-first-assertion conventions live in references/. Use as the shared rule book a test-code review cites back to, or as onboarding for what makes a test code-reviewable; to score a test's quality on weighted axes use test-design-scorecard, and for setup/teardown isolation specifically use test-isolation-patterns.
Install with skills.sh (any agent)
npx skills add testland/qa --skill test-code-conventionstest-code-conventions
Overview
This skill is a pure reference - no actions, no workflows. It catalogs the test-code conventions a test-code review enforces. When a review flags an issue, this reference gives the reviewer the underlying rule.
When to use
How to use
§1 - AAA structure
The canonical test shape - Arrange, Act, Assert - splits each test into three phases:
test('addItem increases cart count', () => {
// Arrange
const cart = new Cart();
// Act
cart.addItem({ sku: 'BOOK-001', qty: 1 });
// Assert
expect(cart.itemCount).toBe(1);
});The phases are visually separated (blank line; comment; or // arrange / act / assert headers). The benefits:
Each test has exactly one Act. Two Acts = two tests. Splitting on multiple Acts is the canonical refactor when a single test grows too long.
§2 - Single-responsibility per test
A test that asserts cart.count === 1 AND cart.totalPrice === 10 AND cart.lastUpdated > now() is three tests in disguise. When one assertion fails, the test stops; the other two failures are masked.
The rule: one logical assertion per test. "Logical" means related to the same observable property - multiple expect calls that all verify "the cart has one item" (count = 1, items.length = 1, contents[0].sku = '...') are one logical assertion.
Splitting:
// Bad - three logical assertions
test('addItem updates cart', () => {
cart.addItem(...);
expect(cart.itemCount).toBe(1); // assertion 1
expect(cart.totalPrice).toBe(10); // assertion 2 (different property)
expect(cart.lastUpdated).toBeGreaterThan(t0); // assertion 3 (different property)
});
// Good - three tests, each assertion isolated
test('addItem increments count', () => { /* ... */ });
test('addItem updates totalPrice', () => { /* ... */ });
test('addItem updates lastUpdated', () => { /* ... */ });§3 - Naming patterns
Two well-established conventions:
A - <system_under_test>_<scenario>_<expected> (Roy Osherove)
test('addItem_validQty_incrementsCount', () => { /* ... */ });
test('addItem_zeroQty_throwsValidationError', () => { /* ... */ });
test('addItem_negativeQty_throwsValidationError', () => { /* ... */ });The triple makes the test self-documenting; no need to read the body to understand what's verified.
B - Nested describe + it
describe('Cart', () => {
describe('addItem', () => {
describe('with valid qty', () => {
it('increments count', () => { /* ... */ });
});
describe('with zero qty', () => {
it('throws ValidationError', () => { /* ... */ });
});
});
});Both are valid; the team picks one and stays consistent. Mixing the two in one suite is the smell.
Avoid: test('it works'), test('test 1'), test('addItem 1'), test('addItem 2'). Generic names are zero debugging help when the failure surfaces.
§4 - Assertion specificity
Assertions should narrow the verification window to exactly what's being asserted. Vague matchers hide regressions:
| Vague | Specific | Why specific is better |
|---|---|---|
expect(x).toBeTruthy() | expect(x).toEqual({ id: 1, name: 'foo' }) | "truthy" passes for 1, 'a', {}, [] - many bug shapes pass. |
expect(arr).toBeDefined() | expect(arr).toEqual(['BOOK-001']) | "defined" passes for [], null-prototype, … |
expect(err).toBeInstanceOf(Error) | expect(err.code).toBe('VALIDATION_ERROR') | Catches "right type, wrong reason" regressions. |
expect(response.status).toBeGreaterThan(199) | expect(response.status).toBe(201) | 200, 204, 299 also pass - masks status-code regressions. |
expect(html).toContain('error') | expect(html).toMatch(/<div class="error">.*Invalid/) | "error" matches "no errors" too. |
The general principle: the assertion should fail on any change to the SUT's behavior that isn't intentional. If the assertion passes for behaviors that shouldn't, it's too loose.
§5 - Mocking
The full taxonomy per mocks-stubs (opens in new window):
"Dummy objects: passed around but never actually used. Usually they are just used to fill parameter lists." (mocks-stubs (opens in new window))
"Fake objects: actually have working implementations, but usually take some shortcut which makes them not suitable for production." (mocks-stubs (opens in new window))
"Stubs: provide canned answers to calls made during the test, usually not responding at all to anything outside what's programmed in." (mocks-stubs (opens in new window))
"Spies: stubs that also record some information based on how they were called." (mocks-stubs (opens in new window))
"Mocks: objects pre-programmed with expectations which form a specification of the calls they are expected to receive." (mocks-stubs (opens in new window))
Per mocks-stubs (opens in new window): "Only mocks insist upon behavior verification. The other doubles can, and usually do, use state verification."
Convention rules:
§6 - Fixture coupling
Tests that share fixtures (parameters, builders, factory functions) should be coupled at the smallest scope:
| Scope | When to use |
|---|---|
| Inline (per test) | Default. The test owns the data; reviewer sees what's being tested. |
describe-block | Multiple tests verify the same scenario differently. |
File-level (beforeEach) | Shared setup with no per-test variation. |
| Cross-file factory | Shared shapes, not shared instances. Use builders / factories. |
Anti-pattern: a giant globalFixtures.ts that every test imports. Tests now break in unrelated ways when the global is touched; the test no longer "owns" what it verifies.
§7 - Magic numbers and strings
Test code is more tolerant of magic numbers than production code - the test's job is often to assert against specific values. But meaningful magic matters:
// Bad
expect(cart.totalPrice).toBe(43.21); // why 43.21?
// Better
const PRICE_PER_BOOK = 10.99;
const QTY = 4;
const EXPECTED_TAX_RATE = 0.0825;
const EXPECTED_TOTAL = PRICE_PER_BOOK * QTY * (1 + EXPECTED_TAX_RATE);
expect(cart.totalPrice).toBeCloseTo(EXPECTED_TOTAL, 2);The named constants double as documentation. The reviewer sees the math; the assertion failure message becomes interpretable.
§8 - E2E selectors
Prefer user-facing, accessibility-first locators over DOM-structure selectors. Per tl-queries (opens in new window) the query priority is getByRole → getByLabelText → text / placeholder → getByTestId (last resort), and per pw-best-practices (opens in new window) CSS-class and XPath selectors are brittle because the DOM changes freely. The full priority table, the per-framework mappings (Playwright / Cypress / Selenium), and the CSS/XPath rationale are in references/e2e-selector-and-assertion-conventions.md.
§9 - Web-first assertions (E2E)
Prefer auto-waiting web-first assertions (await expect(locator).toBeVisible()) over synchronous .isVisible() checks that race the render, per pw-best-practices (opens in new window). The before / after example is in references/e2e-selector-and-assertion-conventions.md.
§10 - Slow setup is a smell
A test that takes >1s in setup (creating fixtures, seeding DB, warming caches) has a coupling problem. The remedies:
The whole-suite cost of slow setup compounds: 10 tests × 2s = +20s per CI run × 50 PRs/day = 1000s/day burned.
Worked example - reviewing one test file
The file under review (checkout.spec.ts):
let cart; // file-level, reused across tests
beforeAll(() => { cart = buildCart(); });
test('checkout 1', async () => {
cart.addItem({ sku: 'BOOK-001', qty: 2 });
const res = await checkout(cart);
expect(res).toBeTruthy();
expect(cart.total).toBe(43.21);
});Walking the conventions:
| Convention | Finding | Fix |
|---|---|---|
| §1 AAA | Phases not separated; two logical Acts (addItem, checkout). | Blank-line the phases; split the two Acts into two tests. |
| §2 Single-responsibility | Asserts the checkout result and the cart total - two targets. | One assertion target per test. |
| §3 Naming | checkout 1 names nothing. | checkout_validCart_confirmsOrder. |
| §4 Assertion specificity | expect(res).toBeTruthy() passes for 1, {}, []. | expect(res.status).toBe('confirmed'). |
| §6 Fixture coupling | cart is a file-level beforeAll fixture the test mutates. | Rebuild per test in beforeEach (inline ownership). |
| §7 Magic literals | 43.21 has no visible derivation. | Derive from named PRICE, QTY, TAX_RATE. |
After the fixes:
const PRICE = 19.99, QTY = 2, TAX_RATE = 0.0825;
let cart;
beforeEach(() => { cart = buildCart(); });
test('checkout_validCart_confirmsOrder', async () => {
// Arrange
cart.addItem({ sku: 'BOOK-001', qty: QTY });
// Act
const res = await checkout(cart);
// Assert
expect(res.status).toBe('confirmed');
});
test('addItem_appliesTaxedTotal', () => {
// Arrange
cart.addItem({ sku: 'BOOK-001', qty: QTY });
// Assert
expect(cart.total).toBeCloseTo(PRICE * QTY * (1 + TAX_RATE), 2);
});Each test now has one Act, one assertion target, a self-documenting name, a specific matcher, an inline-owned fixture, and a derived expected value. For the E2E selector and web-first conventions applied to a *.e2e.ts file, see references/e2e-selector-and-assertion-conventions.md.
References
E2E selectors and web-first assertions
View source (opens in new window)E2E selectors and web-first assertions
Deep reference for the test-code-conventions SKILL.md (§8 and §9). Consult when reviewing end-to-end tests (Playwright / Cypress / Selenium / WebdriverIO) where locator fragility or synchronous assertions are the concern. The universal conventions (§1-§7, §10) stay in the SKILL; these two are E2E-specific.
§8 - E2E selectors
Per Playwright best practices (opens in new window): "Your DOM can easily change so having your tests depend on your DOM structure can lead to failing tests."
Per Testing Library query priority (opens in new window) (highest to lowest):
| Priority | Query | When to use |
|---|---|---|
| 1 | getByRole('button', { name: 'Submit' }) | Default. Tests via the accessibility tree - the same path users take. |
| 2 | getByLabelText('Email') | Form fields with an associated <label>. |
| 3 | getByPlaceholderText, getByText, getByDisplayValue | When labels aren't available. |
| 4 | getByAltText, getByTitle | Images, tooltips. |
| 5 | getByTestId('submit-button') | Last resort. Per Testing Library: "The user cannot see (or hear) these." |
CSS class selectors (.button-primary) and XPath (//div[@class='cart']//button[1]) are not on the priority list - per Playwright best practices they are explicitly identified as brittle.
The same convention holds across runners: Playwright (page.getByRole(...)), Cypress (cy.findByRole(...) via cypress-testing-library), and Selenium (when the test framework supports role-based queries via extensions).
§9 - Web-first assertions (E2E)
Per Playwright best practices: avoid "manual assertions without waiting. Using isVisible() checks immediately without awaiting, rather than web-first assertions like toBeVisible() that wait for conditions to be met."
// Bad - race condition
expect(page.locator('.toast').isVisible()).toBe(true);
// Good - auto-waits
await expect(page.locator('.toast')).toBeVisible();The web-first form auto-waits for the assertion to become true within the test's timeout, eliminating the wait-N-seconds-and-hope pattern. A synchronous .isVisible() snapshot races the render and flakes on any latency the test author did not anticipate.
Worked example - reviewing one E2E test file
// Before - brittle selector, synchronous assertion
await page.locator('.cart-panel .btn-primary').click();
expect(page.locator('.toast-success').isVisible()).toBe(true);
// After - accessibility-first selector, web-first assertion
await page.getByRole('button', { name: 'Checkout' }).click();
await expect(page.getByRole('status')).toHaveText('Order confirmed');The rewrite resolves the button through the accessibility tree (survives DOM refactors) and awaits the outcome (no render race).
References
Related skills
object-model-patterns
Pure reference catalog of the canonical object-model architecture patterns for test automation frameworks - Page Object Model (Fowler), Screenplay (Marcano/Palmer/Hill), Component Object, App Actions (Cypress idiom), Service Object, Repository, and Screen Object (the desktop/mobile sibling of Page Object covering Windows UIA, macOS XCTest, Linux AT-SPI, Appium / Espresso) - each with its canonical citation, when-to-use rules, refuse-to-mix anti-patterns, and a worked example. This is the architecture-tier reference - what each pattern *is* - not file-level style rules and not tool-specific configuration. Use when designing, reviewing, or migrating a test framework's object-model architecture.
test-design-scorecard
Scores test files 1 to 5 on six design axes (AAA phase separation, single-responsibility, naming, fixture coupling, magic literals, setup time) using explicit per-level anchors that settle what separates a 2 from a 4, then turns the scores into growth-framed feedback and a per-author trend report; the per-PR and per-author rollup examples and trend-reporting conventions live in references/. Owns the scoring and the write-up only: the conventions being scored live in a separate conventions catalog such as `test-code-conventions`, and block-or-approve gating belongs to an adversarial review. Use when a test diff needs a graded coaching read rather than a merge verdict: onboarding a new engineer, a team deliberately ramping up test discipline, or a quarterly per-author trend where the output is a conversation, not a gate.
test-framework-architecture-audit
Audits an existing test automation framework across eight architecture-tier axes and bands each one PASS, WARN, or FAIL: page-object coverage and purity, base-class inheritance depth, fixture scope and coupling, helper sprawl, naming-convention drift, retry and wait consistency, documented-versus-actual convention drift, and CI integration health. Carries the numeric cut behind every band and labels which cuts are practitioner conventions rather than published standards. Measures the framework's own structure (page objects, base classes, fixtures, helpers, conventions), not the suite's tier mix or flake rate, and not the design of a framework that does not exist yet. Use when a test framework has grown for a release or more without structural review, before a major refactor, or when a team suspects its written test conventions no longer match what the code actually does.
test-framework-blueprint
Build-an-X workflow that takes an SDET from no test suite to a complete framework design in seven steps - inventory the SUT, choose runner + language, directory layout + fixture architecture, object-model decision, test data + mocking wiring, reporting + CI integration, conventions doc + review gates - producing a written framework blueprint (directory tree, fixture list, chosen patterns, CI matrix) plus an implementation order. This is the whole-framework design workflow - not the Step 2 runner-choice decision on its own, not the Step 4 object-model pattern catalog it defers to, and not the scaffolder that generates the harness skeleton once the blueprint exists. Use when designing a test automation framework from scratch or re-architecting one that grew organically.
test-isolation-patterns
Pure reference catalog of test-isolation and fixture-lifecycle patterns - the four-phase test pattern (Meszaros), fixture scope (per-test / per-describe / shared / global), the Fresh-Fixture vs Shared-Fixture trade-off (Fowler), parallel-safety patterns, and cleanup discipline (afterEach / afterAll / tagged-cleanup), plus a pattern-selection guide and a worked leaking-state diagnosis. The database-isolation strategies (transaction-rollback / database-per-worker / template-database) and network / external-service stubbing live in references/. This is the architecture-tier reference, not a file-level fixture-coupling style rule. Use when designing fixture scope and isolation strategy, auditing fixture coupling or retry/wait policy, or moving a suite to parallel execution.
test-step-design-patterns
Pure reference catalog of test-step design patterns at the architecture tier - step granularity (one logical action per step), abstraction layers (mechanical → page → business), step extraction rules (when to inline / when to extract to a helper / when to extract to a Page Object method), the declarative-vs-imperative phrasing rule, FIRST principles (Fast / Independent / Repeatable / Self-validating / Timely), and the AAA / Given-When-Then mapping. This is the cross-framework architecture-tier reference for what a step IS, when it should exist, and where it should live - not file-level AAA style rules and not Gherkin-specific translation. Use when designing or reviewing the step layer of a test framework - for example when writing or reviewing E2E or integration tests, when the step count per test is high, or when refactoring recorded or codegen test output into readable steps.
test-suite-health-audit
Measures an existing test suite's current state on four axes: per-file tier classification (unit / integration / E2E, first match wins), pyramid ratio against whatever target the team already committed to, per-layer flake rate, and defects-caught-per-run-minute ROI per tier, then reduces them to one categorical verdict (Healthy, Needs pruning, Needs refactor, Cannot assess). Reports severity against a target ratio but never prescribes one: choosing the target unit:integration:E2E mix and the rebalancing plan belongs to a pyramid-balancing capability such as `test-pyramid-balancer`. Use when a suite has grown for a year or more without review and someone needs a defensible read on whether it is healthy, over-grown, or structurally inverted before deciding what to delete or rewrite.