Skills & Agents
Every skill, A to Z
Every one of the 329 QA skills in the testland-qa marketplace, by name, with what each one does and the plugin that installs it.
D19
dotnet-unit-testsCovers .NET tests in C#, F# or VB.NET: Fact and Theory tables, fixtures and shared state between tests, parallel runs, mocking, async tests, output, and coverage with dotnet test.qa-unit-tests-netdata-contract-extractorReads a data PRD, dataset README or lineage doc and writes the contract: schema with types, nullability and PII flags, freshness SLA, volume bounds, distribution rules and owner, for dbt, Great Expectations or Soda.qa-data-qualitydata-quality-conventionsCovers choosing dbt tests vs Great Expectations vs Soda, column vs table-level checks, severity tiers, SLA and freshness conventions, and anti-patterns to avoid.qa-data-qualitydata-quality-gateGathers check results from dbt, Great Expectations or Soda, applies severity-aware thresholds and returns a single go/no-go decision with a reason per check.qa-data-qualitydb-query-plan-analyzerReads plans from PostgreSQL, MySQL or SQLite, finds the main cost (sequential scans, nested loops, sort spills, missing or unusable indexes) and proposes the index or query rewrite.qa-load-testingdbt-testingCovers testing dbt models: generic, singular and custom-macro tests, model assertions, reading failures from run_results.json and gating dbt build on the results in CI.qa-data-qualitydeadlock-detection-harnessRecords lock order, finds cycles, uses lock timeouts to fail instead of hang, and reads jstack or gdb thread dumps.qa-concurrencydecision-table-test-designBuilds a decision table, collapses irrelevant and impossible combinations and writes one test case per remaining column, per ISTQB.qa-manual-testingdeepchecks-testsRuns Deepchecks data integrity, train-test validation and model evaluation suites on tabular, NLP or vision data, reruns them on production samples for drift and gates CI on passed conditions.qa-ml-modelsdeepeval-evaluationCovers testing an LLM or RAG app with pytest: DeepEval LLMTestCase, built-in metrics such as G-Eval, answer relevancy, faithfulness, contextual recall and precision, hallucination, bias and toxicity, deepeval test run with assert_test, and the Confident AI dashboard.qa-llm-evaluationdefect-escape-taxonomyClassifies it as a test, process or tooling gap and one of thirteen sub-patterns at the earliest layer that should have caught it, with the fix, without blame.qa-bug-reprodefinition-of-doneDrafts a starter DoD and a per-PR checklist, and audits work line by line against an existing DoD with repository evidence, never on self-attestation.qa-processdependabot-configCovers Dependabot or .github/dependabot.yml: required keys, ecosystems, directories and schedules, plus ignore rules, grouped PRs, allow lists, labels, PR limits, target branches, versioning strategy and security-only updates.qa-security-scanningdependency-vulnerability-scanningScans lockfiles with thresholds, checks packages were seen, outputs SARIF and allows only expiring ignores.qa-security-scanningdesktop-test-strategy-referenceMaps each app to a driver (FlaUI, WinAppDriver, Playwright for Electron, QtTest, XCUITest, AT-SPI) and covers accessibility-first locators, waits and elevation hazards.qa-desktopdetox-testingCovers gray-box runs inside the app, by.id, by.text and by.label matchers, waitFor for extra sync, and the Jest runner.qa-mobiledocker-compose-testsWrites a compose.test.yaml with healthcheck-ordered startup, per-job project names for parallel CI, --wait and --exit-code-from gating, and clean teardown with volumes removed.qa-test-environmentdr-drill-runnerWrites a runbook with RTO and RPO per tier, a pre-drill checklist, timed failover and failback, abort rules, an audit-ready report, and backup and restore checks.qa-resiliencedst-transition-referenceCovers skipped and repeated hours, jurisdiction differences, the IANA tz database, billing and meetings on transition days, leap seconds and clock smearing.qa-time
A18
ab-test-validity-checklistBuilds a per-experiment checklist and sign-off: pre-registered metric, power and guardrails, randomization unit and sample ratio mismatch checks, assignment, telemetry, peeking rules and novelty effects.qa-feature-flagsa11y-violation-gateBuilds a CI ratchet that fails only on new WCAG violations a PR introduces, with pre-existing ones baselined per rule and page, from axe-core, pa11y, Lighthouse, WAVE or IBM Equal Access results.qa-accessibilityadd-to-homescreen-flow-testsBuilds Playwright tests for the install flow: installability criteria, the beforeinstallprompt and userChoice chain, the iOS Safari path and display-mode standalone after install.qa-pwaai-spec-coverage-mapperUses an LLM to map existing tests to spec sections, outputs a coverage matrix per spec ID and names the gaps.qa-ai-assistedai-test-generatorScores confidence per test case (self-assessment plus assertion, naming and completeness checks), batches uncertain cases for human review and emits tests in the team's existing framework.qa-ai-assistedallure-reportsSets up Allure Report adapters for pytest, Jest, JUnit, TestNG, NUnit or Mocha, failure categories, history trends and the static HTML site as a CI artifact.qa-test-reportingapi-chaos-runnerInjects latency, timeouts, dropped connections, bandwidth caps and packet loss with Toxiproxy and reports which assertions break under which fault.qa-api-testingapollo-server-testsCovers in-process executeOperation calls, supertest against an ephemeral port, context injection, response and error assertions, and checks that production config disables introspection and enforces persisted queries.qa-graphqlappium-testingCovers Appium mobile UI tests: one suite for iOS and Android (native or React Native) with XCUITest, UiAutomator2 and Espresso drivers, capabilities, clients in JS, Python, Java, Ruby or .NET, simulators, emulators and device farms.qa-mobilearia-authoring-patternsGives the W3C ARIA Authoring Practices pattern: required roles and states, keyboard interaction and common violations.qa-accessibilityasync-ordering-testsTest async ordering - event-loop / queue / channel ordering assertions, JS Promise microtask vs macrotask ordering, Python asyncio.gather vs asyncio.wait_for semantics, Go goroutine + channel happens-before relationships, async/await re-entrancy.qa-concurrencyatlas-migrationsAtlas schema apply, migrate diff against a dev database, migrate lint for destructive or locking changes, and migrate hash, across a dozen databases.qa-db-migrationsattack-surface-test-checklistMaps the changed code to nine attack surfaces and attaches OWASP ASVS 4.0.3 requirements, Top 10 2021 IDs and WSTG sections, only for surfaces the change touches.qa-processaudit-trail-test-authorCovers the required events (logins, privilege changes, data access, admin actions, exports), structured log format, tamper-evident hash chains, immutability and retention, and replaying logs for forensics.qa-complianceauth0-testsCovers per-PR or namespaced tenants, Universal Login, PKCE, client credentials, Rules and Hooks, and config drift with a0deploy.qa-auth-flowsaws-sam-local-testingCovers sam local invoke with event payloads, start-api for a local API Gateway, start-lambda for SDK clients and generate-event, plus .NET Lambda handler tests with Amazon.Lambda.TestUtilities.qa-serverlessaxe-a11yCovers axe-core via axe.run(), @axe-core/playwright or the CLI on every PR, rule configuration and CI-gateable results, plus pa11y, Lighthouse CI, WAVE and IBM Equal Access in its references.qa-accessibilityazure-functions-testsRunnings them locally with Core Tools v4 and Azurite, unit tests for .NET isolated, Node v4 and Python v2 handlers, HTTP, queue and timer triggers, admin-endpoint calls and binding checks in local.settings.json.qa-serverless
B10
bats-testingSets up Bats-core with @test blocks, run, status and output assertions, setup/teardown, shared helpers and TAP output for CI.qa-cli-toolsbdd-step-library-curatorInventories steps, merges duplicates, publishes a step-library README and a scenario coverage map.qa-bddbehave-testingCovers BDD in Python: Behave .feature files, step implementations in features/steps, environment.py hooks (sharing a browser or database between scenarios), tags, reports and CI runs, plus the pytest-bdd alternative.qa-bddboundary-value-generatorGenerates the boundary-value cases, one below, at and above each bound, plus one representative per equivalence class, and emits them as parameterized tests (pytest @parametrize, Jest test.each, xUnit InlineData).qa-test-databrowser-matrix-strategy-referenceCovers a three-tier matrix built from traffic data, quarterly re-tier reviews, a published support policy and test budget, or the case for dropping an old browser.qa-web-e2ebuf-cli-lint-breaking-buildExplains which changes break the wire or generated code and why.qa-grpcbug-bash-facilitatorPrepares the charter, data, environments and sign-up, runs roles, a shared board and live triage, scores findings and writes the same-day wrap-up.qa-manual-testingbug-report-templateFills summary, environment, steps, expected vs actual and severity rationale, then checks each field is usable.qa-bug-reprobug-tracker-workflowCovers a bug tracker workflow in Jira, Linear, GitHub Issues or Azure DevOps: dedupe before filing, lifecycle, transitions and CI filing.qa-defect-managementbullmq-testsCovers producers, worker processors, retries, backoff and repeat jobs, FlowProducer parent-child jobs and QueueEvents, against real Redis (Docker, Testcontainers) or ioredis-mock.qa-async-jobs
C29
cache-key-discriminator-auditChecks the key holds every value the response depends on (tenant, user, scope, locale), writes the fixed key, Vary header and tests.qa-cache-testingcdn-cache-purge-testsPurges and invalidations on Cloudflare, Fastly (surrogate keys) and CloudFront, end-to-end write, purge and fresh-read checks, propagation delay and cache-status headers, plus browser Cache-Control, ETag and service-worker caching with Playwright.qa-cache-testingceedling-build-runnerCovers Ceedling project scaffolding, project.yml, test tasks, JUnit XML, gcov coverage, host vs cross builds and CI.qa-embeddedcelery-testsCovers pytest-celery celery_app and worker fixtures, apply() for synchronous calls, why task_always_eager misleads, and mocking task.retry to test retry behavior, for function and class-based tasks.qa-async-jobschaos-drill-protocolSets the go/no-go gates (non-production, healthy baseline, live monitoring, tested rollback), blast-radius bound, abort criteria, inject and abort commands and the recovery check.qa-resiliencechaos-experiment-authorCovers a steady-state hypothesis, real-world faults (latency, node or region failure), blast radius, automation and the verdict, with a five-check validation of the hypothesis and LitmusChaos and Gremlin setup.qa-resiliencechaos-meshConfigures Chaos Mesh pod, network, stress, IO, time, DNS, kernel and HTTP faults, label selectors, namespace limits on blast radius, schedules and the dashboard.qa-resiliencechart-render-testsCanvas charts (Chart.js) get screenshot and toDataURL diffs, SVG (D3) gets normalized structure snapshots, and Vega or Vega-Lite specs get schema and compile checks.qa-visual-regressioncheckov-policyCovers Checkov or scanning infrastructure code (Terraform, CloudFormation, Kubernetes, Helm, ARM, Serverless, CDK) with the broadest built-in rule set: SARIF and JUnit output, and a baseline so CI fails only on new findings.qa-iacchromatic-visual-regression-testingCovers the chromatic CLI, baselines, TurboSnap, UI Review, CI gating and reading exit codes to tell visual changes from errors.qa-visual-regressionchrome-extension-messaging-testsTests runtime.sendMessage, tabs.sendMessage, long-lived ports, externally_connectable and native messaging on a running extension.qa-browser-extensionci-failure-triageDecides what kind of failure a red CI test is before anyone starts fixing it.qa-bug-reproci-test-job-conventionsCovers how many shards, which failures are safe to retry, quarantine, artifact retention, per-PR vs nightly cadence, cancel-on-push, timeouts and secrets.qa-ci-integrationcli-output-conventionsSets the contract for exit codes, stdout vs stderr, --json output, ordering, color and --help, based on the Command Line Interface Guidelines.qa-cli-toolscloud-grid-e2eCovers credentials, the WebDriver hub URL and vendor capabilities, a local tunnel for internal apps, session status reporting and a CI matrix sized to the plan's parallel sessions.qa-web-e2ecloudflare-workers-miniflareCovers Miniflare 3 (workerd-backed), wrangler dev, emulated KV, Durable Objects, R2 and D1 bindings, and in-process tests with Vitest and @cloudflare/vitest-pool-workers.qa-serverlesscodeql-queriesCovers CodeQL or deep semantic static analysis (SAST) on a GitHub repo: codeql database create and analyze per language, query packs, SARIF upload to code scanning, and suppressions.qa-security-scanningcompliance-coverage-scoringMarks each criterion met, partial or not met, records approved exclusions and never claims ready with a gap.qa-complianceconfirmation-testing-workflowProcedure for proving that a claimed defect fix actually reached the build under test and actually works.qa-defect-managementcontract-compatibility-gateCombines Pact can-i-deploy, oasdiff for OpenAPI, graphql-inspector for GraphQL and buf breaking for Protobuf into one go/no-go CI step with severity thresholds and a reason per finding.qa-contract-testingcoverage-diff-reporterCompares current and baseline coverage (LCOV, Cobertura or JSON) and reports per-file line and branch deltas, new files and hidden drops, with a one-line summary for the PR comment.qa-test-reportingcoverage-guided-fuzzingPicks libFuzzer, AFL++, cargo-fuzz, Go fuzzing, Atheris or Jazzer by language, then covers fuzz targets, seed corpora, dictionaries, sanitizers, crash triage and CI smoke fuzzing.qa-fuzz-testingcoverage-py-analysisCovers Python code coverage with pytest or unittest: coverage run, branch coverage, combining parallel data, .coveragerc source, omit and fail_under, and terminal, HTML, Cobertura XML, LCOV or JSON reports for CI.qa-test-reportingcron-job-test-authorCovers cron expression validation, DST and leap-day edge cases, catch-up after downtime, overlapping-run locks with stale-lock recovery, and time zones.qa-async-jobscross-tenant-data-leak-testsInventories tenant-bearing surfaces, then tests read-by-ID, list leaks, spoofed tenant IDs, JWT replay, storage IDOR, search, jobs and caches, plus Postgres row-level security.qa-multi-tenancycucumber-testingCovers Cucumber or Gherkin in Java, Kotlin, JavaScript or Ruby: setting up Cucumber-JVM with JUnit 5, Cucumber-JS or Cucumber-Ruby, writing .feature files and step definitions, undefined or ambiguous steps and Cucumber expression mismatches, tags, and JUnit XML reports.qa-bddcurrents-integrationSets up Currents.dev with @currents/playwright, currents.config.ts, the reporter, traces, videos and screenshots, and runs via npx pwc.qa-test-reportingcve-exploitability-triageRanks each CVE by EPSS exploit probability and CISA KEV status, applies VEX and reachability, and sorts findings into Fix-Now, This-Sprint, Backlog or Accept-Risk.qa-security-scanningcypress-testingCovers Cypress tests: stubbing API calls with cy.intercept, replacing cy.wait sleeps with assertions, tests that pass locally but fail in CI, fixtures and cy.task, cy.clock, cy.origin and cy.session logins, cypress.config.ts, the Cypress 16 upgrade and Cloud parallel runs.qa-web-e2e
E13
e2e-suite-budgetRanks every E2E test by ROI (regressions caught vs runtime, flake rate and maintenance) and recommends which to retire, move to a lower layer or fix.qa-processelasticsearch-relevance-testsBuilds judgment lists and _rank_eval tests with precision, recall, MRR and DCG, plus OpenSearch and Solr specifics in its references.qa-search-relevanceelectron-playwrightCovers Playwright's _electron.launch, renderer windows as Pages, main-process checks via electronApp.evaluate, and IPC and DOM assertions from one suite.qa-desktopembedded-coverage-strategy-referenceCovers host vs QEMU instrumentation, MISRA-C and DO-178C expectations by safety level, and report formats.qa-embeddederror-budget-testsTests error-budget math, burn-rate alerts, exhaustion and freeze triggers, and incident metric calculations.qa-resilienceespresso-suiteCovers onView with perform and check, automatic synchronization instead of sleeps, IdlingResource for app async work, ./gradlew connectedAndroidTest and JUnit XML results.qa-mobileevent-sourcing-testsTests given-events/when-command/then-events, replay determinism, upcasting, snapshot equivalence, projections and eventual-consistency windows.qa-saga-cqrsevidently-monitoringCovers data drift or quality monitoring for a production ML model: Evidently reports with tests for data drift, target drift and performance regression as a CI gate or scheduled job, and a playbook to pick rollback, retrain, quarantine or alert re-tuning.qa-ml-modelsexec-quality-narrativeWrites the executive narrative with the answer first and grouped support beneath it, using the Minto Pyramid and SCQA.qa-team-managementexperiment-results-interpreterComputes significance per metric with multiple-comparison correction, reads confidence intervals, and checks novelty, interactions, Simpson's paradox, guardrails and stop-early rules before a ship decision.qa-feature-flagsexperiment-sdk-testingInitializes the SDK offline from a committed config fixture, pins each test to an arm and checks assignment integrity, with per-vendor references.qa-feature-flagsexploratory-charter-authorWrites a session-based testing charter: one-sentence mission, 3-7 areas, a 60, 90 or 120 minute time-box, suggested tours and the debrief deliverables.qa-manual-testingexploratory-testingPlans and runs time-boxed exploratory testing when tester hours are scarce before a release - one tester with two free 45-minute blocks before code freeze, a high-stakes window such as year-end payroll, or a device and environment the scripted suite never touches.qa-manual-testing
F15
failure-injection-test-authorCombines WireMock fault stubs (500s, bad JSON, slow replies) with Toxiproxy (latency, loss, resets) and checks the app's resilience.qa-resiliencefairlearn-fairnessComputes Fairlearn MetricFrame group metrics, mitigates with ExponentiatedGradient and adds group checks to the gate.qa-ml-modelsfake-clock-testingFake clocks / freeze time in tests across every mainstream runtime: freezegun (Python), Jest fake timers + Sinon @sinonjs/fake-timers (JS/TS), timecop (Ruby), java.time.Clock / InstantSource injection (JVM), .NET TimeProvider / FakeTimeProvider, and libfaketime (LD_PRELOAD for any native binary).qa-timefaker-dataFixes test data that breaks tests - factory values in a shape the code under test rejects (a phone number that is not E.164), fixtures that only pass when the whole suite runs in order, and random values that make an assertion pass or fail depending on the run.qa-test-datafast-check-testingCovers property-based or generated-input tests in JavaScript or TypeScript: fast-check with fc.assert and fc.property, arbitraries, shrinking and seeds, in Jest, Vitest or Mocha.qa-property-basedfeature-flag-test-harnessRuns the same suite under the minimum set of flag combinations with an OpenFeature in-memory provider, as labeled CI matrix shards, and reports results per combination.qa-test-environmentflake-axis-bisectionVaries one condition at a time (isolation, order, workers, viewport, latency, repetition), counts passes and failures with confidence intervals, and walks shared resources once parallelism is implicated.qa-flake-triageflake-dashboard-authorCovers tracking flaky-test rates or test reliability over time: a flake-rate metric from CI history (JUnit XML or JSON), a Grafana panel or Datadog CI Visibility view, the quarantine-candidate query, trend alerts and the report for Slack or a wiki.qa-flake-triageflake-pattern-referenceMatches the failure to one of eight flake patterns (async timing, test order, shared parallel state, resource leaks, network, locator drift, environment variance, randomness) and gives the code fix for each, such as framework auto-waits instead of sleeps, per-worker DB schemas via workerIndex, try/finally teardown, mocked network and clock, TZ pinning and RNG seeding.qa-flake-triageflaky-test-quarantineBuilds a quarantine workflow for flaky tests - marks the test with the framework's skip/fixme/retry annotation, records the failure-rate observation and a bisect link in the annotation body, sets an auto-expiry date, and produces a CI report listing every quarantined test that has expired and needs re-evaluation.qa-flake-triageflame-graph-analyzerReads flame graphs and profiles from py-spy, async-profiler, Go pprof or clinic.js, finds the hottest frames, tells CPU-bound from lock contention or allocation pressure and suggests the next step.qa-load-testingflaui-testsCovers FlaUI UIA2 and UIA3 packages, launching or attaching to the app, ConditionFactory locators by AutomationId, Retry waits and xUnit, NUnit or MSTest.qa-desktopflutter-testingCovers unit tests with flutter test, widget tests with testWidgets and WidgetTester, integration_test on simulators, emulators or devices, choosing the layer per change, mockito with build_runner, LCOV coverage and CI.qa-mobileflyway-migrationsCovers Flyway: versioned, repeatable and undo migration files, migrate, info, validate, baseline and repair, the schema history table, migration ordering, and CI gates on schema changes, via CLI, Maven, Gradle or Docker.qa-db-migrationsframework-choice-advisorCompares tradeoffs, matches project needs to a choice, covers commercial vendor evaluation and records the decision.qa-process
G23
game-perf-profilingProfiles with Unity Profiler and Performance Testing or Unreal Insights, sets 16.6 ms and 33.3 ms budgets, adds CI perf tests and reports per SKU.qa-gamegameplay-recording-replayReplays sessions bit-for-bit and checks the end state, via Unity InputEventTrace, Unreal's Replay System or deterministic Godot input replay.qa-gamegdpr-test-patternsCovers data subject access, erasure, portability and objection, consent and withdrawal, data residency, 72-hour breach notice, data minimization, and CCPA rights including Global Privacy Control.qa-compliancegherkin-from-storiesMaps each criterion to scenarios, finds Scenario Outlines and Background, reuses existing steps and flags hidden preconditions.qa-bddghz-loadCovers ghz runs with request count, concurrency, rate and duration, JSON, CSV or HTML output, and p50, p95 and p99 latency, RPS and error rates checked in CI.qa-grpcgiskard-llmRuns giskard.scan on any model wrapped as giskard.Model to probe hallucination, harmful content, prompt injection, sensitive data disclosure, stereotypes, robustness and sycophancy, with an HTML report.qa-llm-evaluationgiskard-testsRuns Giskard scan and its test catalog for performance, robustness, fairness, data leakage and ethical issues, and emits suites that pass or fail in CI.qa-ml-modelsgithub-actions-test-jobsCovers a test workflow on pull requests, matrix builds across OS and runtime versions, splitting a suite across parallel runners, service containers such as Postgres or Redis, uploading JUnit reports, and trigger filters.qa-ci-integrationgitlab-ci-test-jobsCovers running tests in GitLab CI/CD: test stages in .gitlab-ci.yml, parallel matrix jobs, junit and coverage artifact reports, Postgres or Redis services, needs between jobs, rules for triggers and retry policy.qa-ci-integrationgitleaks-scanningGitleaks git, dir and stdin scans, custom rules and allowlists in .gitleaks.toml, pre-commit and GitHub Action setup, baselines, and TruffleHog live verification.qa-security-scanninggo-unit-testsCovers Go tests: t.Run subtests, t.Parallel, helpers, data races that fail in CI (go test -race), fuzz tests, benchmarks and coverage, plus testify, gomock and Ginkgo.qa-unit-tests-go-rustgodot-gut-testsCovers install, tests extending GutTest, assertions including signals, lifecycle hooks, parameterized tests, doubles, stubs and spies, async tests, the command-line runner with JUnit XML, and CI.qa-gamegolden-file-conventionsSets naming and directory layout, when to add, update or remove a baseline, sanitization, per-OS and per-runtime variants, and the PR review workflow for snapshot diffs.qa-test-datagoogletest-embedded-armCovers TEST, TEST_F and parameterized tests, EXPECT vs ASSERT, fixtures, GoogleMock, cross-compiling with arm-none-eabi-g++, running on host or QEMU and XML output for CI.qa-embeddedgraphql-complexity-limit-testerSends over-limit depth and cost queries and asserts they are rejected, proving graphql-depth-limit, cost analysis or graphql-armor are enforced; covers introspection and persisted-query allowlists.qa-graphqlgraphql-n-plus-one-remediationFinds the fan-out, write a test that counts queries, and fix it with DataLoader batching, parent projection or selection-set prefetch.qa-graphqlgraphql-schema-regressionDiffs schemas with graphql-inspector, classifies changes as breaking, dangerous or safe (removed fields, narrowed types, deprecated-field removal with usage checks), checks Federation supergraph drift and gates CI.qa-contract-testinggraphql-subscription-test-authorCovers subscribing through the async iterator, asserting event shape and order, connection lifecycle and close codes, auth on connect and pubsub triggers.qa-graphqlgraphql-yoga-testsCovers in-process yoga.fetch() for queries and mutations, executor-http for subscriptions and streaming, auth headers, and checks for disabled introspection and persisted operations.qa-graphqlgreat-expectationsCovers ExpectationSuites, ValidationDefinitions and Checkpoints, running validations on batches and reading the JSON result to gate CI.qa-data-qualitygrpc-mockCovers Go bufconn and mockgen, Python pytest-grpc, JVM in-process servers, Node fake servers, with success, error and timeout responses.qa-grpcgrpc-streaming-test-authorCovers ordering, completion, cancellation, deadlines and partial failures, with skeletons for Go, Python, JVM and Node, plus the 17 gRPC status codes and their retry rules.qa-grpcgrpcurl-cliCovers grpcurl list and describe via reflection or .proto files, unary and streaming calls with JSON input, TLS and plaintext flags, auth headers, and exit codes for smoke tests and CI gates.qa-grpc
H6
hardware-in-loop-referenceCovers MIL, SIL, PIL and HIL stages, NI, dSPACE, Vector and Speedgoat stacks, CAN, LIN, FlexRay and Ethernet emulation, fault injection and ISO 26262, DO-178C and IEC 61508 evidence.qa-embeddedhasura-testsCovers a docker-compose test instance, metadata API setup, x-hasura-role and x-hasura-user-id headers, and a role by table by operation permission matrix against the v1/graphql endpoint.qa-graphqlhelm-chart-testerCovers helm-unittest test files per template with isKind, equal, matchRegex and snapshot assertions, plus helm lint and helm template render checks.qa-iachipaa-test-patternsCovers administrative, physical and technical safeguards (access control, audit logs, integrity, transmission security), PHI in fixtures, minimum-necessary access and BAA scope.qa-compliancehybrid-search-eval-authorCovers judgment sets, nDCG@k and MRR on fused results, Reciprocal Rank Fusion vs weighted fusion vs single-stage, and whether the reranker earns its latency.qa-search-relevancehypothesis-testingHypothesis @given strategies, composite strategies, assume and filtering, settings, reproducibility and CI.qa-property-based
I2
i18n-string-coverageScans code for user-facing strings not wrapped in the translation function, maps gaps to the translation files, reports coverage per language and fails PRs that add new untranslated strings.qa-localizationidempotency-test-authorTests idempotency keys, delivery semantics, fingerprint dedup and the idempotency window.qa-async-jobs
J9
jacoco-analysisCovers Java, Kotlin, Scala or Groovy code coverage on Gradle or Maven: JaCoCo agent setup, HTML, XML and CSV reports, check rules such as 80% lines, the six counters, and JaCoCo XML to LCOV or Cobertura.qa-test-reportingjaeger-trace-testsRuns the backend in CI, queries traces by service and operation, and asserts on spans, parent-child links and durations.qa-distributed-tracingjenkinsfile-test-stagesCovers running tests in Jenkins: declarative Jenkinsfile test stages, parallel stages across agents, post always/failure actions, JUnit report publishing and lockable resources for shared test infrastructure.qa-ci-integrationjmeter-load-testingCovers .jmx test plans with thread groups, HTTP samplers, assertions and listeners, headless jmeter -n runs, the HTML dashboard and CI gates from JTL results.qa-load-testingjqwik-testingCovers property-based or generated-input tests in Java or Kotlin: jqwik on JUnit 5 with @Property, @ForAll, Arbitraries, @Provide generators, shrinking and statistics.qa-property-basedjs-unit-testsMockings a module (jest.mock, vi.mock, vi.hoisted), spies and fake timers, path aliases that fail only in tests (Cannot find module '@/...'), coverage thresholds, watch mode and CI.qa-unit-tests-jsjudgment-list-authorCovers query sets, grading scales, rater guidelines, inter-rater agreement, Quepid, TREC-style pooling and refresh cadence.qa-search-relevancejunit-xml-analysisExplains CI test numbers that disagree with what the suite actually did - a 'slowest tests' list dominated by the wrong suite, a release gate or dashboard reading only the summary attributes on the suite element and never the cases below them, or a pass rate that quietly counts skipped tests as passes.qa-test-reportingjvm-unit-testsCovers parameterized tests, lifecycle hooks, Mockito, AssertJ, JaCoCo coverage and Maven or Gradle CI.qa-unit-tests-jvm
K6
k-anonymity-verifierComputes equivalence classes over chosen quasi-identifiers with pycanon or ARX, reports re-identification risk and gates CI.qa-test-data-privacyk6-load-testingCovers VU scripts with checks, stages for ramps, thresholds on p95 latency and errors as the CI gate, and how to read tail latency and coordinated omission.qa-load-testingkafka-consumer-testsCovers a real broker via Testcontainers, offset commits, consumer-group rebalances, at-least-once vs exactly-once transactions, idempotent producers and dead-letter topics.qa-async-jobskarate-testingCovers the Gherkin-style DSL, match with fuzzy validators, JUnit 5 and Maven runs, and JUnit XML for CI.qa-api-testingkeycloak-testsCovers a throwaway Keycloak per test class via Testcontainers, realm JSON imports, OIDC discovery, token and introspection endpoints, the admin REST API, password, auth-code, client-credentials and token-exchange flows, and UMA.qa-auth-flowsknip-dead-codeRuns Knip on a JS/TS project to find unused files, dependencies, exports and class or enum members, aware of test entry points through its framework plugins.qa-code-quality
L12
langfuse-tracingAdds Langfuse with @observe or startActiveObservation, records metadata, cost and latency, scores traces and manages prompts as code.qa-llm-evaluationlanguage-native-sastCovers Bandit for Python, gosec for Go, eslint-plugin-security and no-unsanitized for JavaScript/TypeScript, or PMD's Apex rules for Salesforce, with justified suppressions, baselines for legacy code, SARIF and CI gates.qa-security-scanninglaunchdarkly-testingCovers the TestData source for hermetic tests with no network, file-based fixtures, per-test flag overrides and assignment checks.qa-feature-flagslcov-analysisParses per-file line, function and branch metrics from gcov, llvm-cov, coverage.py, JaCoCo, Jest, nyc or coverlet output, compares with a baseline and returns per-file pass or fail verdicts for a cross-language gate.qa-test-reportinglighthouse-perfSets up Lighthouse CI with Google's thresholds at the 75th percentile, per-route budgets by page type, resource-size budgets, report artifacts and PR comments.qa-load-testingliquibase-migrationsChangelogs and changesets in XML, YAML, JSON or SQL, update, status, rollback and tag, preconditions, contexts and labels, and the changelog lock tables, for portable migrations across databases.qa-db-migrationsliving-documentation-publisherTurns Cucumber JSON into HTML living documentation (multiple-cucumber-html-reporter or Serenity BDD) and publishes it to GitHub or GitLab Pages.qa-bddlizard-complexityRuns Lizard (30+ languages) on production code to enforce per-function cyclomatic complexity, length and parameter-count thresholds as a CI gate, excluding tests.qa-code-qualityllm-eval-anti-patternsChecks eight methodology errors (too few cases, exact match on open text, no baseline, unpinned models, no adversarial cases and more) and how to validate an LLM judge.qa-llm-evaluationllm-regression-suite-authorBuilds a versioned golden dataset, deterministic runs, exact, semantic, judge and rubric checks, and a pass-rate CI gate with a baseline diff across model versions.qa-llm-evaluationload-testing-overviewPicks k6, JMeter, Gatling, Locust or Artillery, explains the six load profiles and percentiles, and gives a first CI gate.qa-load-testinglocale-format-validatorUse when a product shows dates, numbers, currencies, times or durations to users in several locales and needs proof each locale formats them correctly (5/4/2026 vs 04.05.2026, 1,234.56 vs 1.234,56, $ vs EUR placement).qa-localization
M20
madge-depsRuns Madge on production code to find circular dependencies and orphan modules and draw the module graph, excluding test files.qa-code-qualitymaestro-flowsCovers Maestro: .maestro/*.yaml with tapOn, inputText, assertVisible and swipe, for iOS, Android, Flutter, React Native and web, with nested flows and JavaScript hooks.qa-mobilemailpit-testingCovers testing email your code sends: capture messages in Mailpit's local SMTP server (port 1025), assert on subject, body and links through its REST API, test SMTP failures with chaos mode, multipart, unsubscribe and bounce flows, or migrate from MailHog.qa-notificationsmalicious-payload-bankCovers SQL injection, XSS, SSRF, path traversal, command injection, XXE, prototype pollution, ReDoS, Unicode confusables and header injection, with which payloads fit each input context.qa-test-datamanual-test-script-authorWrites self-contained manual test cases as a step table, Gherkin, a business-language UAT script or a one-line checklist.qa-manual-testingmfa-flow-test-authorCovers deterministic TOTP and HOTP codes, SMS or email OTP, WebAuthn passkeys via the Chrome virtual authenticator, recovery codes, enrollment and step-up challenges.qa-auth-flowsmigration-operation-taxonomyClassifies each statement (additive, locking, breaking, data-loss) by lock and rewrite.qa-db-migrationsmobile-a11y-test-authorCovers XCUITest performAccessibilityAudit (iOS 17+), VoiceOver labels and traits, Espresso AccessibilityChecks, Accessibility Scanner and TalkBack order, plus WCAG checks for labels, 44pt and 48dp touch targets, contrast and focus order.qa-mobilemobile-device-matrix-toolkitGenerates Appium configs per device from one YAML, runs a GitHub Actions matrix and merges JUnit results into one table.qa-mobilemodel-based-test-graph-authorBuilds a state-machine model, checks it is complete, picks a coverage criterion, generates covering paths and turns them into a curated test suite.qa-ai-assistedmodel-performance-regression-gateCompares held-out accuracy, F1, AUC or RMSE with the production model within a tolerance, and checks key segments with Deepchecks so a global gain cannot hide a slice regression.qa-ml-modelsmodel-risk-evidence-matrixAssigns a low, medium or high tier, lists required artifacts and returns promote, needs-work or block.qa-ml-modelsmqtt-testsCovers QoS 0, 1 and 2, retained messages, Last Will, shared subscriptions and $SYS with Mosquitto and paho-mqtt; STOMP and RabbitMQ AMQP tests via Testcontainers are in its references.qa-realtime-protocolsmsw-handlersWrites Mock Service Worker handlers (http.get, http.post, HttpResponse.json), wires setupServer (Node) or setupWorker (browser), and manages the listen / resetHandlers / close lifecycle.qa-test-datamull-mutationSets up Mull for Clang builds (version-matched package, -fpass-plugin flags, CMake, mull-runner, mutators, path filters) and runs it in GitHub Actions.qa-mutation-testingmulti-tool-finding-triageNormalizes and dedupes findings, records which scanners agree, rejects waivers without expiry or approver, adds EPSS and KEV, and writes one PR comment.qa-security-scanningmultiplayer-state-machine-coverageBuilds a coverage matrix for connect, authority handoff, disconnect, reconnect and host migration under latency, loss and reordering for Unity Netcode, Unreal and Mirror, with a go/no-go gate.qa-gamemutant-survival-triageClassifies each survivor (missing case, weak assertion, equivalent, unreachable, flaky), drafts the test or assertion that kills it, and states the mutation score with its formula.qa-mutation-testingmutmut-mutationSets up mutmut: mutmut run, results and browse, applying survivors, pragma: no mutate suppressions and pyproject.toml config.qa-mutation-testingmvcc-isolation-testsTests which anomalies each level prevents (dirty, non-repeatable and phantom reads, write skew) in PostgreSQL, MySQL and SQL Server.qa-concurrency
N4
negative-test-generatorUse when code has deliberate error paths but the tests only prove the success case.qa-test-datanon-functional-requirement-extractorExtracts performance, accessibility, security, i18n, reliability and observability needs as threshold-bound assertions, each mapped to its measurement source (Lighthouse, axe, OWASP ASVS, WCAG).qa-shift-leftnotebook-ci-pipeline-authorWires papermill parameterized runs, nbval output checks, testbook unit tests, nbstripout and artifacts into GitHub Actions, plus a review checklist with a BLOCK or PASS verdict.qa-ml-modelsnuclei-dastCovers choosing templates by path, tag or severity, rate limits, JSONL output, custom YAML matchers for app-specific checks, community CVE templates and CI severity gates.qa-security-scanning
O9
oauth-flow-test-authorCovers auth code with PKCE, client credentials, refresh-token rotation and reuse detection, state and nonce checks, scopes and strict redirect-URI matching, per the RFCs.qa-auth-flowsobject-model-patternsExplains what each pattern is, when it fits and mixes to avoid, with citations and examples.qa-test-reviewoffline-fallback-testsMaps each route to an offline caching recipe (cache first, network first and others), tests it with Playwright, and covers Workbox offlineFallback and storage choices.qa-pwaokta-testsCovers per-PR or shared orgs, MFA enforcement, factor enrollment, recovery, SCIM provisioning and least-privilege API tokens.qa-auth-flowsopenapi-contract-diffRuns oasdiff breaking, grades findings ERR, WARN or INFO and gates CI with --fail-on.qa-contract-testingopenfeature-sdk-testingCovers InMemoryProvider for hermetic tests, evaluation details, hooks and targeting context in TypeScript, Java and Python, plus a flag test-matrix workflow.qa-feature-flagsopentelemetry-trace-assertionsCaptures spans with the in-memory exporter in tests (Python, JS, Java) and asserts on names, attributes, status, kind and structure.qa-distributed-tracingotel-collector-config-testerRuns otelcol validate, uses the debug or file exporter to assert spans flow through the pipeline, and wires the check into CI.qa-distributed-tracingoutbox-pattern-test-authorTests that the DB write and event insert are atomic, events publish at least once in order, consumers dedupe and stay idempotent, and the relay recovers from failures.qa-saga-cqrs
P31
pact-contract-testingSets up Pact consumer-driven contract tests, publish pacts to a broker, verify the provider and gate deploys with can-i-deploy.qa-contract-testingpairwise-test-case-generatorCombines boundary values, equivalence classes and pairwise (or N-wise) reduction into parameterized cases in the project's runner format.qa-test-datapayment-flow-test-authorCovers a refund matrix (full, partial, over-refund) for Stripe, Adyen, PayPal and Braintree, chargebacks with card-network reason codes, and webhook replay through each gateway's simulator.qa-paymentpayment-gateway-sandboxesCovers test credentials, sandbox URLs, deterministic test card numbers and each gateway's webhook simulator.qa-paymentpci-dss-control-test-authorCovers no stored or logged CVV, full card number (PAN), track data or PIN, card data only over strong TLS, cardholder data environment boundaries and segmentation, key management, SAQ level, scope reduction with hosted fields.qa-compliancepdf-accessibility-checkerChecks structure tags, alt text, reading order, language and title with veraPDF, PAC or similar, mapped to WCAG PDF techniques.qa-pdf-printpdf-snapshot-testerRenders pages to images and pixel-diffs them against approved baselines, strips volatile metadata, and compares HTML-to-PDF engines.qa-pdf-printpercy-visual-regression-testingCovers @percy/cli with the Playwright, Cypress, Selenium or Storybook SDK, percy exec, viewports, masks and ignored regions, and reviewing diffs in Percy builds.qa-visual-regressionperf-budget-gateCombines k6, JMeter, Gatling or Locust results with Lighthouse CI Web Vitals, applies severity-aware thresholds against the main-branch baseline and returns one go/no-go with per-metric deltas.qa-load-testingpester-cli-testingSets up Pester v5: Describe/Context/It blocks, Should assertions, Mock, setup hooks, tags, code coverage and NUnit/JUnit XML output for CI.qa-cli-toolspii-masking-pipeline-builderClassifies each field against GDPR, CCPA, NIST and HIPAA PII categories, picks a masking operator, decides pseudonymization vs anonymization, emits a Presidio, Faker and Synthea config and blocks promotion if a re-scan finds PII.qa-test-data-privacypitest-mutationSets up PIT (PITest) with Maven or Gradle, target classes, mutators, mutation-score thresholds that fail the build, incremental runs, Kotlin support and the HTML and XML reports.qa-mutation-testingplatform-cert-overview-referenceCovers the six game QA test categories, submission workflows, severity terms and SLAs, mapping QA findings to platform terms and building a pre-submission checklist.qa-gameplaywright-agentsSettings them up, reviewing healer diffs before merging, debugging a failing test from its trace in a terminal with no display, and leaving a video receipt.qa-web-e2eplaywright-extension-fixturesCovers the persistent-context fixture that loads the extension and finds its ID, why an edit seems to have no effect (reload matrix), and popup, content-script, storage and MV3 service-worker tests.qa-browser-extensionplaywright-fixture-builderBuilds test.extend fixtures with the right test or worker scope, setup and teardown, and per-worker isolation for login, database or feature-flag setup.qa-test-environmentplaywright-snapshotsCovers toHaveScreenshot assertions, masks, clips and thresholds, per-OS and per-browser snapshot folders, --update-snapshots, and a viewport matrix across responsive breakpoints.qa-visual-regressionplaywright-testingCovers Playwright tests: role-based locators, web-first assertions instead of waitForTimeout, page objects, config and browser projects, traces, sharding a slow suite in CI.qa-web-e2epolicy-as-code-runnerWrites OPA Rego policies and runs Conftest against Kubernetes manifests, Terraform plans, Dockerfiles or any structured data; also covers Cedar.qa-iacpost-mortem-authorCovers incident post-mortems or incident reviews: a sourced timeline, root cause (what and why, not who), impact on users, revenue and SLOs, action items with owners, dates and success criteria, and what went well.qa-processpostman-collectionsRepairs Postman and Newman runs in CI - a reporter that never writes the HTML file the pipeline expects, a nightly job that fires requests as fast as it can until a partner API rate-limits it, or a report with one row per request when the collection asserts a dozen things between them.qa-api-testingpresidio-pii-detectionCovers Microsoft Presidio analyzer and anonymizer, built-in recognizers for names, emails, cards, SSNs, IBANs and national IDs, custom pattern recognizers, score thresholds and CI gates.qa-test-data-privacyprint-stylesheet-testsTests print CSS with Playwright print emulation and page.pdf(): @page size and margins, page breaks, orphans and widows, and print-only rules.qa-pdf-printprod-canary-validatorCompares the canary's error rate, p50, p95 and p99 latency and business KPIs with the baseline over the observation window, with absolute and relative thresholds and a significance check.qa-shift-rightpromptfoo-evaluationCovers Promptfoo or adding quick regression checks for prompts or RAG pipelines in CI: promptfooconfig.yaml providers, prompts and tests, deterministic, semantic, model-graded, latency and cost assertions, promptfoo eval and view, and CI gating.qa-llm-evaluationproptest-testingCovers property-based or generated-input tests in Rust: proptest with the proptest! macro, strategies for collections, regex strings and any, shrinking, and the persisted regression file.qa-property-basedprotobuf-compat-checkingRuns buf breaking against a past version, picks the FILE, PACKAGE, WIRE_JSON or WIRE category, sets exemptions and gates CI.qa-contract-testingpseudo-localization-runnerReplaces strings with accented, 35%-longer variants to expose hardcoded text, truncation, encoding and bidi problems without real translators.qa-localizationpush-notification-test-authorCovers testing push notifications: Firebase FCM, Apple APNs and Web Push with VAPID, payload encryption, badge, sound and click actions, expired or unregistered tokens, silent vs alert pushes and topic routing, plus in-app delivery over WebSocket or SSE with read state.qa-notificationspytest-asyncio-patternsCovers testing async Python code: pytest-asyncio modes and loop scopes, async fixtures, AsyncMock (assert_awaited), httpx.AsyncClient with ASGITransport and aiohttp_client.qa-unit-tests-pythonpython-unit-testsCovers Python tests: pytest fixtures and conftest.py, parametrize, mocking, markers, slow or untrusted suites, coverage gates and CI.qa-unit-tests-python
Q4
qa-hiring-kitCovers job description, interview questions, a competency-anchored scoring rubric, interviewer calibration, the panel debrief to a hire or no-hire decision and a 30-60-90 day onboarding plan.qa-team-managementqemu-system-test-runnerCovers qemu-system-arm, aarch64 and riscv32 machine and CPU flags, loading ELF binaries, semihosting exit codes, GDB and QMP, and CI.qa-embeddedqt-test-frameworkCovers Qt Test entry macros, private-slot test functions, QVERIFY, QCOMPARE and data-driven QFETCH, simulated mouse, key and touch events, QSignalSpy, QBENCHMARK and JUnit XML output for CI, including Qt Quick and QML logic.qa-desktopquality-status-digestComputes pass rate, escaped defects and flake debt, rates each area red, amber or green, and rolls teams up into a portfolio view.qa-team-management
R15
rabbitmq-testsCovers work queues, pub/sub, routing, topics and RPC, publisher confirms, ack, nack and requeue, durable and quorum queues, with the Testcontainers RabbitMQ image.qa-async-jobsrace-condition-test-authorForces interleavings with barriers and latches, and runs ThreadSanitizer, go test -race with goleak, or jcstress for the JVM.qa-concurrencyragas-evaluationRagas faithfulness, response relevancy, context precision and recall, noise sensitivity, factual correctness, tool-call accuracy, agent goal accuracy and rubric scoring.qa-llm-evaluationreachability-analyzerFinds dependencies the code never uses with knip or depcheck (JS), vulture (Python) or cargo-machete (Rust) and downranks their CVEs.qa-security-scanningred-green-refactorReproduces the problem with a failing test first, watch it fail for the right reason, make the smallest change that passes, refactor, and show the test output before saying it is fixed or works.qa-tddredis-cache-testsCovers TTLs, cache-aside write and invalidate, eviction under memory pressure, pub/sub invalidation across nodes and tenant key namespaces, plus stampede and stale-while-revalidate patterns.qa-cache-testingregression-suite-selectorBuilds a CI step that runs only tests affected by the PR's changed files (from coverage maps or Bazel rdeps), plus previously failing and new tests, while a periodic full run guards against a stale map.qa-test-impact-analysisrelease-runbook-authorWrites a six-phase runbook (pre-flight, smoke, canary, promote gate, rollout, verification) with baseline-relative criteria and rollback paths.qa-shift-rightrenovate-configCovers preset extends, schedules, PR limits, vulnerability alerts, packageRules matching with automerge, ignored dependencies and labels.qa-security-scanningreqnroll-testingConfigures Reqnroll with hooks, async steps, tags and dotnet test runs, and has a SpecFlow migration path.qa-bddrestassured-testingWrites REST Assured given/when/then tests: status, JSON and XML path checks, auth, reusable specs, schema checks, Maven or Gradle and CI reports.qa-api-testingrestler-fuzzingRuns Microsoft RESTler from an OpenAPI spec (compile, test, fuzz-lean, fuzz) and reports 5xx errors, resource leaks and hierarchy violations.qa-api-testingrisk-matrixCovers risk-based testing or deciding what to test first when there is no time to test everything: a risk matrix or register with likelihood x impact scores for a release, a risk-storming session, calibrating ratings against real defects, or mapping each risk to the tests and monitors that cover it.qa-processrtl-rendering-testerRuns the suite under RTL locales, checks dir=rtl, mirrored layout, icons and alignment, logical CSS properties instead of left and right, and captures screenshots per locale for review.qa-localizationrust-unit-testsCovers Rust tests: where tests live, assert macros, should_panic with an expected message, Result-returning tests, integration and doc tests, rstest, mockall, coverage with cargo-llvm-cov and Criterion benchmarks.qa-unit-tests-go-rust
S35
saga-transaction-testsTests orchestrated and choreographed sagas: each compensating step, partial failures, idempotent compensations and the outbox for atomic publish.qa-saga-cqrsschemathesis-fuzzingSchemathesis fuzzes every endpoint for 5xx errors and schema violations from the CLI or pytest, picks the conformance checks and gates CI as the API evolves.qa-api-testingscreen-reader-test-authorCovers step-by-step scripts for NVDA, JAWS, VoiceOver or TalkBack with keystrokes and expected announcements, WCAG 2.2 checklists per page type, widget keystroke matrices and a guided session with a signed report.qa-accessibilitysecrets-rotation-runnerIdentifies the provider, rotate the credential through its API (AWS IAM, GitHub, Stripe, GCP, Azure, Twilio, Slack and more), revoke the old one, log the audit trail and link the post-mortem.qa-security-scanningseed-data-curatorPicks a representative cross-section of users, orgs and data, generates rows with the project's factory library, checks in the fixture and wires it into test setup.qa-test-dataselenium-grid-4-runnerCovers standalone or hub-and-node, the Docker images, node registration, session queue tuning and observability.qa-web-e2eselenium-testingCovers Selenium WebDriver tests in Java, Python, C# or other bindings: explicit waits instead of sleeps, stable locators instead of absolute XPath, driver version errors (Selenium Manager), page objects, BiDi console errors, Grid in Docker and JUnit XML.qa-web-e2esemgrep-rulesCovers Semgrep, writing a rule that flags a code pattern, or a lighter static analysis (SAST) gate than CodeQL that needs no code database: Registry rulesets and custom YAML rules, semgrep ci with diff-aware baselines, nosemgrep suppressions, path filters, severity filters and JSON, SARIF, GitLab or JUnit output.qa-security-scanningserver-sent-events-testsCovers EventSource events and errors, the stream format, reconnect with Last-Event-ID replay, retry intervals and per-origin connection limits, plus k6 load tests.qa-realtime-protocolsserverless-integration-test-builderInventories functions and event sources, picks a local emulator per function, generates test events, asserts cold-start and timeout budgets, and emits the tests and CI config.qa-serverlessservice-worker-lifecycle-testsTests each state change from installing to activated, waitUntil, skipWaiting and clients.claim, update() and a clean v1 to v2 upgrade with Playwright.qa-pwasession-management-test-authorCovers testing sessions, login or logout security in a web app, in any framework: cookie flags (Secure, HttpOnly, SameSite), session ID regeneration on login, idle and absolute timeouts, concurrent-session limits, logout on all devices, CSRF tokens and session binding, per OWASP ASVS V3.qa-auth-flowssidekiq-testsCovers the fake!, inline! and disable! testing modes, RSpec and Minitest helpers, clearing jobs between tests, and assertions on enqueued jobs, arguments, scheduling, retries and unique jobs.qa-async-jobsskill-matrix-authorBuilds an evidence-backed skill matrix, classifies and ranks gaps and recommends train, hire or bring in an expert per gap.qa-team-managementslo-load-test-planTurns each SLO into scenarios with a load profile, workload model, pass/fail threshold and error-budget allowance, before any tool is configured.qa-load-testingsmoke-suite-gateCovers a smoke suite of 5-15 critical journeys (login, checkout, payment, main read path) that runs in under 5 minutes as E2E or API tests and blocks the deploy when it fails, with retries for transient failures.qa-processsms-test-authorCovers testing SMS sending: Twilio magic numbers and test credentials, GSM-7 vs UCS-2 segment counts (emoji messages that cost more), rate limits, STOP and HELP opt-out keywords, and sender ID vs short code vs 10DLC differences.qa-notificationssoc2-evidence-collectorCovers per-criterion artifacts (CC1-CC9 and optional categories), collection from CI, audit and access logs and change records, Vanta, Drata or Secureframe formats, and observation-period sampling.qa-compliancesoda-checksCovers writing checks, configuration.yml data sources, soda scan runs and CI gating on the exit code, with Soda Core or Soda Cloud.qa-data-qualitysonarqube-maintainability-gateRuns SonarQube or SonarCloud on production code for code smells, bugs and maintainability ratings, the maintainability view rather than security.qa-code-qualitysonarqube-rulesCovers sonar-scanner and sonar-project.properties, Sonar Way profiles and custom rules, quality gates on new code, branch and PR analysis, and NOSONAR or SuppressWarnings suppressions.qa-security-scanningspec-testability-heuristicsScores each claim as observable, decidable and bounded, rewrites weak ones and gives a BLOCK, REVIEW or OK verdict.qa-shift-leftsqs-testsCovers Standard vs FIFO semantics, visibility timeouts, dead-letter queues for poison messages and retention, using LocalStack, aws-sdk-client-mock for TypeScript or moto for Python.qa-async-jobsstate-transition-test-designDerives human-readable manual test cases from stateful behavior: identify states, events, transitions, and guard conditions, draw the state table including invalid (empty-cell) transitions, choose a coverage level (all states, valid transitions / 0-switch, transition pairs / 1-switch per Chow, all transitions including invalid ones), then derive one test case per coverage item as an event sequence with per-step expected states (ISTQB CTFL v4.0 section 4.2.4).qa-manual-testingstorybook-visual-regression-testingCovers the hosted Chromatic addon, or the self-hosted Storybook test-runner with a postVisit hook calling Playwright's toHaveScreenshot, plus CI setup.qa-visual-regressionstride-threat-modelingWalks assets and trust boundaries through Microsoft's STRIDE categories, triages threats and writes the threat model into the repo.qa-shift-leftstripe-subscription-billing-test-authorCovers trial to paid, proration on upgrade and downgrade, dunning on failed renewals, cancel and reactivate, and the subscription webhook events, using Stripe test clocks to skip through billing cycles without waiting.qa-paymentstripe-test-cards-and-webhooksCovers testing Stripe payments: test-mode keys, test cards for success, declines and 3D Secure, stripe listen to forward webhooks locally, stripe trigger fixtures, and Stripe-Signature verification.qa-paymentstryker-net-mutationSets up Stryker.NET (dotnet-stryker tool, project and solution scoping, xUnit, NUnit or MSTest, stryker-config.json thresholds) and runs it in CI.qa-mutation-testingstryker-mutationSets up StrykerJS: the Jest, Vitest, Mocha or Karma runner, stryker.conf.json, thresholds and incremental runs on pull requests.qa-mutation-testingsyft-generationGenerates CycloneDX or SPDX SBOMs with Syft, scans them with Grype, diffs SBOMs in CI and explains how to choose a format.qa-security-scanningsynthea-healthcare-dataRuns MITRE Synthea to simulate patient populations and outputs FHIR R4, STU3, DSTU2, C-CDA or CSV, with custom disease modules.qa-test-data-privacysynthetic-data-toolkitFactories with traits and associations (Ruby, Rails), Mimesis bulk data (Python), Bogus Faker<T> builders (.NET), or which generator fits.qa-test-datasynthetic-monitor-authorWrites a synthetic monitor for Datadog, Pingdom, Checkly or New Relic with browser or API steps, cadence, checks and alerts, and ranks unmonitored journeys from RUM data.qa-shift-rightsynthetic-pii-generatorGenerates fake but valid-looking PII: names, emails, phones, addresses, national IDs and SSNs, Luhn-valid test card numbers and birth dates, never real people's data.qa-test-data
T27
tcm-case-managementCovers managing test cases in TestRail, Xray, Zephyr Scale, Allure TestOps or Qase: writing cases from a spec, steps with expected results and mass edits.qa-test-managementtenant-onboarding-test-authorTests for account creation, isolation from the first API call, default quotas, billing links, seed data, idempotent re-provisioning and full deletion on teardown.qa-multi-tenancytest-case-anatomy-referenceLists the ISO/IEC/IEEE 29119-3 and ISTQB test case fields, maps them to TestRail, Xray, Zephyr Scale, Allure TestOps and Qase, and gives a PASS, WEAK or FAIL review rubric.qa-test-managementtest-case-from-live-featureExplores the feature and applies HTSM/SFDPOT, Whittaker attacks, FEW HICCUPPS oracles and ISO 25010 to produce a test case matrix.qa-processtest-case-ideation-from-storyProduces a markdown test case matrix (id, title, precondition, steps, expected, tier) covering happy, alternate, boundary and negative paths, agreed before automation and ready for TestRail, Qase or Xray.qa-processtest-code-conventionsPure-reference catalog of test-code conventions: AAA structure (Arrange / Act / Assert), per-test single-responsibility, descriptive naming ({sut}{scenario}{expected}), assertion specificity, mocking rationale (state vs behavior, fake vs mock), fixture-coupling rules, the magic-number / hard-coded-string anti-patterns, and step design (§11: FIRST principles, step granularity, the mechanical → page → business abstraction layers, the rule-of-three extraction heuristic, declarative phrasing); the E2E selector-priority, web-first-assertion, and step-grouping conventions live in references/.qa-test-reviewtest-coverage-targeterRanks uncovered branches in the diff by complexity, churn and test cost, and tracks per-file coverage drift.qa-test-reportingtest-data-patternsExplains Test Data Builder, Factory, Object Mother, fixture composition, snapshots and production-data anonymization, and when each fits, before picking a tool.qa-test-datatest-design-scorecardScores tests 1-5 on six design axes with explicit anchors and writes growth-framed feedback.qa-test-reviewtest-effort-estimationProduces a PERT three-point estimate as ranges, with a named assumptions ledger and a split across developer, automation and exploratory work; also classifies a change set's shape from git history.qa-processtest-framework-architecture-auditGrades eight axes PASS, WARN or FAIL: page objects, base classes, fixtures, helpers, naming, waits and retries, convention drift and CI.qa-test-reviewtest-framework-blueprintWalks seven steps from inventorying the app to runner, layout, fixtures, object model, data and mocks, reporting, CI and conventions, and outputs a written blueprint with a build order.qa-test-reviewtest-isolation-patternsPure reference catalog of test-isolation and fixture-lifecycle patterns - the four-phase test pattern (Meszaros), fixture scope (per-test / per-describe / shared / global), the Fresh-Fixture vs Shared-Fixture trade-off (Fowler), parallel-safety patterns, and cleanup discipline (afterEach / afterAll / tagged-cleanup), plus a pattern-selection guide and a worked leaking-state diagnosis.qa-test-reviewtest-management-syncMaps tests to case IDs, opens a run per build, pushes results in batches and closes runs on main only; vendor details are in its references.qa-test-reportingtest-pyramid-balancerCounts tests per layer with runtimes, detects ice-cream-cone and hourglass shapes, and recommends target ratios for the codebase's shape.qa-processtest-removal-criteriaSorts candidates into duplicate, tautology, trivial, dead-signal and orphan, and deletes only when all four gate conditions hold, with a written reason, coverage evidence and a named reviewer.qa-test-impact-analysistest-run-summary-authorWrites the markdown narrative: a pass/fail lead, deltas and failure owners.qa-test-reportingtest-strategy-authorCovers a test strategy or master test plan: scope, test types per layer, risk-based prioritization, tools, environments, exit criteria and ownership, plus a budgeted per-risk test plan with owners and effort, for stakeholder sign-off.qa-processtest-suite-health-auditClassifies files by tier, checks the pyramid ratio and flake rate per layer, measures ROI per tier and gives one verdict.qa-test-reviewtestcontainersStarts throwaway containers from inside the test process with Testcontainers (Java, Node.js, Python, Go, .NET, Ruby and more), wiring the container lifecycle, mapped host ports, wait strategies (port, log, HTTP, SQL), networks, Ryuk cleanup and the experimental withReuse for local dev.qa-test-environmenttimezone-test-matrix-builderFinds where the codebase stores, computes, displays, schedules or bills times, picks the edge cases that matter and writes test stubs with the language's fake-clock library.qa-timetoxiproxy-chaosRuns Toxiproxy between client and upstream and applies latency, bandwidth, slow close, timeout, slicer, data limit and reset toxics through its control API.qa-resiliencetrace-spec-authorWrites a trace spec per feature (root and child spans, key attributes per OpenTelemetry conventions) that drives code review and trace tests.qa-distributed-tracingtraceability-matrix-builderBuilds a requirements-to-tests matrix from a test case repository and Jira, Linear or GitHub Issues, with orphaned cases and requirements and a coverage summary.qa-test-managementtrivy-configCovers scanning infrastructure code for misconfigurations with one tool: trivy config with severity gating, .trivyignore suppressions, custom Rego checks and SARIF for GitHub code scanning.qa-iactrivy-imageCovers scanning a container or Docker image for vulnerabilities, secrets, misconfigurations or licenses: trivy image with severity filters, SARIF or JSON output, .trivyignore suppressions, --ignore-unfixed and scanner toggles.qa-security-scanningtui-snapshot-testerCaptures rendered terminal frames as SVG or text snapshots and diffs them on each run: pytest-textual-snapshot for Textual, insta for Ratatui, teatest for Bubble Tea, ink-testing-library for Ink.qa-cli-tools
U3
unity-test-frameworkCovers testing C# code in a Unity game-engine project: Unity Test Framework EditMode vs PlayMode tests, [Test] and [UnityTest], assembly definitions, the Test Runner window, batch-mode command-line runs and CI.qa-gameunity-test-framework-cCovers unit tests for pure C code on 8-bit MCUs, Cortex-M or embedded Linux: ThrowTheSwitch Unity (not the Unity game engine) with TEST_ASSERT families, setUp and tearDown, RUN_TEST, the test runner generator, config defines and CI via Ceedling JUnit XML.qa-embeddedunreal-automation-systemCovers the Automation Test Framework's simple and complex tests, Automation Spec (Describe, It, latent tests), latent commands, the Automation Driver for UI input, Session Frontend and command-line runs in CI.qa-game
V5
varnish-test-vtc-syntaxCovers varnishtest VTC files with server, client and varnish blocks, grace and saint modes, PURGE handlers with ACLs, and surrogate-key invalidation with the xkey vmod.qa-cache-testingvector-search-recall-testsBuilds brute-force ground truth, measures recall@k against latency and detects embedding drift for Qdrant, Weaviate, pgvector, Pinecone, Elasticsearch k-NN and Milvus.qa-search-relevancevex-authorWrites and validates OpenVEX statements (not_affected, affected, fixed, under_investigation) with vexctl and attaches them to images.qa-security-scanningvisual-baseline-conventionsCovers which stories or pages get baselines, which breakpoints, masking vs thresholds, when to add or drop a baseline, and how to choose between Percy, Chromatic, Playwright and Storybook test-runner.qa-visual-regressionvisual-baseline-gateBlocks on regressions or on intended baseline changes without sign-off from a reviewer who is not the author, fails closed when the classifier did not run, and writes visual-gate.json and .md.qa-visual-regression
W12
wcag-color-contrastCovers color contrast or whether colors pass WCAG: WCAG 2.2 text, large-text and non-text contrast ratios (4.5:1, 3:1) at AA and AAA, the measurement formula, palette and component reviews, and bulk checks over CSS and design tokens.qa-accessibilitywcag-compliance-reporterGroups violations by WCAG 2.2 success criterion and level, flags pages that were not scanned and writes a summary plus per-page detail.qa-accessibilitywcag-keyboard-navigationCovers WCAG 2.2 keyboard access, no keyboard traps, shortcuts, focus order, visible and unobscured focus, with test scripts and the focus-trap pattern (focus on open, Escape, restore).qa-accessibilityweb-e2e-overviewExplains what E2E covers, picks between Playwright, Cypress, Selenium, WebdriverIO, Puppeteer, TestCafe and cloud grids, and the traps that make suites flaky.qa-web-e2eweb-push-testsCovers pushManager.subscribe with VAPID keys, pushsubscriptionchange, push event delivery, push-service responses (201, 410, 413, 429) and unsubscribe.qa-pwaweb-vitals-inp-deepBreaks Interaction to Next Paint into input delay, processing and presentation, asserts per-interaction budgets in Playwright and finds long tasks.qa-load-testingwebdriverio-testingCovers WebdriverIO: npm init wdio scaffolding, services for Sauce Labs, BrowserStack, Appium and DevTools, spec, Allure and JUnit reporters, and Mocha, Jasmine or Cucumber frameworks.qa-web-e2ewebhook-delivery-testerCovers HMAC-SHA256 signatures, retries with backoff and jitter, timestamp replay windows, ordering, dead letters and body encoding per Standard Webhooks, plus replaying captured inbound payloads with tampering and key rotation cases.qa-notificationswebsocket-testsCovers connect, send and receive messages, ping/pong, close codes, reconnect after the server drops, subprotocols and backpressure, with ws, Python websockets or Playwright.qa-realtime-protocolswinappdriverCovers WinAppDriver directly or through the Appium 2 Windows driver, capabilities, AccessibilityId and Name locators, and Windows CI runners.qa-desktopwiremock-stubsStubs it with WireMock so tests run offline, including faults such as timeouts and 500 responses, request verification and parallel-safe ports.qa-test-dataworkbox-testsCovers recipe behavior, precache manifest injection, routes, expiration and cacheable-response plugins, workbox-window events, and choosing a cache strategy per route.qa-pwa