qa-feature-flags
Feature-flag and experimentation testing: LaunchDarkly and OpenFeature SDK tests, flag test matrices, A/B test validity, and experiment result analysis. Covers Unleash, Flagsmith and GrowthBook through OpenFeature, and hermetic harnesses for Statsig, Optimizely, Split.io, Amplitude Experiment and VWO. Agents (flag-coverage-gap-detector, stale-flag-detector, sample-ratio-mismatch-detector) find untested flag branches, stale flags, and sample ratio mismatch. Distinct from qa-test-environment/feature-flag-test-harness and qa-shift-right/feature-flag-experiment-validator.
/plugin install qa-feature-flags@testland-qaFirst time? Add the marketplace with /plugin marketplace add testland/qa
- Category
- Integrations & protocols
- Version
v1.7.1- Contents
- 5 skills · 3 agents
- Part of
- qa-role-backend
Skills5
ab-test-validity-checklistUse when launching, auditing or governing an A/B test or online experiment design.skillexperiment-results-interpreterUse when an A/B test result is read for a ship decision, especially off a dashboard, a small sample or many metrics.skillexperiment-sdk-testingUse when code instrumented with Statsig, Optimizely, Split.io (Harness FME), Amplitude Experiment or VWO needs tests.skilllaunchdarkly-testingUse whenever code that reads LaunchDarkly feature flags needs tests: the TestData source for hermetic tests with no network, file-based fixtures, per-test flag overrides and assignment checks.skillopenfeature-sdk-testingUse whenever code that reads feature flags through OpenFeature, Unleash, Flagsmith or GrowthBook needs tests: InMemoryProvider for hermetic tests, evaluation details, hooks and targeting context in TypeScript, Java and Python, plus a flag test-matrix workflow.skill
Agents3
flag-coverage-gap-detectorRead-only adversarial critic that scans code for flag-evaluation call sites (isEnabled / getBooleanValue / variation / variationDetail) and identifies flag branches whose OFF path, FALLTHROUGH path, or non-default variants have no corresponding test exercising them.agentsample-ratio-mismatch-detectorRead-only specialist that detects Sample Ratio Mismatch (SRM) in an A/B test by running a chi-square test against the observed-vs-expected allocation.agentstale-flag-detectorRead-only specialist that scans a codebase for stale feature flags - flags at 100% rollout for long enough to remove, kill-switches that haven't been touched in months, experiments that have already shipped, and orphan flags (referenced in code but not in the platform, or vice versa) - and returns a ranked removal-candidate list plus the safe-removal runbook for each (pre-removal verification, code + platform-side removal steps, post-removal checks, rollback plan).agent
About qa-feature-flags
Feature-flag platform testing + experimentation harness testing: LaunchDarkly SDK tests, the OpenFeature SDK umbrella (with Unleash / Flagsmith / GrowthBook vendor references), the feature-flag test matrix (coverage-suite building + kill-switch test categories, in openfeature-sdk-testing's references), the experiment-sdk-testing umbrella (Statsig, Optimizely, Split.io, Amplitude Experiment, VWO hermetic harnesses), the AB-test validity checklist, the experiment-results interpreter (per-metric significance check, peeking and guardrail methodology in its references), and three agents: flag-coverage-gap detection, stale-flag detection with the removal runbook, and sample-ratio-mismatch (SRM) detection. Distinct from qa-test-environment/feature-flag-test-harness (generic flag-aware test harness); this plugin scopes to platform-SDK testing, flag-lifecycle hygiene, and testing the experimentation harness itself.