Testland
Browse all skills & agents

career-ladder-author

Build-an-X workflow that designs a QA career ladder - parallel individual-contributor and management tracks, per-level criteria across consistent axes, and observable promotion evidence per level - modeled on public engineering career frameworks (the Dropbox Engineering Career Framework, which includes Quality Engineer and SDET roles) and the career-development guidance in Camille Fournier's The Manager's Path (ISBN 978-1491973899). The ladder defines what each level looks like over a career - not a snapshot of the team's capability today, not a scorecard for grading external candidates against one open role, and not feedback on one person's recent work. Use when a QA org needs leveling criteria - before promotion season, during compensation banding, or when senior testers ask what comes next besides management.

Install with skills.sh (any agent)

npx skills add testland/qa --skill career-ladder-author
View source

career-ladder-author

Overview

Without a written ladder, promotions ride on tenure and advocacy, and the answer to "what do I need to do to get promoted?" changes per manager. A career ladder fixes that by defining, per level, the expected scope and the observable evidence that someone already operates at it.

The reference shape comes from public engineering frameworks. The Dropbox Engineering Career Framework (opens in new window) defines an IC track (IC1 - IC7) and a management track (M3 - M7), explicitly includes Quality Engineer and SDET among its IC roles, evaluates each level on the pillars Results, Direction, Talent, Culture, Craft, and states that "Level Expectations define the scope, collaborative reach, and levers for impact at every level." Dozens of other public frameworks (GitLab, Spotify, Square, Etsy) are indexed at progression.fyi (opens in new window), which collects 75 public and open-source career frameworks; study 2 - 3 before drafting, then adapt to QA-specific craft.

For the management track and the dual-ladder split, the canonical practitioner reference is Camille Fournier, The Manager's Path (O'Reilly, 2017), whose "Managing People" chapter treats career cultivation ("Cultivating Careers") as a distinct management duty rather than a side effect of reviews. Full citation in References.

When to use

  • A QA org above ~5 testers has no written leveling criteria, or has criteria that exist only in the head of one manager.
  • Promotion season exposes inconsistency: two testers with similar work are leveled differently across teams.
  • Senior ICs are leaving or drifting toward management because the IC track visibly tops out.
  • Compensation banding requires defensible level definitions.

Do not use this skill to:

  • Decide one specific person's promotion - the ladder is the standard; the case is built from evidence via performance-feedback-author.
  • Map what the team can do today - that is skill-matrix-author.
  • Define a single role for hiring - that is qa-jd-author in qa-hiring.

Step 1 - Capture the inputs

InputNotes
Org size and shapeNumber of QA ICs, existing titles, whether QA reports into engineering or stands alone
Role familiesWhich QA roles the ladder must cover: manual/exploratory QA, automation engineer, SDET, and whether they share one ladder or get role-specific craft criteria
Adjacent laddersThe engineering ladder, if one exists; QA levels should be calibration-equivalent to engineering levels, or transfer and compensation break
2 - 3 reference frameworksFetched from progression.fyi (opens in new window) or directly (e.g., Dropbox (opens in new window)); note what you adopt and what you reject

Step 2 - Fix the track structure

Decide three structural facts before writing any criteria:

  1. Two parallel tracks. An IC track and a management track, with the split point and the equivalences stated (Dropbox: IC track to IC7, management entering at M3, both framed in the same level-expectation language - dbx-career-framework (opens in new window)). The dual ladder exists so that management is a role change, not the only raise; The Manager's Path makes the same point from the other side: management is a distinct skill set to be learned, not a seniority reward.
  2. Level count. Small orgs: 4 - 5 IC levels (junior, mid, senior, staff, principal). Do not copy a 7-level framework into a 12-person org; empty levels invite title inflation.
  3. Axes held constant across levels. Pick 4 - 5 axes and define every level on the same axes, so adjacent levels differ by scope rather than by category. The Dropbox pillar set (Results, Direction, Talent, Culture, Craft) adapts well to QA with Craft expanded into QA-specific terms (test strategy, automation architecture, quality advocacy).

Step 3 - Write per-level criteria with observable promotion evidence

Each level gets: a scope sentence, per-axis criteria on the fixed axes, and an evidence list stating what an existing-at-this-level person has already done. Promotion is recognition of demonstrated scope, not potential. Every level also carries an "explicitly not evidence" block - time in level, test-case volume, certifications alone, sole-keeper-of-knowledge - and that block is what keeps the ladder honest at promotion time. Minimal shape:

## QA-IC3 - Senior QA Engineer
**Scope:** one sentence naming the scope owned end to end without review.
| Axis | Expectation |   (one row per fixed axis, each phrased as an observable)
**Observable promotion evidence (from work already done at the level below):** linkable artifacts, not adjectives.
**Explicitly not evidence:** time in level; test-case volume; certifications alone.

See references/level-criteria-example.md for the full QA-IC3 level worked across all five axes with its evidence and not-evidence blocks.

Step 4 - Write the management track as a role change

Management levels (QA-M1 lead, QA-M2 manager, QA-M3 head/director or per the org's grid) get the same axis treatment, with Craft partially replaced by people and process responsibilities: hiring (hand off to the qa-hiring chain), 1:1s and growth (tester-one-on-one-planner), feedback and reviews (performance-feedback-author), capability planning (skill-matrix-author). The Manager's Path sequences these duties chapter by chapter (mentoring, then tech lead, then managing people, then managing a team) and is the calibration reference for what each management level actually does day to day.

State the transfer rule explicitly: moving IC->M or M->IC at equivalent level is a lateral move, not a promotion or demotion. Frameworks that omit this quietly re-create the management-only ceiling.

Step 5 - Document the anti-patterns the ladder forbids

Ship the ladder with its failure modes named, so calibration meetings can cite them:

Anti-patternWhy it failsLadder counter-rule
Tenure-based promotionYears in seat measure exposure, not scope; it levels the patient, not the capableEvidence lists contain artifacts only; time-in-level appears in every "not evidence" block
Promotion as retention counter-offerLevels the loudest resignation threat; corrodes every honest casePromotions only in calibration cycles, against the written evidence list
Management as the only senior pathLoses the best ICs to other orgs or converts them into reluctant managersDual track with stated IC ceiling >= management ceiling (Dropbox runs IC to IC7 vs M to M7 - dbx-career-framework (opens in new window))
Hero-based levelingRewards being the single point of failure"Not evidence" blocks exclude sole-keeper-of-knowledge; Talent axis rewards spreading it
Criteria written as adjectives ("strong", "excellent")Unfalsifiable; calibration becomes adjective arbitrationEvery criterion phrased as an observable with a linkable artifact
Copying a big-tech ladder verbatimA 7-level framework in a 10-person org creates empty levels and inflationStep 2 sizes the level count to the org

Anti-patterns (of authoring the ladder itself)

  • Authoring without engineering-ladder alignment. If QA-IC3 and ENG-IC3 are not calibration-equivalent, transfers and pay bands break; align the grids before publishing.
  • Publishing without a calibration process. A ladder without a cross-team calibration meeting reverts to per-manager interpretation within two cycles.
  • Treating the ladder as immutable. Revisit yearly; role families change (e.g., an SDET track may need to split out as automation scope grows).

Limitations

  • Compensation mapping is out of scope. The ladder defines levels; attaching salary bands is a compensation exercise with market data this skill does not carry.
  • Public frameworks are inputs, not authority. Dropbox's pillars fit Dropbox; the fetched frameworks ground the shape, while the criteria content must come from the org's own QA work.
  • Small-org floor. Below ~5 testers a written ladder is mostly ceremony; a lightweight level note per person plus the skill matrix is usually enough.
  • Book guidance is uncited-by-page. The Manager's Path is cited by ISBN as a management framework; teams wanting verbatim guidance should read the "Managing People" and "Managing a Team" chapters directly.

Hand-off targets

  • Measure today's capability against the new levelsskill-matrix-author.
  • Run the growth conversations the ladder enablestester-one-on-one-planner.
  • Build a promotion case from evidenceperformance-feedback-author.
  • Hire into a levelqa-jd-author and the qa-hiring structured-interview chain.

References

  • Dropbox Engineering Career Framework - IC1 - IC7 and M3 - M7 tracks, Results/Direction/Talent/Culture/Craft pillars, Quality Engineer and SDET role coverage: https://dropbox.github.io/dbx-career-framework/ (fetched 2026-06-10).
  • progression.fyi - index of 75 public and open-source career frameworks (GitLab, Spotify, Square, Etsy, and others) for Step 1 reference selection: https://progression.fyi/ (fetched 2026-06-10).
  • Camille Fournier, The Manager's Path: A Guide for Tech Leaders Navigating Growth and Change, O'Reilly 2017, ISBN 978-1491973899 - management-track duties, dual-ladder rationale, "Cultivating Careers".
  • skill-matrix-author, tester-one-on-one-planner, performance-feedback-author - sibling skills this ladder composes with.

Worked example - one mid-ladder level (QA-IC3)

View source (opens in new window)

Worked example - one mid-ladder level (QA-IC3)

A full level entry showing the fixed-axis criteria plus the observable-evidence and not-evidence blocks that Step 3 of career-ladder-author prescribes. Copy the shape; replace the content with the org's own QA work. The "not evidence" block is what keeps the ladder honest at promotion time.

QA-IC3 - Senior QA Engineer

Scope: Owns quality for a product area end to end; trusted to make test-approach decisions inside that area without review.

AxisExpectation
ResultsShips the test approach for area-sized features; escapes in the owned area trend down or stay at the team floor
DirectionWrites the test-strategy section for their area; flags risk trade-offs to the lead before they become escapes
TalentOnboards new testers onto the area; gives review feedback that changes what others ship
CultureRaises quality concerns outside their lane through the right channel, with evidence
CraftDesigns tests across at least two test levels; automation contributions reviewed without rework loops

Observable promotion evidence (from work already done at IC2):

  • Authored the test approach for >=2 area-sized deliveries, including one with a documented risk trade-off the team followed.
  • A defect-escape or incident retro where their analysis changed team practice.
  • Review comments on others' test code that produced concrete changes (linkable PRs).
  • Onboarded >=1 tester onto the area, with the onboardee shipping independently after.

Explicitly not evidence: time in level; volume of test cases executed; certifications alone; being the only person who knows a system (that is a bus-factor problem, not seniority).

Related skills

exec-quality-narrative

Build-an-X workflow that turns already-computed quality data - weekly digests, KPI roll-ups, DORA delivery metrics, escape-defect trends, OKR grading - into an executive or QBR narrative structured by the Minto Pyramid Principle: governing answer first, MECE-grouped support beneath it, SCQA opening (Barbara Minto, The Pyramid Principle, ISBN 978-0273710516). Distinct from single-team digest computation (which computes the RAG digest from raw CI and tracker signals; this skill consumes such digests and writes the upward story), from portfolio-review aggregation (which aggregates teams into a portfolio review; this skill is the communication layer either output feeds), and from QA OKR authoring (forward-looking commitments; this skill narrates what happened and what it means). Use before a QBR, board update, or exec review when the data exists but the story does not.

performance-feedback-author

Build-an-X workflow that drafts evidence-based performance feedback and review input for testers using the Center for Creative Leadership's SBI model (Situation - Behavior - Impact, extended to SBII with Intent) - pulling every Behavior statement from verifiable work artifacts (bug reports authored, test cases and automation merged, review comments, charter session logs) rather than impressions or adjectives. Produces the written feedback artifact itself - not the agenda for the recurring conversation where it is delivered, not a team capability map (kept deliberately separate from performance data), and not a scorecard for external candidates. Use when a QA manager owes someone specific feedback this week, or when writing review input or a promotion case for review season.

quality-status-digest

Computes a recurring quality status digest from metrics that already exist: CI pass rate with an explicit denominator rule, escape-defect count, and a flake-debt score, assigns red / amber / green per area against stated thresholds, then rolls the same per-team rows into a portfolio view with a severity-by-blast-radius heatmap, STABLE / WATCH / INVEST tags, and a capacity flag. Keeps DORA delivery metrics separate from defect-leakage and flake measures instead of blending them under one label. Produces the status artifact only: it does not instrument anything, does not define SLOs or targets, and does not decide what gets fixed first. Use when a weekly quality review, sprint check-in, or quarterly portfolio review is due and the CI history, defect tracker, and quarantine list already hold the numbers but nobody has assembled them into one page.

skill-matrix-author

Build-an-X workflow that produces a QA team skill matrix - team members crossed with competency dimensions at explicit proficiency levels, each cell backed by observable evidence - then derives a gap analysis comparing the matrix against the team's required testing skills. Competency dimensions follow ISTQB CTAL-TM v3.0 chapter 3 (Managing the Team): professional, methodological, social, and personal competence. Maps the existing team on an ongoing basis - not a point-in-time score of external candidates, not the downstream prioritization of those gaps against a roadmap, and not one new hire's ramp plan. Use when a QA manager needs to know what the team can do today versus what its projects demand - before planning training, hiring, or work allocation.

tester-one-on-one-planner

Build-an-X workflow that produces recurring 1:1 agenda structures for a QA manager and each tester - a cadence plan, a per-meeting agenda with an explicit status-versus-growth time split, and a coaching-question bank built on the GROW model (Goal, Reality, Options, Will) with QA-specific prompts seeded from the tester's skill-matrix row. Grounded in the 1:1 meeting styles cataloged in Camille Fournier's The Manager's Path (ISBN 978-1491973899). Plans the recurring conversation where feedback lands - not the written evidence-based feedback artifact itself, not the level structure those growth conversations point at, and not a review of work products. Use when a QA manager sets up 1:1s with a new team, or when existing 1:1s have degraded into status meetings.