The outcome-reporting spectrum
Outcome numbers in tech training are not equally trustworthy. They sit on a spectrum from independently audited to unverified marketing. The single most useful fact about a number is which tier it comes from, not how big it is.
The reporting-integrity spectrum
| Integrity tier | What it means | Who is here (mid-2026) | How much weight it bears |
|---|---|---|---|
| Tier 1 — Independently third-party audited | Standardized template; 100% of the cohort accounted for; definitions fixed in advance; data validated by independent CPAs / auditors. | The CIRR standard and the small set of schools reporting under it. Per the CIRR schooldata portal and Course Report, only about three schools (Code Platoon, Codesmith, Hacktiv8) were active CIRR reporters as of mid-2026. | Highest available, but narrow coverage and a shrinking roster. |
| Tier 2 — Self-reported, vendor-published | The organization publishes its own outcome survey with some method disclosure; it is not independently audited; the publisher sets the definitions. | Google Career Certificates, the Coursera Learner Outcomes Report, and individual bootcamp 'jobs reports' outside CIRR. | A directional signal only; exposed to definition-breadth and response / selection bias. |
| Tier 3 — Aggregate third-party survey | A neutral aggregator surveys many graduates / schools and mixes alumni self-report with audited data where available. | Course Report's Annual Outcomes & Demographics Study. | Good for ranges and context; not school-specific verification. |
| Tier 4 — Unverified marketing | A headline placement / salary number on a landing page with no published method, cohort definition, or audit. | Many bootcamp and 'cert' marketing pages. | Lowest; treat as advertising until a method is shown. |
What the published numbers say
The figures below are each PUBLISHER's own claim, attributed, dated, and caveated with the audit tier and method; we do not restate any of them as fact and we do not average them into a number of our own.
| Publisher | Metric (as the publisher frames it) | Published figure | Method / definition | Audited? | Source (accessed 2026-06-14) |
|---|---|---|---|---|---|
| CIRR (the standard) | Standardized in-field employment, reported at fixed windows | A reporting framework, not a single number: employment reported at 90 / 180 / 360 days, in-field vs out-of-field, with median salaries | Standardized template; 100% of the cohort accounted for (not opt-in only); intent documented at enrollment; annual third-party / CPA audit | Yes (the standard itself) | CIRR — cirr.org/our-standards and cirr.org/schooldata |
| Codesmith (CIRR reporter) | Graduates employed in field within 6 months | Codesmith states 'more than 80%' employed in field within 6 months for a Jan-Jun 2022 CIRR cycle; median salary about $127,500 (full-time immersive, that cycle, per Codesmith) | CIRR-audited; Codesmith's 2023-24 report covers 1,152 graduates (2023); excludes fellows / contractors / Codesmith-employed instructors | Yes (CIRR) | Codesmith — 2023-24 CIRR outcomes report |
| Google Career Certificates | 'Positive career outcome' within six months | Google's site states '70%+' of certificate graduates report a positive career outcome within six months; an FAQ phrases it as '75 percent report an improvement in their career within six months' | Self-reported program-graduate survey (footnote: United States 2025). 'Positive outcome' explicitly includes a raise or promotion at an existing job, not only new hires | No (self-report) | Google — grow.google/certificates |
| Coursera | Learners reporting a positive career outcome | '91%' of learners achieved at least one positive career outcome; '46%' experienced a salary increase since enrolling; '27%' reported a higher job level | Self-reported survey with The Harris Poll, 52,000+ learners across 179 countries (2025 Learner Outcomes Report); 'positive career outcome' is a broad composite | No (self-report, third-party-administered) | Coursera — 2025 Learner Outcomes Report |
| Course Report (aggregate) | Bootcamp graduate employment & salary | '83%' of graduates surveyed say they were employed in a job requiring the technical skills learned; average starting salary about $69,079; median salary increase '56% or $25,000' | Annual Outcomes & Demographics Study; mixes alumni self-report with audited school reports where available; about 69,000 expected grads in 2024 | Mixed (aggregate) | Course Report — Outcomes & Demographics Study |
| Audited vs self-reported gap (secondary synthesis) | In-field employment within 180 days | CIRR-audited 64-78% in-field within 180 days (strict full-time / in-field) vs self-reported 70-90% from unaudited schools (often 'any job') — treat as directional | Illustrates how the DEFINITION drives the headline: the audited range is lower because it counts only in-field, full-time roles | CIRR figure audited; comparison via secondary sources | Course Report and secondary aggregators |
How exclusion inflates a headline
| Finding | Publisher (dated) |
|---|---|
| An investigation documented how advertised rates can be inflated by EXCLUDING graduates from the denominator — for example it reported one school's actual placement was 'around 30%' against a 74% advertised figure, and that other schools dropped or omitted 22-40% of graduates from their counts. This is attributed to that 2021 investigation and is about METHOD, not any school's current performance. | Business Insider (Vincent Woo, updated Nov 16, 2021) |
A claim we checked and rejected
Not every number that circulates survives checking. The example below is shown only so a reader recognizes an unverifiable claim; it is not used as evidence and we make no such claim.
| Claim (unverified — not used as evidence) | Why it is rejected |
|---|---|
| A widely repeated claim that 'one school's outcomes fell from 83% (2021) to 37% (2023)' | It appears only in secondary aggregator blogs, attributed loosely to 'Reuters', and could not be traced to a primary Reuters article. The research report marks it [unverified] and does not use it as evidence; it is shown here only as an example of a claim a reader should reject. |
The honest headline
The honest headline of the underlying research is that the audited tier is small and contracting: with only about three active CIRR reporters in mid-2026, most programs a reader meets publish no audited number at all, and the numbers most visible in marketing are the least verified tiers.
Sources
- RoleMath Outcome Transparency Meta-Analysis (2026-06-14, AI review draft) (RoleMath editorial analysis)
- CIRR — Reporting standards (Council on Integrity in Results Reporting): https://www.cirr.org/our-standards
- CIRR — School outcomes data portal: https://www.cirr.org/schooldata
- Codesmith — 2023-24 CIRR outcomes report: https://www.codesmith.io/blog/against-the-odds-codesmith-2023-24-salary-outcomes-prove-its-still-worth-it-to-invest-in-tech-education
- Google — Career Certificates (Grow with Google): https://grow.google/certificates
- Coursera — 2025 Learner Outcomes Report: https://www.coursera.org/enterprise/resources/ebook/learner-outcomes
- Course Report — Coding Bootcamp Ultimate Guide / Outcomes & Demographics Study: https://www.coursereport.com/coding-bootcamp-ultimate-guide
- Business Insider — Coding-bootcamp exclusion-practices investigation (Vincent Woo, Nov 16, 2021): https://tech.yahoo.com/business/articles/biggest-coding-bootcamps-may-exaggerate-170000563.html
Citation Ledger
| ID | Supports | Evidence | Source |
|---|---|---|---|
| CIT-01 | The integrity-spectrum tiers | Synthesis of the methodology research | RoleMath Outcome Transparency Meta-Analysis (2026-06-14, AI review draft) (RoleMath editorial analysis) |
| CIT-02 | CIRR (the standard): figure as the publisher frames it (accessed 2026-06-14) | Publisher's own outcome report | CIRR — cirr.org/our-standards and cirr.org/schooldata |
| CIT-03 | Codesmith (CIRR reporter): figure as the publisher frames it (accessed 2026-06-14) | Publisher's own outcome report | Codesmith — 2023-24 CIRR outcomes report |
| CIT-04 | Google Career Certificates: figure as the publisher frames it (accessed 2026-06-14) | Publisher's own outcome report | Google — grow.google/certificates |
| CIT-05 | Coursera: figure as the publisher frames it (accessed 2026-06-14) | Publisher's own outcome report | Coursera — 2025 Learner Outcomes Report |
| CIT-06 | Course Report (aggregate): figure as the publisher frames it (accessed 2026-06-14) | Publisher's own outcome report | Course Report — Outcomes & Demographics Study |
| CIT-07 | Audited vs self-reported gap (secondary synthesis): figure as the publisher frames it (accessed 2026-06-14) | Publisher's own outcome report | Course Report and secondary aggregators |
| CIT-08 | The exclusion-practice finding (about method, dated 2021) | Dated investigative reporting | Business Insider (Vincent Woo, updated Nov 16, 2021) |
| CIT-09 | The rejected example, shown as [unverified] | No primary source located; not used as evidence | RoleMath Outcome Transparency Meta-Analysis (2026-06-14, AI review draft) (RoleMath editorial analysis) |