Launchr

How often do AI-built apps fail?

Version 2.0 · Published 20 August 2026, updated 22 August 2026 · Data collected 17 June – 22 August 2026 · Launchr Pty Ltd, Brisbane, Australia (ABN 46 696 518 206)

Across 403 AI builds run through our own factory, 27.5% could not reach a working, shipped state without a human stepping in. For apps with a real backend that figure was 37.8%. For static sites, games and simple tools it was 7.4%. The gap between those two numbers is the whole story.

403build records analysed
27.5%never shipped unaided (111/403)
37.8%failure rate, backend apps (101/267)
7.4%failure rate, static apps (10/136)

Why publish this

Almost every claim about AI-built software is an adjective. Tools are “fast”, results are “production-ready”, failures are “rare”. We could not find a single published figure with a denominator attached, so we measured our own factory and published the number — including the parts that make us look worse.

We are not a neutral party. We sell a service that fixes this problem. That is exactly why the method and the limitations are set out in full below: so you can check the arithmetic rather than take our word for it.

Method

Every build our pipeline runs writes a telemetry record. This analysis reads those records directly from the production system — one record per venture, latest build wins — for every build dated between 17 June and 22 August 2026.

Population403 build records (292 deployed, 111 escalated)
Window17 June – 22 August 2026
SourceLive production build telemetry, read from the pipeline's own stats route
UnitOne record per venture. Cosmetic-revision records (3 at this extract) are excluded by the stats route itself
“Failed” meansOutcome escalated — the automated pipeline exhausted its attempt budget or hit a confident end-to-end verification failure, and routed the job to a human

What the numbers say

MeasureCountRate
Never reached a working, shipped state without a human111 of 40327.5%
Pulled up by a human before delivery (escalated + held)114 of 40328.3%
Flagged by automated QA at least once, then fixed and shipped95 of 40323.6%
Caught by QA or a human, combined206 of 40351.1%
Passed every gate untouched, first time197 of 40348.9%

Slightly more than half of all builds were caught by something before anyone saw them. Under half passed clean.

Which apps fail, and which don't

The failure rate is not evenly distributed. It is almost entirely a function of whether the app has a real backend.

WorkloadFailed unaidedRate
Data and scheduling apps (accounts, saved records, bookings)101 of 26737.8%
Static sites, games and simple tools10 of 1367.4%

A five-fold difference. If an app only has to render, AI builds it reliably. The moment it has to remember something, the failure rate goes up more than five times.

The single defect behind most failures

We classified the escalated builds by their recorded failure reason. One defect dominates everything else:

Recorded failure events by class — 168 events mined from 406 build records. Shares are of all recorded failure events.
Defect classEventsShare
The interface never calls the data layer — screens render, nothing is saved12976.8%
The primary action is inert — the main button does nothing when clicked1911.3%
No part of the build reached a passing state158.9%
A uniqueness rule was never actually proved, so duplicate records stay possible53.0%

The finding is stable. Version 1.0 of this paper reported an 87% / 13% split across two defect classes. On the larger corpus those same two classes are 129 and 19 events — 87.2% and 12.8%. The split did not move. The taxonomy simply widened to name two smaller classes that version 1.0 had grouped together.

Both are the same disease: the app looks finished and isn't wired. The scores bear that out — among failed attempts, code-weak-only outnumbered visual-weak-only by 37 to 2, and average visual quality (81.6) was indistinguishable from average code quality (80.8).

This matters because it is exactly what a non-technical owner reports: “it looks great but nothing saves”, “the button does nothing”. That is not a vague complaint. It is the most common failure mode in AI-assisted software, and it is mechanically detectable.

We are not alone in finding this. Security firm Escape scanned 5,600 live AI-built applications and reported 2,038 critical vulnerabilities — their methodology is published here. That is their finding on their corpus, not ours; we cite it because it points the same way, not as evidence for our own numbers.

Limitations — read these before quoting the number

  • This is our internal hardening corpus, not client work. These builds were run to find and fix weaknesses in our own pipeline. They are not a sample of customer projects.
  • The number is conservative — it makes us look worse than the pipeline does now. Escalations cluster heavily in the June stress-test batches (45 on 17 June alone). Only 4 escalations appear across the 41 dated July records, after our decomposition and lesson-mining fixes landed. These date-level figures were computed on the version 1.0 window (17 June – 24 July) and have not been recomputed for the records added since; the headline rates above are current.
  • Operational contamination is included. Roughly 22 of the escalations date to a single credit-exhaustion incident on 26 June. Excluding that day gave 85 of 365 — 23.3% — on the version 1.0 corpus. We report the higher figure because the noise cannot be cleanly separated.
  • 28.3% is a floor, not a ceiling. One record per venture means an escalated venture later re-run successfully overwrites to “deployed”, so human involvement is undercounted.
  • The combined QA-or-human figure is a range of 206–209 (51.1–51.9%) because of overlap ambiguity between holds and QA flags. We report the lower bound.
  • One number is deliberately withheld. Our end-to-end mission-verification pass rate is not published as a failure rate: it is advisory for some app types and structurally blind to canvas-based games, so it would not be a defensible public statistic.

What we changed because of it

The interface-never-calls-the-data-layer finding is the reason our build gate now requires runtime proof that the front end actually reached the backend, rather than accepting that the code looks correct. A build that renders beautifully and saves nothing fails our gate before anyone sees it.

If you have an app in that state, the same detection runs as a code scan — it reads the app end to end and names every defect in plain English, whatever language or framework it was built in.

Citing this

Free to quote with attribution. Suggested form:

Launchr (2026). How often do AI-built apps fail? 403 builds, measured. Data collected 17 June – 22 August 2026. https://launchr.bot/research/ai-build-failure-rates/

If you want the underlying method in more detail than this page carries, ask us — we would rather the number was checked than repeated.

Who wrote this

PublisherLaunchr Pty Ltd, Brisbane, Australia · ABN 46 696 518 206
AuthorNamed author to be confirmed
Technical reviewNamed reviewer to be confirmed
Contact for the datalaunchr.bot/contact
Competing interestsDeclared. Launchr sells services that repair the failures described here. The method and limitations are published so the arithmetic can be checked independently.

Version history

VersionDateWhat changed
2.022 August 2026Corpus re-extracted from live telemetry: 387 → 403 build records. Headline rate 27.6% → 27.5%. Backend-app failure 39.1% → 37.8%; static-app failure 6.0% → 7.4%, narrowing the gap from six-fold to five-fold. Defect taxonomy widened from two classes to four; the original two-class split held at 87.2% / 12.8%. Third-party source named in visible text rather than only in a link.
1.020 August 2026First publication. 387 build records, 17 June – 24 July 2026.

Superseded figures are listed rather than quietly overwritten, so anyone who cited version 1.0 can see exactly what moved and why.