Research · Financial Press

Back to sweep

Research sweep · deep · 2023 – 2026

DORA Metrics in the AI Era

How the DORA four keys (deployment frequency, lead time for changes, change failure rate, failed deployment recovery time) plus the 2024 rework-rate metric are measured and improved in practice, and how AI-assisted development has shifted them, September 2023 to September 2026: DORA State of DevOps 2023 and 2024, the 2025 State of AI-assisted Software Development and its AI Capabilities Model, the METR developer RCT, GitClear code-churn data, and the SPACE and DevEx frameworks

  • Claude Fable 5
  • tech
  • academic
  • blogs
  • financial
  • frontier
  • vc

Synthesised 2026-09-09

Narrative

Financial and business coverage of DORA-style delivery metrics in the AI era clusters around three storylines: capital flooding into AI coding tools, contested productivity evidence, and enterprise caution about code quality. On capital flows, Bloomberg's reporting (relayed via TechCrunch and Crunchbase News) tracked Anysphere, maker of the Cursor editor, raising 900 million dollars at a 9.9 billion dollar valuation in June 2025, with Bloomberg describing the three-year-old firm as "the fastest growing startup ever" after its annualised revenue crossed 500 million dollars. Subsequent reporting citing Bloomberg and CNBC shows Cursor's annualised revenue run rate climbing past 1 billion dollars in November 2025 and past 2 billion by February 2026, with the company forecasting more than 6 billion dollars by end-2026, a trajectory investors are pricing even as the underlying productivity case remains disputed.

On the productivity question, Reuters technology correspondent Anna Tong reported on the METR randomised controlled trial, describing how AI tools "slowed down experienced software developers when they were working in codebases familiar to them, rather than supercharging their work". The METR study itself, published as an arXiv preprint by Joel Becker, Nate Rush, Elizabeth Barnes and David Rein, recruited 16 experienced open-source developers across 246 real tasks and found actual completion time rose 19 percent under AI assistance even though developers forecast a 24 percent speedup and, after finishing, still believed they had been sped up by 20 percent. METR's own February 2026 update flagged that its second-wave experiment produced an unreliable signal because too many developers refused to work without AI, biasing estimates downward, a methodological caveat that financial-press summaries of the "AI productivity paradox" (echoed by Moody's chief economist Mark Zandi's comments to Business Insider that AI's productivity lift will be gradual) have generally omitted.

DORA's own Google Cloud-sponsored research provides the enterprise-scale counterpart. The 2024 report found a 25 percent rise in AI adoption associated with roughly a 1.5 percent drop in delivery throughput and a 7.2 percent drop in delivery stability, prompting the DORA team's own reclassification of failed-deployment recovery time from a stability to a throughput measure and the addition of rework rate as a stability signal, as tracked by industry analyst Rachel Stephens (RedMonk). The 2025 DORA report, based on survey responses from nearly 5,000 technology professionals and over 100 hours of qualitative interviews, reversed the throughput sign to positive while instability persisted, and introduced the "AI Capabilities Model" describing AI as an amplifier that "magnifies the strengths of high-performing organizations and the dysfunctions of struggling ones," per Google Cloud's own announcement.

Code-quality telemetry from GitClear, drawn from analysis of 211 million lines of changed code between 2020 and 2024, found that copy-pasted code exceeded refactored ("moved") code for the first time in 2024, that duplicated code blocks rose roughly eightfold that year, and that short-term code churn rose from roughly 3.1 percent in 2020 to 5.7 percent in 2024. Wall Street Journal reporting cited in trade press quoted MIT's Armando Solar-Lezama comparing AI-assisted coding to "a brand new credit card...going to allow us to accumulate technical debt," while the same coverage noted TD Bank telling the Journal it now screens for abstract coding and prompt-engineering skills as AI absorbs routine coding tasks. These vendor and press accounts remain claims requiring independent replication rather than settled findings, particularly where productivity percentages diverge by 30 to 50 points between vendor marketing, DORA's Bayesian survey modelling, and METR's controlled trial.


Sources

ID Title Outlet Date Significance
f1 AI slows down some experienced software developers, study finds Reuters (via Investing.com) 2025-07 Reuters wire report on the METR randomised controlled trial, the most rigorous causal evidence yet that AI coding assistance can increase task completion time despite near-universal developer belief in speedups.
f2 We are Changing our Developer Productivity Experiment Design METR 2026-02 METR's own follow-up disclosing that its second-wave experiment produced an unreliable signal due to selection effects, a methodological caveat rarely reported alongside the original 19 percent headline.
f3 Announcing the 2025 DORA Report Google Cloud Blog 2025-09 Google Cloud's official summary of the 2025 report, based on nearly 5,000 respondents and 100+ hours of interviews, introducing the AI Capabilities Model and the amplifier framing.
f4 How are developers using AI? Inside Google's 2025 DORA report Google Blog 2025-09 Google's own framing that AI adoption alone is insufficient and that a blend of technical and cultural capabilities determines outcomes, central to the accelerator vs amplifier distinction.
f5 DORA | DORA 2025: Year in review DORA 2025 DORA's own recap distinguishing the September State of AI-assisted Software Development report from the December AI Capabilities Model companion, useful for tracking methodology and publication cadence.
f6 Sources: Cursor in talks to raise $2B+ at $50B valuation as enterprise growth surges TechCrunch (citing Bloomberg) 2026-04 TechCrunch report citing Bloomberg on Cursor/Anysphere's revenue trajectory (over 2 billion in annualised revenue by February 2026, forecasting over 6 billion by end-2026), illustrating the scale of capital betting on AI-coding productivity claims.
f7 Cursor's Anysphere nabs $9.9B valuation, soars past $500M ARR TechCrunch (citing Bloomberg) 2025-06 TechCrunch report citing Bloomberg's original reporting on Anysphere's 900 million dollar raise, documenting investor conviction in AI-coding tools well ahead of independent productivity verification.
f8 Anysphere, maker of AI coding tool Cursor, confirms $900M raise led by Thrive Capital Crunchbase News 2025-06 Crunchbase News piece corroborating Bloomberg's description of Anysphere as "the fastest growing startup ever", tying the AI-coding capital story to specific investor names.
f9 AI in Software Development: Productivity at the Cost of Code Quality? DevOps.com (citing Wall Street Journal) 2025-12 Trade coverage quoting the Wall Street Journal's interview with MIT's Armando Solar-Lezama comparing AI coding assistance to a credit card that lets teams "accumulate technical debt", linking financial-press framing to DevOps quality concerns.
f10 How AI is already shaking up the job market Morning Brew 2025-05 Reports TD Bank's comments to the Wall Street Journal that it now screens for abstract coding and prompt-engineering ability, and Salesforce's claim of a 30% productivity boost behind its engineering hiring freeze.
f11 AI's productivity paradox AOL (Business Insider) 2026-06 Cites Moody's chief economist Mark Zandi arguing AI's productivity lift will emerge gradually rather than immediately, framing the gap between capital markets' AI enthusiasm and measured output.
f12 The Economics of Intelligence Citadel Securities 2026-05 Citadel Securities analysis applying the Jevons Paradox to software engineering, arguing cheaper AI-assisted coding could expand rather than shrink developer demand, a market-structure argument financial analysts use to explain flat headcount despite productivity claims.
f13 Research: Quantifying GitHub Copilot's impact in the enterprise with Accenture GitHub Blog 2024-05 Primary vendor-commissioned study (GitHub/Accenture) on enterprise Copilot telemetry, useful as a vendor claim requiring independent corroboration against DORA and METR findings.
f14 AI is eroding code quality states new in-depth report DevClass 2025-02 devclass coverage of GitClear's findings that duplicated code blocks rose eightfold in 2024, providing an independent technology-press read on the code-quality telemetry debate.
f15 RDEL #112: What's AI's impact on software delivery performance? (2025 DORA Report) Research-Driven Engineering Leadership (Substack) 2025 Practitioner analysis quantifying DORA's Bayesian modelling approach (nearly 5,000 professionals, 100+ hours of interviews) and its finding that AI adoption improved throughput but continued to increase instability in 2025.
f16 How Generative AI Is Changing Software Development: Key Insights from the DORA Report opslevel.com Retrieved by this lane's web search.
f17 Top takeaways from the 2024 DORA Report – sponsored by Gearset! | DevOps Launchpad devopslaunchpad.com October 23, 2024 Retrieved by this lane's web search.
f18 DORA 2024: AI Is Speeding Up Delivery and Hurting Stability at the Same Time | Ali Safari alisafari.space May 14, 2026 Retrieved by this lane's web search.
f19 METR on X: "We ran a randomized controlled trial to see how much AI coding tools speed up experienced open-source developers. The results surprised us: Developers thought they were 20% faster with AI tools, but they were actually 19% slower when they had access to AI than when they didn't." / X x.com July 10, 2025 Retrieved by this lane's web search.
f20 My Participation in the METR AI Productivity Study | Domenic Denicola domenic.me July 15, 2025 Retrieved by this lane's web search.
f21 IACDM: Interactive Adversarial Convergence Development Methodology -- A Structured Framework for AI-Assisted Software Development arxiv.org Retrieved by this lane's web search.
f22 A METR Study Reveals that AI Slows Down Experienced Developers - ActuIA actuia.com July 16, 2025 Retrieved by this lane's web search.
f23 AI Coding Statistics - Adoption, Productivity & Market Metrics getpanto.ai August 7, 2026 Retrieved by this lane's web search.

We use analytics cookies to understand site usage and improve the service. We do not use marketing cookies.