Research · Blogs & Independent Thinkers

Back to sweep

Research sweep · deep · 2025 – present

Enterprise AI Transformation Programmes (2025–2026)

Enterprise AI transformation programmes from July 2025 to July 2026: reported success and failure rates and who measures them, delivery frameworks borrowed from and diverging from classic digital transformation, token cost economics and budgeting under consumption pricing, adoption strategy including leadership over-provisioning of access, and AI governance across AI-Ops, financial business cases, security and regulatory controls as they scale with sector risk tolerance, referencing MIT, McKinsey State of AI, DORA, ThoughtWorks Technology Radar, NIST AI RMF, ISO 42001, and the EU AI Act.

  • Claude Fable 5
  • financial
  • tech
  • academic
  • vc
  • blogs
  • frontier

Synthesised 2026-07-15

Narrative

The MIT NANDA "GenAI Divide" report's headline that 95% of generative AI pilots show no measurable P&L impact drew immediate and sustained scrutiny from independent AI writers. Zvi Mowshowitz, writing on his widely-read Substack, dissected the report's internal inconsistencies directly, noting the study's own data shows purchased tools succeed "twice the success rate of" internally built ones and questioning the "zero return" framing given that the report calls the 95% of projects without "measurable P&L impact" failures, even though back-office ROI is hard to prove within a P&L window, and doubling coder productivity has real value even without a directly attributable dollar figure. Marketing AI Institute's Paul Roetzer made a parallel critique, arguing the study's methodology used a narrow six-month, P&L-only success definition and rested on just 52 interviews that the report itself admits are only "directionally accurate based on individual interviews rather than official company reporting". Even sources sympathetic to the report's broader thesis, such as a 2026 industry landscape blog, concede that "the figure has been debated, critics note its six-month P&L definition ignores efficiency and CX gains, but even sceptics accept the underlying signal: High Adoption, Low Transformation".

Independent commentary through 2026 has shifted attention from pilot failure rates toward a more granular story about token economics and cost governance. Simon Willison's Newsletter and TILs blog documented the collision between falling per-token prices and exploding per-task consumption in near real time, noting cases like Uber, where he observed that the company's coding-tool budget problem stemmed from a policy set "before anyone could have predicted how popular token-burning coding agents were about to become". Other Substack writers quantified this pattern more starkly: one investor-newsletter piece reported that "Amazon, supposedly, blew $500m in one month on Claude without seeing much ROI and had to stop token leaderboards" while "Uber blew its 2026 AI budget in 4 months and blamed Anthropic for it, without moving any of their business KPIs", while a separate FinOps-focused Substack cited survey data that "Benchmarkit's 2025 survey of 372 enterprise organizations found that only 15 percent of companies could forecast AI costs within 10 percent of actual spend," with "nearly one in four" missing "by more than 50 percent". A widely-discussed newsletter piece coined "tokenmaxxing" for the practice of gamifying token consumption as an adoption proxy, warning that "organizations are measuring AI adoption by how much the users are using... often called token maxing... it's a terrible measure. Because if you think about it, if you are holding people accountable to how many tokens they use, they have a natural incentive to use as much as possible". Confirming the trend at leadership level, an enterprise-CTO-briefing Substack reported "Jensen Huang has publicly proposed a token budget of up to 50% of an engineer's annual salary" and that "the CTO is becoming the CFO of tokens".

On delivery frameworks, independent bloggers treat the DORA and ThoughtWorks lineages as the credible bridge between classic DevOps/agile practice and agentic AI, while pushing back on report inflation. One critical Substack post accused Google Cloud's DORA team of recycling its own prior findings, observing that the 2026 report's core message closely mirrors the 2025 report's: "Artificial Intelligence (AI) serves as a powerful amplifier in software development. It magnifies the strengths of high-performing organizations and the dysfunctions of struggling ones," compared with the 2025 report's near-identical framing that "AI's primary role in software development is that of an amplifier". Thoughtworks' own Technology Radar volume 34, discussed on Martin Fowler's blog, argued the industry response should be a return to fundamentals rather than a new methodology, noting the radar's finding that teams are "returning to many established techniques, from pair programming to zero trust architecture, and from mutation testing to DORA metrics" as "not nostalgia, but a necessary counterweight to the speed at which AI tools can generate complexity". Independent consultants writing on "pilot purgatory" converge on organisational rather than technical explanations: one consultant's Substack cited a randomised trial finding that a survey of 5,000 white-collar workers found over 40% of executives claimed AI saved them eight-plus hours weekly while two-thirds of non-management staff reported saving under two hours, and a METR randomised controlled trial "found that AI tools made them 19% slower - while the developers themselves believed they were 20% faster". O'Reilly Radar's independent analysis reached a similar structural diagnosis, arguing that centre-of-excellence models "invariably" become bottlenecked ivory towers and that the fix companies like JPMorganChase, Walmart and Uber found was a "third way," an "outcome-oriented hybrid architecture" combining "centralized enablement with distributed execution, aggressive governance with operational autonomy, and technical excellence with a relentless focus on business value".

On governance and sector risk, independent research blogs increasingly note that existing regulatory scaffolding predates agentic AI and is being stretched to fit it. A May 2026 independent research publication observed that in financial services, "Goldman Sachs has embedded Anthropic engineers to co-develop autonomous compliance agents while its model validation function still operates on quarterly cycles," and that "three in four health plans now use AI in prior authorization, with appeal overturn rates above 80% in Medicare Advantage and patient appeal rates below 1%", framing this as an accountability gap rather than a framework gap. The same source noted that decade-old US banking model-risk rules remain the reference point even for agentic systems, since "SR 11-7, issued jointly by the Office of the Comptroller of the Currency and the Federal Reserve Board in 2011... established the supervisory expectation that banks maintain strong model governance," with its "foundational principles" still described by risk professionals in February 2026 as "conceptually robust" even as implementation tools strain under agentic complexity. A regulatory-tracking Substack flagged early state-level enforcement signals, noting that Michigan's insurance regulator issued a 2026 bulletin explicitly referencing NIST's framework, requiring firms to maintain a written AI Systems Program while making clear that Michigan's bulletin "explicitly references the NIST AI RMF as an appropriate framework" but "does not provide a formal safe harbor," meaning "AI made the decision" is not a defense for adverse consumer outcomes.


Sources

ID Title Outlet Date Significance
b1 Reports Of AI Not Progressing Or Offering Mundane Utility Are Often Greatly Exaggerated Don't Worry About the Vase (Substack) 2025-08 Zvi Mowshowitz's detailed line-by-line critique of the MIT GenAI Divide report's internal inconsistencies and definition of failure, the most substantive independent rebuttal in the lane.
b2 GPT-5: Key characteristics, pricing and model card Simon Willison's Newsletter (Substack) 2025-08 Primary practitioner documentation of frontier model pricing structure underpinning enterprise token-cost budgeting decisions.
b3 Simon Willison on llm-pricing Simon Willison's Weblog 2025-2026 Running first-hand log of token pricing changes and corporate token-budget incidents (Uber, Anthropic profitability) from the most cited independent LLM-tooling blogger.
b4 Understanding Tokens: The Hidden Economics of AI Models for AI Governance Professionals AI Governance Lead (Substack) 2026 Explains token cost mechanics (input vs output pricing, caching) specifically framed for AI governance and budget-setting decisions.
b5 Almost Timely News: 18 Ways To Save AI Token Budgets Almost Timely (Substack) 2026-05 Coined and critiqued 'token maxing' as a flawed adoption metric, arguing usage-as-proxy-for-adoption incentivises inefficiency.
b6 [How to Drive AI Adoption Lessons From 21 GTM Leaders](https://thegtmnewsletter.substack.com/p/how-to-drive-ai-adoption-gtm-leaders) The GTM Newsletter (Substack) 2026
b7 This Week in AI #157: Enterprise AI, AI Infrastructure & Anthropic Export Controls (CW26) The Strategy Stack (Substack) 2026-06 Surveys enterprise AI budget-survey data challenging the token-cost-as-blocker narrative and tracks shift from proving value to building governance.
b8 The real, embarrassing state of enterprise AI adoption Nextword (Substack) 2026-06 First-hand documentation of Amazon and Uber token-spend failures and a critique of 'tokenmaxxing' as a vanity metric distinct from real value capture.
b9 The Agentic Stack Wars: Part Three - EXTRACTION Haverin (Substack) 2026-06 Detailed FinOps-for-AI analysis including Benchmarkit and GAO survey data on enterprises' inability to forecast AI infrastructure costs.
b10 Dispatches From the Enterprise AI Frontline Substack newsletter (CTO advisory interviews) 2026-06 First-hand interviews with CTOs at American Express, Gap, and Warner Bros. Discovery on token budgeting and the shift from free-form to explicit AI operating budgets.
b11 The End of Free Money in AI: Why the Industry Is Moving to Cost-Accounting Mode Substack 2026-06 Documents named corporate token-budget blowouts (Uber, Amazon, Meta, Microsoft) and quantifies the gap between falling per-token price and rising per-task consumption.
b12 What should one think of the 2026 DORA brochure? makemeacto.cc (independent blog) 2026-05 Sharp independent critique arguing DORA's 2026 ROI report substantially recycles its 2025 findings without materially new evidence.
b13 AI Insights from the 2025 DORA Report Substack 2025-10 Independent synthesis of DORA's 2025 findings connecting them to Stack Overflow sentiment decline and platform-engineering best practice.
b14 Escaping AI Pilot Purgatory: Building an Agentic AI Operating System for the Next-Gen Enterprise Brian Solis (Substack) 2025-11 Independent analyst framing of the governance-versus-innovation tension and centre-of-excellence versus federated operating model debate.
b15 Pilot Purgatory Substack 2026-04 Consultant's first-hand account of repeated CIO claims of AI maturity contradicted by outcome data, citing McKinsey, Deloitte and a METR RCT on developer productivity illusions.
b16 Beyond Pilot Purgatory O'Reilly Radar 2026-02 Independent technical-publisher analysis diagnosing pilot-stage failure as an organisational-design problem and proposing a hybrid centralised/federated operating model.
b17 Fragments: April 21 Martin Fowler's Bliki 2026-04 Canonical independent software-engineering commentary on Thoughtworks Technology Radar vol.34's themes of agent permissioning, harness engineering and cognitive debt.
b18 Thoughtworks Tech Radar Recap: The AI Refresher Medium 2026-04 Independent practitioner recap of eval-driven and spec-driven development patterns emerging from the Technology Radar, mapped to agentic delivery practice.
b19 95% of Corporate Generative AI Projects Fail, MIT Study Finds Medium 2026-03 Independent Medium analysis reframing the MIT findings around organisational 'learning gap' and augmented-intelligence strategy rather than technology failure.
b20 AI and the Fundamentals of Software Engineering - What the 2025 DORA Report Really Tells Us Medium 2025-10 Cross-references DORA findings with Kent Beck's public commentary on AI agents deleting tests, illustrating eval-driven development tension.
b21 AI Governance in Regulated Industries - Horizon Scan 001 Horizon Search Institute 2026-05 Independent research publication documenting the institutional gap between AI governance frameworks and operational capacity in banking and healthcare, citing SR 11-7 and prior-authorization appeal data.
b22 Your Weekly AI Pulse: The Institutional Age of Artificial Intelligence (July 6, 2026 Edition) Substack 2026-07 Independent weekly synthesis arguing financial services governance patterns are becoming the template for other regulated sectors' agentic AI oversight.
b23 The Week That Was (4–10 July 2026): AI Governance Becomes a Financial Stability Issue Substack 2026-07 Tracks UK FCA and European Central Bank regulatory moves treating AI governance as a financial-stability and cybersecurity supervisory priority.
b24 Artificial Intelligence Regulatory Roundup Substack 2026-05 Documents Michigan's 2026 insurance-regulator bulletin referencing NIST AI RMF as an operative but non-safe-harbor compliance standard.
b25 You Don't Need to be Technical to Work in AI: Why AI Governance Is Exploding in 2026 Substack 2026-02 Independent commentary on AI governance becoming a distinct career function and procurement requirement as regulatory and audit demands scale.

We use analytics cookies to understand site usage and improve the service. We do not use marketing cookies.