Research · Blogs & Independent Thinkers
Back to sweepResearch sweep · deep · 2025 – present
Enterprise AI Transformation Programmes (2025–2026)
Enterprise AI transformation programmes from July 2025 to July 2026: reported success and failure rates and who measures them, delivery frameworks borrowed from and diverging from classic digital transformation, token cost economics and budgeting under consumption pricing, adoption strategy including leadership over-provisioning of access, and AI governance across AI-Ops, financial business cases, security and regulatory controls as they scale with sector risk tolerance, referencing MIT, McKinsey State of AI, DORA, ThoughtWorks Technology Radar, NIST AI RMF, ISO 42001, and the EU AI Act.
- Claude Fable 5
- financial
- tech
- academic
- vc
- blogs
- frontier
Synthesised 2026-07-15
Narrative
The MIT NANDA "GenAI Divide" report's headline that 95% of generative AI pilots show no measurable P&L impact drew immediate and sustained scrutiny from independent AI writers. Zvi Mowshowitz, writing on his widely-read Substack, dissected the report's internal inconsistencies directly, noting the study's own data shows purchased tools succeed "twice the success rate of" internally built ones and questioning the "zero return" framing given that the report calls the 95% of projects without "measurable P&L impact" failures, even though back-office ROI is hard to prove within a P&L window, and doubling coder productivity has real value even without a directly attributable dollar figure. Marketing AI Institute's Paul Roetzer made a parallel critique, arguing the study's methodology used a narrow six-month, P&L-only success definition and rested on just 52 interviews that the report itself admits are only "directionally accurate based on individual interviews rather than official company reporting". Even sources sympathetic to the report's broader thesis, such as a 2026 industry landscape blog, concede that "the figure has been debated, critics note its six-month P&L definition ignores efficiency and CX gains, but even sceptics accept the underlying signal: High Adoption, Low Transformation".
Independent commentary through 2026 has shifted attention from pilot failure rates toward a more granular story about token economics and cost governance. Simon Willison's Newsletter and TILs blog documented the collision between falling per-token prices and exploding per-task consumption in near real time, noting cases like Uber, where he observed that the company's coding-tool budget problem stemmed from a policy set "before anyone could have predicted how popular token-burning coding agents were about to become". Other Substack writers quantified this pattern more starkly: one investor-newsletter piece reported that "Amazon, supposedly, blew $500m in one month on Claude without seeing much ROI and had to stop token leaderboards" while "Uber blew its 2026 AI budget in 4 months and blamed Anthropic for it, without moving any of their business KPIs", while a separate FinOps-focused Substack cited survey data that "Benchmarkit's 2025 survey of 372 enterprise organizations found that only 15 percent of companies could forecast AI costs within 10 percent of actual spend," with "nearly one in four" missing "by more than 50 percent". A widely-discussed newsletter piece coined "tokenmaxxing" for the practice of gamifying token consumption as an adoption proxy, warning that "organizations are measuring AI adoption by how much the users are using... often called token maxing... it's a terrible measure. Because if you think about it, if you are holding people accountable to how many tokens they use, they have a natural incentive to use as much as possible". Confirming the trend at leadership level, an enterprise-CTO-briefing Substack reported "Jensen Huang has publicly proposed a token budget of up to 50% of an engineer's annual salary" and that "the CTO is becoming the CFO of tokens".
On delivery frameworks, independent bloggers treat the DORA and ThoughtWorks lineages as the credible bridge between classic DevOps/agile practice and agentic AI, while pushing back on report inflation. One critical Substack post accused Google Cloud's DORA team of recycling its own prior findings, observing that the 2026 report's core message closely mirrors the 2025 report's: "Artificial Intelligence (AI) serves as a powerful amplifier in software development. It magnifies the strengths of high-performing organizations and the dysfunctions of struggling ones," compared with the 2025 report's near-identical framing that "AI's primary role in software development is that of an amplifier". Thoughtworks' own Technology Radar volume 34, discussed on Martin Fowler's blog, argued the industry response should be a return to fundamentals rather than a new methodology, noting the radar's finding that teams are "returning to many established techniques, from pair programming to zero trust architecture, and from mutation testing to DORA metrics" as "not nostalgia, but a necessary counterweight to the speed at which AI tools can generate complexity". Independent consultants writing on "pilot purgatory" converge on organisational rather than technical explanations: one consultant's Substack cited a randomised trial finding that a survey of 5,000 white-collar workers found over 40% of executives claimed AI saved them eight-plus hours weekly while two-thirds of non-management staff reported saving under two hours, and a METR randomised controlled trial "found that AI tools made them 19% slower - while the developers themselves believed they were 20% faster". O'Reilly Radar's independent analysis reached a similar structural diagnosis, arguing that centre-of-excellence models "invariably" become bottlenecked ivory towers and that the fix companies like JPMorganChase, Walmart and Uber found was a "third way," an "outcome-oriented hybrid architecture" combining "centralized enablement with distributed execution, aggressive governance with operational autonomy, and technical excellence with a relentless focus on business value".
On governance and sector risk, independent research blogs increasingly note that existing regulatory scaffolding predates agentic AI and is being stretched to fit it. A May 2026 independent research publication observed that in financial services, "Goldman Sachs has embedded Anthropic engineers to co-develop autonomous compliance agents while its model validation function still operates on quarterly cycles," and that "three in four health plans now use AI in prior authorization, with appeal overturn rates above 80% in Medicare Advantage and patient appeal rates below 1%", framing this as an accountability gap rather than a framework gap. The same source noted that decade-old US banking model-risk rules remain the reference point even for agentic systems, since "SR 11-7, issued jointly by the Office of the Comptroller of the Currency and the Federal Reserve Board in 2011... established the supervisory expectation that banks maintain strong model governance," with its "foundational principles" still described by risk professionals in February 2026 as "conceptually robust" even as implementation tools strain under agentic complexity. A regulatory-tracking Substack flagged early state-level enforcement signals, noting that Michigan's insurance regulator issued a 2026 bulletin explicitly referencing NIST's framework, requiring firms to maintain a written AI Systems Program while making clear that Michigan's bulletin "explicitly references the NIST AI RMF as an appropriate framework" but "does not provide a formal safe harbor," meaning "AI made the decision" is not a defense for adverse consumer outcomes.
Sources
| ID | Title | Outlet | Date | Significance |
|---|---|---|---|---|
| b1 | Reports Of AI Not Progressing Or Offering Mundane Utility Are Often Greatly Exaggerated | Don't Worry About the Vase (Substack) | 2025-08 | Zvi Mowshowitz's detailed line-by-line critique of the MIT GenAI Divide report's internal inconsistencies and definition of failure, the most substantive independent rebuttal in the lane. |
| b2 | GPT-5: Key characteristics, pricing and model card | Simon Willison's Newsletter (Substack) | 2025-08 | Primary practitioner documentation of frontier model pricing structure underpinning enterprise token-cost budgeting decisions. |
| b3 | Simon Willison on llm-pricing | Simon Willison's Weblog | 2025-2026 | Running first-hand log of token pricing changes and corporate token-budget incidents (Uber, Anthropic profitability) from the most cited independent LLM-tooling blogger. |
| b4 | Understanding Tokens: The Hidden Economics of AI Models for AI Governance Professionals | AI Governance Lead (Substack) | 2026 | Explains token cost mechanics (input vs output pricing, caching) specifically framed for AI governance and budget-setting decisions. |
| b5 | Almost Timely News: 18 Ways To Save AI Token Budgets | Almost Timely (Substack) | 2026-05 | Coined and critiqued 'token maxing' as a flawed adoption metric, arguing usage-as-proxy-for-adoption incentivises inefficiency. |
| b6 | [How to Drive AI Adoption | Lessons From 21 GTM Leaders](https://thegtmnewsletter.substack.com/p/how-to-drive-ai-adoption-gtm-leaders) | The GTM Newsletter (Substack) | 2026 |
| b7 | This Week in AI #157: Enterprise AI, AI Infrastructure & Anthropic Export Controls (CW26) | The Strategy Stack (Substack) | 2026-06 | Surveys enterprise AI budget-survey data challenging the token-cost-as-blocker narrative and tracks shift from proving value to building governance. |
| b8 | The real, embarrassing state of enterprise AI adoption | Nextword (Substack) | 2026-06 | First-hand documentation of Amazon and Uber token-spend failures and a critique of 'tokenmaxxing' as a vanity metric distinct from real value capture. |
| b9 | The Agentic Stack Wars: Part Three - EXTRACTION | Haverin (Substack) | 2026-06 | Detailed FinOps-for-AI analysis including Benchmarkit and GAO survey data on enterprises' inability to forecast AI infrastructure costs. |
| b10 | Dispatches From the Enterprise AI Frontline | Substack newsletter (CTO advisory interviews) | 2026-06 | First-hand interviews with CTOs at American Express, Gap, and Warner Bros. Discovery on token budgeting and the shift from free-form to explicit AI operating budgets. |
| b11 | The End of Free Money in AI: Why the Industry Is Moving to Cost-Accounting Mode | Substack | 2026-06 | Documents named corporate token-budget blowouts (Uber, Amazon, Meta, Microsoft) and quantifies the gap between falling per-token price and rising per-task consumption. |
| b12 | What should one think of the 2026 DORA brochure? | makemeacto.cc (independent blog) | 2026-05 | Sharp independent critique arguing DORA's 2026 ROI report substantially recycles its 2025 findings without materially new evidence. |
| b13 | AI Insights from the 2025 DORA Report | Substack | 2025-10 | Independent synthesis of DORA's 2025 findings connecting them to Stack Overflow sentiment decline and platform-engineering best practice. |
| b14 | Escaping AI Pilot Purgatory: Building an Agentic AI Operating System for the Next-Gen Enterprise | Brian Solis (Substack) | 2025-11 | Independent analyst framing of the governance-versus-innovation tension and centre-of-excellence versus federated operating model debate. |
| b15 | Pilot Purgatory | Substack | 2026-04 | Consultant's first-hand account of repeated CIO claims of AI maturity contradicted by outcome data, citing McKinsey, Deloitte and a METR RCT on developer productivity illusions. |
| b16 | Beyond Pilot Purgatory | O'Reilly Radar | 2026-02 | Independent technical-publisher analysis diagnosing pilot-stage failure as an organisational-design problem and proposing a hybrid centralised/federated operating model. |
| b17 | Fragments: April 21 | Martin Fowler's Bliki | 2026-04 | Canonical independent software-engineering commentary on Thoughtworks Technology Radar vol.34's themes of agent permissioning, harness engineering and cognitive debt. |
| b18 | Thoughtworks Tech Radar Recap: The AI Refresher | Medium | 2026-04 | Independent practitioner recap of eval-driven and spec-driven development patterns emerging from the Technology Radar, mapped to agentic delivery practice. |
| b19 | 95% of Corporate Generative AI Projects Fail, MIT Study Finds | Medium | 2026-03 | Independent Medium analysis reframing the MIT findings around organisational 'learning gap' and augmented-intelligence strategy rather than technology failure. |
| b20 | AI and the Fundamentals of Software Engineering - What the 2025 DORA Report Really Tells Us | Medium | 2025-10 | Cross-references DORA findings with Kent Beck's public commentary on AI agents deleting tests, illustrating eval-driven development tension. |
| b21 | AI Governance in Regulated Industries - Horizon Scan 001 | Horizon Search Institute | 2026-05 | Independent research publication documenting the institutional gap between AI governance frameworks and operational capacity in banking and healthcare, citing SR 11-7 and prior-authorization appeal data. |
| b22 | Your Weekly AI Pulse: The Institutional Age of Artificial Intelligence (July 6, 2026 Edition) | Substack | 2026-07 | Independent weekly synthesis arguing financial services governance patterns are becoming the template for other regulated sectors' agentic AI oversight. |
| b23 | The Week That Was (4–10 July 2026): AI Governance Becomes a Financial Stability Issue | Substack | 2026-07 | Tracks UK FCA and European Central Bank regulatory moves treating AI governance as a financial-stability and cybersecurity supervisory priority. |
| b24 | Artificial Intelligence Regulatory Roundup | Substack | 2026-05 | Documents Michigan's 2026 insurance-regulator bulletin referencing NIST AI RMF as an operative but non-safe-harbor compliance standard. |
| b25 | You Don't Need to be Technical to Work in AI: Why AI Governance Is Exploding in 2026 | Substack | 2026-02 | Independent commentary on AI governance becoming a distinct career function and procurement requirement as regulatory and audit demands scale. |