Research · Frontier Lab & Model News

Back to sweep

Research sweep · deep · 2025 – present

Enterprise AI Transformation Programmes (2025–2026)

Enterprise AI transformation programmes from July 2025 to July 2026: reported success and failure rates and who measures them, delivery frameworks borrowed from and diverging from classic digital transformation, token cost economics and budgeting under consumption pricing, adoption strategy including leadership over-provisioning of access, and AI governance across AI-Ops, financial business cases, security and regulatory controls as they scale with sector risk tolerance, referencing MIT, McKinsey State of AI, DORA, ThoughtWorks Technology Radar, NIST AI RMF, ISO 42001, and the EU AI Act.

  • Claude Fable 5
  • financial
  • tech
  • academic
  • vc
  • blogs
  • frontier

Synthesised 2026-07-15

Narrative

Frontier lab data in this window functions as the primary quantitative record of enterprise AI usage, even though it is self-reported. Anthropic's Economic Index, now in its fifth and sixth iterations through mid-2026, tracks Claude usage across millions of sampled conversations and finds that coding remains the dominant enterprise task, with enterprise API usage overwhelmingly automated rather than augmented. The January 2026 report noted that enterprise API customers concentrated usage even further than consumer users: the top ten tasks represented 32% of first-party API traffic, up from 28% in the prior report. Anthropic also documents an elasticity between input and output tokens of 0.38, meaning complex enterprise tasks are increasingly bottlenecked by available context rather than raw model capability, a direct data point for the token-cost-economics research thread.

OpenAI's own "State of Enterprise AI" report frames enterprise adoption as accelerating in depth rather than just breadth: weekly Enterprise messages grew roughly 8x since November 2024, with ChatGPT Enterprise seats up approximately 9x year-over-year, while the report explicitly states that the primary constraints for organisations are no longer model performance or tooling, but rather organisational readiness. This claim, that the bottleneck has shifted from technology to organisation, directly parallels the independent commentary around the MIT NANDA "GenAI Divide" report, which found that about 5% of AI pilot programmes achieve rapid revenue acceleration while the vast majority stall, delivering little to no measurable impact on P&L. Independent critiques of the MIT figure note the underlying evidence is preliminary, based on a modest sample of executive interviews and public deployments, and caution that the finding reflects organisations treating GenAI as a parallel tool rather than an embedded operating change rather than proving outright technology failure.

On the governance and platform side, Google's April 2026 launch of the Gemini Enterprise Agent Platform (the rebranded successor to Vertex AI) packaged explicit governance primitives, an Agent Registry, Agent Gateway, and Agent Identity with cryptographic signatures, directly targeting the "agent sprawl" and audit-trail problems enterprises report when scaling from pilot to production. Anthropic has meanwhile built out a formal compliance stack (SOC 2 Type II, ISO 27001:2022, and ISO/IEC 42001:2023, achieved in January 2025 as one of the first frontier labs to do so) and offers HIPAA-ready configurations and zero-data-retention options, evidence that sector-specific regulatory bite (healthcare, finance) is shaping product design at the model-provider layer, not just at the enterprise deployment layer.

METR's evaluation work provides the independent capability backbone underlying claims about agentic transformation. Its time-horizon methodology, first published in March 2025, found that the length of tasks frontier models can complete autonomously with 50% reliability has been doubling approximately every seven months since 2019, with signs the trend accelerated to roughly every four months in 2024-2025. METR's February-March 2026 Frontier Risk Report, produced with data shared by participating AI companies, found that AI agents within AI companies often worked autonomously on real research and engineering projects with permissions and oversight comparable to human employees, while also documenting that agents showed significantly weaker performance on tasks requiring strategic judgement, stealth, and adversarial modelling than on pure technical capability, a nuance relevant to enterprises weighing autonomy-heavy agentic rollouts against residual human-oversight requirements.


Sources

ID Title Outlet Date Significance
t1 Frontier Risk Report (February to March 2026) METR 2026-05 Independent evaluation of internal AI agent autonomy and rogue-deployment risk at frontier labs, directly relevant to enterprise risk assessment of agentic AI oversight requirements.
t2 Measuring AI Ability to Complete Long Tasks METR 2025-03 Foundational paper introducing the task-completion time horizon metric, the industry's key measure of agentic capability growth underpinning agentic transformation claims.
t3 Task-Completion Time Horizons of Frontier AI Models METR 2026-05 Continuously updated tracker of time-horizon measurements across named frontier model releases, used to benchmark agentic reliability for production deployment decisions.
t4 How Does Time Horizon Vary Across Domains? METR 2025-07 Extends time-horizon methodology across coding, GUI, and other task domains, showing uneven growth rates relevant to sector-specific agentic readiness.
t5 OpenAI GPT-5 System Card arXiv / OpenAI 2026 Contains METR's external evaluation of gpt-5-thinking for autonomy risks, illustrating the independent evaluator model tied to specific named releases.
t6 Anthropic Economic Index report: Learning curves Anthropic 2026-03 Documents how experienced enterprise users extract more value from Claude over time, key evidence on adoption maturity curves.
t7 Anthropic Economic Index report: Cadences Anthropic 2026-06 Introduces survey-linked usage data on workplace AI expectations and self-reported job-loss forecasts, relevant to adoption-strategy and workforce impact debates.
t8 Anthropic Economic Index report: Economic primitives Anthropic 2026-01 Establishes primitives for measuring enterprise task concentration and success rates by task complexity, central data for the adoption-maturity research question.
t9 Anthropic Economic Index report: Uneven geographic and enterprise AI adoption Anthropic 2025-09 First report introducing first-party API enterprise data, documenting token-cost elasticity (0.38) directly relevant to FinOps-for-AI budgeting questions.
t10 [The state of enterprise AI OpenAI](https://openai.com/business/guides-and-resources/the-state-of-enterprise-ai-2025-report/) OpenAI 2025
t11 OpenAI revenue chief Dresser says enterprise AI adoption is 'at a tipping point' CNBC 2026-05 Reports OpenAI's launch of a forward-deployed-engineer consulting arm (Tomoro acquisition) to accelerate enterprise onboarding, evidence of labs moving into delivery-consulting territory.
t12 MIT report: 95% of generative AI pilots at companies are failing Fortune 2025-08 Primary coverage of the MIT NANDA 'GenAI Divide' report, the most widely cited and contested success/failure statistic in the enterprise AI transformation debate.
t13 The MIT '95% of GenAI Pilots Fail' Report: What It Gets Wrong and What Leaders Should Do Instead Medium 2025-08 Methodological critique of the MIT NANDA report's sample size and framing, representing the skeptical counter-narrative to the widely propagated 95% failure figure.
t14 MIT Report Finds Most AI Business Investments Fail, Reveals 'GenAI Divide' Virtualization Review 2025-08 Detailed breakdown of the MIT report's build-versus-buy findings (33% internal build success vs 67% vendor success) relevant to delivery framework choices.
t15 Introducing Gemini Enterprise Agent Platform Google Cloud Blog 2026-04 Official announcement of Google's consolidated agent governance platform (Agent Identity, Registry, Gateway), directly evidencing vendor productisation of AI-Ops governance.
t16 Google launches Gemini Enterprise Agent Platform for governance Let's Data Science 2026-04 Independent editorial analysis noting vendor governance features are necessary but not sufficient for safe production agent deployment in regulated environments.
t17 The new Gemini Enterprise: one platform for agent development Google Cloud Blog 2026-04 Details Model Armor and Agent Gateway security controls addressing prompt injection and data leakage risks in enterprise agent deployment.
t18 Claude Enterprise Compliance: BAA, SOC 2, GDPR and Data Policy (2026) Tygart Media 2026 Documents Anthropic's ISO/IEC 42001:2023 certification and HIPAA-ready configuration, showing how sector regulatory requirements shape model-provider compliance posture.
t19 When AI Builds Itself: The Enterprise Compliance Gap Cloud Security Alliance 2026-06 Analyses how NIST AI RMF, ISO 42001 and EU AI Act update cycles lag the pace of frontier capability growth, and reports the Pentagon's supply-chain-risk designation of Anthropic.
t20 Anthropic beats OpenAI on business adoption Ramp Economics Lab / Substack 2026-05 Independent business-spend data (Ramp AI Index) showing Anthropic overtaking OpenAI in business adoption share and documenting token-cost incentive misalignment risk.
t21 OpenAI's first state of enterprise AI Enterprise AI Executive 2025-12 Summarises Menlo Ventures' enterprise generative AI market survey findings including the shift from internally-built to purchased AI solutions.
t22 AI Adoption Trends in the Enterprise 2026 TechRepublic 2026-03 Cites Recon Analytics survey data on 'pilot purgatory' persistence, with only 8.6% of companies reporting agents deployed in production against 63.7% with no formalised initiative.
t23 A new Moore's Law for AI agents AI Digest 2026 Independent explainer synthesising METR's time-horizon findings and their implications for extrapolating agentic transformation timelines.
t24 Is there a half-life for the success rates of AI agents? arXiv 2025 Academic analysis building on METR's time-horizon dataset to model agent reliability decay, relevant to evaluating agentic deployment risk in production.
t25 How frontier AI companies could implement an internal audit function arXiv 2025-12 Proposes internal audit frameworks for frontier AI companies drawing on METR evaluation practice, relevant to AI-Ops governance council design.

We use analytics cookies to understand site usage and improve the service. We do not use marketing cookies.