AI engineering and architecture
Building systems around models rather than on top of them: control planes, deterministic rails, retrieval over volatile corpora, and code intelligence at scale.
Research sweeps
2026-08-27 · deep
Information Density and Semantic Determinacy - Formal vs Natural Language
Information density, entropy and semantic determinacy in formal versus natural languages, and what it implies for specifying computation
Claude Opus 4.8- academic
- frontier
- blogs
- +1
2026-08-25 · deep
Observability for Agent Orchestration, Pipelines and Swarms
Observability for LLM agent orchestration, pipelines and multi-agent swarms between August 2025 and August 2026: emerging standards (OpenTelemetry GenAI semantic conventions, MCP tool tracing), the tooling landscape (LangSmith, Langfuse, Arize Phoenix, Braintrust, W&B Weave, Comet Opik, Datadog LLM Observability), the two-layer pattern of durable orchestration plus agent tracing (Temporal, LangGraph), and how production operators such as Stripe, Shopify, Airbnb and Anthropic instrument, evaluate and debug agent fleets at scale
Claude Fable 5- financial
- frontier
- academic
- +3
2026-08-04 · deep
Apple Silicon Unified Memory as On-Premise AI Infrastructure (Jan 2025 – Aug 2026)
Whether Apple Silicon unified memory and the Neural Engine are becoming a credible substrate for how AI is run commercially and on consumer devices between January 2025 and August 2026: shipped capacity and bandwidth (M3 Ultra at 512GB, M4 and M5 Max) versus the rumoured 1.5TB M7 Ultra, comparison against NVIDIA H200, GB200 NVL72 and AMD MI355X on memory-bound serving, the orchestration and scheduling gap (MLX distributed, EXO, Thunderbolt 5 fabrics, Kubernetes and MDM on macOS, Metal kernel maturity versus CUDA), the on-device stack (Neural Engine, Core ML, the Foundation Models framework, Private Cloud Compute), fleet monitoring and data-centre economics, and how Apple is positioned to capture value from the AI race as compute substrate rather than as a frontier model lab.
Claude Fable 5- frontier
- academic
- tech
- +3
2026-07-21 · deep
Agentic Harnesses Market Landscape, July 2025 to July 2026
Agentic harnesses from July 2025 to July 21, 2026: competitive landscape, market share by use case, model integration, orchestration patterns, and differences between coding harnesses and broader workflow agents, including Claude Code, OpenAI Codex, Cursor, GitHub Copilot, Google Jules, Replit Agent, Devin, Windsurf, OpenCode, Aider, OpenHands, LangGraph, CrewAI, AutoGen, and n8n.
GPT-5.6-sol- financial
- frontier
- academic
- +3
2026-06-07 · deep
AI on Deterministic Rails
AI on deterministic rails: how AI and traditional deterministic software are forming a symbiotic stack from January 2025 through June 2026: the enterprise "PoC-opalypse" and the shift from token consumption to durable agentic adoption patterns, AI leveraging software-encoded workflows as guardrails (variance and error control) rather than replacing them, the frontier moving from raw model capability to model orchestration and harness design (Claude Code, OpenCode, Pi), right-sizing with smaller and open-weight models (Llama, Qwen, DeepSeek, Mistral) for cheap routine automation and private inference, and the token-pricing economics behind enterprise sticker-shock over agentic spend versus delivered value
Claude Opus 4.8- financial
- frontier
- academic
- +3
2026-06-03 · deep
Code Intelligence & Code-Graph Indexing for AI Agents
Tools and emerging approaches for code intelligence and code-graph indexing for AI coding agents from June 2025 through early June 2026, spanning local/embedded indexers (CodeGraph/Caveman-style repo maps, tree-sitter, SQLite and embedded graph stores), enterprise-scale code understanding (SCIP, code knowledge graphs, embeddings+retrieval), LSP-to-MCP bridges such as Serena, and the semantic-vs-syntactic-vs-embedding trade-off.
GPT-5.5- tech
- frontier
- academic
- +2
2026-06-01 · standard
Handling Large Volatile Corpora with AI: Caching, Freshness, and Retrieval at Scale
Engineering patterns for large, fast-changing corpora from 2024 to 2026: prompt and prefix caching, the shift from prompt engineering to context engineering, embedding staleness and freshness strategies, multi-strategy retrieval beyond pure vector search, and the inference-cost economics now reshaping infrastructure decisions.
Claude Opus 4.8- frontier
- tech
- academic
- +1
2026-05-10 · deep
Agentic RAG - Evolution, Challenges, and Decision Criteria
Agentic RAG between November 2025 and May 2026: how retrieval-augmented generation is shifting toward agent-driven architectures, the operational problems (token burn, context management, latency, reliability), information-organisation patterns such as context catalogues and semantic categorisation, parallels with traditional data warehousing (dimensions, measures, star schemas), the evolving RAG tooling landscape, and decision criteria for switching to pure agentic workflows.
Claude Opus 4.8- academic
- frontier
- tech
- +2
2026-04-30 · deep
Agentic Engineering And Enterprise Architecture Discipline
Agentic engineering after Andrej Karpathy's vibe coding meme, April 2025-April 2026: how AI coding agents are changing enterprise software engineering across security, testability, reliability, maintainability, availability, resilience, observability, operability, cost, recovery, and engineering governance.
GPT-5.5- frontier
- academic
- vc
- +3
2026-04-24 · deep
Engineering AI Control Plane
Engineering AI control planes for software delivery from July 1, 2025 through April 24, 2026: how teams implement AI across development workflows and CI/CD, choose tools/models/SDKs, govern observability and compliance, manage reliability and provider availability, and handle cognitive debt, dark code, case studies, success stories, and failure modes across team size, company scale, and greenfield versus brownfield systems
Claude Opus 4.8- financial
- frontier
- academic
- +3
2026-04-13 · deep
AI Dark Code - Organisational Accountability and Control
AI-generated and agent-produced code ("dark code") in enterprise settings June 2025–April 2026: organisational accountability structures, failure and adaptation of established management frameworks, technical and governance controls, observability and discoverability of agent logic, and documented outcomes from early enterprise adoption.
Claude Opus 4.8- financial
- frontier
- academic
- +2
Explainers
- Research Explainer · West (2026)
Free models agree with the expensive verifier when it says yes, but miss most of its real failures
Eight free candidates, five local open-weight models and three cloud free-tier routes, were retro-graded against frontier verdicts on ten real stages of agent-written code. The best caught 77% of genuine failures. Five caught almost none, while agreeing with passing work up to 98% of the time.
- Research Explainer · Vella (2026)
AI helps engineers move faster, but turns more of the job into supervision
Over six months, professional engineers reported spending less time writing code and shifting towards verification. Productivity remained positive, even as flow and other aspects of developer experience deteriorated for a growing minority.
- Research Explainer · Lin et al. (2026)
An agent rewrites its own coding harness, and beats the engineers who used to do it by hand
Agentic Harness Engineering turns harness tuning into an automated loop. Ten iterations lift pass@1 on Terminal-Bench 2 from a bash-only 69.7% to 77.0%, past the human-built Codex harness and every self-evolving baseline.
- Research Explainer · Hitzig (2026)
Coding agents make a software background optional, but expertise still decides who succeeds
An analysis of roughly 400,000 Claude Code sessions finds a clear split of labour: people decide what to build, the agent decides how. Command of a domain, not the ability to write code, is what makes sessions succeed.
- Research Explainer · Demirer, Musolff & Yang (2026)
AI coding agents triple the code developers write, but shipped software barely budges
A study of more than 100,000 GitHub developers finds that each generation of AI coding tool delivers bigger task-level gains, yet those gains shrink dramatically as they travel down the production chain toward actual releases and end users.
- Research Explainer · Hu et al. (2025)
EPIC reuses KV caches across any prefix, by recomputing only a handful of tokens per chunk
Position-Independent Caching lets language models reuse document KV vectors regardless of what comes before them. EPIC's LegoLink algorithm fixes the resulting attention sink with O(kN) work instead of O(N²).
- Research Explainer · Liu et al. (2026)
Claude Code is a thin agent loop wrapped in a thick safety harness
A source-level reading of Anthropic's coding agent finds that about 1.6% of the code is AI decision logic. The other 98.4% is permission gates, context compaction, extensibility plumbing, and recovery.
- Research Explainer · Liu (2026)
AI coding assistants fix more code smells than they create, but introduce nearly twice the security issues they resolve
Across 304,362 AI-authored commits from 6,275 GitHub repositories, AI tools are a net positive for surface-level code quality but a net negative for bugs and security vulnerabilities, with 24.2% of all introduced issues persisting indefinitely.
- Research Explainer · Li (2025)
AI coding agents now ship 456,000 pull requests, but their code gets rejected far more often than human work
The first large-scale dataset of autonomous coding agent activity on GitHub reveals that speed and scale are real, but acceptance rates, review dynamics, and code complexity tell a more sobering story about the gap between benchmarks and production.
- Research Explainer · Arunkumar (2026)
AI systems are evolving from text generators to autonomous agents, but the architecture for making them reliable is still being invented
A comprehensive survey proposes a six-dimension taxonomy for LLM-based agents, mapping the shift from simple reasoning loops to hierarchical multi-agent systems with standardized tool connectivity, and catalogues the open failure modes that still block real-world deployment.
- Research Explainer · Alenezi (2026)
AI agents are no longer just answering prompts, they're becoming goal-directed systems with their own control loops
This paper maps the architectural shift from stateless LLM calls to autonomous agent systems with typed tools, hierarchical memory, multi-agent coordination, and governance baked in from the start.
- Research Explainer · Humberd (2026)
Agency theory was built for human managers, but AI is becoming the agent nobody knows how to supervise
A new framework maps five stages of AI evolution against traditional agency mechanisms, arguing that firms need to scaffold monitoring and incentive systems now, well before AI gains full decision-making autonomy.
- Research Explainer · Zheng et al. (2024)
Treat LLM calls like a program; then the cache starts doing real work
SGLang pairs a small Python DSL with a runtime that understands prompt structure, shared prefixes, and batching. That combination makes agent, reasoning, long-document, and vision workloads measurably faster, while also cutting the amount of glue code needed to build them.
- Research Explainer · Xia, Lu, Zhu et al. (2025)
Most LLM agent evaluation stops at launch; so the same failures keep recurring in production
A multivocal review of 161 sources reveals that academic evaluation overwhelmingly focuses on pre-deployment benchmarks. The authors propose EDDOps, a process model and reference architecture that make evaluation a continuous, governing function across the entire agent lifecycle.
- Research Explainer · Vandeputte (2025)
Stop letting AI agents run everything; make them automate themselves out of the critical path
A Nokia Bell Labs framework argues that reliable GenAI systems should blend traditional software engineering with cognitive AI processing, keeping agents as occasional problem-solvers rather than permanent gatekeepers.
- Research Explainer · Su et al. (2025)
Kubernetes dominates five years of practitioner talks; while planning and coding get almost no attention
An analysis of 5,677 talks from eight major industry conferences (2020–2024) reveals that a tiny cluster of technologies shapes modern software architecture, most tools serve late DevOps stages, and early design phases remain a blind spot.
- Research Explainer · Pan, Chodnekar, Roy & Wang (2025)
Running your own LLM can pay for itself in months; but only if you pick the right model size
A cost-benefit analysis of 54 deployment scenarios finds that small open-source models break even against commercial APIs in under three months on a $2,000 GPU, while large models can take years to justify their quarter-million-dollar hardware.
- Research Explainer · Koc, Verre, Blank & Morgan (2025)
Your IDE should watch your AI's metrics; not just your code's syntax
A conceptual framework for wiring real-time LLM telemetry (traces, evaluations, prompt versions) directly into the code editor through the Model Context Protocol, turning prompt engineering from guesswork into a data-driven feedback loop.
- Research Explainer · Esposito et al. (2025)
GenAI can help architects sketch systems; but nobody is checking whether the sketches are right
A multivocal literature review of 46 studies finds GenAI is already embedded in early architectural tasks, yet 93% of the work skips formal validation of what the models produce.