EP248: 10x Faster AI Agents with JIT Compilation

EP248: 10x Faster AI Agents with JIT Compilation

Title: Agent JIT Compilation for Latency-Optimizing Web Agent Planning and Scheduling Source: http://arxiv.org/abs/2605.21470v1 Summary: This paper introduces Agent Just-In-Time (JIT) compilation, a novel architectural primitive that transforms natural language task descriptions into optimized, executable code plans. It represents a significant breakthrough in agentic efficiency by replacing traditional sequential loops with a compiled, parallelized execution framework that drastically reduces latency.

EP247: PEEK Cures AI Goldfish Memory

Title: PEEK: Context Map as an Orientation Cache for Long-Context LLM Agents Source: http://arxiv.org/abs/2605.19932v1 Summary: This work introduces 'context maps' as a novel architectural primitive for long-context agents, enabling them to cache and maintain structured orientation knowledge about recurring external datasets. By implementing a programmable cache policy for distilling and translating inference-time signals, it significantly improves efficiency and accuracy across multi-turn reasoning workloads.

EP246: Replacing AI manuals with programmable runtimes

Title: Formal Skill: Programmable Runtime Skills for Efficient and Accurate LLM Agents Source: http://arxiv.org/abs/2605.19604v1 Summary: This work introduces a foundational architectural primitive for agents that replaces informal natural-language instructions with programmable, stateful runtime skills governed by hook policies and action schemas. This shift from prompting to executable state machines provides a more enforceable and token-efficient control surface for reliable agentic workflows in real-world environments.

EP245: The Geometric Shape of AI Reasoning

Title: A Measure-Theoretic Analysis of Reasoning: Structural Generalization and Approximation Limits Source: http://arxiv.org/abs/2605.19944v1 Summary: This paper establishes fundamental theoretical bounds for LLM reasoning, proving that scaling physical layer depth is a non-negotiable requirement for out-of-distribution generalization that cannot be bypassed by scaling width. It also formalizes why specific architectural choices, such as shift-invariant embeddings, are mathematically necessary to maintain reasoning equivariance across domain shifts.

EP244: Training decentralized AI through private handoffs

Title: Learning to Hand Off: Provably Convergent Workflow Learning under Interface Constraints Source: http://arxiv.org/abs/2605.19140v1Summary: This research provides the first finite-sample guarantee for neural Q-learning in decentralized multi-agent settings, a foundational breakthrough for reliable agentic workflow learning. By formalizing handoffs as interface-constrained SMDPs, it enables provably convergent learning in complex LLM pipelines where agents have restricted observability.