EP240: Small AI agents beat giants with Orchard

EP261: EchoRL turns hesitation into genius

Title: EchoRL: Reinforcement Learning via Rollout Echoing Source: http://arxiv.org/abs/2605.31228v1 Summary: This paper introduces EchoRL, a novel reinforcement learning primitive that prevents training signal collapse in reasoning models by recovering gradients from successfully verified rollouts. It establishes a foundational method for post-training LLMs to achieve higher reasoning performance without encountering the typical diminishing returns of standard RLVR methods.

EP260: GrepSeek brings Unix precision to AI

Title: GrepSeek: Training Search Agents for Direct Corpus Interaction Source: http://arxiv.org/abs/2605.29307v1 Summary: This paper introduces Direct Corpus Interaction (DCI), a foundational paradigm shift where search agents treat text corpora as executable environments via shell commands instead of traditional ranked indices. By training agents to find and compose evidence directly from raw data using a two-stage RL pipeline, it establishes a new architectural framework for knowledge-intensive agentic reasoning.

EP259: The ESPO Kill Switch For AI Reasoning

Title: ESPO: Early-Stopping Proximal Policy Optimization Source: http://arxiv.org/abs/2605.29860v1 Summary: Early-Stopping Proximal Policy Optimization (ESPO) provides a significant breakthrough in efficiency and reasoning for LLM reinforcement learning by detecting and terminating failed reasoning trajectories on-the-fly. This foundational optimization reduces compute overhead by 20% while improving performance on complex math and reasoning benchmarks by concentrating negative reward signals at the exact point of logical failure.

EP258: TRACER teaches AI to stay silent

Title: TRACER: Turn-level Regret Matching with Inner Reinforcement Credit for Cooperative Multi-LLM Reasoning Source: http://arxiv.org/abs/2605.28699v1 Summary: TRACER introduces a novel turn-level reinforcement framework that unifies regret matching with role-specific rewards to optimize multi-agent cooperation and reasoning. By separating the decision of when to speak from the content of the utterance, it establishes a mathematically rigorous foundation for evolving complex collaborative protocols in multi-LLM systems.

EP257: How planning wakes up deep AI layers

Title: Do Agents Think Deeper? A Mechanistic Investigation of Layer-Wise Dynamics in Sequential Planning Source: http://arxiv.org/abs/2605.27935v1 Summary: This study provides foundational mechanistic evidence that agentic reasoning requires dynamic, adaptive recruitment of model depth, distinguishing it from static inference tasks. These insights into layer-wise dynamics are critical for developing the next generation of LLM architectures optimized for long-horizon planning and iterative tool use.