From the arXiv
Wednesday, 26 August 2026 · 20 papers
Joint Optimization of Tool Creation and Use for Large Language Model Agents
This paper introduces SMITH, a reinforcement learning framework that jointly optimizes LLM agent tool creation and usage within a single policy. By training tool building and invocation together, and using independent reward signals for schema, code, and outcome correctness, SMITH enables agents to learn to create and …
On-policy Distillation with Verifiable Reward
This paper proposes **OPDVR**, a novel method that seamlessly integrates on-policy distillation (OPD) and reinforcement learning with verifiable rewards (RLVR) for post-training large language models. The core innovation is reformulating OPD's implicit reward to incorporate trajectory correctness and using a ReLU gatin…
Parason: Revealing Subtask and Trial Parallelism in LLM Reasoning
This paper introduces Parason, a method that identifies and leverages two types of parallelism in LLM reasoning: Subtask Parallelism (breaking down a task) and Trial Parallelism (parallel exploration of hypotheses). The key contribution is demonstrating that Trial Parallelism is a significant and often dominant form of…
Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnesses
This paper introduces Recuris, a novel architecture designed to overcome challenges in long-horizon tasks by employing a recursive Experiential-Working Memory. Recuris uses Working Memory to track task progress and guide skill selection from Experiential Memory, grounding actions in current needs. This approach enables…
The Invisible Editorial Layer: Formalizing Undisclosed Inference-Time Steering, Probability Placement, and the Attribution Problem in Deployed Language Models
This paper introduces the concept of an "invisible editorial layer" in deployed language models, where undisclosed interventions modify the model's probability distribution at inference time. This layer allows for systematic steering of generated text, creating an attribution problem and raising concerns about governan…
SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agents
SkillForge addresses the limitation of episodic reinforcement learning agents by introducing a framework for continuous skill evolution. It allows skills to be verified and refined through environment interaction, explicitly optimizing both actions and skill invocation. This leads to a growing and high-quality skill ba…
CAFE: Self-Improving Search Agents Need Co-Evolving Feedback
CAFE introduces a novel framework where a single model acts as both a search agent and a feedback critic, enabling self-improvement. The core method involves the agent learning to request and utilize corrective feedback, while the critic infers useful interventions from potentially flawed trajectories. This co-evolutio…
Confident at the moment of action: belief miscalibration in LLM play under hidden information
This paper investigates whether Large Language Models (LLMs) accurately reflect their knowledge when making decisions under uncertainty. The core method involves testing LLMs in a chess variant with hidden information, where their stated confidence in predicting the opponent's hidden piece location is compared to the a…
EviDx: Evidence-Aware Active Diagnosis with Scaffolded LLM Agents
EviDx is a novel framework for active clinical diagnosis using LLM agents. It addresses the limitations of static LLM diagnosis by creating interactive, evidence-seeking environments. EviDx's core contribution lies in its scaffolded approach, which guides specialized agents to dynamically acquire and process patient ev…
Meta$^n$: Recursive Self-Improvement through Emergent Depth
Meta$^n$ achieves recursive self-improvement by repeatedly applying a fixed meta-operation ($Ω$) to its own outputs, rather than modifying the operation itself. This allows for emergent depth, where each new layer builds upon the reasoning of the previous ones, leading to superior performance on benchmarks compared to …
Neurosymbolic Alignment for Physiologically-Safe Clinical Language Models
This paper introduces Neurosymbolic Alignment, a method to improve the physiological safety of clinical language models. It achieves this by integrating a clinical LLM with a knowledge graph-based physiological world model. This grounding allows the model to evaluate candidate responses against structured physiological…
PeakBench: Benchmarking Resource-Aware Tool Invocation in LLM Agents
PeakBench introduces a novel benchmark for LLM agents that focuses on resource-aware tool invocation and parallel execution. Its core method involves executable multi-tool workflows with dependency annotations and resource profiles, addressing the limitations of existing benchmarks that overlook safe parallelization. T…
RACE: Scalable Statistical Estimation of Functional Consistency in LLM Neurons
RACE is a scalable statistical framework for evaluating the functional consistency of Transformer neurons across entire domains. It uses a forward-pass approach to estimate neuron behavior, offering superior domain specificity and significantly lower computational cost compared to existing gradient-based methods. This …
Reading Is Not Using: Retrieval, Judgment, and the Design of AI Financial Research Workflows
This paper highlights a critical "retrieval-integration gap" in AI financial research: LLMs can accurately retrieve information from long financial documents, but this retrieved data doesn't reliably influence their investment judgments. The core contribution is demonstrating that even with accurate retrieval, the shee…
Simthesizer: An Agent-Driven Simulation Framework for LLM Serving Systems
This paper introduces Simthesizer, an agent-driven simulation framework for LLM serving systems. Its core method is Borg, a composable infrastructure that uniformly expresses serving workflows and control decisions as a dynamic graph. The contribution is a novel approach to simulator development, using a coding agent t…
SPO++: Stream-Aligned Policy Optimization for Asynchronous Agentic RL
This paper introduces SPO++, an improved method for asynchronous reinforcement learning in agentic settings. It addresses limitations of prior work by standardizing terminal-outcome advantages according to the action-token measure, aligning the value estimation with the actor's optimization objective. This novel approa…
StepGuard: Learning Step-Level Guardrails with Scalable Supervision and Safety-Utility Balancing
StepGuard introduces a novel step-level guard model for LLM agents, enabling pre-execution monitoring of tool actions to prevent security risks. Its core method involves StepGen for scalable data generation and Balance-GRPO for dynamically balancing safety and utility. The contribution lies in achieving high accuracy i…
When "Must" Becomes "Maybe": Constraint Weakening in LLM Agent Workflows
This paper introduces "constraint weakening" for LLM agents, addressing how requirements in multi-stage workflows can shift from mandatory to optional. The core method involves analyzing how intermediate artifacts transform action-binding state, specifically focusing on safety blockers. The contribution is demonstratin…
When Do Supervised UQ Ensembles Improve LLM Hallucination Detection? A Robustness Study
This paper investigates the effectiveness of supervised ensembles for detecting LLM hallucinations when ground truth is unavailable. The core method involves training a classifier on diverse uncertainty quantification (UQ) signals from multiple LLMs. The key contribution is a systematic robustness analysis demonstratin…
IAPO: Influence-Aware Policy Optimization for Credit Assignment in Multi-Turn Service Agents
This paper introduces Influence-Aware Policy Optimization (IAPO) for multi-turn LLM agents. IAPO models the flow of information and errors within a task's interaction history as a typed influence-dependency graph. This allows for more effective credit assignment by directly leveraging the inherent structure of past int…