From the arXiv
Thursday, 4 June 2026 · 20 papers
AgentOrchestra: Orchestrating Multi-Agent Intelligence with the Tool-Environment-Agent(TEA) Protocol
This paper introduces the Tool-Environment-Agent (TEA) protocol, a novel framework for coordinating multi-agent systems. TEA models agents, tools, and environments as versioned resources with explicit lifecycles, enabling better context management and reproducibility. Building on TEA, AgentOrchestra provides a hierarch…
BenchTrace: A Benchmark for Testing Reflection Ability and Controlled Evolution in LLM Agents
This paper introduces BenchTrace, a benchmark designed to evaluate the reflection and controlled evolution capabilities of LLM agents. BenchTrace utilizes a dataset of annotated episodes and includes two key evaluations: one that probes failure identification through targeted QA, and another that tests an agent's abili…
EAPO: Enhancing Policy Optimization with On-Demand Expert Assistance
EAPO is a novel RL framework that enhances LLM reasoning by allowing policies to adaptively seek assistance from external experts during training. This on-demand expert interaction provides richer reward signals and more reliable reasoning trajectories, ultimately internalizing expert knowledge to improve the LLM's ind…
Estimating the Empowerment of Language Model Agents
This paper introduces EELMA, an algorithm that estimates the "empowerment" of language model agents. Empowerment, an information-theoretic measure, quantifies an agent's ability to influence future states through its actions. EELMA allows for scalable evaluation of LM agents in text-based environments, demonstrating th…
EvoSpec: Evolving Speculative Decoding via Real-Time Vocabulary and Parameter Adaptation
EvoSpec accelerates LLM inference by dynamically adapting the draft model's vocabulary and parameters in real-time. This approach overcomes the limitations of static pruning by efficiently retrieving relevant long-tail tokens and minimizing the distributional gap between draft and target models through online alignment…
From AR to Diffusion: Efficiently Adapting Large Language Models with Strictly Causal and Elastic Horizons
This paper introduces FLUID, a framework for efficiently adapting autoregressive (AR) language models to diffusion models for text generation. FLUID achieves this by enforcing "Strictly Causal Alignment" to allow seamless initialization from AR checkpoints, avoiding costly retraining. It also employs "Elastic Horizons"…
From Meta-Thought to Execution: Cognitively Aligned Post-Training for Generalizable and Reliable LLM Reasoning
This paper proposes a new LLM post-training method called Chain-of-Meta-Thought (CoMT). It addresses the limitation of current methods by mimicking human problem-solving, which involves first learning abstract strategies (meta-knowledge) and then applying them. CoMT achieves this by separating supervised learning of ge…
Graph-Enhanced Policy Optimization in LLM Agent Training
This paper introduces Graph-Enhanced Policy Optimization (GEPO) to improve LLM agent training for multi-step tasks. GEPO addresses the issue of uniform credit assignment by developing a dual-level structural credit system. It calculates a "Task-Conditioned Criticality" score for each state, considering its topological …
GroundAct: Can LLM Agents Ground Actions in Environmental States?
This paper introduces GroundAct, a benchmark designed to assess Large Language Model (LLM) agents' ability to ground actions in environmental states. The core method involves evaluating LLMs on tasks where action feasibility depends on unstated environmental conditions. The key contribution is demonstrating that LLMs s…
InsightEval: An Expert-Curated Benchmark for Assessing Insight Discovery in LLM-Driven Data Agents
This paper addresses the lack of robust benchmarks for evaluating LLM-driven data agents' insight discovery capabilities. The authors identify critical flaws in existing benchmarks like InsightBench and propose new criteria for high-quality evaluation. They then introduce InsightEval, a new, expert-curated dataset cons…
Jailbreak Scaling Laws for Large Language Models: Polynomial-Exponential Crossover
This paper identifies that adversarial prompt injection dramatically accelerates the success rate of attacks on language models from polynomial to exponential growth. They propose a theoretical generative model based on a spin-glass system to explain this phenomenon, where unsafe generations correspond to low-energy cl…
LsrIF: Enhancing Logic-Structured Instruction Following of Large Language Models
This paper introduces LsrIF, a novel training framework designed to improve how large language models follow instructions with complex logical structures. LsrIF addresses limitations of existing methods by constructing training data that explicitly models parallel, sequential, and conditional dependencies between const…
Provably Secure Agent Guardrail
This paper introduces a novel security framework for AI agents that moves beyond empirical semantic guardrails. Its core method, the Proof-Constrained Action (ePCA) framework, forces agents to formally translate their intentions into logical constraints before execution, ensuring provable security by leveraging the lim…
Reasoning and Tool-use Compete in Agentic RL:From Quantifying Interference to Disentangled Tuning
This paper investigates the assumption that joint training of reasoning and tool-use in Agentic Reinforcement Learning (ARL) is always beneficial. Using a new method called Capability Effect Attribution (CEA), they demonstrate that these two capabilities often interfere with each other due to misaligned gradients, hind…
Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers
This paper introduces Proactive Interactive Reasoning (PIR), a new paradigm for LLMs that moves beyond passive problem-solving. PIR enables LLMs to proactively ask clarifying questions to users when facing uncertainty about premises or intent, rather than just performing internal reasoning. This is achieved through a f…
ReflexGrad: Within-Episode Failure Recovery in LLM Agents via Progress-Gated Dual-Process Routing
ReflexGrad introduces a dual-process architecture to enable LLM agents to recover from failures within a single episode without needing demonstrations. It dynamically routes between a fast, continuous refinement process and a slower, diagnostic process that triggers upon detecting low progress. This approach significan…
Relevance as a Vulnerability: How Web Retrieval Degrades Safety Alignment in LLM Agents
This paper introduces AgentREVEAL, a framework to diagnose how web retrieval in LLM agents can degrade safety alignment. It finds that tightly coupling tool use with generation amplifies harmful outputs. Surprisingly, even safety-oriented content can increase harmful compliance due to the "Safe Source Paradox."
RewardFlow: Topology-Aware Reward Propagation on State Graphs for Agentic RL with Large Language Models
RewardFlow addresses sparse rewards in LLM-based RL by constructing state graphs and using topology-aware propagation to estimate state-level rewards. This method generates principled, annotation-free dense rewards, significantly improving agent performance and training efficiency across various benchmarks.
SCOPE: Prompt Evolution for Enhancing Agent Effectiveness
This paper introduces SCOPE, a novel method for LLM agents to dynamically manage large, evolving contexts. SCOPE frames this as an online optimization problem, automatically evolving agent prompts by synthesizing guidelines from execution traces. Its core contribution lies in a Dual-Stream memory mechanism and Perspect…
SIA: Self Improving AI with Harness & Weight Updates
This paper introduces SIA, a novel self-improving AI loop that breaks down silos in AI development. SIA's core method is a language-model agent that simultaneously updates both the "harness" (tools, prompts, retry logic) and the "weights" of a task-specific agent. This unified approach, unlike previous methods that foc…