From the arXiv
Tuesday, 2 June 2026 · 20 papers
COMAP: Co-Evolving World Models and Agent Policies for LLM Agents
COMAP co-evolves textual world models and agent policies in a closed loop. The world model predicts future feedback for candidate actions, which the agent uses to refine its choices by assessing feedback reliability. This process allows the world model to adapt to the agent's evolving behavior through self-distillation…
MOC: Multi-Order Communication in LLM-based Multi-Agent Systems
This paper introduces Multi-Order Communication (MOC) for LLM-based multi-agent systems. MOC addresses the limitation of current methods by reconstructing communication to capture multi-hop dependencies and employing a structural message consolidation strategy. This allows for more effective message transmission and op…
Policy and World Modeling Co-Training for Language Agents
This paper proposes PaW, a framework that co-trains a language agent's policy and world model simultaneously during reinforcement learning. By leveraging on-policy rollouts, PaW adds auxiliary world modeling supervision without requiring separate simulators or changing inference. This approach improves agent performanc…
SIRI: Self-Internalizing Reinforcement Learning with Intrinsic Skills for LLM Agent Training
SIRI trains LLM agents to develop reusable skills internally, eliminating the need for external skill generators or inference-time skill banks. It achieves this through a three-phase process: initial policy warmup, self-skill discovery and validation using the agent's own trajectories, and finally, distilling beneficia…
ResMerge: Residual-based Spectral Merging of Large Language Models
ResMerge addresses the challenge of merging large language models trained with reinforcement learning (RL). Unlike previous methods that focus on high-energy spectral components, ResMerge recognizes that RL task vectors have both a concentrated "head" and a dispersed "residual" component, both containing valuable infor…
TVIR: Building Deep Research Agents Towards Text--Visual Interleaved Report Generation
This paper introduces TVIR, a benchmark and agent framework for generating research reports that integrate text and visuals. TVIR-Bench comprises 100 tasks requiring visually supported analysis, while TVIR-Agent is a multi-agent system that retrieves and generates relevant images and charts. The contribution lies in ad…
Unified Context Evolution for LLM Agents
This paper introduces Unified Context Evolution (UCE), a framework for LLM agents that addresses the loss of learned strategies between tasks. UCE externalizes agent experience into a typed library of "Evolvable Context Units" (ECUs), categorized into Memory, Strategy, Workflow, and Skill. This system dynamically gener…
AGENTCL: Toward Rigorous Evaluation of Continual Learning in Language Agents
This paper introduces AgentCL, a rigorous evaluation framework for continual learning in language agents. Its core method involves constructing controlled, compositional task streams that allow for the systematic reuse of prior sub-solutions and evidence. AgentCL's main contribution is enabling a deeper understanding o…
AgentPLM: Agentic Protein Language Models with Reasoning-Augmented Decoding for Protein Sequence Design
AgentPLM introduces a novel approach to protein sequence design by augmenting traditional language models with a reasoning and feedback loop. Its core method, Reasoning-Augmented Decoding (RAD), interleaves sequence generation with calls to biophysical simulation tools. This allows the model to iteratively refine seque…
Bridging the Last Mile of Time Series Forecasting with LLM Agents
This paper addresses the "last-mile forecasting" problem, where raw statistical forecasts are revised with unstructured business context. The core method is an LLM-agent framework that sits atop a forecasting backbone, using tools to retrieve contextual evidence and perform reasoned forecast revisions under safety cons…
ClinEnv: An Interactive Multi-Stage Long Horizon EHR Environment for Agents
ClinEnv is an interactive benchmark designed to evaluate LLMs as attending physicians in a simulated inpatient setting. Its core method involves presenting agents with real patient admissions as a sequence of decision stages, requiring them to actively query specialized agents for information before making irreversible…
Harness-1: Reinforcement Learning for Search Agents with State-Externalizing Harnesses
This paper proposes Harness-1, a reinforcement learning search agent that offloads routine state management to an external "harness." The harness handles complex bookkeeping like candidate pools and evidence tracking, allowing the policy to focus on semantic search decisions. This separation improves learning efficienc…
HLL: Can Agents Cross Humanity's Last Line of Verification?
This paper introduces Humanity's Last Line of Verification (HLL), a benchmark designed to test if multimodal AI agents can bypass CAPTCHAs, which are human-verification barriers. HLL uses interactive CAPTCHAs and controlled stressors to evaluate agents' ability to perform human-like interactions, not just recognition, …
Iteris: Agentic Research Loops for Computational Mathematics
Iteris is an agentic AI system designed to tackle open problems in computational mathematics. Its core method involves generating numerical evidence, constructions, and proof drafts, which are then refined by human experts. The paper's contribution is demonstrating Iteris's capability to produce verified results on cha…
MCP-Persona: Benchmarking LLM Agents on Real-World Personal Applications via Environment Simulation
This paper introduces MCP-Persona, a novel benchmark for evaluating LLM agents on real-world personal applications that use the Model Context Protocol (MCP). Unlike existing benchmarks, MCP-Persona focuses on personalized tools like social media and collaboration suites. The benchmark reveals that current state-of-the-…
Mitigating Perceptual Judgment Bias in Multimodal LLM-as-a-Judge via Perceptual Perturbation and Reward Modeling
This paper addresses "Perceptual Judgment Bias" in multimodal LLMs used as judges, where they favor plausible text over visual accuracy. The core method involves creating a dataset of minimally perturbed visual examples to isolate perceptual errors and then training a reward model using a GRPO-based approach and batch …
Moment-Video: Diagnosing Temporal Fidelity of Video MLLMs on Momentary Visual Events
This paper introduces Moment-Video, a new benchmark designed to evaluate how well video multimodal large language models (MLLMs) can understand brief, critical visual events. The core method involves creating questions that hinge on short-lived visual occurrences, testing the models' ability to detect and reason about …
Not All Errors Are Equal: A Systematic Study of Error Propagation in Large Language Model Inference
This paper introduces LLMFI, a novel fault-injection framework, to systematically study how soft errors propagate during Large Language Model (LLM) inference. By injecting faults across various LLMs and tasks, the study reveals critical vulnerability patterns and provides practical, low-overhead software-only solutions…
POIROT: Interrogating Agents for Failure Detection in Multi-Agent Systems
POIROT is a novel protocol that uses the agents within a Multi-Agent System (MAS) itself to detect failures, rather than relying on external evaluators. This "interrogation" approach leverages the inherent diversity of the agents' knowledge to identify issues like hallucinations. POIROT significantly outperforms tradit…
Repurposing Adversarial Perturbations for Continual Learning: From Defense to Active Alignment
This paper proposes AdvCL, a novel continual learning method that repurposes adversarial perturbations to stabilize model adaptation. By employing three plug-in modules (Intra-Smooth, Proto-Clip, and Inter-Align), AdvCL promotes local smoothness, prevents over-alignment to new tasks, and actively aligns representations…