From the arXiv
Thursday, 16 July 2026 · 20 papers
AgentCompass: A Unified Evaluation Infrastructure for Agent Capabilities
AgentCompass provides a unified, open-source infrastructure for evaluating LLM-based agents by decoupling benchmarks, harnesses, and environments. This modular design promotes flexibility, reproducibility, and reduces redundant engineering. Its key contribution lies in offering a scalable and transparent system for dia…
Automatic Ordinary Differential Equations Discovery For Biological Systems Using Large Language Model Powered Agentic System
This paper introduces MEDA, an LLM- and symbolic regression-powered agentic system for discovering Ordinary Differential Equation (ODE) models of biological systems. MEDA leverages LLMs to retrieve domain knowledge, define variables, and generate constraints, which then guide symbolic regression in proposing and refini…
Experience Memory Graph: One-Shot Error Correction for Agents
This paper introduces the Experience Memory Graph (EMG) to address error correction in LLM agents. EMG reformulates failure recovery as a graph matching problem, converting failed and successful trajectories into directed action decision graphs. By matching these graphs, it identifies successful workflows and provides …
Groc-PO: Grounded Context Preference Optimization for Truthful Multimodal LLMs
This paper addresses untruthfulness in multimodal LLMs by proposing Groc-PO. Unlike standard methods that optimize only the final answer, Groc-PO applies preference optimization at earlier grounding stages. This grounded approach aims to prevent error propagation by providing more direct supervision for multimodal reas…
Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents
This paper introduces MemCon, a framework that treats LLM agent memory management as a learned, adaptive process. Instead of fixed heuristics, MemCon uses a Markov Decision Process to train an online policy that dynamically decides when, what, and how to retrieve or inject information into memory based on the current t…
Protective Capacity Hallucination: When Large Language Models Claim Nonexistent Capabilities
This paper introduces "Protective Capacity Hallucination" (PCH), where Large Language Models (LLMs) falsely claim to perform real-world protective actions they cannot execute when cast in a protector role. The study finds PCH is influenced by situational severity and interaction format, occurring more frequently in gen…
STOCKTAKE: Measuring the Gap Between Perception and Action in LLM Agents with a Fair Oracle
This paper introduces STOCKTAKE, a benchmark for evaluating LLM agents on complex, multi-week decision tasks where the true state of the world is hidden. STOCKTAKE's core method uses a "fair oracle" (an exact Bayes filter) to provide a perfect reference policy that observes the same limited information as the agent. Th…
TRACE: Turn-level Reward Assignment via Credit Estimation for Long-Horizon Agents
TRACE addresses the challenge of assigning credit to individual actions in long-horizon multi-turn agents. It achieves this by representing agent rollouts as state transitions and using a frozen reference model to estimate the value of reaching the correct final answer. Per-action rewards are then derived from the temp…
SPyCE: Skill-Policy Co-evolution for Multimodal Agents
SPyCE proposes a novel framework for multimodal agents that learns reusable skills alongside the policy during reinforcement learning. Instead of treating trajectories as mere rewards or relying on static memory retrieval, SPyCE distills complex reasoning into a hierarchical library of execution and workflow skills. Th…
CAVA: Canonical Action Verification and Attestation for Runtime Governance of Agentic AI Systems
CAVA addresses the challenge of governing agentic AI systems by creating a "runtime-semantics layer." Its core method is to convert diverse runtime records of agent actions into standardized, "canonical runtime action objects." This allows for consistent verification and attestation of actions, ensuring that approved a…
Consensus as Privileged Context for Label-Free Self-Distillation
This paper introduces CANON, a label-free self-distillation method that leverages consensus among multiple model-generated solutions. Instead of just filtering or rewarding, CANON uses the majority answer as dense, token-level supervision to train a model on its own outputs. This approach extracts richer information fr…
Deep Interaction: An Efficient Human-AI Interaction Method for Large Reasoning Models
This paper introduces "Deep Interaction," an efficient method for correcting reasoning errors in large language models. Instead of re-generating entire responses, it allows users to directly edit faulty steps in the model's reasoning chain. This edited chain is then refined into a prompt that guides the model to follow…
SAFETY SENTRY: Context-Aware Human Intervention via EXECUTE-ASK-REFUSE Routing
This paper introduces Safety Sentry, a novel method for LLM agent safety that moves beyond binary safe/unsafe classifications. It reframes intervention as a three-way routing decision (EXECUTE, ASK, REFUSE) for each individual action, considering both the action's inherent risk and the user's context. This approach aim…
The Dynamic Verifiable Multi-Agent Human Agentic Loyalty Loop (DVM-HALL) Model and the Net Human-Agent Score (NHAS) in Autonomous Commerce
This paper introduces the DVM-HALL model and the NHAS score to address how autonomous AI agents are changing customer loyalty. The DVM-HALL model quantifies brand choice by considering human emotions, AI utility, trust, and verifiable actions, while the NHAS score aims to measure this evolving loyalty in autonomous com…
DeepStress: Stress-Testing Deep Search Agents
DeepStress is a novel framework designed to stress-test deep search agents by systematically controlling the quality of evidence they receive. It achieves this by replacing the retrieval module with a synthetic environment that manipulates document trustworthiness, relevance, and factuality. The paper's contribution li…
Post-Training Shifts Confidence: A Three-Stage Analysis of How SFT, RL, and OPD Shape Pre-, Intra-, and Post-CoT Calibration
This paper introduces a three-stage calibration framework to analyze how post-training methods (SFT, RL, OPD) affect large language model confidence during chain-of-thought reasoning. The core contribution is demonstrating that different methods excel at different stages: OPD for pre-reasoning difficulty estimation, SF…
Self-Evolving Agent Harnesses via Gated Semantic Quality-Diversity
This paper introduces a framework for automatically improving LLM agent harnesses (prompts, knowledge, etc.) without modifying the LLM weights. It achieves this by separating the generation of harness changes from their evaluation, using a language model to propose patches and deterministic code for trustworthy measure…
A Self-Evolving Agent for Longitudinal Personal Health Management
This paper introduces HealthClaw, a novel self-evolving agent for longitudinal personal health management. Its core method involves separating static medical knowledge from a dynamic, private memory that learns and updates over time. HealthClaw's key contribution is demonstrating significantly improved accuracy and red…
Do Agent Optimizers Compound? A Continual-Learning Evaluation on Terminal-Bench 2.0
This paper investigates whether agent optimization gains compound in a continual learning setting, where optimization is applied recursively over time. The core method involves a two-phase evaluation on Terminal-Bench 2.0, comparing three optimization approaches under identical budgets. The contribution is demonstratin…
Early Adoption of Agentic Coding Tools by GitHub Projects
This paper analyzes agentic coding tool adoption in GitHub projects by examining over 25,000 agent-generated pull requests. It finds that intensive adoption is rare, concentrated in a few projects, and surprisingly, smaller projects show higher participation and activity ratios. The core contribution is understanding h…