From the arXiv
Wednesday, 2 September 2026 · 20 papers
EDGE: Error Dependency Graph-Guided Multi-Error Attribution in Multi-Agent LLM Systems
This paper introduces EDGE, a framework that addresses multi-agent LLM failures by explicitly modeling dependencies between multiple errors. EDGE constructs an error dependency graph and uses counterfactual reasoning to identify a reliable causal subset of errors. This graph-guided approach improves the accuracy of mul…
EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents
EmbodiedSkills is a unified framework for Vision-Language-Action (VLA) agents that treats skill decisions as executable proposals. It introduces a runtime that verifies skill prerequisites before execution and checks outcomes afterward, ensuring robust long-horizon task completion. This approach allows for flexible rep…
Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching
This paper evaluates Multimodal Large Language Models (MLLMs) as generalist agents for drone control by directly integrating them into the control loop with a prompt-defined action space. Their contribution is DroneCATS-Agent, a flexible architecture, and DroneCATS, a benchmark that tests MLLMs on complex vision-langua…
GlossoGen: Emergent Language in Complex Multi-Agent LLM Interactions
GlossoGen is a novel platform designed to study language evolution in complex multi-agent LLM interactions. The paper demonstrates that LLM agents, under pressure and with partial information, can develop compositional and morphologically productive languages that are incomprehensible to humans. Key factors enabling th…
Harness-of-Harness: Multi-Day Autonomous Software Development with Continual Improvement
This paper introduces Harness-of-Harness (HoH), a framework for multi-day autonomous software development using LLM coding agents. HoH enables continual improvement by organizing agents into iterative planning-coding-testing loops, balancing repair with capability growth and focusing on verifiable increments. Its core …
The Rise of Verbal Reinforcement Learning
This paper introduces Verbal Reinforcement Learning (VRL), a paradigm where natural language serves as the feedback mechanism for language agents. It unifies existing research by categorizing VRL based on when and what verbal feedback modifies, defining three core pillars: language as a grounding signal for task defini…
When Safety Routing Breaks: Understanding Alignment Fragility under Benign Fine-Tuning
This paper argues that safety alignment in LLMs is fragile due to a "routing pathway" in output-side MLP modules that is selectively re-sharpened by benign fine-tuning. This Fisher-geometric explanation posits that safety Fisher information is low-rank, and fine-tuning flattens the safety geometry while preserving this…
HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?
This paper introduces HarnessDev, a benchmark that evaluates an LLM's ability to create and improve its own agent execution infrastructure (harness). Instead of just assessing task outputs, HarnessDev measures how well the LLM can build and refine the underlying system that enables agent functionality. This contributes…
A Composable Evaluation System for Reproducible Omni-Modal Foundation Model Evaluation
This paper introduces OmniEvaluator, a system that addresses the challenge of evaluating omni-modal foundation models by unifying existing, incompatible evaluation toolkits. Its core method connects diverse inference engines and evaluation libraries through a single interface, enabling reproducible benchmarking across …
CordisBench: Can Language Models Reason About Component Lifecycles in Dynamic Agent Harnesses?
This paper introduces CordisBench, a benchmark designed to test language models' ability to reason about component lifecycles in dynamic agent systems where models can modify their own execution environment. The benchmark comprises 1,200 questions covering tasks like identifying affected components and predicting syste…
Designing Proactive Thought Partners for Writing
This paper introduces "proactive thought partners," AI agents designed to offer customizable, higher-level cognitive support during writing, moving beyond basic text suggestions. Through a user study, the research demonstrates that these partners can assist with planning, idea generation, and self-monitoring, with user…
Efficiently Estimating Optimal Hyperparameter Scaling Laws through Power-Law Entropy Search
This paper introduces Power-Law Entropy Search (PLES), a novel method for efficiently estimating optimal hyperparameter scaling laws for LLMs. PLES uses a cost-aware Bayesian optimization approach that adaptively experiments to reduce uncertainty in scaling law estimates, rather than optimizing a single objective. Its …
LEAP: Likelihood Elicitation and Aggregation for LLM-based Probabilistic Forecasting
This paper introduces LEAP, a novel method for LLM-based probabilistic forecasting that addresses the limitations of monolithic prediction. LEAP elicits likelihood parameters from individual evidence items separately and then aggregates them using an explicit prior and a deterministic probabilistic model. This approach…
Mechanism Design for Alignment and Control
This paper proposes a mechanism design framework for AI agents with unknown preferences and capabilities. The core method involves a one-sided imitation structure that incentivizes both honest reporting of preferences and obedience to instructions. The contribution lies in characterizing implementable policies and iden…
Selective Agent Guidance via Entropy: Learning Autonomous Policies from Imperfect VLM Teachers
This paper introduces SAGE, a framework for learning efficient autonomous policies from imperfect Vision-Language Model (VLM) teachers. SAGE selectively queries the VLM only when the learning agent is uncertain, distilling its guidance into a lightweight Reinforcement Learning policy. A key contribution is weighting VL…
Some Emotions Run Deeper: Layer-wise Probing and Causal Intervention in Large Language Models
This paper investigates how Large Language Models (LLMs) represent emotion by analyzing their internal layers across diverse text types. The core method combines layer-wise probing with causal interventions to understand where and how emotion information is processed. The key contribution is demonstrating that the dept…
When Guardrails Look Effective: Construct Validity Failures in LLM Agent Commerce Evaluation
This paper argues that current evaluations of LLM agents in simulated markets often suffer from construct validity failures, meaning observed economic outcomes don't truly reflect the intended agent behaviors. The authors demonstrate this by showing how seemingly positive welfare gains from marketplace guardrails disap…
Diffusion as a Training Curriculum for Timestep-Free Iterative Reasoning
This paper introduces a novel training curriculum for iterative reasoning models by adapting diffusion models. They achieve this by adding a persistent hidden state to a diffusion denoiser and removing timestep conditioning, allowing for arbitrary inference depth. This "anytime solver" demonstrates impressive accuracy …
mzCache: On-Device LLM Memory Management under Multitasking
mzCache addresses the challenge of on-device LLM performance degradation in multitasking mobile environments. Its core method is a novel memory management system that elastically evicts LLM memory and utilizes unified SoC memory for zero-wait GPU inference. The contribution lies in enabling concurrent CPU-side restorat…
The Structure of Quantization Damage in LLMs: Why the Next Bit Should Be Spent Globally
This paper investigates how quantization, a technique to reduce LLM size, impacts accuracy. It finds that quantization damage is generally spread across many layers, rather than being concentrated in specific "task circuits" or weight statistics. The core contribution is demonstrating that globally distributing a small…