From the arXiv
Friday, 7 August 2026 · 20 papers
ECHO: A Locally-Deployable Agentic Health Assistant with Temporal Memory, Safety Guardrails, and Speech Assessment
ECHO is a locally-deployable health assistant for chronic care that uses an agentic chatbot with temporal memory and clinical tools. Its core contribution lies in its robust safety system, combining a fast rule-based layer with a GNN for accurate clinical intent classification, ensuring secure and effective long-term h…
Learning Globally Reusable Skills for Coding Agents
This paper introduces GSE, a framework for improving LLM coding agents by evolving skills globally. Unlike local updates, GSE uses a Skill Relation Graph to model inter-skill relationships and cluster-based consolidation to abstract reusable capabilities, enhancing generalization and preventing overfitting. This approa…
TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories
TrajDebug is a framework designed to pinpoint the root cause of failures in long, complex trajectories generated by LLM-based agents. It addresses challenges of scattered evidence and multiple local errors by using multi-granularity history compression and evidence-based identification. The core contribution is tracing…
A Six-Dimensional Taxonomy of Post-Training Adaptation Techniques with Applications in AI Governance
This paper introduces a six-dimensional taxonomy to systematically categorize and understand the diverse landscape of post-training adaptation techniques in machine learning. Its core contribution lies in providing a unified framework that clarifies distinctions between similar methods and illustrates the evolution of …
The Bitter Lesson of Tool Calling
This paper introduces Programmatic Tool Calling (PTC), a method that allows LLMs to use tools by invoking them as typed Python scripts, enabling natural chaining and parallelization. Empirically, PTC matches or surpasses traditional JSON tool calling across most tested models, significantly improving performance for so…
Training-Free Token-Level Steering for LLM Personalized Co-Writing
This paper introduces SteerWrite, a training-free framework for personalized LLM co-writing. Its core method achieves token-level steering without gradient updates, making it efficient for small datasets and specialized domains. SteerWrite's contribution lies in enabling personalized co-writing with reduced human editi…
Benchmarking the Benchmarks: Evaluating Benchmarks for Conversational Agents
This paper introduces a novel, reference-free framework that leverages LLM judges to evaluate the quality of conversational agent benchmarks. The core method assesses benchmark consistency, complexity, and policy coverage, providing actionable diagnostics of weaknesses. The contribution lies in offering a practical and…
Contextual Information Policy Optimization for Search Agents
This paper introduces Contextual Information Policy Optimization (CIPO), a novel reinforcement learning framework for search agents. CIPO addresses the problem of agents relying too heavily on internal knowledge by explicitly rewarding the grounding of their reasoning in retrieved external evidence at each step. This e…
DASH: Divergence-Adaptive Supervision Horizons for On-Policy Self-Distillation of Reasoning Models
This paper introduces DASH, a novel on-policy self-distillation method for improving reasoning in language models. DASH addresses the issue of sparse rewards in reinforcement learning by adaptively weighting token-level supervision based on the temporal context of divergence between a teacher and student model. This di…
EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning
EnvACE trains large language model agents for complex tool use by replacing costly environment interactions with "world rehearsal." The agent learns by alternating between generating tool calls and simulating the environment's responses to those calls, internalizing environment dynamics directly into its parameters. Th…
Evaluating Investment Logic in Large Language Models: A Real-World Benchmark Towards Personalzied Financial Agents
This paper argues that current evaluations of financial LLMs fail to capture personalized investment competence. They introduce \textsc{InvestLogicBench}, a novel benchmark using real-world investor data to evaluate LLMs based on their reasoning and decision-making process, not just profit. This allows for a more nuanc…
FinEvo-Bench: A Longitudinal Benchmark for Self-Evolving Agents in Professional Financial Workflows
FinEvo-Bench is a new benchmark designed to evaluate self-evolving financial agents by testing their ability to learn and improve across a series of interconnected, real-world financial tasks. Its core method involves a longitudinal design with 120 tasks across six financial domains, each with institution-defined proce…
HarnessOpt-Bench: Evaluating LLMs at Harness Optimization
This paper introduces HarnessOpt-Bench, a novel benchmark designed to evaluate Large Language Models (LLMs) in their ability to optimize "harnesses" – the surrounding code, prompts, and tools that enable LLMs to act as agents. The core method involves an LLM-based optimizer iteratively improving a given harness based o…
Poli-Bias: Understanding and Measuring Large Language Model Biases in International Political Conflicts
This paper introduces Poli-Bias, a novel counterfactual framework to measure political bias in LLMs. It systematically swaps country identities in legally equivalent conflict scenarios to reveal subtle disparities in framing and reasoning. Poli-Bias decomposes these differences into five dimensions, offering a nuanced …
When History Lies: Evaluating and Improving Tool Use under Misleading Multi-Turn Histories
This paper addresses how misleading multi-turn histories can cause tool-using AI agents to make incorrect decisions, even when they possess the correct underlying policy. The authors introduce a benchmark with synchronized "Original," "Polluted," and "Oracle" history views to isolate failure points. They then propose a…
MetaboLLM: a metabolomics-specialized large language model for biochemical knowledge integration and predictive metabolite graph construction
MetaboLLM is a specialized large language model designed to integrate fragmented metabolomics knowledge by adapting general LLMs through continual pretraining, fine-tuning, and structured retrieval. Its core contribution is enabling the construction of predictive metabolite graphs (MetaboLLM-GIN) from generated biochem…
On-Policy Self-Distillation without Any Supervision
This paper introduces Unsupervised On-Policy Self-Distillation (U-OPSD), a novel method for improving large language models without external supervision. U-OPSD leverages internal consistency by generating multiple outputs, identifying confident errors through majority voting, and then distilling a corrected version in…
SAGA: Score-Weighted Adaptive Generation Alignment for Low-Resource Nordic Language Models
SAGA is a novel framework that uses dependency parser outputs instead of human annotations to optimize low-resource language models. It converts parser judgments into preference pairs, combines parser quality with lexical diversity for rewards, and filters low-information pairs. This approach significantly improves gra…
RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning Transfer
This paper introduces RP-OPSD, a method to improve multilingual reasoning transfer in LLMs. It guides on-policy self-distillation by focusing on "reasoning pivots" – critical decision points in the reasoning process. By using the distributional shift between teacher views with and without an English reference, RP-OPSD …
AV-AIVAT: 74x Cheaper Agent Evaluation with Certified Anytime-Valid Stopping in Imperfect-Information Games
This paper introduces AV-AIVAT, a method for evaluating the relative strength of two agents in imperfect-information games. It combines a variance reduction technique (AIVAT) with anytime-valid stopping rules (Confidence Sequences) to achieve significantly cheaper evaluations. The core contribution is enabling evaluati…