From the arXiv
Thursday, 17 September 2026 · 20 papers
A Zeroth-Order Paradigm for LLM Preference Alignment
This paper introduces Comparison-based Preference Optimization (ComPO), a novel zeroth-order method for aligning LLMs with human preferences. Instead of relying on direct optimization of differentiable losses, ComPO extracts directional information from preference pairs using comparison oracles. This approach offers co…
CERA-MoA: Co-Evolving Routing Mechanisms with Continually Learning LLM Agents
CERA-MoA introduces a novel iterative reinforcement learning framework that co-evolves a dynamic router with continually learning LLM agents. Its core contribution is a predictive familiarity estimator that uses mid-layer hidden states to assess agent competence, enabling a cumulative-threshold adaptive routing mechani…
Cognitive Extensions for Dual-Process Language Agents: Memory and Self-Reflection in Interactive Environments
This paper introduces cognitive extensions, an Adaptive Memory Module (AMM) and a Self-Reflection Module (SRM), to enhance dual-process language agents in interactive environments. The AMM provides salience-gated memory, while the SRM offers execution-time validation and correction. The full system, incorporating both …
Higher-order pruning of experts in mixture-of-experts language models
This paper introduces HOPE (Higher-Order Pruning of Experts), a novel method for reducing the parameter count in Mixture-of-Experts (MoE) language models. Unlike prior methods that prune experts independently, HOPE considers the cooperative nature of expert usage by employing a second-order pruning objective. This appr…
Hypothesis-Driven Autonomous Materials Synthesis with Multimodal LLM Agents
This paper introduces SynAgent, a framework for autonomous materials synthesis that uses multimodal Large Language Model (LLM) agents. Unlike traditional black-box optimizers, SynAgent's core method involves the LLM agents maintaining and evolving an explicit, hypothesis-driven understanding of the synthesis process. I…
Recursive Reasoning or Statistical Extrapolation? In-Context Learning in Multi-Agent Interdependent Decision-Making
This paper investigates whether in-context learning (ICL) in LLM agents performing interdependent decision-making relies on genuine reasoning or statistical pattern extrapolation. By testing LLM agents in games with manipulated historical feedback, they found that disrupting statistical patterns significantly degrades …
STRETCH the Boundaries: A Unified Self-Taught Framework for Progressive LLM Evolution
STRETCH is a unified framework for progressive LLM self-improvement that addresses capability stagnation by dynamically adjusting challenge difficulty. Its core method, the Stretch Zone mechanism, uses a dual-loop co-evolution of a Scaffolder and a Learner within a single parameter space. This approach promotes stable …
Ask the Tool, Don't Guess: Agent Tool Calls Hold Their Progress, and the Serving System Should Read It
This paper addresses the inefficiency of agent systems waiting for tool execution by proposing that tools explicitly report their progress. Instead of guessing tool durations, the system can dynamically manage GPU memory based on real-time progress signals. This approach recovers valuable KV cache memory without negati…
ASLEval: Measuring Privacy Exposure Displacement in LLM Agent Sessions
This paper introduces "privacy exposure displacement" to address limitations in evaluating LLM agent privacy. Their framework, ASLEval, measures the mismatch between local privacy checks and actual data exposure across multi-step sessions. This approach reveals significant privacy leaks missed by traditional methods, h…
Beyond Outcomes: Dual-View Relational Learning for Efficient Agent Benchmarking
This paper introduces DualViewEval, a novel method for compressing agent benchmarks. It addresses the high cost of evaluating agents by jointly learning from both final outcomes and complementary process signals observed in agent trajectories. This dual-view approach allows for more efficient and accurate prediction of…
Beyond Truncation: Rethinking LLM Decoding as Ensemble Pruning
This paper proposes Mahalanobis-Ensemble Decoding (ME-Decoding), a new LLM decoding method that views token selection as pruning an ensemble of candidates. Unlike previous approaches that ignore semantic relationships between tokens, ME-Decoding uses Mahalanobis distance to identify and discount redundant candidates, p…
Clueing up LLMs with Tool-Augmented Deductive Reasoning
This paper introduces a novel benchmark, a text-based Clue game, to evaluate multi-step deductive reasoning in LLMs. The core method involves instantiating LLM agents that play the game, requiring them to infer hidden information, maintain logical consistency, and update beliefs over multiple turns. The contribution li…
Compositional Policy Violations: When Step-Level Compliance Fails In Agentic AI Workflows
This paper introduces "Compositional Policy Violations" (CPVs), a new failure mode in agentic AI workflows where individual steps comply with policies, but the overall execution violates them. The core method is defining and categorizing CPVs, highlighting the inadequacy of step-scoped governance for complex, multi-ste…
Reasoning through Evolution: Automatic Meta-path Discovery for LLM-based Fake News Detection
This paper proposes MAGER, a novel framework that uses a multi-agent genetic evolution approach to automatically discover optimal meta-paths within news propagation graphs. These discovered meta-paths effectively compress complex graph structures into informative subgraphs, overcoming the modality mismatch and informat…
Rethinking Critic Learning in PPO: Understanding and Mitigating Value Flattening
This paper identifies "Value Flattening" as a failure mode in PPO critics for large language models, where estimated state values are overly smooth compared to actual returns. This phenomenon is linked to implicit variance penalties and redundant updates. The authors propose SP$^3$O, which applies the value loss to spa…
Which LLM is Best for Translating Natural Language Goals to PDDL
This paper investigates the effectiveness of Large Language Models (LLMs) in translating natural language testing goals into the formal PDDL language for automated planning. The core method involves a carefully designed prompt template to assess six state-of-the-art LLMs on accuracy, speed, and error rates using real-w…
Preventing Model Collapse: A Fisher-Rao Perspective on the Dynamics of Training with Synthetic Data
This paper provides a theoretical framework to prevent "model collapse" in LLMs trained on synthetic data. By analyzing training dynamics through the lens of Fisher-Rao geometry, it establishes rigorous guarantees on the minimum proportion of real human data needed to maintain training stability and prevent models from…
ScienceIDE: Turning World's Scientific Codebase into Agent Learnable Environments
ScienceIDE addresses the "scientific experience bottleneck" by transforming scientific code repositories into agent-learnable environments. Its core method involves agents, guided by expert-defined cases and criteria, converting code into executable environments for task generation, execution, and verification. The pap…
Affora: A Design System for Agent-Friendly Interfaces
Affora is a design system that makes software interfaces understandable to both human users and computer agents. Its core method involves defining interaction meanings within interface components, allowing agents to interpret task states and actions while preserving visual design freedom for humans. The contribution is…
Flag Game: A Toy Model for Mechanistic Swarm Interpretability
The Flag Game is a toy model designed to understand how AI agents form collective beliefs. Agents observe private data, share beliefs, and weigh social evidence to infer a hidden truth. The paper's contribution lies in demonstrating how this simple model reproduces complex emergent phenomena like performance scaling wi…