From the arXiv
Friday, 21 August 2026 · 20 papers
Break It Down, Pass It On: Cross-Task Skill Transfer in LLM Agents
This paper investigates how LLM agents learn and reuse skills across tasks. The core method involves comparing different skill induction strategies: task-level vs. subtask-level and text vs. code formats. The key contribution is demonstrating that subtask-level skill induction and text-based skill representation lead t…
Optimal Skill Selection for LLM Agents with Provable Bicriteria Guarantees
This paper addresses the challenge of selecting optimal skills for LLM agents within a limited context window. The authors propose a novel optimization framework that balances skill benefit against token cost, moving beyond independent skill scoring. Their developed algorithm, Best Prefix Selection (BPS), provides the …
FormalTCS: Benchmarking End-to-End Frontier Formal Theoretical Computer Science Research of Large Language Models
This paper introduces FormalTCS, an expert-validated benchmark for evaluating LLMs on realistic, end-to-end theoretical computer science research tasks. It comprises 175 instances from top TCS conferences, preserving original definitions and proof structures with formal Lean verifications. The benchmark reveals that cu…
AI4AI-Bench: Benchmarking LLM Agents in Algorithmic Design for Recursive Self-Improvement
This paper introduces AI4AI-Bench, a novel benchmark designed to evaluate Large Language Model (LLM) agents' ability to design training algorithms for recursive self-improvement (RSI). The core method involves agents modifying existing training algorithms within frozen research repositories, with their rewritten code t…
DARS: Dual-Level Credit Assignment RL with Structured Reasoning for Instruction-Based Image Editing
This paper introduces DARS, a reinforcement learning framework for instruction-based image editing. DARS addresses the inefficiency of traditional training by employing dual-level credit assignment. It achieves this by using multi-plan, multi-render rollouts to estimate reward variability for module routing and adaptiv…
From Agent Behaviour to Agent-Friendly Documentation: An Empirical Study of How Coding Agents Discover, Read, and Write Technical Documentation
This paper empirically studies how coding agents interact with technical documentation. It reveals that agents primarily consult agent-facing artifacts like instruction files and working notes, rather than traditional technical documentation or API references. This finding challenges current documentation practices, su…
Inject, Align, Recover: Staged Post-Training for Retrieval-Free Document Knowledge Internalization
This paper introduces IAR, a three-stage post-training method for enabling large language models to answer questions from a fixed document set without retrieval. IAR first injects document knowledge through specialized objectives, then aligns the model with question-answering behavior using answer-only supervision, and…
Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts
This paper introduces a compute-efficient method to transfer optimal learning rates for large Mixture-of-Experts (MoE) models. It first demonstrates that optimal learning rates are consistent across width-scaled MoE models using a novel parameterization. Then, it extrapolates these findings to trillion-token training h…
Manifold Drift in Flow Preference Optimization: A Root Cause of Reward Hacking
This paper identifies "manifold drift" as a key cause of reward hacking in continuous-time generative model alignment. The authors show that standard preference optimization can push generated samples off the original data manifold. They propose ThermoDPO, a temperature-controlled objective that anchors preference upda…
MemTrapBench: Benchmarking Cognitive Traps in LLM Memory Use
This paper introduces MemTrapBench, a novel benchmark designed to evaluate how retrieved memories can negatively impact LLM reasoning and performance, a phenomenon termed "cognitive traps." The core method involves testing for Reasoning Fixation and Belief Distortion, revealing that current memory frameworks often degr…
MidTool: Mid-training Data Synthesis for Agentic Tool Use
This paper introduces MidTool, a method for synthesizing data during the mid-training phase of large language models to improve their general tool-use capabilities. MidTool combines diverse real-world data with synthesized supervision to teach models how to effectively recognize, utilize, and compose tools. The contrib…
ReguSim: Evaluating LLM Agent Rule Grounding in Financial Compliance
This paper introduces ReguSim, a controlled environment and benchmark (ReguBench) to evaluate how well LLM agents in finance adhere to compliance rules. Their core method separates reasoning, action, enforcement, and evidence to analyze rule grounding. The key contribution is framing financial compliance evaluation as …
Rule-Compliant Visual Spatial Planning for Multimodal Large Language Models
This paper addresses the challenge of MLLMs performing visual spatial planning under complex, novel rules. Their core method involves the RuleMaze benchmark and a Language-Logic-Function Hybridization approach to automatically generate and validate rules. The contribution is a framework that enables MLLMs to understand…
The Third Restructuring of Software Form: From the Three-Tier Architecture to Storage, Models, and Agents
This paper proposes Software 3.0, a new paradigm where context and reasoning drive software behavior. Its core method is the convergence of three elements: a generalized database for state, a large model for reasoning, and an agent for execution. This shift restructures traditional software architectures by integrating…
Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Design
This paper introduces RGA-Designer, a method for efficiently designing communication topologies in multi-agent systems. It builds upon autoregressive graph generation by incorporating a reinforcement learning-inspired reward model that incentivizes both task accuracy and structural sparsity. This approach successfully …
ConceptGuard: Benchmarking Context-Sensitive Unlearning in Large Language Models
This paper introduces **ConceptGuard**, a novel benchmark for evaluating context-sensitive unlearning in LLMs. Its core method focuses on **dual-use concepts**, which have both harmful and benign applications, to assess if LLMs can selectively remove unsafe knowledge while retaining beneficial uses. The key contributio…
Multi-Agent Orchestration with the Common-Sense Reasoning Capabilities of LLMs for Autonomous Driving
This paper proposes a hybrid framework for autonomous driving that combines reinforcement learning (RL) and PID control, orchestrated by a Large Language Model (LLM). The LLM provides common-sense reasoning to guide the control modules and iteratively refines the RL reward function, enhancing adaptability to dynamic en…
When Text and Numbers Disagree: Evidence Arbitration in Large Language Models
This paper introduces a synthetic benchmark to study how Large Language Models (LLMs) resolve conflicts between textual and numerical evidence. The core method involves creating controlled scenarios where one evidence source is correct and the other is not, allowing for systematic analysis of LLM arbitration. The key c…
A three-dimensional typology of agency for advanced AI systems
This paper introduces a novel three-dimensional typology to categorize the agency of advanced AI systems. It distinguishes agency based on its nature (moral/legal), mode (individual/collective), and locus (human/non-human). This framework allows for a more nuanced understanding of AI agency, particularly non-moral form…
Bringing analytic rigor to agentic AI for science: The Brain Researcher platform for neuroimaging data analysis
This paper introduces Brain Researcher, an agentic AI platform designed to bring analytic rigor to scientific AI. Its core method involves operating within a researcher's environment under strict rules for admissible analyses, checks, and claim scope. The key contribution is demonstrating how this framework significant…