From the arXiv
Monday, 5 October 2026 · 20 papers
Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability
This paper investigates whether efficient Chain-of-Thought (CoT) training harms faithfulness and monitorability in large language models. The authors fine-tune models using three distinct length-pressure methods and evaluate their impact on how well the CoT reflects the model's decision-making process. Their contributi…
FrugalEvo: Towards Cost-Aware LLM-Guided Program Evolution
FrugalEvo introduces a cost-aware evolutionary framework for LLM-guided program optimization. It leverages a two-tiered LLM approach, with a powerful LLM guiding strategy and a cheaper LLM implementing and refining code, to maximize performance gain per unit cost. The contribution lies in this cost-efficient design and…
HazardWeaver: Scientific Route Selection for Hazard Analysis Agents
HazardWeaver addresses the challenge of AI agents selecting appropriate scientific methods for hazard analysis by formulating it as state-dependent route selection. Its core method involves compiling evidence-linked conditions for scientific applicability and representing executable capabilities in a graph to check com…
HyperBrowseComp: A Multilingual and Multimodal Stress Test for Web-Browsing Agents
HyperBrowseComp is a new benchmark designed to rigorously test web-browsing agents. Its core method involves creating extremely challenging, multilingual, and multimodal questions that require agents to locate obscure information, follow complex clue chains, and synthesize data from diverse sources like videos and scan…
MobiAgent: Dual-Loop Recursive Policy Self-Improvement for Long-Horizon Mobile Manipulation
MobiAgent tackles long-horizon mobile manipulation by introducing a dual-loop framework for robust deployment and continuous self-improvement. The Inner Loop uses a Vision-Language Model to dynamically compose atomic skills for receding-horizon planning and error recovery. The Outer Loop recursively refines these skill…
NeutronGym: Physics-Graded Neutron Instrument Design for LLM Agents
NeutronGym is a novel, executable environment designed to test whether Large Language Models (LLMs) can truly perform physics-based design rather than just recall information. It allows LLM agents to build neutron instruments by validating tools, with McStas ray-tracing and a physics-graded ladder evaluating their crea…
IDRF: Inverse-Distilled Reward Fine-tuning of Masked Discrete Diffusion Models
This paper introduces IDRF, a framework for efficiently fine-tuning masked discrete diffusion models with rewards. IDRF replaces computationally expensive sequence-level KL divergence with an "inverse-distillation regularization" that is provably equivalent under optimal conditions. This allows for reward optimization …
UniIntervene++: An Adaptive Intervention Agent for Efficient Real-World Reinforcement Learning
UniIntervene++ introduces an adaptive intervention agent for online reinforcement learning in robots. It learns to dynamically switch between autonomous execution and various assisted behaviors by formulating them as "Options" within a unified semi-Markov decision process. This approach ensures interventions remain rel…
CLIMB: Confidence-Guided Complementary Evidence for Multimodal Retrieval-Augmented Generation
CLIMB is a training-free framework for multimodal retrieval-augmented generation (RAG) that improves knowledge-intensive visual question answering. It first creates a diverse pool of relevant textual evidence using a redundancy-reducing objective. Then, it refines the answer by selecting evidence based on relevance, sp…
Passing the Test You Trained On: Re-evaluating Prompt-Injection Detectors for LLM Agents
This paper re-evaluates prompt-injection detectors used by LLM agents, finding that their performance on public benchmarks doesn't reliably predict their effectiveness within actual agents. By replaying tool calls from agent benchmarks, the authors demonstrate significant performance discrepancies and poor transferabil…
4DCodeBench: Benchmarking Agents on Inverse Graphics of Dynamic Scenes
4DCodeBench is a new benchmark for evaluating AI agents' ability to perform 4D inverse graphics by generating executable code that reconstructs dynamic scenes from videos. The core method involves agents translating visual observations into compact representations of scene structure and dynamics, often requiring them t…
Credit Where It Matters: Dependency-Aware Policy Optimization for Terminal Agents
This paper introduces Dependency-Aware Group Policy Optimization (DepGPO) for reinforcement learning agents operating in terminal environments. DepGPO addresses the issue of irrelevant credit assignment by constructing a command dependency graph from execution traces. It then traces backward from task verification resu…
CVE2AP: Automated Generation of PDDL-Encoded Attack Paths via Large Language Models
CVE2AP automates the creation of formal attack path models in PDDL from natural language CVE descriptions. It leverages Large Language Models (LLMs) with structured prompting and an error-feedback loop to overcome the limitations of manual expert-driven modeling, enabling scalable and dynamic cybersecurity analysis.
Do Large Language Models Know Colombian Law? A Reliability Benchmark for the Colombian Legal System
This paper introduces a novel, expert-validated benchmark to assess the reliability of Large Language Models (LLMs) on Colombian law. The benchmark, comprising 1,042 questions across ten legal areas and three formats, reveals significant limitations: while LLMs can be relevant, their factual accuracy on free-text legal…
Jumping the Line: Exploiting Length Predictions in LLM Scheduling
This paper introduces JIL, an attack that exploits length predictions in LLM schedulers. JIL adds an adversarial suffix to requests, causing schedulers to underestimate their length and thus grant them higher priority. This manipulation leads to significantly faster completion times for adversarial requests.
Measure Less, Know More: Self-Supervised Test-Time Feature Acquisition
This paper proposes ECHO-$k$, a self-supervised method for efficiently acquiring relevant features from multimodal data at test time. It leverages a foundation model's internal representations as proxy targets to learn a task-agnostic policy for selecting the most informative modalities, thereby reducing acquisition co…
Threat-Preserving Representation Sensitivity in Agent-Security Benchmarks
This paper introduces Threat-Preserving Representation Sensitivity (TPRS) to evaluate how benchmark representations affect LLM agent security evaluations. TPRS measures changes in attack success rate (ASR) when only the agent-visible representation is altered, keeping other factors constant. The study demonstrates that…
When a Correct Reward Is Not Enough: Diagnosing and Guiding PPO in an Analytically Solved Broker-Trader Game
This paper investigates whether Proximal Policy Optimization (PPO) can effectively learn optimal strategies in a financial game with an analytical solution. The core method involves training a PPO agent to act as a broker in a broker-trader game, using a derived reward function. The contribution lies in demonstrating t…
Divergence controls entropy in distillation
This paper reveals that the choice of divergence function in distillation directly controls the student model's entropy. Specifically, forward KL divergence inflates student entropy, while reverse KL deflates it. This finding offers a new entropic perspective on distillation, explaining observed behaviors and highlight…
FALCON: A Model and Dataset Agnostic Framework for Synthetic Data Generation for NL2SQL Pairs
FALCON is a framework that generates realistic and ambiguity-aware synthetic NL-to-SQL data. It addresses the limitations of existing methods by producing complex queries that better reflect real-world challenges, using reserved-word SQL seeding and persona-based prompting. The framework's contribution lies in its abil…