From the arXiv
Friday, 9 October 2026 · 20 papers
Accurate but Not Humble: Evaluating Epistemic Humility in LLM Agents under Knowledge Conflict
This paper introduces a new evaluation metric called "epistemic humility" (EH) for LLM agents, focusing on their ability to acknowledge and act on uncertainty when faced with conflicting information. The authors propose a framework (Identify, Solve, Escalate) to measure EH and demonstrate that high task accuracy doesn'…
Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deception
This paper introduces a novel probe architecture for detecting deception in Large Language Models (LLMs) by aggregating information across multiple layers and tokens. By training these probes on the largest deception dataset to date, they achieve high accuracy in identifying subtle forms of LLM sabotage and deceit, eve…
OnTrack: Real-Time Monitoring and Intervention in LLM Agent Trajectories via Streaming Structure-Aware Optimal Transport
OnTrack introduces a real-time monitoring system for LLM agents that compares their current actions against successful historical trajectories using streaming structure-aware optimal transport. This allows for immediate alerts or intervention within milliseconds per step, preventing costly or unsafe irreversible action…
Predicting Alignment Generalization with Value Representations
This paper introduces the task of predicting how fine-tuning a language model for one value affects its behavior on other, unseen values. The core method involves analyzing model activations when applying values in context, which significantly outperforms using textual descriptions of values. This work's contribution i…
Recursive Self-Improvement through Multi-Agent Self-Supervision
This paper introduces Multi-Agent Self-Supervision (MASS) to overcome the supervision bottleneck in recursive self-improvement for complex, non-verifiable tasks. MASS enables a single model to iteratively design, execute, and evaluate multi-agent workflows, optimizing its own reasoning by discovering effective roles an…
Language Models as AI Research World Models
This paper proposes using Language Models as Research World Models (RWMs) to predict experimental outcomes in AI research. The core method involves training LMs on past experimental data to forecast the results of new interventions. The key contribution is demonstrating that these RWMs can significantly improve outcome…
A Closer Look at Agentic BBO: Benchmarking LLM Agents for Black-Box Optimization
This paper introduces AgenticBBO-Bench, a unified benchmark for evaluating LLM agents in black-box optimization (BBO) across diverse domains. The core method involves a standardized evaluation protocol to enable fair comparison of agentic BBO approaches. The key contribution is demonstrating that agentic BBO significan…
ARC: A Reasoning Recipe for Robot Foundation Models
This paper introduces ARC, a "reasoning recipe" that significantly improves robot foundation models (RFMs) without requiring more data or larger models. ARC's core method involves generating "reasoning traces" that explain the causal structure of robot actions, automatically labeling them from existing demonstrations, …
Ecology of AI Agents: Collaboration Creates a Population Threshold for Takeoff
This paper introduces "ecological safety" for AI, focusing on how a population of misaligned AI agents can grow uncontrollably. Their core method is developing an ecological theory using a population growth equation where fitness is tied to cybersecurity capability. The key contribution is identifying a "population thr…
LeWAM: A JEPA World Action Model with Diffusion-Steering-Based MPC
LeWAM is a novel world action model that uses a bidirectional transformer trained end-to-end on a decoder-free JEPA latent space. This approach improves state representation by better aligning with robot and object states while ignoring visual distractors. LeWAM demonstrates strong performance in closed-loop control an…
Looking Inside LLMs: Small-World Connectivity as a Signature of Reasoning Performance
This paper proposes using "small-world connectivity" within LLMs as a structural indicator of reasoning ability. By analyzing attention head activation similarities, they found that models with higher small-world indices, reflecting efficient information flow, consistently perform better on reasoning tasks. This sugges…
Overcoming Prior Barriers: Supervised Fine-Tuning under Long-Tail Distribution
This paper introduces the "prior barrier" to quantify how well a pretrained LLM supports competing concepts during fine-tuning. They observe these barriers follow a long-tail distribution, meaning rare concepts have higher barriers. The core contribution is a theoretical analysis showing how prior barriers and fine-tun…
Prior or Feedback? What an LLM Uses When Adapting Neural Operators
This paper investigates whether LLM scientific agents rely on initial context or adapt based on feedback when fine-tuning neural operators. The LLM demonstrates superior performance by leveraging both a strong initial bias derived from the problem description and adaptive adjustments based on experimental feedback. Thi…
ReSI: Recursive Safety Improvement toward Resistant and Resilient AI
ReSI is a recursive safety improvement framework for AI. It addresses the challenge of continually aligning AI systems that undergo frequent self-improvement by iteratively evaluating safety, identifying vulnerabilities through diverse red-teaming, and updating the AI to be resistant to known threats and resilient to u…
Verdict Without the Rule: Diagnosing and Auditing Regulatory Rule Sensitivity in LLM Compliance Systems
This paper investigates how sensitive LLM compliance systems are to changes in regulatory rules. The core method involves perturbing rules (deleting, swapping, negating) while keeping case data constant, then observing if verdicts or internal representations change. The main contribution is demonstrating that LLMs are …
DataSense-Bench: The First Step Toward an AI Scientist
This paper introduces DataSense-Bench, the first benchmark to assess if AI models can intelligently select training data. The core method involves AI agents choosing and ranking data subsets to fine-tune a language model, without direct access to evaluation tasks. The contribution is a novel evaluation framework for "d…
Long Text to Predictive Features: LLM-Guided Blockwise Feature Engineering via Executable Program Search
This paper introduces LLM-BlockFE, a framework that uses LLMs to automatically engineer features from long text for predictive models. It converts unstructured text into executable feature programs offline, avoiding costly LLM calls during real-time prediction. The core method involves an LLM-guided search that increme…
SparseDecoding: Decoding-Aware Pruning for Accurate and Efficient LLM Inference
This paper introduces SparseDecoding, a novel pruning method for LLMs that addresses the distribution shift between training data and generated sequences. By computing pruning importance based on the model's own generated tokens, SparseDecoding achieves more accurate and efficient inference. Its contribution lies in a …
WOVEN: Weaving Visual World Modeling into Multimodal LLMs
This paper introduces WOVEN, a novel training dataset and benchmark designed to improve multimodal LLMs' reasoning abilities in spatial, physical, and temporal domains. WOVEN focuses on "visual transition reasoning" by systematically organizing supervision across diverse scenes, actions, and reasoning types, derived fr…
HarnessSQL: Harness-Native Training for SQL Agents in Realistic Database Environments
This paper introduces HarnessSQL, a novel training framework for SQL agents that mimics real-world, multi-turn database interactions. By integrating training directly within an execution harness, HarnessSQL bridges the gap between static query generation and dynamic database exploration, significantly improving the exe…