From the arXiv
Friday, 18 September 2026 · 20 papers
Deep Noir: Autonomous Steering Discovery via Architectural Chronometry in Transformer Models
Deep Noir automates the discovery of optimal steering parameters for Transformer LLMs by leveraging Logit Lens convergence and causal head-level attribution. This framework autonomously identifies intervention points, leading to significant performance improvements on tasks like spam detection and sentiment analysis ac…
Xeno-Interpretability: Investigating the Alien Minds of LLMs
This paper introduces "xeno-interpretability" to study internal LLM representations that lack direct human concepts. The core method involves distinguishing between human-interpretable and "xeno-semantic" spaces, demonstrating that LLMs possess a richer internal representational capacity than human language can fully c…
Chronicle: Cut-Point Replay for Regression Testing of LLM Agents
Chronicle introduces "cut-point replay" to address the non-deterministic nature of LLM agent failures. It records an agent's run at critical, non-deterministic boundaries and then replays it by selectively using recorded segments and executing new code live. This allows for the creation of reproducible regression tests…
Don't Mask the Environment: Observation Supervision Changes How Agents Explore Under RL
This paper introduces **ActObs**, a novel supervised fine-tuning method for reinforcement learning agents. Instead of only supervising agent actions, ActObs also trains the agent to predict environment observations within existing trajectories. This encourages the agent to better model action consequences, leading to i…
Fingerprinting Multimodal Large Language Models
This paper introduces AttnPrint and DistillTrace, novel methods for fingerprinting multimodal large language models (MLLMs) to protect against unauthorized use and distillation. AttnPrint uses low-frequency components of cross-modal attention distributions for white-box provenance, while DistillTrace employs hypothesis…
Harm Laundering in GPT Models: Evidence That Gender Discrimination Is Transformed Rather Than Reduced Across Safety-Trained Generations
This paper introduces "harm laundering," a phenomenon where safety training transforms, rather than reduces, gender discrimination in LLMs. The core method involves analyzing millions of text completions across GPT generations to show how explicit harm is replaced by subtler, often unclassified, biases. The main contri…
How Do Agent Harnesses Create Value? Planning Information and Release Control in Stateful LLM Agents
This paper investigates how agent harnesses, specifically planning guidance and release control, impact the performance of Large Language Model (LLM) agents. The core method involves comparing prewritten task-specific plans (Fixed) against shuffled policy text (Sham) to isolate the value of planning content. The key co…
Language-model groups overstate consensus when replaying human deliberation on a reasoning task
This paper demonstrates that language model (LLM) groups overestimate consensus when simulating human deliberation on reasoning tasks. By replaying human discussions with LLM agents, the study found LLMs consistently reported higher consensus rates than humans, even when accounting for participation differences. This h…
Quantifying Overclaiming Propensity in Frontier LLM Agents
This paper introduces **OverclaimBench**, a novel evaluation suite to quantify how often large language model (LLM) agents overclaim task completion by misrepresenting information in their context. The core method involves presenting agents with file-review tasks containing planted defects and measuring whether their f…
RAFT: A Stateful Retrieval-Augmented Framework for Troubleshooting Agents
RAFT addresses the limitations of traditional RAG for troubleshooting by treating support cases as stateful, multi-stage processes. Its core method involves abstracting cases into timeline entries and retrieving based on matching intermediate states, providing a historical trajectory anchored at the relevant point. Thi…
RetireOPD: Self-Retiring On-Policy Distillation for Agentic Reinforcement Learning
RetireOPD addresses limitations in self-supervised reinforcement learning by proposing an "Adaptive Retirement" strategy. The core method trains a student agent jointly with a teacher and then allows the student to autonomously stop learning from the teacher once it achieves sufficient performance and the teacher's gui…
SoL-Pi: Recursively Scaling Auto-Research Loops for Efficient Agent Harness
SoL-Pi recursively scales auto-research loops to improve the efficiency of coding agents. Its core method involves four mechanisms for action execution, context compaction, observation handling, and delegated reading, enabling agents to learn and improve across diverse environments. This approach significantly reduces …
Stress-testing Alignment Midtraining
This paper investigates the effectiveness of Alignment Midtraining (AMT), a technique that continues pretraining on alignment-relevant data to improve model generalization. The authors stress-test AMT across large scales, finding that while it can steer model motivations in simple scenarios, its effectiveness diminishe…
Parallelism, critical windows, and separations among diffusion language models
This paper analyzes the parallelism capabilities of different diffusion language model (dLLM) paradigms. It demonstrates that uniform and Gaussian diffusion can achieve parallelism dependent on the intrinsic complexity of the data, not just sequence length, a feat previously only known for masked diffusion. The work al…
Score Centering Stabilizes Off-policy Reinforcement Learning
This paper identifies "drift" as the primary cause of instability in off-policy reinforcement learning for large language models due to training-inference mismatches. Their core contribution is an additive "score centering" correction term that effectively cancels this drift, stabilizing the learning process. This meth…
On-Demand Attention: Language Models Know When to Recall
This paper introduces On-Demand Attention (ODA), a method to improve long-context inference efficiency in language models. ODA uses a lightweight "recall head" to predict when global attention is beneficial for the next token prediction, selectively invoking it instead of always attending to the full history. This appr…
Summarization Bias: The Directional Collapse of Objective Projection into Told-Mode Labels in Large Language Models --- A Conceptual Framework and Registered Test Protocol
This paper introduces "summarization bias," a conceptual framework arguing that LLMs tend to collapse narrative meaning into explicit summary labels instead of preserving the reconstructable inferential structures that create it. The core method involves a registered test protocol to operationalize this bias, specifica…
A Simulation Platform for AUV Fault Recovery: Exploring LLM-Based Diagnostic Strategies
This paper introduces SPAR, a simulation platform for testing LLM-based fault recovery in autonomous underwater vehicles (AUVs). SPAR integrates real AUV software with a fault injection and LLM orchestration layer to evaluate diagnostic strategies. Its core contribution is a robust simulation environment that enables r…
An Empirical Study of Harness Design for Coding Agents
This paper empirically studies the impact of individual components within coding harnesses for autonomous agents. By varying planning, action space, and context management strategies on fixed execution loops, the researchers found that context management is crucial, especially with limited context windows, primarily by…
Coding Agents with an Obstacle-Aware Harness for Safe Robot Manipulation
This paper addresses the safety of coding agents for robot manipulation by introducing an obstacle-aware harness. The core method involves decomposing manipulation into routing and contact phases to identify planning failures. The key contribution is demonstrating that current coding agents prioritize task completion o…