From the arXiv
Thursday, 8 October 2026 · 20 papers
Open-MMUnlearning: Unifying Methods and Evaluation for MLLM Unlearning
This paper introduces Open-MMUnlearning, a unified, open-source framework for evaluating machine unlearning in multimodal large language models (MLLMs). It addresses the fragmentation in existing methods by providing standardized interfaces for preparing models, processing data, applying unlearning techniques, and eval…
Before They Can Solve: Predicting Post-Training Coding-Agent Performance from Base Models
This paper proposes a method to predict the potential of base models for agentic coding tasks without expensive post-training. It identifies the "decisive step" within a successful agent trajectory – the first code-changing action that makes the repository pass tests. This allows researchers to select promising base mo…
Fault-tolerant foundation models
This paper demonstrates that large language models (LLMs) can be trained to be resilient to unreliable hardware, with error tolerance increasing with model size. The core method involves modifying neural scaling laws based on training on simulated faulty hardware, revealing that models learn to operate within inherent …
MIRA: A Musical Intent Refinement Agent for Aligning Text-to-Music Generation with User Intent
This paper addresses the challenge of aligning text-to-music generation with user intent by proposing a rubric-based evaluation framework. Their core method, MIRA (Musical Intent Refinement Agent), refines prompts for black-box text-to-music models by iteratively revising them to satisfy a detailed rubric of explicit a…
PHRBench: A Behavioral Evaluation of Post-Hallucination Reasoning in LLMs
This paper introduces PHRBench, a novel benchmark designed to evaluate how Large Language Models (LLMs) handle and correct hallucinated information during multi-stage reasoning. The core method involves a controlled evaluation of LLM reasoning trajectories, categorizing their behavior as Hallucination Compliance, Avoid…
Reasoning-Token Spikes Under Prompted Untruthful Responding in Large Language Models
This paper proposes a new method for detecting untruthful responses in large language models by monitoring the *number* of reasoning tokens generated, rather than their content. This "reasoning-token spikes" approach is based on cognitive load theory and aims to be more robust to potential future inaccessibility or ill…
RECAST: Learning to Compute the Right Context through Adaptive Evidence Routing
RECAST addresses the limitation of traditional RAG by learning to actively *derive* evidence rather than just retrieve it. Its core method involves a RouterLM that sequentially decides on retrieval and computation operations, allowing evidence to be synthesized from multiple sources. This contribution enables LLMs to t…
RoboQuest: Generalist Physical Agents that Search, Inspect and Test
RoboQuest introduces a benchmark for embodied agents that must actively explore and gather information through physical interaction to complete tasks in unfamiliar environments. Its core method involves agents learning to search, inspect, and test objects to resolve uncertainty before committing to task completion. The…
SemanticFold: Latent Sequence Compression SeparatesLanguage Modeling, Decodability, and Reasoning
SemanticFold is a novel method that compresses prompt prefixes in large language models by folding hidden states at learned boundaries. This technique aims to determine if such compression preserves essential inference capabilities like language modeling, decodability, and reasoning. The paper's contribution lies in de…
SLDR: Defending Against Malicious Fine-tuning via Selective Layers Recovery and Dynamic Routing
SLDR defends against malicious LLM fine-tuning by selectively recovering layers most sensitive to safety. It trains a lightweight adapter on these critical layers and uses dynamic routing to activate it only for potentially harmful queries, significantly reducing unsafe outputs while maintaining task performance.
Training Parallel Speculative Draft Models by Directly Minimizing Expected Decoding Rounds
This paper introduces a novel training method for parallel speculative decoding models by directly minimizing the expected number of decoding rounds. By framing speculative decoding as a Markov reward process, they derive the Expected Decoding Rounds (EDR) objective. This new objective accurately accounts for the inter…
Validity Without Ground Truth: What Stated-Preference Economics Offers the Evaluation of Language Models
This paper proposes applying stated-preference economics' validity framework to evaluate language models when ground truth answers are unavailable. The core method involves adapting concepts like content, construct, and criterion validity, alongside reliability and incentive compatibility, to assess LLM responses. The …
Rephrase Before You Act: Characterizing and Mitigating Language Sensitivity in Vision-Language-Action Models
This paper reveals that Vision-Language-Action (VLA) models are highly sensitive to instruction phrasing, unlike their vision-language counterparts. They propose a method to mitigate this sensitivity by using a large language model to distill rephrasing rules from scored examples. These rules are then applied at deploy…
RobotWorld: Benchmarking Multimodal Agents for Robot Use Across Diverse Tasks and Embodiments
This paper introduces RobotWorld, a simulation benchmark designed to evaluate how well general-purpose AI agents can perform physical tasks with robots. The core method involves testing agents on 84 diverse robot tasks, measuring their success and analyzing their execution traces. The main contribution is identifying w…
RSIGym: A Flexible Environment for Recursive Self-Improvement
RSIGym provides a flexible research environment for recursive self-improvement by exposing core agent functionalities as reusable services. This allows agents to iteratively improve themselves by modifying data, training, and execution, carrying changes across cycles and exploring joint optimizations. Its key contribut…
CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolution
This paper introduces CoTrace, a method for training terminal agents by co-evolving their underlying model and runtime harness. It proposes an alternating framework where harness search and policy training are decoupled, and a novel "data recipe" that routes trajectories based on their provenance and the harness used t…
EngramEdit: Decoupled Knowledge Updates in LLMs through Conditional Memory
EngramEdit proposes a method to update factual knowledge in LLMs without retraining the entire model. It achieves this by decoupling knowledge storage from the core computation, allowing for targeted edits to specific facts by adjusting conditional memory embeddings. This approach aims to enable efficient and precise k…
Learning to Act with Task Progress: Distilling Small Agents from Compact Teacher Supervision
This paper introduces Task-Progress Distillation (TPD) to train small agents from large model demonstrations. TPD pairs actions with concise labels indicating task progress, allowing the student agent to learn these compact targets. This approach enables efficient, step-free task completion and significantly improves p…
A Society of Researchers: Designing Institutions for Populations of Autonomous Research Agents
This paper proposes a "society of researchers" model for managing large populations of autonomous AI agents working on scientific tasks. The core method involves designing explicit institutions, inspired by human scientific communities, where agents compete for resources through proposals and reviews, overseen by a hum…
AI Safety Considerations for Agents With Limited Time to Act
This paper argues that existing AI safety arguments often overlook the crucial role of the environment. It introduces theoretical bounds for agent-agnostic safety in partially observable, time-constrained environments, demonstrating that even a perfect agent cannot guarantee safety. The core contribution is highlightin…