From the arXiv
Wednesday, 10 June 2026 · 20 papers
Null-Space Constrained Low-Rank Adaptation for Response-Specified Large Language Model Unlearning
This paper introduces Null-Space Constrained Response-Specified Unlearning (NSRU), a method for unlearning specific knowledge from large language models while preserving general capabilities. NSRU achieves this by projecting low-rank adaptation updates into the null space of learned "retain" subspaces, ensuring that mo…
ReasonAlloc: Hierarchical Decoding-Time KV Cache Budget Allocation for Reasoning Models
ReasonAlloc addresses the KV cache bottleneck in LLM reasoning by dynamically allocating its budget. It uses a hierarchical approach: an offline strategy identifies an architecture-driven "Reasoning Wave" of demand across layers, and an online strategy reallocates resources to information-rich heads during decoding. Th…
Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolution
Role-Agent addresses LLM agent limitations by using a single LLM as both agent and environment for bootstrapped co-evolution. It employs World-In-Agent (WIA) for environment-aware reasoning via state prediction rewards, and Agent-In-World (AIW) to refine training data by analyzing and retrieving tasks based on failure …
Workflow-GYM: Towards Long-Horizon Evaluation of Computer-use Agentic tasks in Real-World Professional Fields
Workflow-GYM is a new benchmark designed to evaluate AI agents' ability to perform complex, long-horizon tasks within professional software environments, unlike existing benchmarks that focus on simpler applications. Its core contribution is to highlight the significant gap in current agent capabilities for real-world …
Flow-DPPO: Divergence Proximal Policy Optimization for Flow Matching Models
Flow-DPPO addresses limitations of existing RL methods for flow matching models by replacing noisy policy ratio clipping with a divergence proximal constraint. Its core method leverages the Gaussian nature of per-step policies in flow models to efficiently compute KL divergence, enabling more stable and effective polic…
Does Reasoning Preserve Alignment? On the Trustworthiness of Large Reasoning Models
This paper investigates whether training large language models for reasoning sacrifices their alignment with human values like safety and bias avoidance. The study finds that current reasoning model training methods often lead to "alignment regressions," meaning they become less trustworthy in these areas despite impro…
It Takes One to Bias Them All: Breaking Bad with One-Shot GRPO
This paper demonstrates that a single biased example, using Group Relative Policy Optimization (GRPO), is enough to systematically bias large language models. This bias then generalizes across various contexts, revealing a significant vulnerability in current LLM alignment methods. The core contribution is showing how …
Pushing the Limits of LLM Tool Calling via Experiential Knowledge Integration and Activation
This paper addresses LLM tool-use limitations by integrating and activating experiential knowledge. The core method involves acquiring instance-level knowledge, which proves more effective than abstract intent-level knowledge. For activation, parallel sampling with reasoning width expansion outperforms depth expansion,…
A History-Aware Visually Grounded Critic for Computer Use Agents
This paper introduces HiViG, a novel framework for improving computer use agents. HiViG addresses limitations of existing critics by incorporating both a history of past actions and visual grounding to evaluate agent decisions. This allows HiViG to provide more informed critiques, preventing errors like clicking incorr…
AuRA: Internalizing Audio Understanding into LLMs as LoRA
AuRA internalizes audio understanding into Large Language Models (LLMs) by distilling audio encoding capabilities into a lightweight LoRA adaptation. It trains the LLM to mimic the hidden states of an ASR encoder, allowing the LLM to directly process speech without relying on separate ASR modules. This approach offers …
EEVEE: Towards Test-time Prompt Learning in the Real World for Self-Improving Agents
EEVEE is a novel framework for test-time prompt learning in LLM agents that handles real-world, heterogeneous task streams. Its core method involves a router that clusters inputs and assigns them to specialized prompt configurations, preventing cross-dataset interference. This router and prompt system co-evolve, leadin…
Frontier Coding Agents Use Metaprogramming to Adapt to Unfamiliar Programming Languages
This paper introduces a novel evaluation method for LLM coding agents by testing them on unfamiliar, esoteric programming languages. The core method involves a sequential setup with file editing, local execution, and hidden-test grading. The key contribution is demonstrating that top-performing agents like Claude Opus …
Mind the Gap: Can Frontier LLMs Pass a Standardized Office Proficiency Exam?
This paper introduces a novel benchmark for evaluating LLM agents' proficiency in office software automation, using a comprehensive exam based on China's NCRE. The core method involves 200 practical tasks across Word, Excel, and PowerPoint, scored using thousands of machine-gradable criteria. The key contribution is de…
Modeling Complex Behaviors: Multi-Personality Composition and Dynamic Switching in Vision-Language Models
This paper proposes a method for explicitly conditioning Vision-Language Models (MLLMs) with personalities and introduces a framework to evaluate single, multiple, and dynamic personality switching. The core contribution is demonstrating that personality induction can improve captioning but hinder precise reasoning tas…
Superficial Beliefs in LLM Decision-Making
This paper investigates whether LLMs' choices in decision-making tasks reflect genuine underlying reasoning or mere imitation. By comparing LLM choices with a behavioral model, they find that LLM decisions are systematically driven by attributes, allowing for prediction. However, the LLMs' explicit justifications only …
T1-Bench: Benchmarking Multi-Scenario Agents in Real-World Domains
T1-Bench addresses the limitations of existing benchmarks by introducing a high-fidelity, multi-domain evaluation framework for LLM agents. Its core method involves creating complex, interleaved scenarios that mimic real-world customer interactions, requiring agents to perform sustained reasoning and tool-use across mu…
TRACE: A Unified Rollout Budget Allocation Framework for Efficient Agentic Reinforcement Learning
This paper addresses the challenge of inefficient rollout budget allocation in agentic reinforcement learning for large language models. The core method, TRACE, extends budget allocation beyond initial prompts to individual turns within a multi-turn rollout, treating each thought-action-observation sequence as a distin…
What Fits (Into Few Tokens) Doesn't Overfit: Compression and Generalization in ML Research Agents
This paper investigates why benchmark-driven ML research rarely overfits, proposing that successful strategies are highly compressible. The authors test this by creating "research agents" that either compress the agent's output (reproducing performance with minimal information) or its input (using only one-bit feedback…
The Shibboleth Effect: Auditing the Cross-Lingual Distributional Skew of Large Language Models
This paper introduces the "Shibboleth Effect," a cross-lingual distributional skew in LLMs, by simulating a geopolitical wargame in English versus Turkish. The core method involves using a multi-agent wargame to expose LLMs to adversarial conditions and measuring their behavioral dispositions like concession rate and c…
ABC-Bench: An Agentic Bio-Capabilities Benchmark for Biosecurity
This paper introduces ABC-Bench, a benchmark designed to evaluate the biosecurity-relevant capabilities of AI agents, specifically Large Language Models (LLMs). The benchmark assesses LLM agents on tasks requiring both biological and software expertise, such as robot control and DNA design. The key contribution is demo…