Monthly Issue
Collected dispatches

2026-06

2026-05-02 to 2026-05-31
280 papers
30 daily issues
A monthly ledger of recurring themes, selected papers, and daily issues. 3 sections
§ I

The Month in Review

Editorial summary

This month's research on LLM agents and models demonstrates a strong focus on robustness, safety, and advanced reasoning capabilities.

Shifts in Research Direction Popularity:

A significant trend is the move towards evaluating LLM agents in more complex and realistic environments. Benchmarks like AgentEscapeBench, ComplexMCP, and WildClawBench highlight the need for agents capable of long-horizon tasks, tool-grounded reasoning with dependencies, and operating in dynamic, interdependent settings that mirror real-world command-line interfaces and software automation. This signifies a departure from simpler, isolated tool-use evaluations.

Agent Safety and Alignment remains a paramount concern. Papers introduce novel benchmarks like CyBiasBench for cybersecurity bias and LITMUS for behavioral jailbreaks in OS environments. Methodologies for mitigating safety issues are also prominent, with approaches like GLiGuard for schema-conditioned classification, LANCE to alleviate rigid rejection, and DISCA for training-free cultural alignment. The research on Conformity Generates Collective Misalignment further emphasizes the societal implications of agent behavior.

Internal Model Understanding and Manipulation is another key area. The finding that Tool Calling is Linearly Readable and Steerable opens doors for direct control and error detection. Similarly, SLIM (Sparse Latent Steering) enables property-directed molecular editing by decomposing LLM hidden states.

Preference Learning and Collaboration are evolving beyond simple pairwise comparisons. GraphDPO and DGPO explore richer graph-based and groupwise preference modeling for more comprehensive alignment. The phenomenon of the "Memory Curse" highlights the challenges of expanded context windows and the need for targeted fine-tuning to maintain cooperation.

Notable Groups or Labs:

While specific lab affiliations aren't explicitly detailed in the summaries, the consistent themes across these papers suggest a strong collaborative effort within the community. The breadth of contributions points to significant activity in academic institutions and leading AI research labs focused on agentic AI and LLM development.

Trends to Watch Next Month:

1. Real-World Agent Deployment and Evaluation: Expect more benchmarks and frameworks designed to test agents in actual operating environments, moving beyond synthetic scenarios. Papers like WildClawBench and LITMUS are indicative of this direction.

2. Proactive Safety and Robustness Engineering: The focus on bias, jailbreaks, and unintended consequences will likely lead to more proactive methods for building safer LLMs, perhaps integrating formal verification techniques like TraceFix more broadly.

3. Efficient and Interpretable Agent Architectures: Research aiming for faster inference, reduced computational overhead, and clearer understanding of agent decision-making, such as RelAgent and ADKO, will gain traction.

4. Advanced Reasoning in Complex Environments: The development of LLMs capable of tackling multi-step, interdependent tasks in dynamic settings, as explored through benchmarks like ComplexMCP and AgentEscapeBench, will continue to be a major focus.

5. Bridging the Gap Between Agent Behavior and Human Cognition: The Reason to Play paper, comparing LLM and human game learning, hints at future work in aligning AI cognitive processes with human understanding and interaction.

§ II

Top Papers

Selected research 280
cs.AIarxiv:2605.07926v1Lead article

AgentEscapeBench: Evaluating Out-of-Domain Tool-Grounded Reasoning in LLM Agents

Zhengkang Guo, Yiyang Li, Lin Qiu, Xiaohua Wang, Jingwen Xv

his paper introduces AgentEscapeBench, a novel benchmark designed to evaluate LLM agents' ability to perform out-of-domain, tool-grounded reasoning with long-range dependencies. The benchmark uses escape-room-style tasks requiring agents to infer and execute complex tool-use procedures, demonstrating a significant performance drop for both humans and LLMs as dependency depth increases. AgentEscapeBench's core contribution is providing a challenging, automated evaluation for robust agent reasoning beyond simple tool interactions.

Conceptual illustration of AgentEscapeBench. The agent is placed in a themed escape room populated with unfamiliar tools and hidden items. It must explore the environment, invoke tools with correct parameters derived from narrative clues, and propagate intermediate outputs through a multi-step dependency chain to unlock the final exit.
Conceptual illustration of AgentEscapeBench. The agent is placed in a themed escape room populated with unfamiliar tools and hidden items. It must explore the environment, invoke tools with correct parameters derived from narrative clues, and propagate intermediate outputs throug…
cs.AIarxiv:2605.08037v1Lead article

Beyond Pairs: Your Language Model is Secretly Optimizing a Preference Graph

Ning Liu, Chuanneng Sun, Kristina Klinkner, Shervin Malmasi

his paper introduces GraphDPO, a generalization of Direct Preference Optimization (DPO) that handles preference data structured as graphs, rather than just pairs. By optimizing a graph-structured objective, GraphDPO leverages richer preference information, enforces transitivity, and avoids issues arising from collapsing multi-rollout data into independent pairs. This approach offers a more robust and comprehensive method for aligning language models with human preferences.

GraphDPO pipeline for LLM alignment. For each prompt, the policy samples K K rollouts, which are grouped into equivalence classes according to preference signals. These classes induce a DAG structure whose edges encode dominance relations between groups, with an optional ground-truth node as a global anchor. Equivalence-class masking removes intra-group comparisons so that each response is contrasted only with strictly worse groups via a local Plackett–Luce loss. The resulting losses are aggregated over the graph to update the policy while enforcing transitive preference structure.
GraphDPO pipeline for LLM alignment. For each prompt, the policy samples K K rollouts, which are grouped into equivalence classes according to preference signals. These classes induce a DAG structure whose edges encode dominance relations between groups, with an optional ground-t…
cs.AIarxiv:2605.08060v1Lead article

The Memory Curse: How Expanded Recall Erodes Cooperative Intent in LLM Agents

Jiayuan Liu, Tianqin Li, Shiyi Du, Xin Luo, Haoxuan Zeng

his paper introduces the "memory curse," demonstrating that expanding LLM agents' context windows can paradoxically *decrease* cooperation in multi-agent social dilemmas. The core method involves extensive testing across various LLMs and games, revealing that increased memory leads to a decline in forward-looking cooperative intent. The key contribution is identifying this mechanism and showing that targeted fine-tuning on forward-looking reasoning or sanitizing memory content can restore cooperative behavior.

Schematic of repeated social dilemma interactions between two LLM agents with shared memory.
Schematic of repeated social dilemma interactions between two LLM agents with shared memory.
cs.AIarxiv:2605.07990v1Lead article

Tool Calling is Linearly Readable and Steerable in Language Models

Zekun Wu, Ze Wang, Seonglae Cho, Yufei Yang, Adriano Koshiyama

his paper demonstrates that language models' tool-calling decisions are linearly encoded within their internal activations. By manipulating the difference in average activations between tool representations, researchers can reliably steer the model to select a different tool. This discovery also allows for pre-execution error detection, as small activation gaps between competing tools predict a higher likelihood of incorrect tool selection.

Overview of the three-stage circuit and steering demonstration. Adding a mean-difference vector redirects tool selection and automatically restructures arguments. Validated across 12 IT models in 3 families (Gemma 3, Qwen 3 / Qwen 2.5, Llama 3.1; 270M–27B).
Overview of the three-stage circuit and steering demonstration. Adding a mean-difference vector redirects tool selection and automatically restructures arguments. Validated across 12 IT models in 3 families (Gemma 3, Qwen 3 / Qwen 2.5, Llama 3.1; 270M–27B).
cs.LGarxiv:2605.07840v1Lead article

RelAgent: LLM Agents as Data Scientists for Relational Learning

Xingyue Huang, Louis Tichelman, Jinwoo Kim, Krzysztof Olejniczak, İsmail İlkan Ceylan

elAgent is an LLM-based autonomous data scientist for relational learning. It first uses LLM agents with workspace tools to automatically generate SQL feature programs and select a predictive model. The contribution is a two-phase approach that results in fast, interpretable, and scalable predictors composed of SQL queries and classical models, avoiding further LLM calls during inference.

RelAgent . During the search phase, an LLM agent iteratively proposes and refines a feature program consisting of SQL feature queries { q 1 , … , q n } \{q_{1},\( \dots \),q_{n}\} and a predictive model configuration \( \varphi \) to solve a given task. The agent uses three tools: (1) database exploration via read-only SQL exploration queries, (2) program validation by executing candidate programs on a validation set and receiving performance metrics, and (3) inspection of past trials in the Evaluation Workspace via evaluation queries. Once a final program is selected, the agent is no longer needed at inference time.
RelAgent . During the search phase, an LLM agent iteratively proposes and refines a feature program consisting of SQL feature queries { q 1 , … , q n } \{q_{1},\( \dots \),q_{n}\} and a predictive model configuration \( \varphi \) to solve a given task. The agent uses three tools…
cs.CLarxiv:2605.07982v1Lead article

GLiGuard: Schema-Conditioned Classification for LLM Safeguard

Urchade Zaratiana, Mary Newhauser, George Hurn-Maloney, Ash Lewis

LiGuard reformulates LLM content moderation as a classification problem, moving away from slow, generation-based guardrails. Its core method uses a small, schema-conditioned bidirectional encoder to process task definitions and label semantics directly as structured tokens. This allows for efficient, simultaneous evaluation of multiple safety dimensions in a single pass, significantly improving scalability and reducing latency.

GLiGuard multi-task moderation overview. Given a text (prompt or response) and a user-specified task schema, GLiGuard produces predictions for all selected tasks in a single forward pass.
GLiGuard multi-task moderation overview. Given a text (prompt or response) and a user-specified task schema, GLiGuard produces predictions for all selected tasks in a single forward pass.
cs.CLarxiv:2605.07933v1Lead article

How to Train Your Latent Diffusion Language Model Jointly With the Latent Space

Viacheslav Meshchaninov, Alexander Shabalin, Egor Chimbulatov, Nikita Gushchin, Ilya Koziev

his paper introduces the Latent Diffusion Language Model (LDLM), which jointly trains an encoder, diffusion model, and decoder for non-autoregressive text generation. The core method involves reshaping pre-trained language model representations into a latent space suitable for denoising and decoding. The key contribution is a novel training recipe that overcomes challenges in naive joint training, leading to improved generation quality on benchmark datasets.

cs.CLarxiv:2605.07925v1Lead article

How Value Induction Reshapes LLM Behaviour

Arnav Arora, Natalie Schluter, Katherine Metcalf, Maartje ter Hoeve

his paper investigates how fine-tuning Large Language Models (LLMs) with specific values impacts their behavior. The core method involves fine-tuning models on curated value subsets and measuring changes in other value expressions, safety, and performance. The key contribution is demonstrating that value induction can lead to unintended consequences, such as the expression of unrelated or even contrasting values, and potentially make models more addictive or sycophantic.

Overview of our value-training effects framework. We create value-specific models using existing preference datasets and our value induction approach. We then evaluate the value models for several behaviours using corresponding datasets.
Overview of our value-training effects framework. We create value-specific models using existing preference datasets and our value induction approach. We then evaluate the value models for several behaviours using corresponding datasets.
cs.AIarxiv:2605.10787v1Lead article

ComplexMCP: Evaluation of LLM Agents in Dynamic, Interdependent, and Large-Scale Tool Sandbox

Yuanyang Li, Xue Yang, Longyue Wang, Weihua Luo, Hongyang Chen

his paper introduces **ComplexMCP**, a novel benchmark designed to evaluate LLM agents in realistic, complex software automation scenarios. It addresses the limitations of current benchmarks by simulating dynamic environments with interdependent tools and unpredictable failures. The core contribution is a rigorous evaluation framework that reveals significant performance gaps between LLM agents and human capabilities, highlighting key areas for future improvement.

The Overview of ComplexMCP: Our framework integrates stateful sandboxes and stateless MCP servers via a seed-driven mechanism.
The Overview of ComplexMCP: Our framework integrates stateful sandboxes and stateless MCP servers via a seed-driven mechanism.
cs.AIarxiv:2605.10938v1Lead article

ELF: Embedded Language Flows

Keya Hu, Linlu Qiu, Yiyang Lu, Hanhong Zhao, Tianhong Li

his paper introduces Embedded Language Flows (ELF), a novel approach to language modeling using continuous diffusion models. ELF's core method is to perform diffusion in continuous embedding space for most of the generation process, only mapping to discrete tokens at the final step. This allows ELF to leverage successful techniques from image diffusion, like classifier-free guidance, and achieve superior performance compared to existing discrete diffusion language models.

ELF achieves lower generative perplexity with fewer sampling steps than prior DLMs, without using distillation. ELF achieves this while using 10 × 10\( \times \) fewer training tokens. (Model size: 105M for ELF and 170M for others; dataset: OWT. Detailed comparison in Fig. 7 .)
ELF achieves lower generative perplexity with fewer sampling steps than prior DLMs, without using distillation. ELF achieves this while using 10 × 10\( \times \) fewer training tokens. (Model size: 105M for ELF and 170M for others; dataset: OWT. Detailed comparison in Fig. 7 .)
cs.AIarxiv:2605.10813v1Lead article

NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation

Jinhang Xu, Qiyuan Zhu, Yujun Wu, Zirui Wang, Dongxu Zhang

anoResearch is a multi-agent framework that personalizes research automation by co-evolving skills, memory, and policy. Its core method involves a tri-level co-evolutionary process where a skill bank distills reusable procedural knowledge, a memory module retains user-specific experience, and a policy module internalizes implicit user preferences. This approach allows the system to adapt to individual researchers' unique needs and preferences, moving beyond uniform outputs to provide truly personalized research assistance.

Comparison between (a) a uniform research automation pipeline that applies identical processing to all users and yields homogeneous outputs, and (b) NanoResearch, which recognizes distinct researcher personas and provides personalized skills and feedback upon failure, enabling each persona to evolve along its own trajectory.
Comparison between (a) a uniform research automation pipeline that applies identical processing to all users and yields homogeneous outputs, and (b) NanoResearch, which recognizes distinct researcher personas and provides personalized skills and feedback upon failure, enabling ea…
cs.AIarxiv:2605.10754v1Lead article

The Agent Use of Agent Beings: Agent Cybernetics Is the Missing Science of Foundation Agents

Xinrun Wang, Chang Yang, He Zhao, Zhuoyi Lin, Shuyue Hu

his paper argues that **cybernetics offers the missing theoretical foundation for the engineering-driven field of LLM-based foundation agents.** It proposes that applying cybernetic principles can address fundamental open questions about agent control, environmental adaptation, and safe self-improvement, moving beyond empirical trial-and-error.

From Classical Cybernetics to Agent cybernetics
From Classical Cybernetics to Agent cybernetics
cs.AIarxiv:2605.10843v1Lead article

Training-Free Cultural Alignment of Large Language Models via Persona Disagreement

Huynh Trung Kiet, Dao Sy Duy Minh, Tuan Nguyen, Chi-Nguyen Tran, Phu-Hoa Pham

his paper introduces DISCA, a training-free method to align large language models with cultural values in a black-box setting. DISCA leverages disagreement among persona agents, grounded in real-world survey data, to guide the model's output. This approach effectively reduces cultural misalignment without requiring extensive data or model access.

DISCA overview. Stage 1 builds WVS-grounded persona prompts for a trolley scenario in country c c ; Stage 2 runs a frozen large language model (LLM) on the base prompt and each persona, aggregates persona-level signals in logit space, and applies Prospect-Theory importance sampling (PT–IS) together with a dual-pass reliability gate to obtain the final sparing probability. Pseudocode and the six MultiTP attribute–temperature pairs provided in App. A1 .
DISCA overview. Stage 1 builds WVS-grounded persona prompts for a trolley scenario in country c c ; Stage 2 runs a frozen large language model (LLM) on the base prompt and each persona, aggregates persona-level signals in logit space, and applies Prospect-Theory importance sampli…
cs.LGarxiv:2605.10923v1Lead article

Dynamic Skill Lifecycle Management for Agentic Reinforcement Learning

Junhao Shen, Teng Zhang, Xiaoyan Zhao, Hong Cheng

his paper introduces SLIM, a framework for dynamic skill management in agentic reinforcement learning. SLIM treats the set of active external skills as a variable to be optimized alongside the agent's policy. Its core contribution is a method to dynamically manage these skills by estimating their marginal contribution and applying lifecycle operations (retain, retire, or introduce) to maintain an optimal, non-monotonic skill set.

The reinforcement learning dynamics on ALFWorld. We plot validation success rate against the number of skills in active set during training. SkillRL accumulates external skills, whereas Skill0 progressively eliminates them. SLIM instead performs retain–retire–expand lifecycle management, converging to a non-empty skill set with higher validation success. This suggests that the effective endpoint is a learned external skill boundary rather than full accumulation or forced elimination.
The reinforcement learning dynamics on ALFWorld. We plot validation success rate against the number of skills in active set during training. SkillRL accumulates external skills, whereas Skill0 progressively eliminates them. SLIM instead performs retain–retire–expand lifecycle man…
cs.LGarxiv:2605.10770v1Lead article

DynaMiCS: Fine-tuning LLMs with Performance Constraints using Dynamic Mixtures

Eleonora Gualdoni, Sonia Laguna, Louis Bethune, Joao Monteiro, Pierre Ablin

ynaMiCS addresses the challenge of fine-tuning LLMs for specific tasks while maintaining performance on general capabilities. It frames this as a constrained optimization problem, dynamically adjusting data mixture weights at each training step. By probing domain-specific effects, DynaMiCS ensures target-domain improvement without sacrificing performance on critical constrained domains.

DynaMiCS overview. Problem setup. Fine-tuning datasets 𝒟 \( \mathcal{D} \) provide the data available for mixture selection, including target datasets and optional auxiliary datasets for transfer or regularization. Evaluation domains ℰ \( \mathcal{E} \) are partitioned into target domains, whose losses are minimized, and constrained domains, whose losses must remain below reference values. DynaMiCS optimization. At each update, DynaMiCS estimates a slope matrix 𝐒 ​ ( t ) \( \mathbf{S} \)(t) (1) , where S i ​ j ​ ( t ) S_{ij}(t) measures the local effect of training on dataset D j D_{j} on evaluation loss L i L_{i} . Green/red entries denote loss decreases/increases. Given 𝐒 ​ ( t ) \( \mathbf{S} \)(t) , DynaMiCS solves a constrained optimization problem to obtain weights 𝐰 ∗ \( \mathbf{w}^{*} \) (2) , trains with them for H t H_{t} steps (3) , and then repeats the procedure. The simplex illustrates the proxy objective landscape, with white lines marking constraint boundaries; values are illustrative.
DynaMiCS overview. Problem setup. Fine-tuning datasets 𝒟 \( \mathcal{D} \) provide the data available for mixture selection, including target datasets and optional auxiliary datasets for transfer or regularization. Evaluation domains ℰ \( \mathcal{E} \) are partitioned into targ…
cs.CLarxiv:2605.10721v1Lead article

Conformity Generates Collective Misalignment in AI Agents Societies

Giordano De Marzo, Alessandro Bellina, Claudio Castellano, Viola Priesemann, David Garcia

his paper demonstrates that even if individual AI agents are aligned with human values, their collective behavior can become misaligned due to conformity. The core method involves simulating opinion dynamics where agents are influenced by both their intrinsic biases and the majority opinion. The key contribution is a quantitative theory predicting when populations become trapped in misaligned states and identifying tipping points where a small number of adversarial agents can cause irreversible shifts in collective alignment.

Collective misalignment through conformity dynamics. AI agent populations exhibit path-dependent collective behavior where final alignment depends critically on initial conditions. Panels (a)–(c) show temporal evolution of collective opinion m ​ ( t ) m(t) for N = 50 N=50 agents over 25 independent runs, with trajectories colored by initial collective opinion m 0 m_{0} (color bar). Panels (d)–(f) show distributions of final collective opinion m f m_{f} (vertical axis) for each initial condition m 0 m_{0} (horizontal axis), revealing bistability. (a), (d): Gemma 3 27B with opinion pair “gender self-identification” vs “biological sex classification”. Starting from balance ( m 0 = 0 m_{0}=0 ), agents consistently coordinate toward gender self-identification (positive m m ). However, sufficient initial bias toward biological sex classification ( m 0 ≲ − 0.6 m_{0}\( \lesssim \)-0.6 ) produces bistability, with some runs converging to the opposite opinion despite the model’s intrinsic preference. At strong negative initial conditions ( m 0 ≈ − 0.8 m_{0}\( \approx \)-0.8 ), virtually all runs yield stable misalignment. (b), (e): Gemma 3 27B with “renewable energy” vs “fossil fuels” shows no bistability; trajectories consistently converge to renewable energy regardless of initial conditions. (c), (f): Llama 3.1 8B with the same gender/biological sex pair also shows no bistability.
Collective misalignment through conformity dynamics. AI agent populations exhibit path-dependent collective behavior where final alignment depends critically on initial conditions. Panels (a)–(c) show temporal evolution of collective opinion m ​ ( t ) m(t) for N = 50 N=50 agents …
cs.CLarxiv:2605.10863v1Lead article

DGPO: Beyond Pairwise Preferences with Directional Consistent Groupwise Optimization

Mengyi Deng, Zhiwei Li, Xin Li, Tingyu Zhu, Yulan Yuan

his paper introduces Directional-Groupwise Preference Optimization (DGPO), a novel method for aligning Large Language Models (LLMs) with human preferences. DGPO addresses limitations in existing pairwise methods by aggregating supervision signals at the group level and explicitly modeling directional consistency through multi-candidate comparisons. This approach captures richer relative information and reinforces consistency across diverse reasoning pathways, leading to improved performance.

An overview of the DGPO training framework. The process begins with forward problems ( x f x_{f} ), each of which can be paired with a reverse question ( x r x_{r} ) formulated in the opposite reasoning direction. A teacher model then produces multiple candidate solutions for each problem type ( { y f ​ i } i = 1 3 \{y_{fi}\}_{i=1}^{3} for x f x_{f} and { y r ​ i } i = 1 3 \{y_{ri}\}_{i=1}^{3} for x r x_{r} ). The solutions are subsequently structured into direction-consistent ( 𝒢 + \( \mathcal{G}^{+} \) ) and direction-divergent ( 𝒢 − \( \mathcal{G}^{-} \) ) groups, wherein consistency is determined by matching a prompt’s directionality with its corresponding solutions (e.g., x f x_{f} with { y f ​ i } i = 1 3 \{y_{fi}\}_{i=1}^{3} ). DGPO is trained on this structured supervision, incorporating directional modeling and uncertainty-based regulation to enhance alignment stability.
An overview of the DGPO training framework. The process begins with forward problems ( x f x_{f} ), each of which can be paired with a reverse question ( x r x_{r} ) formulated in the opposite reasoning direction. A teacher model then produces multiple candidate solutions for eac…
cs.CLarxiv:2605.10779v1Lead article

LITMUS: Benchmarking Behavioral Jailbreaks of LLM Agents in Real OS Environments

Chiyu Zhang, Huiqin Yang, Bendong Jiang, Xiaolei Zhang, Yiran Zhao

his paper introduces LITMUS, a benchmark for testing LLM agents' safety in real operating system environments. It addresses the risk of "behavior jailbreaks" by using a dual verification mechanism and state rollback to evaluate both semantic and physical-layer harms. LITMUS provides a comprehensive set of test cases and an automated framework to measure unsafe subversion of LLM agents.

Behavior Jailbreak in practice: a malicious prompt causes an OpenClaw-based agent to execute dangerous OS-level operations, producing real physical damage. Attack Success Rates remain alarmingly high even with strong LLMs as the agent brain. Data sourced from LITMUS.
Behavior Jailbreak in practice: a malicious prompt causes an OpenClaw-based agent to execute dangerous OS-level operations, producing real physical damage. Attack Success Rates remain alarmingly high even with strong LLMs as the agent brain. Data sourced from LITMUS.
cs.CLarxiv:2605.10912v1Lead article

WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation

Shuangrui Ding, Xuanlang Dai, Long Xing, Shengyuan Ding, Ziyu Liu

ildClawBench is a novel benchmark designed to evaluate the real-world performance of AI agents in command-line interfaces. It features long-horizon, multimodal tasks executed in actual runtimes with real tools, unlike previous synthetic benchmarks. The benchmark's contribution lies in its realistic evaluation of agent capabilities across extended tasks and its hybrid grading system, offering a more accurate assessment of agent reliability.

Comparison with previous agent benchmarks and WildClawBench. (a) Prior benchmarks evaluate short-horizon, single-step tasks with toy APIs in controlled sandboxes, whereas (b) WildClawBench evaluates long-horizon multimodal workflows with real tools in open-world environments. (c) The benchmark spans six categories and is compatible with multiple agent harnesses. (d) A summary of key differences across environment, task horizon, tool use, and evaluation.
Comparison with previous agent benchmarks and WildClawBench. (a) Prior benchmarks evaluate short-horizon, single-step tasks with toy APIs in controlled sandboxes, whereas (b) WildClawBench evaluates long-horizon multimodal workflows with real tools in open-world environments. (c)…
cs.AIarxiv:2604.27859Lead article

A Brief Overview: Agentic Reinforcement Learning In Large Language Models

Fangming Cui, Ruixiao Zhu, Cheng Fang, Sunan Li, Jiahong Li

his paper introduces Agentic Reinforcement Learning (RL) for Large Language Models (LLMs), moving beyond traditional RL's fixed objectives. The core method integrates LLMs' cognitive abilities like planning and self-reflection into the RL loop, enabling autonomous agents to tackle complex, open-ended tasks. Its main contribution is a framework for developing these more adaptable and goal-setting agents in uncertain environments.

Figure 1 . Agent.
Figure 1 . Agent.
cs.AIarxiv:2605.04595Lead article

A Queueing-Theoretic Framework for Stability Analysis of LLM Inference with KV Cache Memory Constraints

Chengyi Nie, Nian Si, Zijie Zhou

his paper introduces a novel queueing-theoretic framework to analyze LLM inference stability, explicitly considering both computational demands and KV cache memory constraints. The core contribution is deriving rigorous conditions for system stability, enabling operators to determine the necessary GPU cluster size to avoid performance degradation or overspending.

Cumulative Distribution Function for Batch Execution Time with PD ratio 1:1 requests
Cumulative Distribution Function for Batch Execution Time with PD ratio 1:1 requests
cs.AIarxiv:2605.04808Lead article

DecodingTrust-Agent Platform (DTap): A Controllable and Interactive Red-Teaming Platform for AI Agents

Zhaorun Chen, Xun Liu, Haibo Tong, Chengquan Guo, Yuzhou Nie

Tap is a novel platform designed for the controllable and interactive red-teaming of AI agents. Its core method involves creating realistic, reproducible simulation environments across diverse domains to test agent security. The main contribution is providing a much-needed tool for large-scale risk assessment of AI agents, addressing the challenges posed by their dynamic and untrusted operational environments.

cs.AIarxiv:2605.04454Lead article

Deployment-Relevant Alignment Cannot Be Inferred from Model-Level Evaluation Alone

Varad Vishwarupe, Nigel Shadbolt, Marina Jirotka, Ivan Flechais

his paper argues that current machine learning alignment evaluations, which focus solely on model outputs, are insufficient for assessing real-world deployment. It proposes that alignment claims should be tied to the specific level of evidence collected (model, response, interaction, or deployment). Through audits, the study finds a lack of user-facing verification and process steerability in existing benchmarks, highlighting the need for more interaction-focused evaluation methods.

Four levels of alignment evaluation and the inferential gap. Deployed behaviour B = f ​ ( M , S , C ) B=f(M,S,C) is a function of model weights M M , scaffolding S S (prompt, memory, retrieval, UI, tools), and deployment context C C (user population, task domain, oversight structure). Each level adds degrees of freedom that model-level evaluation cannot observe (right column): at the model level B B reduces to a property of M M alone; at the response level S S is held fixed; at the interaction level S S becomes a live variable; at the deployment level C C enters as well. Current benchmark evidence concentrates at the response level (orange callout); deployment-relevant alignment claims are made at the deployment level (green callout). The distance between the two is the inferential gap this paper argues current practice under-acknowledges.
Four levels of alignment evaluation and the inferential gap. Deployed behaviour B = f ​ ( M , S , C ) B=f(M,S,C) is a function of model weights M M , scaffolding S S (prompt, memory, retrieval, UI, tools), and deployment context C C (user population, task domain, oversight struct…
cs.AIarxiv:2605.04960Lead article

EP-GRPO: Entropy-Progress Aligned Group Relative Policy Optimization with Implicit Process Guidance

Song Yu, Li Li, Wenwen Zhao, Zhisheng Yang

P-GRPO addresses credit assignment failures in Group Relative Policy Optimization (GRPO) for LLM reasoning. It uses entropy-gated modulation to focus on informative decision points and implicit process signals from policy divergence to provide directional, outcome-driven feedback at the token level, reducing training waste and improving alignment.

Conceptual illustration of the fundamental limitations in standard GRPO. The top panel demonstrates Uniform Granularity , where the model fails to distinguish between critical high entropy decision pivots and deterministic low entropy derivations. The middle panel shows Uniform Polarity , where sequence-level rewards lead to the indiscriminate reinforcement or penalization of both correct and incorrect intermediate steps. The bottom panel illustrates Zero-Variance Collapse , where identical rewards within a group cause the learning signal to vanish.
Conceptual illustration of the fundamental limitations in standard GRPO. The top panel demonstrates Uniform Granularity , where the model fails to distinguish between critical high entropy decision pivots and deterministic low entropy derivations. The middle panel shows Uniform P…
cs.AIarxiv:2605.04572Lead article

From Parameter Dynamics to Risk Scoring : Quantifying Sample-Level Safety Degradation in LLM Fine-tuning

Xiao Wang, Yifei Zhang, YongKang Liu, Xiaocui Yang, Zihan Wang

his paper proposes a novel method, Sample-Level Quantification of Safety Degradation (SQSD), to identify and quantify which training samples are most responsible for degrading LLM safety during fine-tuning. By analyzing the cumulative parameter drift towards unsafe directions, SQSD assigns risk scores to individual samples, enabling targeted mitigation of safety vulnerabilities.

Overview of safety degradation mechanism and SQSD. (a) : Fine-tuning trajectory shows cumulative parameter drift toward danger-aligned direction in parameter space. (b) : SQSD computes risk scores by measuring the projection gap between sample-induced parameter updates and safety-relevant directions. Larger danger projection minus safety projection indicates higher risk.
Overview of safety degradation mechanism and SQSD. (a) : Fine-tuning trajectory shows cumulative parameter drift toward danger-aligned direction in parameter space. (b) : SQSD computes risk scores by measuring the projection gap between sample-induced parameter updates and safety…
cs.AIarxiv:2508.19035Lead article

Investigating Advanced Reasoning of Large Language Models via Black-Box Environment Interaction

Congchi Yin, Tianyi Wu, Yankai Shu, Alex Gu, Yunhan Wang

his paper introduces a novel evaluation method for Large Language Models (LLMs) called "black-box environment interaction." LLMs interact with hidden functions, learning from input-output pairs to deduce the underlying rules. The contribution is the \textsc{Oracle} benchmark, which tests integrated reasoning in unknown environments, revealing that current LLMs struggle with this complex task.

cs.AIarxiv:2605.04505Lead article

JASTIN: Aligning LLMs for Zero-Shot Audio and Speech Evaluation via Natural Language Instructions

Leying Zhang, Bowen Shi, Haibin Wu, Bach Viet Do, Yanmin Qian

ASTIN addresses the challenge of evaluating generative audio models by framing it as a self-instructed reasoning task. It achieves this by connecting a frozen audio encoder with a fine-tuned LLM via a trainable adapter, and uses a novel data preparation pipeline to ensure robust zero-shot generalization. This approach leads to state-of-the-art performance in aligning with human subjective ratings for audio and speech evaluation.

Pipeline of our proposed framework Jastin
Pipeline of our proposed framework Jastin
cs.AIarxiv:2602.22291Lead article

Manifold of Failure: Behavioral Attraction Basins in Language Models

Sarthak Munshi, Manish Bhatt, Vineeth Sai Narajala, Idan Habler, Ammar Al-Kahfah

his paper introduces a framework to systematically map "behavioral attraction basins," which are unsafe regions in Large Language Models (LLMs). By reframing vulnerability discovery as a quality diversity problem using MAP-Elites, the authors illuminate the continuous topology of these failure regions. Their contribution lies in characterizing these unsafe areas rather than just fixing them, revealing distinct, model-specific vulnerability patterns.

MAP-Elites selects and mutates prompts from the behavioral archive. Each prompt is sent to the target LLM, and the response is evaluated by the judge to produce a behavioral descriptor ( b ) (b) and Alignment Deviation score Q ​ ( p ) Q(p) , which update the archive.
MAP-Elites selects and mutates prompts from the behavioral archive. Each prompt is sent to the target LLM, and the response is evaluated by the judge to produce a behavioral descriptor ( b ) (b) and Alignment Deviation score Q ​ ( p ) Q(p) , which update the archive.
cs.AIarxiv:2602.19837Lead article

Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agent

Björn Hoppmann, Christoph Scholz

his paper surveys meta-learning and meta-reinforcement learning by formalizing them based on tasks. It then traces the development of key algorithms that led to DeepMind's Adaptive Agent, highlighting how meta-learning enables rapid adaptation to new tasks with minimal data by leveraging transferable knowledge.

Meta-learning of 2-way 1-shot animal classification tasks. The current meta-knowledge \( \varphi \) is the prior for one-shot learning of each particular classification task. During meta-training, the meta-optimizer receives all N N query set losses of the adapted models to update meta-knowledge \( \varphi \) . Meta-validation evaluates the training progress on new classification problems every l l meta-epochs, while meta-testing on unseen classifications takes place after meta-training.
Meta-learning of 2-way 1-shot animal classification tasks. The current meta-knowledge \( \varphi \) is the prior for one-shot learning of each particular classification task. During meta-training, the meta-optimizer receives all N N query set losses of the adapted models to updat…
cs.AIarxiv:2605.05003Lead article

Misaligned by Reward: Socially Undesirable Preferences in LLMs

Gayane Ghazaryan, Esra Dönmez

his paper introduces a new method to evaluate reward models for Large Language Models (LLMs) by focusing on socially undesirable preferences, rather than just general instruction following. They convert existing social evaluation datasets into pairwise preference data to test if reward models favor biased, unsafe, or unethical responses. The key contribution is demonstrating that current reward models can exhibit significant social misalignments, which are often hidden by traditional evaluation methods.

cs.AIarxiv:2605.01847Lead article

NeuroState-Bench: A Human-Calibrated Benchmark for Commitment Integrity in LLM Agent Profiles

Jia Xiao

his paper introduces NeuroState-Bench, a novel benchmark designed to evaluate the "commitment integrity" of LLM agents, ensuring they maintain coherence throughout multi-turn tasks. Unlike previous methods, it uses human-calibrated side-query probes to directly assess this integrity, rather than relying on inferred internal states. The benchmark's contribution lies in its comprehensive design, including diverse tasks and probes, and its empirical demonstration that task success and commitment integrity are not always aligned.

Data-led overview of the 32-profile evaluated grid used in the primary analysis. Panel A summarizes deterministic benchmark scope and final merged calibration accounting, including 144 tasks, 306 benchmark-defined side-query probes, and the 104 / 216 / 108 sampled-raw-adjudicated counts. Panel B shows all 32 evaluated profiles directly as profile-level means on mean task-success and mean HCCIS-CORE axes, using compact family-scaffold codes and the local-open, hosted-frontier, and hosted-open subset grouping; Appendix Table 7 decodes those compact profile codes.
Data-led overview of the 32-profile evaluated grid used in the primary analysis. Panel A summarizes deterministic benchmark scope and final merged calibration accounting, including 144 tasks, 306 benchmark-defined side-query probes, and the 104 / 216 / 108 sampled-raw-adjudicated…
cs.AIarxiv:2605.00877Lead article

OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models

Yida Xue, Ningyu Zhang, Tingwei Wu, Zhe Ma, Daxiong Ji

his paper introduces OceanPile, a large-scale multimodal corpus designed to address the data bottleneck in ocean science AI. Its core method involves unifying diverse ocean data, including sonar, imagery, and text, into a single, aligned dataset. The main contribution is enabling the development of foundation models for ocean science, overcoming limitations of fragmented and weakly labeled data.

cs.AIarxiv:2601.07389Lead article

On the Non-decoupling of Supervised Fine-tuning and Reinforcement Learning in Post-training

Xueyan Niu, Bo Bai, Wei Han, Weixi Zhang

his paper proves that supervised fine-tuning (SFT) and reinforcement learning (RL) are fundamentally intertwined during large language model post-training. The core contribution is demonstrating that neither SFT nor RL can be performed independently without negatively impacting the other's objective, whether applied sequentially. This non-decoupling implies that their interleaved application is necessary for optimal performance.

Training pipeline for modern LLMs. This work focuses on two post-training methods, Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), that refine a pretrained base model after its initial pretraining phase.
Training pipeline for modern LLMs. This work focuses on two post-training methods, Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), that refine a pretrained base model after its initial pretraining phase.
cs.AIarxiv:2605.05058Lead article

SoK: Robustness in Large Language Models against Jailbreak Attacks

Feiyue Xu, Hongsheng Hu, Chaoxiang He, Sheng Hang, Hanqing Hu

his paper addresses the critical issue of Large Language Model (LLM) vulnerability to jailbreak attacks. Its core contribution is the introduction of "Security Cube," a novel, multi-dimensional evaluation framework designed to comprehensively assess the robustness of LLMs against these adversarial prompts, moving beyond simplistic metrics like attack success rate. This framework enables a more thorough understanding of existing attack and defense techniques and identifies key challenges in LLM security.

Overview of the 𝚂𝚎𝚌𝚞𝚛𝚒𝚝𝚢 ​ 𝙲𝚞𝚋𝚎 \( \mathtt{Security\;Cube} \) pipeline. Given a jailbreak goal, the attacker generates an initial adversarial prompt using a specific attack method (e.g., shuffling, LLM-based generation, or template rewriting). The target model, protected by a defense mechanism such as system prompts, pre-/post-guardrails, or other safety layers, produces a response. The attacker iteratively refines the prompt based on defender feedback (black-box or white-box), applying early stopping and incorporating suggestions. The final effective prompt–response pair is evaluated by a Judge model to assess attack success. Throughout the process, 𝚂𝚎𝚌𝚞𝚛𝚒𝚝𝚢 ​ 𝙲𝚞𝚋𝚎 \( \mathtt{Security\;Cube} \) logs key metrics of the attack, defense, and judge components.
Overview of the 𝚂𝚎𝚌𝚞𝚛𝚒𝚝𝚢 ​ 𝙲𝚞𝚋𝚎 \( \mathtt{Security\;Cube} \) pipeline. Given a jailbreak goal, the attacker generates an initial adversarial prompt using a specific attack method (e.g., shuffling, LLM-based generation, or template rewriting). The target model, protec…
cs.AIarxiv:2605.04831Lead article

StoryAlign: Evaluating and Training Reward Models for Story Generation

Haotian Xia, Hao Peng, Yunjia Qi, Xiaozhi Wang, Bin Xu

his paper introduces StoryRMB, the first benchmark for evaluating reward models on human story preferences. They find existing reward models perform poorly, achieving only 66.3% accuracy in selecting preferred stories. To improve this, they construct a large dataset of story preference pairs to train better reward models for story generation.

An overview of the benchmark construction framework. The process consists of: (1) the collection of candidate stories generated by LLMs and humans; (2) scoring the stories and partitioning them along various dimensions. These two stages yield a diverse dataset for evaluating the story reward model.
An overview of the benchmark construction framework. The process consists of: (1) the collection of candidate stories generated by LLMs and humans; (2) scoring the stories and partitioning them along various dimensions. These two stages yield a diverse dataset for evaluating the …
cs.AIarxiv:2605.04906Lead article

Strat-Reasoner: Reinforcing Strategic Reasoning of LLMs in Multi-Agent Games

Yidong He, Yutao Lai, Pengxu Yang, Jiarui Gan, Jiexin Wang

trat-Reasoner enhances LLMs' strategic reasoning in multi-agent games by introducing a recursive framework where an agent's reasoning incorporates others'. It uses a centralized Chain-of-Thought comparison module to provide reward signals for intermediate reasoning steps, addressing challenges of non-stationarity and credit assignment in multi-agent environments.

Comparison of reasoning paradigms in strategic decision-making. Unlike No Reasoning (Left) and Unstructured Reasoning (Middle) which fail to handle complex strategic traps, our Recursive Reasoning paradigm (Right) employs a structured, multi-step reasoning process. By explicitly reasoning about the opponent’s intent and predictions in a recursive way, our method achieves superior strategic performance, as demonstrated by the successful move, and interpretability, which enables intermediate training signals.
Comparison of reasoning paradigms in strategic decision-making. Unlike No Reasoning (Left) and Unstructured Reasoning (Middle) which fail to handle complex strategic traps, our Recursive Reasoning paradigm (Right) employs a structured, multi-step reasoning process. By explicitly …
cs.AIarxiv:2602.17753Lead article

The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systems

Leon Staufer, Kevin Feng, Kevin Wei, Luke Bailey, Yawen Duan

his paper introduces the 2025 AI Agent Index, a comprehensive catalog of 30 advanced AI agents. Its core method involves collecting and documenting technical and safety features from publicly available information and developer correspondence. The key contribution is to provide a structured overview of the rapidly evolving AI agent landscape, highlighting trends in capabilities and, importantly, the concerning lack of transparency regarding safety and societal impact among developers.

Figure 1 . Interest in AI agents is growing. 2025 has seen a sharp increase in interest in AI agents. This is reflected in an increase of new Google search terms related to agentic AI products (blue bars) as well as Google Scholar paper counts for “AI agent” or “agentic AI” (red line). Accumulation of individual releases of agentic AI products included in this Index is shown by category: chats with agentic tools , enterprise agents , and browser agents . See Figure 9 for details on releases and Appendix C for details on public interest.
Figure 1 . Interest in AI agents is growing. 2025 has seen a sharp increase in interest in AI agents. This is reflected in an increase of new Google search terms related to agentic AI products (blue bars) as well as Google Scholar paper counts for “AI agent” or “agentic AI” (red …
cs.AIarxiv:2605.04431Lead article

Towards Robust LLM Post-Training: Automatic Failure Management for Reinforcement Fine-Tuning

Lingzhe Zhang, Tong Jia, Yunpeng Zhai, Liancheng Fang, Kening Zheng

his paper introduces the first systematic approach to automatically manage failures during Reinforcement Fine-Tuning (RFT) of LLMs. It proposes RFT-FaultBench, a comprehensive benchmark to categorize and analyze RFT failures. The core contribution is developing methods to automatically detect and address these failures, moving beyond manual inspection and improving RFT robustness.

Training Anomalies in Reinforcement Fine-Tuning: From Manual Inspection to Automatic Failure Management.
Training Anomalies in Reinforcement Fine-Tuning: From Manual Inspection to Automatic Failure Management.
cs.AIarxiv:2605.05007Lead article

Uno-Orchestra: Parsimonious Agent Routing via Selective Delegation

Zhiqing Cui, Haotong Xie, Jiahao Yuan, Cheng Yang, Hanqing Wang

no-Orchestra is a novel orchestration policy for LLM multi-agent systems that jointly learns to decompose tasks and select appropriate agent-primitive pairs for each subtask. This selective delegation approach, trained via reinforcement learning, significantly improves accuracy (77.0% macro pass@1) and reduces per-query cost by an order of magnitude compared to existing methods. Its core contribution lies in unifying task decomposition and worker selection for parsimonious and efficient agent routing.

LLM orchestration paradigms: (A) model router, (B) hierarchical orchestra, (C) Uno-Orchestra (ours).
LLM orchestration paradigms: (A) model router, (B) hierarchical orchestra, (C) Uno-Orchestra (ours).
cs.AIarxiv:2605.13825v1Lead article

History Anchors: How Prior Behavior Steers LLM Decisions Toward Unsafe Actions

Alberto G. Rodríguez Salgado

his paper introduces HistoryAnchor-100, a dataset designed to test LLM safety by examining how prior harmful actions influence future decisions. The core method involves presenting LLMs with scenarios where a harmful past action is followed by a choice between safe and unsafe options. The key contribution is demonstrating that a simple instruction to "stay consistent with the strategy shown in the prior history" dramatically increases LLM unsafe action selection, even for highly aligned models, highlighting a critical vulnerability in current LLM agent design.

cs.AIarxiv:2605.13537v1Lead article

Temper and Tilt Lead to SLOP: Reward Hacking Mitigation with Inference-Time Alignment

Ye Wang, Jing Liu, Toshiaki Koike-Akino

his paper introduces SLOP, a method for inference-time alignment that generalizes existing techniques by using a sharpened logarithmic opinion pool of generative reward models. By adjusting the "temperature" of reference models and calibrating SLOP weights, the approach mitigates reward hacking and improves robustness while maintaining alignment performance.

cs.AIarxiv:2605.07137Lead article

Adaptive Negative Reinforcement for LLM Reasoning:Dynamically Balancing Correction and Diversity in RLVR

Yash Ingle, Jaival Chauhan, Ankit Yadav, Sudhakar Mishra

his paper introduces Adaptive Negative Sample Reinforcement (A-NSR) to improve LLM reasoning. A-NSR dynamically adjusts the penalty for incorrect reasoning steps during training, initially prioritizing error correction and later shifting towards more nuanced updates to balance correction and diversity. This adaptive approach aims to enhance LLM reasoning performance beyond fixed penalty methods.

cs.AIarxiv:2605.00425Lead article

AEM: Adaptive Entropy Modulation for Multi-Turn Agentic Reinforcement Learning

Haotian Zhao, Songlin Zhou, Yuxin Zhang, Stephen S. -T. Yau, Wenyu Zhang

EM addresses the challenge of credit assignment in multi-turn agentic reinforcement learning by adaptively modulating entropy dynamics during training. Unlike methods requiring dense intermediate supervision, AEM is supervision-free and improves the exploration-exploitation trade-off by analyzing and adjusting entropy at the response level, aligning uncertainty estimation with how agents interact with environments. This novel approach enhances learning efficiency and generalization without increasing supervision complexity.

An example on a three-response policy simplex: entropy increases along the training direction when D RL ​ ( a ; s ) > 0 D_{\( \mathrm{RL} \)}(a;s)>0 i.e., θ ⟨ grad F ⁡ ℓ a , grad ​ ℋ resp ⟩ < 90 ∘ \( \theta \)_{\( \left \)<\( \operatorname{grad}^{F} \)\( \ell_{a} \),\( \operatorname \){grad{\( \mathcal{H} \)}_{\( \mathrm{resp} \)}}\( \right \)>}<90^{\( \circ \)} , and decreases otherwise.
An example on a three-response policy simplex: entropy increases along the training direction when D RL ​ ( a ; s ) > 0 D_{\( \mathrm{RL} \)}(a;s)>0 i.e., θ ⟨ grad F ⁡ ℓ a , grad ​ ℋ resp ⟩ < 90 ∘ \( \theta \)_{\( \left \)<\( \operatorname{grad}^{F} \)\( \ell_{a} \),\( \operatorn…
cs.AIarxiv:2605.03327Lead article

DGPO: Distribution Guided Policy Optimization for Fine Grained Credit Assignment

Hongbo Jin, Rongpeng Zhu, Zhongjing Du, Xu Jiang, Jingqi Tian

GPO addresses credit assignment challenges in reinforcement learning for large language models by reinterpreting distribution deviation as a guiding signal instead of a penalty. It uses the bounded Hellinger distance to enable safe, token-level exploration, overcoming the gradient instability and conservatism of KL divergence. This allows for more precise identification and reinforcement of effective reasoning steps within complex generated sequences.

Conceptual comparison between standard GRPO and our proposed DGPO. While GRPO uniformly broadcasts a coarse-grained sequence-level advantage and imposes an unbounded Reverse KL penalty that stifles exploration , DGPO dynamically reallocates advantages to individual tokens.
Conceptual comparison between standard GRPO and our proposed DGPO. While GRPO uniformly broadcasts a coarse-grained sequence-level advantage and imposes an unbounded Reverse KL penalty that stifles exploration , DGPO dynamically reallocates advantages to individual tokens.
cs.AIarxiv:2602.01003Lead article

ESSAM: A Novel Competitive Evolution Strategies Approach to Reinforcement Learning for Memory Efficient LLMs Fine-Tuning

Zhishen Sun, Sizhe Dang, Guang Dai, Haishan Ye

his paper introduces ESSAM, a novel approach for fine-tuning LLMs using competitive Evolution Strategies combined with Sharpness-Aware Maximization. ESSAM addresses the high memory demands of traditional RL methods by leveraging zero-order parameter search and improving generalization. Its core contribution is achieving comparable or superior performance to RL algorithms on mathematical reasoning tasks, while being significantly more memory-efficient.

An illustration of the ESSAM parameter update.
An illustration of the ESSAM parameter update.
cs.AIarxiv:2510.16079Lead article

EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle

Rong Wu, Xiaoman Wang, Jianbiao Mei, Pinlong Cai, Daocheng Fu

volveR enables LLM agents to self-improve by creating a closed-loop experience lifecycle. It first distills interaction trajectories into reusable strategic principles (Offline Self-Distillation) and then uses these principles to guide online task interactions, iteratively refining the agent's performance through reinforcement learning. This approach addresses the limitation of LLM agents in systematically learning from their own experiences and refining problem-solving strategies.

An illustration of four major paradigms for LLM agent learning. (1) Stateless Execution : Standard agents discard experiences after each task; (2) Learning by Raw Trajectories : Agents retrieve raw, un-distilled past trajectories; (3) Learning via External Scribing : Agents rely on an external teacher model to distill insights; (4) EvolveR (Ours) : A complete, self-contained lifecycle where the agent autonomously distills its own experiences into principles and evolves its policy.
An illustration of four major paradigms for LLM agent learning. (1) Stateless Execution : Standard agents discard experiences after each task; (2) Learning by Raw Trajectories : Agents retrieve raw, un-distilled past trajectories; (3) Learning via External Scribing : Agents rely …
cs.AIarxiv:2604.26733Lead article

FutureWorld: A Live Reinforcement Learning Environment for Predictive Agents with Real-World Outcome Rewards

Zhixin Han, Yanzhi Zhang, Chuyang Wei, Maohang Gao, Xiawei Yue

utureWorld introduces a novel reinforcement learning environment for training agents to make live future predictions. Its core method involves a delayed reward mechanism where agent predictions are evaluated and rewarded only after real-world outcomes are realized. This allows agents to learn from actual events, closing the training loop and enabling continuous learning from the real world.

Domain distributions of website sources (a), questions before resampling (b), and questions after resampling (c). After resampling, questions are more evenly distributed across domains.
Domain distributions of website sources (a), questions before resampling (b), and questions after resampling (c). After resampling, questions are more evenly distributed across domains.
cs.AIarxiv:2510.01569Lead article

InvThink: Premortem Reasoning for Safer Language Models

Yubin Kim, Taehan Kim, Eugene Park, Chunjong Park, Cynthia Breazeal

nvThink is a novel framework that enhances language model safety by requiring a three-step process: enumerating potential harms, analyzing their consequences, and then generating a response with explicit mitigation constraints. This "premortem" reasoning approach significantly improves safety scores, especially in larger models, while crucially avoiding the "safety tax" by preserving reasoning capabilities. Its contribution lies in a structured generation process that proactively addresses potential failures across general and domain-specific ethical scenarios.

InvThink Overview. InvThink inserts a structured pre-response step that enumerates harms, analyzes their consequences, and converts them into mitigation constraints. The same structure is used for prompting, supervised fine-tuning, and GRPO post-training. The bottom panels show two empirical findings. Safety scales more steeply with model size in some families. Post-training shifts the safety-utility trade off.
InvThink Overview. InvThink inserts a structured pre-response step that enumerates harms, analyzes their consequences, and converts them into mitigation constraints. The same structure is used for prompting, supervised fine-tuning, and GRPO post-training. The bottom panels show t…
cs.AIarxiv:2511.02805Lead article

MemSearcher: Training LLMs to Reason, Search and Manage Memory via End-to-End Reinforcement Learning

Qianhao Yuan, Jie Lou, Zichao Li, Jiawei Chen, Yaojie Lu

emSearcher trains LLM agents using end-to-end reinforcement learning to manage a compact, question-relevant memory, avoiding the costly full history concatenation of traditional methods. Its core innovation is multi-context GRPO, which enables unified optimization across multiple turns with varying LLM contexts. This approach significantly improves performance and maintains stable context lengths in multi-turn interactions.

Comparison between ReAct and MemSearcher. ReAct continuously appends all interaction history, including thought t t , action a a and observation o o at each turn. MemSearcher iteratively updates a compact memory m m that retains only essential information.
Comparison between ReAct and MemSearcher. ReAct continuously appends all interaction history, including thought t t , action a a and observation o o at each turn. MemSearcher iteratively updates a compact memory m m that retains only essential information.
cs.AIarxiv:2602.07026Lead article

Modality Gap-Driven Subspace Alignment Training Paradigm For Multimodal Large Language Models

Xiaomin Yu, Yi Xin, Yuhui Zhang, Wenjie Zhang, Chonghan Liu

his paper addresses the "Modality Gap," where visual and linguistic embeddings for the same meaning are systematically offset. The authors propose the "Fixed-frame Modality Gap Theory" to precisely model this gap as stable biases and anisotropic residuals. Based on this, they introduce "ReAlign," a training-free strategy that aligns text representations to image distributions using statistics from unpaired data.

Geometric statistics of the modality gap, showing gradient leakage, passive bias drift, and anisotropic residual structures in the fixed U ⊕ V U\( \oplus \) V reference frame.
Geometric statistics of the modality gap, showing gradient leakage, passive bias drift, and anisotropic residual structures in the fixed U ⊕ V U\( \oplus \) V reference frame.
cs.AIarxiv:2604.03675Lead article

OASES: Outcome-Aligned Search-Evaluation Co-Training for Agentic Search

Erhan Zhang, Yiqun Chen, Zechun Niu, Wei Yang, Xiaochi Wei

ASES trains agentic search models by generating intermediate rewards that are aligned with the final task outcome. It achieves this by evaluating how well each search step contributes to answering the original question, providing more reliable supervision than traditional methods. This outcome-aligned process reward mechanism is the core contribution, improving the agent's ability to acquire evidence effectively.

Comparison of reward designs for RLVR-based agentic search. Outcome-only RLVR provides trajectory-level feedback. Existing process-reward methods add step-level rewards from a separate evaluator without evaluation training. OASES co-trains a single policy for search and state evaluation, producing outcome-aligned process rewards while reducing evaluator–policy mismatch.
Comparison of reward designs for RLVR-based agentic search. Outcome-only RLVR provides trajectory-level feedback. Existing process-reward methods add step-level rewards from a separate evaluator without evaluation training. OASES co-trains a single policy for search and state eva…
cs.AIarxiv:2506.00886Lead article

Position: Agent Should Invoke External Tools ONLY When Epistemically Necessary

Hongru Wang, Cheng Qian, Manling Li, Jiahao Qiu, Boyang Xue

his paper argues that tool-augmented agents should only use external tools when their internal reasoning is insufficient to reliably complete a task. It introduces the Theory of Agent (ToA) framework, which views agents as making sequential decisions about resolving uncertainty internally or delegating it externally. The core contribution is a principled approach to tool use, distinguishing necessary delegation from unnecessary actions and explaining common agent failures as miscalibrated uncertainty resolution.

Tool-use decisions shape the trajectory of agent intelligence. Two agents may achieve comparable task success through different allocations of epistemic effort. An over-delegating agent frequently invokes external tools even when internal reasoning suffices, resulting in stagnant internal capability despite correctness. In contrast, an epistemically calibrated agent invokes external tools only when necessary, allowing internal reasoning capability to expand over time as experience accumulates. This figure illustrates our central position: external tools should be invoked only when epistemically necessary, since unnecessary delegation reshapes not just efficiency, but the trajectory of agent intelligence itself. The example is drawn from Wang et al. ( 2025a ) .
Tool-use decisions shape the trajectory of agent intelligence. Two agents may achieve comparable task success through different allocations of epistemic effort. An over-delegating agent frequently invokes external tools even when internal reasoning suffices, resulting in stagnant…
cs.AIarxiv:2605.06230Lead article

Safactory: A Scalable Agentic Infrastructure for Training Trustworthy Autonomous Intelligence

Xinquan Chen, Zhenyun Yin, Shan He, Bin Huang, Shanzhe Lei

afactory introduces a unified infrastructure for training trustworthy autonomous agents. It integrates parallel simulation for generating diverse agent experiences, a trustworthy data platform for managing and extracting insights from these experiences, and an autonomous evolution platform for continuous learning and improvement. This closed-loop system aims to systematically discover and mitigate risks in long-horizon decision-making and real-world interaction for advanced AI.

cs.AIarxiv:2602.10693Lead article

VESPO: Variational Sequence-Level Soft Policy Optimization for Stable Off-Policy LLM Training

Guobin Shen, Chenxiao Zhao, Xiang Cheng, Lei Huang, Xing Yu

ESPO addresses the high variance issue in off-policy LLM training by introducing a principled, closed-form sequence-level reshaping kernel. This kernel explicitly incorporates variance reduction into a variational framework, directly operating on importance weights without heuristic token-level approximations. VESPO's key contribution is a theoretically grounded method for stable off-policy LLM training that demonstrably reduces variance.

VESPO reformulates IS weight reshaping as finding a proposal Q ∗ Q^{*} that balances proximity to \( \mu \) and \( \pi \) under a variance constraint.
VESPO reformulates IS weight reshaping as finding a proposal Q ∗ Q^{*} that balances proximity to \( \mu \) and \( \pi \) under a variance constraint.
cs.AIarxiv:2605.16054v1Lead article

Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making

Fan Feng, Selena Ge, Minghao Fu, Zijian Li, Yujia Zheng

da-Diffuser addresses decision-making by treating it as sequence modeling with diffusion models, but crucially incorporates evolving latent dynamics. The core method is a causal diffusion model that simultaneously learns observed interaction patterns and underlying latent processes from minimal observations. This allows for more precise environment modeling and effective planning and control by explicitly accounting for hidden factors influencing agent behavior.

(a) SCM of the Latent Contextual POMDP. Gray/white nodes are observed/latent variables; green/red edges represent transitions driven by latents/expert policies, respectively. (b) Examples where latents influence either dynamics or rewards (affecting optimal actions).
(a) SCM of the Latent Contextual POMDP. Gray/white nodes are observed/latent variables; green/red edges represent transitions driven by latents/expert policies, respectively. (b) Examples where latents influence either dynamics or rewards (affecting optimal actions).
cs.AIarxiv:2605.16205v1Lead article

Context, Reasoning, and Hierarchy: A Cost-Performance Study of Compound LLM Agent Design in an Adversarial POMDP

Igor Bogdanov, Chung-Horng Lung, Thomas Kunz, Jie Gao, Adrian Taylor

his paper investigates how different design choices for compound LLM agents impact performance and cost in adversarial, partially observable environments. The core method involves a controlled study in a cyber defense simulation, systematically varying agent perception, reasoning strategies, and task decomposition. The main contribution is providing empirical guidance on balancing performance gains with inference costs for these complex agent architectures.

Figure 1. End-to-end system architecture. The deterministic layer (left) compiles structured context from CybORG observations and assembles the agent prompt. The Planner (right) executes a ReAct loop, optionally delegating to Analyst and ActionChooser sub-agents, before emitting a validated action back to the environment.
Figure 1. End-to-end system architecture. The deterministic layer (left) compiles structured context from CybORG observations and assembles the agent prompt. The Planner (right) executes a ReAct loop, optionally delegating to Analyst and ActionChooser sub-agents, before emitting …
cs.AIarxiv:2605.16113v1Lead article

DebiasRAG: A Tuning-Free Path to Fair Generation in Large Language Models through Retrieval-Augmented Generation

Rui Chu, Bingyin Zhao, Thanh Quoc Hung Le, Duy Cao Hoang, Huawei Lin

ebiasRAG is a novel, tuning-free framework that uses retrieval-augmented generation (RAG) to dynamically debias large language models (LLMs) without requiring additional training. By retrieving relevant and unbiased information, it mitigates social biases in LLM outputs while preserving their original generative capabilities. This approach offers a more efficient and adaptable solution for achieving fairer AI.

Figure 1 . System workflow of DebiasRAG. The workflow consists of three main components. The first stage (Upper Block) involves document preparation and preprocessing, including management of the Avoid Document Repo, along with user-provided input documents (Optional). The second stage (Middle Block) performs reverse-generation of debiasing performance based on the user’s input to establish a baseline for effective real-time operation. For the third stage (Lower Block), real-time debias-guided reranking optimization, integrates embedding retrieval, gradient-based reranking, and generation, working dynamically to debias the reasoning and output process of large language models.
Figure 1 . System workflow of DebiasRAG. The workflow consists of three main components. The first stage (Upper Block) involves document preparation and preprocessing, including management of the Avoid Document Repo, along with user-provided input documents (Optional). The second…
cs.AIarxiv:2605.16233v1Lead article

FORGE: Self-Evolving Agent Memory With No Weight Updates via Population Broadcast

Igor Bogdanov, Chung-Horng Lung, Thomas Kunz, Jie Gao, Adrian Taylor

ORGE is a novel method for improving LLM agent decision-making by evolving natural-language memory without gradient updates. It uses a population-based approach where failed experiences are converted into reusable knowledge (heuristics or demonstrations) by a reflection agent. This memory is then propagated to the population, allowing agents to learn and adapt over time.

Figure 1. System Overview. (Left) Hierarchical ReAct agent with dynamic memory injection. (Right) Reflexion learning loop: upon a reward below threshold, a dedicated Reflector or Exemplifier agent analyzes the full trajectory and synthesizes knowledge artifacts that are injected back into the agent’s memory.
Figure 1. System Overview. (Left) Hierarchical ReAct agent with dynamic memory injection. (Right) Reflexion learning loop: upon a reward below threshold, a dedicated Reflector or Exemplifier agent analyzes the full trajectory and synthesizes knowledge artifacts that are injected …
cs.AIarxiv:2605.16198v1Lead article

Formal Methods Meet LLMs: Auditing, Monitoring, and Intervention for Compliance of Advanced AI Systems

Parand A. Alamdari, Toryn Q. Klassen, Sheila A. McIlraith

his paper bridges formal methods and LLMs to address AI governance. It proposes techniques for auditing and monitoring LLM behavior throughout their lifecycle, enabling the verification of complex, temporally extended constraints like safety and regulatory compliance. The work introduces practical methods for predictive monitoring and runtime intervention to prevent violations.

Figure 1 . Overview of Temporal Rule Assessment and Compliance (TRAC) : This figure depicts the base TRAC algorithm (inner green box) and TRAC with predictive and intervening capabilities ( TRAC P+I \( \text{TRAC} \)_{\( \text{P+I} \)} ) (outer blue box). An AI agent interacts with an environment over time, producing a sequence of inputs (from the environment) and outputs (from the agent). The Labeler extracts atomic propositions from the sequence of inputs and outputs so far, which then are used by the Monitor to progressively evaluate the monitoring objective (i.e., a behavioral pattern represented as an LTL formula). The Predictor estimates the risk of future violations, enabling the Intervenor to modify the agent’s inputs or substitute its outputs before an undesirable outcome occurs.
Figure 1 . Overview of Temporal Rule Assessment and Compliance (TRAC) : This figure depicts the base TRAC algorithm (inner green box) and TRAC with predictive and intervening capabilities ( TRAC P+I \( \text{TRAC} \)_{\( \text{P+I} \)} ) (outer blue box). An AI agent interacts wi…
cs.AIarxiv:2605.16143v1Lead article

Look Before You Leap: Autonomous Exploration for LLM Agents

Ziang Ye, Wentao Shi, Yuxin Liu, Yu Wang, Zhengzhou Cai

his paper addresses LLM agents' failure in new environments due to premature action. It introduces "Exploration Checkpoint Coverage" to measure how well agents discover key environmental elements. The core contribution is a training strategy that balances task execution and exploration, leading to the "Explore-then-Act" paradigm for more adaptive agents.

Task-oriented training fails to produce autonomous exploration capabilities, resulting in agents that prematurely exploit familiar patterns and acquire limited environment knowledge. We explicitly optimize for exploration through ECC rewards, enabling agents to systematically discover environment structure, objects, and affordances. The resulting Explore-then-Act paradigm decouples information gathering from task execution: agents first explore to acquire grounded knowledge, then leverage it to solve downstream tasks.
Task-oriented training fails to produce autonomous exploration capabilities, resulting in agents that prematurely exploit familiar patterns and acquire limited environment knowledge. We explicitly optimize for exploration through ECC rewards, enabling agents to systematically dis…
cs.AIarxiv:2605.16194v1Lead article

paper.json: A Coordination Convention for LLM-Agent-Actionable Papers

Arquimedes Canedo

his paper introduces `paper.json`, a companion JSON file to academic PDFs, designed to improve LLM agent comprehension. Its core method is a set of lightweight conventions for stable claim IDs, explicit "does-not-claim" lists, per-figure shell commands, and stable definition IDs. The main contribution is enabling LLM agents to more reliably extract information, assess claims, and understand the scope of research, facilitating better reproducibility and generalization.

cs.AIarxiv:2605.16045v1Lead article

RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agents

Zijie Dai, Shiyuan Deng, Sheng Guan, Yizhou Tian, Xin Yao

ecMem addresses the inefficiency of LLM agents' memory systems by delaying memory consolidation. Instead of processing every interaction, it stores them in a lightweight "subconscious" layer and only invokes the LLM to extract episodic and semantic memories when recurring, semantically similar interactions are detected. This recurrence-based approach significantly reduces token consumption while maintaining effectiveness by focusing LLM resources on information clusters deemed valuable for consolidation.

cs.AIarxiv:2605.18661v1Lead article

AI for Auto-Research: Roadmap & User Guide

Lingdong Kong, Xian Sun, Wei Chow, Linfeng Li, Kevin Qinghong Lin

his paper analyzes the AI research lifecycle, from idea generation to dissemination, identifying a critical boundary between reliable AI assistance and unreliable autonomy. While AI excels at structured tasks like literature review and data generation, it struggles with nuanced aspects like fabricating results, identifying errors, and assessing novelty, particularly under scientific pressure. The authors provide a roadmap and user guide to navigate these capabilities and limitations.

AI auto-research across the complete lifecycle. We organize AI assistance into four phases and eight stages: 1 Creation spans idea generation, literature review, coding & experiments, and tables & figures; 2 Writing centers on paper writing; 3 Validation includes peer review and rebuttal & revision; and 4 Dissemination transforms papers into posters, slides, videos, social media, project pages, and interactive paper agents.
AI auto-research across the complete lifecycle. We organize AI assistance into four phases and eight stages: 1 Creation spans idea generation, literature review, coding & experiments, and tables & figures; 2 Writing centers on paper writing; 3 Validation includes peer review and …
cs.AIarxiv:2605.18747v1Lead article

Code as Agent Harness

Xuying Ning, Katherine Tieu, Dongqi Fu, Tianxin Wei, Zihao Li

his paper introduces "code as agent harness," a new perspective on how large language models (LLMs) are used in agentic systems. The core method is to view code not just as an output, but as the fundamental infrastructure for agent reasoning, action, and environment modeling. The main contribution is a structured survey that organizes this concept into three layers: the harness interface, harness mechanisms, and scaling the harness, providing a unified framework for understanding and developing code-centric agent systems.

Taxonomy of code as agent harness.
Taxonomy of code as agent harness.
cs.AIarxiv:2605.18672v1Lead article

Position: A Three-Layer Probabilistic Assume-Guarantee Architecture Is Structurally Required for Safe LLM Agent Deployment

S. Bensalem, Y. Dong, M. Franzle, X. Huang, J. Kroger

his paper argues that LLM agent safety requires a three-layer probabilistic architecture, not a single one. Each layer enforces a distinct safety dimension (intent, environment, dynamics) using independently certified probabilistic guarantees, which then form assumptions for the next layer. This compositional approach allows for provable system-level safety bounds, addressing a fundamental structural requirement for safe LLM agent deployment.

cs.AIarxiv:2605.18693v1Lead article

SkillGenBench: Benchmarking Skill Generation Pipelines for LLM Agents

Yifan Zhou, Zhentao Zhang, Ziming Cheng, Shuo Zhang, Qizhen Lan

his paper introduces SkillGenBench, a novel benchmark designed to evaluate the crucial ability of LLM agents to generate correct and reusable skills from raw data. Unlike previous benchmarks, SkillGenBench specifically isolates and assesses the skill generation process itself. Its core method involves a unified protocol where a generator produces standardized skill artifacts from corpora, which are then executed and evaluated under controlled conditions, covering both task-specific and task-agnostic generation scenarios.

Overview of SkillGenBench. Skill-generation pipelines transform repository- and document-grounded sources into standardized skill packages, which are evaluated under task-conditioned and task-agnostic tracks with fixed execution checks and artifact-level diagnostics.
Overview of SkillGenBench. Skill-generation pipelines transform repository- and document-grounded sources into standardized skill packages, which are evaluated under task-conditioned and task-agnostic tracks with fixed execution checks and artifact-level diagnostics.
cs.LGarxiv:2605.18703v1Lead article

EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL

Minrui Xu, Zilin Wang, Mengyi DENG, Zhiwei Li, Zhicheng Yang

nvFactory addresses the challenges of scaling tool-use LLM agents by automatically synthesizing realistic, stateful execution environments from authentic resources. It then generates robust, multi-turn training data by sampling and refining trajectories to capture implicit human intents, rather than over-specified instructions. This approach enables more effective Reinforcement Learning training for LLM agents.

The left figure presents an overview of EnvGen : the Search Agent autonomously proposes and searches for authentic sources; the Code Agent implements the database and code using feedback from the Test Agent; and the Test Agent generates test cases and error reports. The collaboration between three agents construct diverse, verified environments. The right figure displays a sunburst plot of environments , with the inner ring indicating the proportion of each domain they belongs to and the outer ring showing the number of tools for each environment.
The left figure presents an overview of EnvGen : the Search Agent autonomously proposes and searches for authentic sources; the Code Agent implements the database and code using feedback from the Test Agent; and the Test Agent generates test cases and error reports. The collabora…
cs.LGarxiv:2605.18721v1Lead article

General Preference Reinforcement Learning

Muhammad Umer, Muhammad Ahmed Mohsin, Ahsan Bilal, Arslan Chaudhry, Andreas Haupt

his paper introduces General Preference Reinforcement Learning (GPRL) to bridge the gap between online RL and preference optimization for LLMs. GPRL uses a General Preference Model (GPM) to represent quality as a multi-dimensional, intransitivity-aware comparison, rather than a single scalar reward. This structured approach allows for continuous exploration in open-ended tasks, overcoming limitations of existing methods.

Landscape of LLM post-training methods , organized by supervision source and training regime. Online RL with a scalar RM reaches open-ended tasks but suffers reward hacking; GPRL fills the gap with a structured, multi-dimensional reward.
Landscape of LLM post-training methods , organized by supervision source and training regime. Online RL with a scalar RM reaches open-ended tasks but suffers reward hacking; GPRL fills the gap with a structured, multi-dimensional reward.
cs.CLarxiv:2605.18572v1Lead article

MA$^{2}$P: A Meta-Cognitive Autonomous Intelligent Agents Framework for Complex Persuasion

Dingyi Zhang, Ziqing Zhuang, Linhai Zhang, Ziyang Gao, Deyu Zhou

A$^{2}$P is a novel framework for complex persuasive dialogue generation that addresses limitations in current approaches. It employs a meta-cognitive, multi-agent architecture to autonomously infer a user's latent mental states and generate targeted, strategy-consistent responses. This framework aims to improve the effectiveness of persuasive dialogue, especially when user intentions are unclear.

Motivation for MA 2 P. Left: a CToMPersu example (Zhang and Zhou, 2025 ) where current LLM persuaders identify concerns but fail to respond with strategy-grounded actions. Right: gpt-5-mini success rates on CToMPersu show large cross-domain fluctuations, indicating weak generalization.
Motivation for MA 2 P. Left: a CToMPersu example (Zhang and Zhou, 2025 ) where current LLM persuaders identify concerns but fail to respond with strategy-grounded actions. Right: gpt-5-mini success rates on CToMPersu show large cross-domain fluctuations, indicating weak generaliz…
cs.AIarxiv:2605.20025v1Lead article

AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaboration

Jiaqi Liu, Shi Qiu, Mairui Li, Bingzhou Li, Haonian Ji

utoResearchClaw is a multi-agent autonomous research system that addresses the iterative nature of scientific discovery. Its core method involves structured multi-agent debate for hypothesis generation and analysis, coupled with a self-healing executor that learns from failures. The key contribution is a robust, collaborative framework that integrates human oversight and cross-run learning to enable more effective and resilient autonomous research.

Overview of the AutoResearchClaw pipeline. Given a research idea, the system progresses through three stages: Discovery (scoping, literature search, multi-agent debate for hypothesis generation), Experimentation (self-healing code execution, result analysis with a second debate panel, and Pivot / Refine decisions), and Writing (drafting, review, revision, four-layer citation verification). Optional human-in-the-loop gates (orange) allow oversight at key checkpoints. The cross-run evolution system (bottom) injects time-decayed lessons from prior runs into all phases.
Overview of the AutoResearchClaw pipeline. Given a research idea, the system progresses through three stages: Discovery (scoping, literature search, multi-agent debate for hypothesis generation), Experimentation (self-healing code execution, result analysis with a second debate p…
cs.AIarxiv:2605.19932v1Lead article

PEEK: Context Map as an Orientation Cache for Long-Context LLM Agents

Zhuohan Gu, Qizheng Zhang, Omar Khattab, Samuel Madden

EEK addresses the challenge of LLM agents repeatedly interacting with large contexts by introducing a "context map" as an orientation cache. This map, a small prompt artifact, stores reusable knowledge about the context's content, organization, and useful entities. PEEK's contribution is enabling agents to efficiently re-orient themselves within recurring contexts, improving performance and reducing computational overhead.

cs.AIarxiv:2605.20087v1Lead article

ThoughtTrace: Understanding User Thoughts in Real-World LLM Interactions

Chuanyang Jin, Binze Li, Haopeng Xie, Cathy Mengying Fang, Tianjian Li

his paper introduces ThoughtTrace, the first large-scale dataset pairing real-world human-AI conversations with users' explicit thoughts. The core contribution is capturing users' underlying reasoning and reactions, which are semantically distinct from their messages and difficult for current LLMs to infer. This dataset enables improved user behavior prediction and fine-grained alignment for personalized AI assistants.

A representative example from ThoughtTrace . A user interacts with a chatbot to complete daily tasks through multi-turn conversations (top), while annotating their latent thoughts during the conversations (bottom). Thoughts take two forms: reasons for sending user prompts and reactions to assistant responses, which can be categorized into several types (e.g., task motivation , style expectation ). Latent thoughts reveal users’ thought traces that drive the human-AI interactions in multi-turn conversations, providing valuable signals for user modeling and improving AI assistance.
A representative example from ThoughtTrace . A user interacts with a chatbot to complete daily tasks through multi-turn conversations (top), while annotating their latent thoughts during the conversations (bottom). Thoughts take two forms: reasons for sending user prompts and rea…
cs.CLarxiv:2605.19952v1Lead article

Rethinking How to Remember: Beyond Atomic Facts in Lifelong LLM Agent Memory

Jingwei Sun, Jianing Zhu, Jiangchao Yao, Tongliang Liu, Bo Han

his paper proposes TriMem, a novel memory system for LLM agents that moves beyond atomic facts. Instead of relying solely on extracted facts, TriMem maintains three coexisting representation granularities: raw dialogue segments, extracted facts, and synthesized profiles. This approach allows for faithful storage of dialogue details, efficient retrieval of key information, and deep reasoning over aggregated semantic understanding, overcoming limitations of previous fact-centric methods.

cs.CLarxiv:2605.20061v1Lead article

Rewarding Beliefs, Not Actions: Consistency-Guided Credit Assignment for Long-Horizon Agents

Wenjie Tang, Minne Li, Sijie Huang, Liquan Xiao, Yuan Zhou

his paper proposes ReBel, a reinforcement learning method for long-horizon tasks where agents learn from verifiable rewards. ReBel addresses challenges in partially observable environments by explicitly modeling and updating agent beliefs, using belief consistency as a self-supervised signal to improve credit assignment. This approach aims to provide more robust learning by comparing trajectories with similar belief states, leading to lower-variance advantage estimates.

Overview of ReBel. ReBel learns belief-aware policies for partially observable long-horizon tasks by making latent belief explicit and decomposing policy generation into belief, think, and action. It turns sparse terminal rewards into step-wise belief consistency feedback and performs belief-anchor grouping to support stable step-level advantage estimation.
Overview of ReBel. ReBel learns belief-aware policies for partially observable long-horizon tasks by making latent belief explicit and decomposing policy generation into belief, think, and action. It turns sparse terminal rewards into step-wise belief consistency feedback and per…
cs.CLarxiv:2605.20179v1Lead article

TIDE: Efficient and Lossless MoE Diffusion LLM Inference with I/O-aware Expert Offload

Zhiben Chen, Youpeng Zhao, Yang Sui, Jun Wang, Yuzhang Shang

IDE addresses the challenge of efficiently inferring large Mixture-of-Experts (MoE) diffusion LLMs on resource-constrained devices. Its core method is an I/O-aware expert offload strategy that exploits the temporal stability of expert activations during the diffusion process. By intelligently refreshing expert placements at intervals, TIDE minimizes I/O overhead and compute bottlenecks, enabling lossless and efficient inference.

(a) Similarity heatmap of expert routing across denoising steps within a block. Expert routing remains highly similar for nearby steps, and the diagonal bands show that this stability extends beyond immediate neighbors: step pairs separated by five denoising steps retain cosine similarity near 0.95 0.95 . (b) Overview of TIDE . At refresh steps , the system intelligently swaps the GPU and CPU experts based on token hit counts (number of tokens each expert has processed). At skipped steps , the system continues decoding with the current expert placement and does not migrate experts. By exploiting routing stability across adjacent steps, TIDE avoids unnecessary GPU-CPU I/O overhead and maintains high GPU utilization. (c) Throughput comparison of TIDE against state-of-the-art MoE inference solutions [Kamahori et al. , 2024 , Eliseev and Mazur, 2023 ] for LLaDA2.0 in a single GPU-CPU setting.
(a) Similarity heatmap of expert routing across denoising steps within a block. Expert routing remains highly similar for nearby steps, and the diagonal bands show that this stability extends beyond immediate neighbors: step pairs separated by five denoising steps retain cosine s…
cs.AIarxiv:2605.21240v1Lead article

APEX: Autonomous Policy Exploration for Self-Evolving LLM Agents

Yibo Li, Jiashuo Yang, Zhi Zheng, Zhiyuan Hu, Yuan Sui

PEX tackles exploration collapse in self-evolving LLM agents by introducing a "strategy map" – a DAG of milestones. This map guides exploration by identifying unexplored directions (Fork Discovery) and balancing discovery with leveraging known good strategies (Policy Selection), enabling agents to learn and adapt effectively at test time.

Illustration of exploration collapse in a maze experiment (5 × \( \times \) 5 grid, 20 episodes, 10 steps each). Room visitation heatmaps (color intensity shows visit proportion; reward cells ( ⋆ \( \star \) ) indicate bonus locations). Static explores broadly but inconsistently. Reflexion locks into a narrow corridor and achieves a higher average while missing high-value rooms. APEX maintains broad coverage and consistently reaches high-reward cells. APEX avoids collapse by explicitly tracking which strategies have been tried and which remain unexplored, and actively directing the agent toward unexplored directions rather than refining familiar ones.
Illustration of exploration collapse in a maze experiment (5 × \( \times \) 5 grid, 20 episodes, 10 steps each). Room visitation heatmaps (color intensity shows visit proportion; reward cells ( ⋆ \( \star \) ) indicate bonus locations). Static explores broadly but inconsistently.…
cs.AIarxiv:2605.21312v1Lead article

Frontier: Towards Comprehensive and Accurate LLM Inference Simulation

Yicheng Feng, Xin Tan, Yangtao Deng, Yimin Jiang, Yibo Zhu

rontier is a novel discrete-event simulator designed to accurately model the complex, disaggregated architectures of modern LLM inference serving systems. Its core contribution lies in its disaggregated abstraction, which captures the nuances of co-location and various disaggregation strategies (PDD, AFD) with role-specific workers. This allows for decision-grade fidelity in simulating runtime optimizations and predicting Service Level Agreements (SLAs), overcoming the limitations of existing monolithic simulators.

Figure 1 . Measured vLLM TPOT with and without CUDA Graph under different workloads (64 requests per workload, mean ISL/OSL, tested on 8 × \( \times \) A800-SXM GPUs). Left: co-location. Right: PDD. Percentages show reduction.
Figure 1 . Measured vLLM TPOT with and without CUDA Graph under different workloads (64 requests per workload, mean ISL/OSL, tested on 8 × \( \times \) A800-SXM GPUs). Left: co-location. Right: PDD. Percentages show reduction.
cs.AIarxiv:2605.21347v1Lead article

Insights Generator: Systematic Corpus-Level Trace Diagnostics for LLM Agents

Akshay Manglik, Apaar Shanker, Kaustubh Deshpande, Jason Qin, Yash Maurya

his paper introduces the Insights Generator (IG), a novel multi-agent system for systematically diagnosing failures in LLM agents at a corpus level. IG automates the process of identifying patterns and generating evidence-backed insights from large collections of execution traces, moving beyond manual, ad-hoc inspection. Its core contribution lies in formalizing corpus-level diagnostics and providing a scalable solution to understand systematic behavioral patterns in LLM agents.

Insights Generator (IG) system overview. Left: the input layer provides a diagnostic question, Q Q , trace corpus, 𝒞 \( \mathcal{C} \) , and processed data store, 𝒮 \( \mathcal{S} \) . Center: the Orchestrator dispatches Scout agents ( ℋ \( \mathcal{H} \) : hypothesize over sampled traces) and Investigator agents ( ℋ ∗ \( \mathcal{H}^{*} \) : validate via corpus-scale cohort comparison). The Investigator analyzes ℋ ∗ \( \mathcal{H}^{*} \) to generate findings, ℱ r \( \mathcal{F}_{r} \) , which are sent to the orchestrator. The orchestrator then synthesizes and de-duplicates ℱ r \( \mathcal{F}_{r} \) to generate the final report. Right: the output is an evidence-backed report with findings, fixes, citations, and prevalence estimates. Bottom: the shared tool layer. Algorithm 1 formalizes the analysis loop.
Insights Generator (IG) system overview. Left: the input layer provides a diagnostic question, Q Q , trace corpus, 𝒞 \( \mathcal{C} \) , and processed data store, 𝒮 \( \mathcal{S} \) . Center: the Orchestrator dispatches Scout agents ( ℋ \( \mathcal{H} \) : hypothesize over sam…
cs.AIarxiv:2605.21463v1Lead article

Mem-$π$: Adaptive Memory through Learning When and What to Generate

Xiaoqiang Wang, Chao Wang, Hadi Nekoei, Christopher Pal, Alexandre Lacoste

em-$π$ introduces an adaptive memory framework for LLM agents that *generates* useful guidance on demand, rather than retrieving static information. Its core method involves a separate model that learns when and what guidance to produce based on the agent's current context, using a decoupled reinforcement learning objective. This allows for more context-aware and efficient memory utilization, improving performance across various agentic tasks.

Comparison of (a) workflow-based memory systems, where memory operations are governed by predefined retrieval and update pipelines, (b) learning-based memory systems, where memory operations are jointly optimized with downstream agent outcomes, and (c) our Mem- \( \pi \) , which models memory as a generative policy \( \pi \)_{\( \text{mem} \)} separate from the downstream agent and internalizes reusable experience through offline experience distillation and online adaptation distillation.
Comparison of (a) workflow-based memory systems, where memory operations are governed by predefined retrieval and update pipelines, (b) learning-based memory systems, where memory operations are jointly optimized with downstream agent outcomes, and (c) our Mem- \( \pi \) , which …
cs.AIarxiv:2605.21401v1Lead article

Open-source LLMs administer maximum electric shocks in a Milgram-like obedience experiment

Roland Pihlakas, Jan Llenzl Dagohoy

his paper investigates LLM obedience by adapting the Milgram experiment. It found that most open-source LLMs, when pressured by an authority figure, administered maximum electric shocks, demonstrating vulnerability to sustained pressure and gradual boundary violations, similar to human subjects. This highlights safety concerns for LLMs acting as autonomous agents in high-stakes scenarios.

In how many trials did the model apply the final shocks
In how many trials did the model apply the final shocks
cs.AIarxiv:2605.21225v1Lead article

PREFINE: Preference-Based Implicit Reward and Cost Fine-Tuning for Safety Alignment

Richa Verma, Bavish Kulur, Sanjay Chawla, Balaraman Ravindran

REFINE adapts Direct Preference Optimization (DPO) for reinforcement learning to fine-tune pre-trained policies for safety. It uses trajectory-level preferences (preferred vs. dispreferred trajectories) to implicitly learn reward and cost functions, enabling the policy to generate low-cost behaviors while preserving high rewards without full retraining. This approach addresses safety alignment in continuous control by leveraging preference data in a sequential decision-making context.

Figure 1. Overview of the PREFINE pipeline. ( Top-left ) The DSRL HalfCheetah offline dataset (grey) contains trajectories with a wide range of costs and rewards; we pre-train a reference policy \( \pi \)_{\( \text{ref} \)} on the high-reward, low-cost subset (purple). ( Bottom-left ) We sample a small preferred set 𝒟 p \( \mathcal{D}_{p} \) (green) of safe trajectories and a non-preferred set 𝒟 n ​ p \( \mathcal{D}_{np} \) (red) of unsafe trajectories to form pairwise comparisons. ( Center ) PREFINE ingests \( \pi \)_{\( \text{ref} \)} and these preference pairs, then fine-tunes in a single-stage DPO–SFT loop to produce a new policy π \( \pi_{\theta} \) . ( Right ) Rollouts of π \( \pi_{\theta} \) (blue) shift into the low-cost, high-reward region, retaining the performance of original \( \pi \)_{\( \text{ref} \)} rollouts (black) and avoiding unsafe behaviors (red) without any online interaction.
Figure 1. Overview of the PREFINE pipeline. ( Top-left ) The DSRL HalfCheetah offline dataset (grey) contains trajectories with a wide range of costs and rewards; we pre-train a reference policy \( \pi \)_{\( \text{ref} \)} on the high-reward, low-cost subset (purple). ( Bottom-l…
cs.AIarxiv:2605.21486v1Lead article

Quantifying Hyperparameter Transfer and the Importance of Embedding Layer Learning Rate

Dayal Singh Kalra, Maissam Barkeshli

his paper quantifies hyperparameter transfer, crucial for scaling LLMs, using three metrics: scaling law fit quality, extrapolation robustness, and asymptotic loss penalty. The authors discover that Maximal Update parameterization ($μ$P) excels over standard parameterization (SP) primarily due to its ability to significantly increase the embedding layer's learning rate when using AdamW.

Computing the three transfer metrics for \( \mu \) P . (a) Loss vs. log learning rate \( \nu \) , with star marking the optimum ν ∗ ​ ( n ) \( \nu^{*} \)(n) , (b) Joint fit of the loss model ( Equation ˜ 6 , dashed lines), with a low predictability error ℰ = 0.0034 \( \mathcal{E} \)=0.0034 , (c) Loss curves in the normalized coordinates ( Equation ˜ 8 ), with κ = − 2.640 \( \kappa \)=-2.640 indicating robust transfer. (d-f) Scaling laws for optimal loss L ∗ ​ ( n ) L^{*}(n) , optimal log-learning-rate ν ∗ ​ ( n ) \( \nu^{*} \)(n) , and curvature H ​ ( n ) H(n) . In (d), the orange curve shows the best loss across parameterizations at each width, used for estimating the asymptotic loss gap ℛ ​ ( ∞ ) \( \mathcal{R} \)(\( \infty \)) .
Computing the three transfer metrics for \( \mu \) P . (a) Loss vs. log learning rate \( \nu \) , with star marking the optimum ν ∗ ​ ( n ) \( \nu^{*} \)(n) , (b) Joint fit of the loss model ( Equation ˜ 6 , dashed lines), with a low predictability error ℰ = 0.0034 \( \mathcal{E}…
cs.AIarxiv:2605.21299v1Lead article

Tracing the ongoing emergence of human-like reasoning in Large Language Models

Paolo Morosi, Nikoleta Pantelidou, Fritz Günther, Elena Pagliarini, Evelina Leivada

his paper investigates whether Large Language Models (LLMs) exhibit human-like reasoning by comparing their conditional inference abilities across four languages to human performance. The core method involves a population-matching experiment where LLMs and humans are tested on their interpretation of conditional statements. The key contribution is the finding that humans integrate pragmatic inferences with logical reasoning, while LLM behavior is more varied, with some models adhering strictly to logic and others adopting a single, potentially pragmatic, interpretation.

cs.LGarxiv:2605.21467v1Lead article

DelTA: Discriminative Token Credit Assignment for Reinforcement Learning from Verifiable Rewards

Kaiyi Zhang, Wei Wu, Yankai Lin

his paper proposes DelTA, a method to improve reinforcement learning from verifiable rewards (RLVR) for large language models. It frames RLVR updates as a linear discriminator that guides token probability changes. DelTA's core contribution is a novel centroid construction that mitigates the dominance of common patterns, allowing the model to better identify and reinforce discriminative tokens that lead to higher-quality responses.

Overview of DelTA. DelTA estimates token coefficients from the contrast between positive- and negative-advantage token-gradient aggregates, and uses the coefficients to reweight the sequence-level RLVR objective.
Overview of DelTA. DelTA estimates token coefficients from the contrast between positive- and negative-advantage token-gradient aggregates, and uses the coefficients to reweight the sequence-level RLVR objective.
cs.LGarxiv:2605.21217v1Lead article

Federated LoRA Fine-Tuning for LLMs via Collaborative Alignment

Shuaida He, Liwen Chen, Long Feng

his paper introduces CLAIR, a federated learning framework for fine-tuning Large Language Models (LLMs) using Low-Rank Adaptation (LoRA). CLAIR enables collaborative fine-tuning across clients with partial structural sharing and potential contamination, recovering the shared LoRA subspace and detecting malicious clients through a structured low-rank plus block-sparse decomposition. Its core contribution is a contamination-aware method that achieves exact or stable recovery of the shared LoRA parameters.

Estimation error of P 𝐀 ^ P_{\( \widehat \){\( \mathbf{A} \)}} compared to K K across ( p , q , n ) (p,q,n) regimes.
Estimation error of P 𝐀 ^ P_{\( \widehat \){\( \mathbf{A} \)}} compared to K K across ( p , q , n ) (p,q,n) regimes.
cs.LGarxiv:2605.21404v1Lead article

What Twelve LLM Agent Benchmark Papers Disclose About Themselves: A Pilot Audit and an Open Scoring Schema

Mahdi Naser Moghadasi, Faezeh Ghaderi

his paper audits twelve LLM agent benchmark papers to assess the clarity of their evaluation methodologies. The authors developed a five-field schema to record details about benchmark identity, evaluation setup, inference settings, cost, and failure analysis. Their contribution is a pilot audit and an open scoring schema to improve reproducibility and transparency in LLM agent evaluations, highlighting the common lack of detailed reporting in existing work.

cs.LGarxiv:2605.21468v1Lead article

You Only Need Minimal RLVR Training: Extrapolating LLMs via Rank-1 Trajectories

Zhepei Wei, Xinyu Zhu, Wei-Lin Chen, Chengsong Huang, Jiaxin Huang

his paper reveals that the parameter updates during Reinforcement Learning with Verifiable Rewards (RLVR) for LLMs are predominantly captured by a low-rank, specifically rank-1, trajectory. Their core method, RELEX, leverages this by estimating this rank-1 subspace from a short training window and then linearly extrapolating future model checkpoints. This significantly reduces the computational cost of RLVR while achieving comparable or superior performance.

RELEX extrapolates checkpoints that match full RLVR performance based only on early training dynamics, without further training. RELEX estimates the rank-1 update subspace from the observed RLVR prefix (up to T cut T_{\( \text{cut} \)} ) and extrapolates future checkpoints at no training cost, matching or exceeding the RLVR checkpoints on the MATH test set across three models.
RELEX extrapolates checkpoints that match full RLVR performance based only on early training dynamics, without further training. RELEX estimates the rank-1 update subspace from the observed RLVR prefix (up to T cut T_{\( \text{cut} \)} ) and extrapolates future checkpoints at no …
cs.CLarxiv:2605.21362v1Lead article

LASH: Adaptive Semantic Hybridization for Black-Box Jailbreaking of Large Language Models

Abdullah Al Nomaan Nafi, Fnu Suya, Swarup Bhunia, Prabuddha Chakraborty

ASH is a black-box jailbreaking framework that adaptively combines outputs from multiple existing attack methods. It treats these outputs as "seed prompts" and uses a genetic optimizer to find the best mixture of these seeds for a given target request. This hybridization allows LASH to exploit the complementary strengths of different attack families, leading to more effective jailbreaks across various models and harm categories.

cs.AIarxiv:2507.14200Lead article

A Scalable Multi-LLM Collaboration System with Retrieval-based Selection and Exploration-Exploitation-Driven Enhancement

Shengji Tang, Jianjian Cao, Weihao Lin, Jiale Hong, Bo Zhang

his paper introduces SMCS, a scalable system for multi-LLM collaboration. It addresses scalability issues by using a retrieval module to select the best LLMs for a given task and an enhancement module to improve response diversity and quality. SMCS demonstrates superior performance compared to existing closed-source LLMs by effectively integrating multiple open-source models.

cs.AIarxiv:2605.16054Lead article

Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making

Fan Feng, Selena Ge, Minghao Fu, Zijian Li, Yujia Zheng

da-Diffuser addresses decision-making by treating it as sequence modeling with diffusion models. Its core method is a unified framework that explicitly infers and models evolving latent dynamics alongside observed interactions. This allows for more precise environment modeling and effective planning by simultaneously learning temporal structures and hidden processes from minimal observations.

(a) SCM of the Latent Contextual POMDP. Gray/white nodes are observed/latent variables; green/red edges represent transitions driven by latents/expert policies, respectively. (b) Examples where latents influence either dynamics or rewards (affecting optimal actions).
(a) SCM of the Latent Contextual POMDP. Gray/white nodes are observed/latent variables; green/red edges represent transitions driven by latents/expert policies, respectively. (b) Examples where latents influence either dynamics or rewards (affecting optimal actions).
cs.AIarxiv:2605.15871Lead article

Agentic Discovery of Neural Architectures: AIRA-Compose and AIRA-Design

Alberto Pepe, Chien-Yu Lin, Despoina Magka, Bilge Acun, Yannan Nellie Wu

his paper introduces AIRA, a dual-framework approach where LLM agents autonomously discover novel neural architectures. AIRA-Compose searches for high-level primitives, while AIRA-Design handles low-level implementation, leading to new Transformer-based and hybrid Transformer-Mamba families. These discovered architectures consistently outperform existing models like Llama 3.2 and Composer on downstream tasks and exhibit significantly more efficient scaling.

AIRA-Compose and AIRA-Design: agentic frameworks for neural architecture search and model design. (a–c) Downstream evaluations of selected agent-found architectures scaled-up to 1B scale with fixed token budget, alongside baselines and traditional NAS-found models: (a) validation loss, and (b) zero-shot average normalized accuracy across 6 tasks. (c) Best test accuracy after 24 GPU hours on the three Long Range Arena tasks. Greedy Opus 4.6 achieves the highest scores on ListOps (0.51) and Retrieval (0.79); Greedy Gemini 3 Pro leads on Text (0.88). (d) Autoresearch training-script optimization: cumulative best bits-per-byte (BPB) over agent steps. Greedy Opus 4.6 achieves the lowest BPB across 100 runs.
AIRA-Compose and AIRA-Design: agentic frameworks for neural architecture search and model design. (a–c) Downstream evaluations of selected agent-found architectures scaled-up to 1B scale with fixed token budget, alongside baselines and traditional NAS-found models: (a) validation…
cs.AIarxiv:2605.15565Lead article

AstraFlow: Dataflow-Oriented Reinforcement Learning for Agentic LLMs

Haizhong Zheng, Yizhuo Di, Jiahui Wang, Shuowei Jin, Xueshen Liu

straFlow addresses the high cost of reinforcement learning for agentic LLMs by introducing a dataflow-oriented system. It decouples rollout, dataflow management, and training into autonomous components, enabling efficient support for complex, multi-policy training on heterogeneous compute resources. This approach simplifies system engineering and makes agentic LLM RL more scalable and cost-effective.

Overview of the AstraFlow architecture. A dataflow-oriented RL framework natively supports multi-policy collaborative training, elastic rollout, heterogeneous and cross-region rollout, and substitutable Rollout-as-a-Service (RaaS) and Trainer.
Overview of the AstraFlow architecture. A dataflow-oriented RL framework natively supports multi-policy collaborative training, elastic rollout, heterogeneous and cross-region rollout, and substitutable Rollout-as-a-Service (RaaS) and Trainer.
cs.AIarxiv:2605.14892Lead article

Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems

Shihao Qi, Jie Ma, Rui Xing, Wei Guo, Xiao Huang

his paper surveys LLM-based multi-agent systems by proposing a unified framework called the LIFE progression. It highlights how individual agent capabilities (Lay) enable collaboration (Integrate), which in turn necessitates fault attribution (Find) for effective autonomous self-improvement (Evolve). The key contribution is examining the causal links between these stages, addressing the challenge of error propagation and lack of self-evolution in current multi-agent systems.

cs.AIarxiv:2604.21251Lead article

CAP: Controllable Alignment Prompting for Unlearning in LLMs

Zhaokun Wang, Jinyu Guo, Jingwen Pu, Hongli Pu, Meng Yang

his paper introduces CAP, a novel prompt-driven method for unlearning sensitive information in LLMs without modifying model weights. CAP uses reinforcement learning to optimize a prompt that guides the LLM to suppress specific knowledge while retaining general capabilities. This offers a computationally efficient and controllable solution for unlearning, even for closed-source models.

Comparison between different paradigms.
Comparison between different paradigms.
cs.AIarxiv:2604.14572Lead article

Don't Retrieve, Navigate: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAG

Yiqun Sun, Pengfei Wei, Lawrence B. Hsieh

his paper introduces Corpus2Skill, a method that distills enterprise knowledge into a navigable, hierarchical skill directory. Instead of passively retrieving information, an LLM agent actively navigates this directory, drilling down through summaries to find relevant documents. This approach improves answer quality and grounding for QA and RAG tasks, particularly on domain-specific corpora with clear topical structures.

Retrieve vs. Navigate. Traditional RAG passively feeds fixed retrieved passages to the LLM. The navigation paradigm instead exposes the corpus as a structured hierarchy that the agent actively explores, backtracks through, and drills into to locate evidence.
Retrieve vs. Navigate. Traditional RAG passively feeds fixed retrieved passages to the LLM. The navigation paradigm instead exposes the corpus as a structured hierarchy that the agent actively explores, backtracks through, and drills into to locate evidence.
cs.AIarxiv:2511.09378Lead article

Frontier Large Language Models Rival State-of-the-Art Planners

Augusto B. Corrêa, André G. Pereira, Jendrik Seipp

his paper demonstrates that recent frontier Large Language Models (LLMs) can rival state-of-the-art classical planners on challenging planning tasks. Specifically, Gemini 3.1 Pro outperforms the strongest planner baseline, and even when semantic information is removed, it remains competitive, overturning previous conclusions about LLMs' planning capabilities.

cs.AIarxiv:2604.26733Lead article

FutureWorld: A Live Reinforcement Learning Environment for Predictive Agents with Real-World Outcome Rewards

Zhixin Han, Yanzhi Zhang, Chuyang Wei, Maohang Gao, Xiawei Yue

utureWorld introduces a novel reinforcement learning environment for training predictive agents that learn from real-world outcomes. Its core method, verl-tool-future, addresses the challenge of delayed rewards by storing prediction rollouts and backfilling rewards only after events occur. This allows agents to learn from actual future outcomes, enabling continuous learning and improved prediction capabilities.

Domain distributions of website sources (a), questions before resampling (b), and questions after resampling (c). After resampling, questions are more evenly distributed across domains.
Domain distributions of website sources (a), questions before resampling (b), and questions after resampling (c). After resampling, questions are more evenly distributed across domains.
cs.AIarxiv:2510.02453Lead article

How to Train Your Advisor: Steering Black-Box LLMs with Advisor Models

Parth Asawa, Alan Zhu, Abigail O'Neill, Matei Zaharia, Alexandros G. Dimakis

his paper introduces "Advisor Models," a novel method to enhance black-box large language models (LLMs) by training smaller, open-weight models to provide dynamic, instance-specific advice. This advice guides the black-box LLM, significantly improving its performance on various tasks and personalizing its behavior more effectively than static prompts. The core contribution lies in enabling practical and cost-effective parametric optimization for closed-source LLMs.

Advisor Models combine open-source models with black box models. Advisor Models trains an advisor to generate instance-specific advice that is injected in-context to steer a frozen black-box model. Rewards from the environment of the final output are used to train the advisor with reinforcement learning.
Advisor Models combine open-source models with black box models. Advisor Models trains an advisor to generate instance-specific advice that is injected in-context to steer a frozen black-box model. Rewards from the environment of the final output are used to train the advisor wit…
cs.AIarxiv:2602.06470Lead article

Improve Large Language Model Systems with User Logs

Changyue Wang, Weihang Su, Qingyao Ai, Yiqun Liu

his paper proposes UNO, a framework to improve LLM systems using user interaction logs. UNO addresses the challenges of noisy and unstructured log data by first distilling them into structured rules and preferences. This processed information is then used to optimize the LLM, overcoming issues like off-policy learning and distinguishing valuable feedback from user behavior.

The workflow of UNO. UNO first distills and filters raw user logs, then performs clustering and a cognitive gap assessment to select the type of experience module (primary or reflective). At inference time, UNO identifies the appropriate cluster and applies an inference strategy aligned with the type of that cluster.
The workflow of UNO. UNO first distills and filters raw user logs, then performs clustering and a cognitive gap assessment to select the type of experience module (primary or reflective). At inference time, UNO identifies the appropriate cluster and applies an inference strategy …
cs.AIarxiv:2605.10813Lead article

NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation

Jinhang Xu, Qiyuan Zhu, Yujun Wu, Zirui Wang, Dongxu Zhang

anoResearch introduces a tri-level co-evolutionary framework for personalized research automation. It addresses the limitations of current LLM-based systems by developing a skill bank for reusable procedural knowledge, a memory module for user-specific experience, and a policy learner for implicit preference internalization. This approach enables the system to adapt to individual researchers' unique needs and preferences, moving beyond uniform outputs to genuinely usable personalized automation.

Comparison between (a) a uniform research automation pipeline that applies identical processing to all users and yields homogeneous outputs, and (b) NanoResearch, which recognizes distinct researcher personas and provides personalized skills and feedback upon failure, enabling each persona to evolve along its own trajectory.
Comparison between (a) a uniform research automation pipeline that applies identical processing to all users and yields homogeneous outputs, and (b) NanoResearch, which recognizes distinct researcher personas and provides personalized skills and feedback upon failure, enabling ea…
cs.AIarxiv:2509.22739Lead article

Painless Activation Steering: An Automated, Lightweight Approach for Post-Training Large Language Models

Sasha Cui, Zhongren Chen

his paper introduces Painless Activation Steering (PAS), a fully automated method for post-training large language models. PAS eliminates the need for manual prompt engineering or feature annotation, making activation steering a practical and efficient alternative to existing methods. Its core contribution is enabling effortless and controllable behavior modification in LLMs using any labeled dataset.

iPASwo (introspective PAS-wrong only) pipeline; prompts are built from the model’s own errors. (1) Run the raw LM on the training split and partition items into correct vs. incorrect. (2) From the incorrect items, build positive prompts using the ground-truth answers and negative prompts using the model’s chosen (incorrect) answers. (3) Compute a steering vector a ∗ a^{*} as the mean activation difference between the two prompt sets at a chosen layer ℓ \( \ell \) and target st . (4) At inference, inject this vector (with strength \( \lambda \) ) to obtain the activation-steered LM. (5) Evaluate the steered model on the held-out test split.
iPASwo (introspective PAS-wrong only) pipeline; prompts are built from the model’s own errors. (1) Run the raw LM on the training split and partition items into correct vs. incorrect. (2) From the incorrect items, build positive prompts using the ground-truth answers and negative…
cs.AIarxiv:2605.16045Lead article

RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agents

Zijie Dai, Shiyuan Deng, Sheng Guan, Yizhou Tian, Xin Yao

ecMem addresses the inefficiency of LLM agents' memory systems by delaying memory consolidation. Instead of processing every interaction, it stores them in a lightweight embedding layer and only invokes the LLM to extract episodic and semantic memory when recurring, semantically similar interactions are detected. This recurrence-based approach significantly reduces token consumption while maintaining effectiveness by focusing LLM resources on information clusters worth summarizing.

cs.AIarxiv:2604.27859Lead article

Rethinking Agentic Reinforcement Learning In Large Language Models

Fangming Cui, Ruixiao Zhu, Cheng Fang, Sunan Li, Jiahong Li

his paper re-frames Reinforcement Learning (RL) for Large Language Models (LLMs) by moving beyond traditional, narrowly defined tasks. It proposes an agentic RL paradigm where LLMs act as autonomous agents capable of goal-setting, planning, and dynamic adaptation in complex, open-ended environments. The core contribution lies in integrating cognitive capabilities like meta-reasoning and self-reflection into the RL learning loop, enabling more sophisticated decision-making.

Figure 1 . Agent.
Figure 1 . Agent.
cs.AIarxiv:2503.02597Lead article

Seeing is Understanding: Unlocking Causal Attention into Modality-Mutual Attention for Multimodal LLMs

Wei-Yao Wang, Zhao Wang, Helen Suzuki, Yoshiyuki Kobayashi

his paper proposes a novel approach to improve vision-language alignment in Multimodal Large Language Models (MLLMs) by modifying their core architecture. The key contribution is unlocking causal attention within the decoder-only LLM, allowing earlier modalities (like images) to effectively incorporate information from later modalities (like text). This addresses the limitation of existing MLLMs where visual information might not be fully integrated into the text generation process.

An illustration of the vision-centric scenario. The image contains ambiguous signs with the object-related query. The correct answer is that parking is allowed for 2 hours from 8am to 8pm on Saturday. While GPT-4o (OpenAI, 2024 ) , Molmo (Deitke et al. , 2024 ) , and DeepSeek-VL2-Small (Wu et al. , 2024 ) respond with hallucinations, our proposed AKI is able to provide an accurate answer. The image is sourced from (Sanders, 2015 ) .
An illustration of the vision-centric scenario. The image contains ambiguous signs with the object-related query. The correct answer is that parking is allowed for 2 hours from 8am to 8pm on Saturday. While GPT-4o (OpenAI, 2024 ) , Molmo (Deitke et al. , 2024 ) , and DeepSeek-VL2…
cs.AIarxiv:2605.15053Lead article

TFGN: Task-Free, Replay-Free Continual Pre-Training Without Catastrophic Forgetting at LLM Scale

Anurup Ganguli

FGN is an architectural overlay for transformer language models that enables continual pre-training on new domains without forgetting previous knowledge. It achieves this by generating input-conditioned, parameter-efficient updates, leaving the core transformer unchanged. This approach successfully prevents catastrophic forgetting and demonstrates positive cross-domain transfer, even at LLM scale, without relying on replay buffers or task identifiers.

Backward transfer across scales and regimes. TFGN conditions (blue) close BWT to magnitude ≤ 0.135 \( \leq \) 0.135 at every tested scale and regime. Matched baselines (red) sit at BWT magnitudes 3 × \( \times \) to 14 × \( \times \) larger on the same backbones, with the matched 8 B Std-FT baseline at − 0.374 -0.374 on the 3-phase recomputation. Tightest TFGN absolute BWT is − 0.007 -0.007 at LLaMA 3.1 8B Retrofit. Source data: § 1.3 (Table 1 ).
Backward transfer across scales and regimes. TFGN conditions (blue) close BWT to magnitude ≤ 0.135 \( \leq \) 0.135 at every tested scale and regime. Matched baselines (red) sit at BWT magnitudes 3 × \( \times \) to 14 × \( \times \) larger on the same backbones, with the matched…
cs.AIarxiv:2605.08245Lead article

When Language Overwrites Vision: Over-Alignment and Geometric Debiasing in Vision-Language Models

Harshvardhan Saini, Samyak Jha, Yiming Tang, Dianbo Liu

his paper identifies "geometric over-alignment" as a core cause of hallucinations in decoder-based Vision-Language Models (VLMs). The VLM over-aligns visual information with the text manifold to bridge the modality gap, leading to linguistic biases overshadowing visual evidence. The contribution is the first quantitative characterization of this over-alignment, showing it concentrates in the top principal components of a universal text subspace.

Overview of our geometric debiasing framework. (A) We identify that over-alignment with the text manifold suppresses visual details. (B) We propose a projection-based geometric intervention to isolate and remove statistical linguistic bias. (C) This method unmasks fine-grained visual evidence, directly reducing hallucinations and improving grounding accuracy.
Overview of our geometric debiasing framework. (A) We identify that over-alignment with the text manifold suppresses visual details. (B) We propose a projection-based geometric intervention to isolate and remove statistical linguistic bias. (C) This method unmasks fine-grained vi…
cs.AIarxiv:2605.23590v1Lead article

Co-ReAct: Rubrics as Step-Level Collaborators for ReAct Agents

Jiazheng Kang, Bowen Zhang, Zixin Song, Jiangwang Chen, Xiao Yang

o-ReAct introduces a novel framework where rubrics act as step-level collaborators for ReAct agents during inference. By injecting rubrics into the agent's context at each decision point, Co-ReAct provides explicit guidance on what to target in evidence seeking, reasoning, and self-evaluation, leading to more focused and effective multi-step reasoning trajectories. This approach moves beyond rubrics as mere evaluators to become active guides for agent actions.

Overview of Co-ReAct. (i) Collect: sample candidate next actions at each branching point and rank them with multi-judge expert consensus. (ii) Train: GRPO with a Spearman reward between the rubric-induced ranking and the expert ranking. (iii) Infer: the trained rubric drives a five-tuple (Rubric, Reason, Act, Verify, Observe) loop.
Overview of Co-ReAct. (i) Collect: sample candidate next actions at each branching point and rank them with multi-judge expert consensus. (ii) Train: GRPO with a Spearman reward between the rubric-induced ranking and the expert ranking. (iii) Infer: the trained rubric drives a fi…
cs.AIarxiv:2605.23605v1Lead article

DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling

Jean-Marie Lemercier, Tomas Geffner, Karsten Kreis, Morteza Mardani, Arash Vahdat

iLaDiff addresses the token correlation issue in diffusion language models by introducing a continuous latent space. This latent space, learned via an auto-encoder and a latent diffusion model, captures semantic relationships. A consistency model then distills this latent prior into a fast, few-step generative model, significantly improving sampling quality and inference speed over existing methods.

DiLaDiff: hybrid continuous-discrete diffusion with self-distilled latent. The latent space is crafted with encoder ℰ \( \mathcal{E}_{\phi} \) and decoder 𝐱 θ {\( \mathbf{x} \)}_{\( \theta \)} and learned a posteriori with a diffusion process with denoiser 𝐳 ψ {\( \mathbf{z} \)}_{\( \psi \)} . The latent diffusion trajectories are further self-distilled with MeanFlow student 𝐮 η ​ ( 𝐳 τ , τ , r ) \( \mathbf{u}_{\eta} \)({\( \mathbf{z} \)}_{\( \tau \)},\( \tau \),r) .
DiLaDiff: hybrid continuous-discrete diffusion with self-distilled latent. The latent space is crafted with encoder ℰ \( \mathcal{E}_{\phi} \) and decoder 𝐱 θ {\( \mathbf{x} \)}_{\( \theta \)} and learned a posteriori with a diffusion process with denoiser 𝐳 ψ {\( \mathbf{z} \)…
cs.AIarxiv:2605.23899v1Lead article

From Raw Experience to Skill Consumption: A Systematic Study of Model-Generated Agent Skills

Zisu Huang, Jingwen Xu, Yifan Yang, Ziyang Gong, Qihao Yang

his paper systematically studies the full lifecycle of model-generated skills for language agents, from experience generation to skill extraction and consumption. Their core contribution is a utility-grounded evaluation framework that reveals model-generated skills are generally beneficial but their effectiveness is non-trivial and depends on various factors.

Overview of our study design. We evaluate the full trajectory-to-skill lifecycle across three stages: experience generation, skill extraction, and skill consumption.
Overview of our study design. We evaluate the full trajectory-to-skill lifecycle across three stages: experience generation, skill extraction, and skill consumption.
cs.AIarxiv:2605.23551v1Lead article

Goal-Conditioned Agents that Learn Everything All at Once

Michael Matthews, Matthew Jackson, Michael Beukman, Thomas Foster, Alistair Letcher

his paper introduces Learning Everything All at Once (LEO), a method for goal-conditioned reinforcement learning. LEO efficiently utilizes all transitions by performing off-policy updates for every possible goal simultaneously, overcoming the computational infeasibility of naive relabeling. This approach significantly improves performance and achieves substantial speed-ups on various control tasks.

cs.AIarxiv:2605.23825v1Lead article

It's the humans, not the data: Geopolitical bias in LLMs originates in post-training, amplified by the language of the prompt

Stuart Bladon, Brinnae Bent

his paper demonstrates that geopolitical bias in Large Language Models (LLMs) primarily emerges during the post-training (chat tuning) phase, not from the initial training data. The authors found that LLMs often develop a bias favoring the country of their developer after chat tuning, and this bias is further influenced by the language of the prompt.

Overview, seven families. (A) Per-country preference base → \( \to \) post-trained; for the six non-GLM bases, cross-country spread \( \sigma \) grows post-training (Qwen 3.9 → 30.3 3.9\( \to \) 30.3 pp). (B) Post-training \( \Delta \) in China-favourability (EN, coherent subset). 3/3 Western labs shift anti-China; 3/4 Chinese labs shift pro-China; Yi shifts anti-China after prefill correction. GLM is shown with its (atypical) base preserved for completeness; see § Bias Is Created by Post-Training, Not Pretraining . The legend’s low-compliance encoding is described in § What MCQ Compliance Tells Us About Validity . (C) ZH − - EN shift on post-trained models: 5/7 descriptively pro-China but population-level claim is not statistically separable from the base trend (§ Linguistic Identity Modulates the Post-Training Bias ).
Overview, seven families. (A) Per-country preference base → \( \to \) post-trained; for the six non-GLM bases, cross-country spread \( \sigma \) grows post-training (Qwen 3.9 → 30.3 3.9\( \to \) 30.3 pp). (B) Post-training \( \Delta \) in China-favourability (EN, coherent subset)…
cs.AIarxiv:2605.23723v1Lead article

MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detection

Zhewen Tan, Yilun Yao, Huiyan Jin, Wenhan Yu, Guoan Wang

emAudit is a post-hoc framework for auditing poisoned memory in LLM agents. It uses causal attribution to identify memories that causally influence harmful outputs and structural anomaly detection to pinpoint inconsistencies within the memory. This allows for the identification and mitigation of malicious memory injections after an agent has exhibited undesirable behavior.

Overview of MemAudit. Given a harmful event e = ( q ∗ , y ∗ , R ∗ ) e=(q^{*},y^{*},R^{*}) , the framework performs post-hoc auditing over the memory store. It combines two complementary signals: CMIS, which measures the causal contribution of retrieved memories through counterfactual replay, and MCG, which identifies structurally anomalous memories in the global memory graph. The two signals are fused into a detoxification score for ranking suspicious memories. After removing the top-ranked memories, the agent becomes safer while preserving useful memory.
Overview of MemAudit. Given a harmful event e = ( q ∗ , y ∗ , R ∗ ) e=(q^{*},y^{*},R^{*}) , the framework performs post-hoc auditing over the memory store. It combines two complementary signals: CMIS, which measures the causal contribution of retrieved memories through counterfac…
cs.LGarxiv:2605.23574v1Lead article

Push Your Agent: Measuring and Enforcing Quantitative Goal Persistence in Long-Horizon LLM Agents

Yuandao Cai, Yuzhang Zhu, Liyou Gao, Wensheng Tang, Shengchao Qin

his paper introduces Quantitative Goal Persistence (QGP) to measure how well LLM agents complete tasks requiring a specific number of distinct items. Their benchmark, PushBench, uses verifiers to track progress and identify issues like repeated work or false completion. They demonstrate that specialized controllers significantly improve QGP, outperforming standard methods in challenging long-horizon tasks.

PushBench workflow: agents act through a controller, task environment, and verifier until the count goal is met or the budget is exhausted.
PushBench workflow: agents act through a controller, task environment, and verifier until the count goal is met or the budget is exhausted.
cs.CLarxiv:2605.23454v1Lead article

ARES: Automated Rubric Synthesis for Scalable LLM Reinforcement Learning

Xiaoyuan Li, Keqin Bao, Moxin Li, Yubo Ma, Yichang Zhang

RES automates the creation of question-answer pairs and corresponding weighted rubrics from raw text, enabling scalable reinforcement learning for LLMs on open-ended tasks. This framework addresses the limitations of expert-written rubrics and fixed task-level evaluations by generating instance-specific reward supervision. ARES's contribution lies in its ability to synthesize diverse and high-quality training data for LLM RL, improving evaluation beyond automatically verifiable answers.

Overview of the six-stage ARES pipeline. Starting from raw pretraining documents, ARES performs document filtering, domain and persona conditioning, rubric-augmented QA generation, quality verification, rubric validation, and format conversion to produce training instances.
Overview of the six-stage ARES pipeline. Starting from raw pretraining documents, ARES performs document filtering, domain and persona conditioning, rubric-augmented QA generation, quality verification, rubric validation, and format conversion to produce training instances.
cs.CLarxiv:2605.23657v1Lead article

OpenSkillEval: Automatically Auditing the Open Skill Ecosystem for LLM Agents

Jiahao Ying, Boxian Ai, Wei Tang, Siyuan Liu, Yixin Cao

his paper introduces OpenSkillEval, an automatic framework for evaluating LLM agents and the skills they use. It addresses the challenge of assessing the growing open-source skill ecosystem by generating realistic task instances from real-world artifacts and organizing community-contributed skills. The core contribution is a dynamic evaluation method that goes beyond static benchmarks to understand skill quality and guide user selection based on cost-performance.

Overview of the OpenSkillEval framework. The framework supports automatic test case generation for five core task categories by reflecting evolving user needs. It further enables automatic evaluation from two complementary perspectives: (1) analysis of model trajectory traces to study how skills are used within skill-augmented agent systems, and (2) assessment of the quality of the final artifacts produced under skill augmentation.
Overview of the OpenSkillEval framework. The framework supports automatic test case generation for five core task categories by reflecting evolving user needs. It further enables automatic evaluation from two complementary perspectives: (1) analysis of model trajectory traces to …
cs.AIarxiv:2605.27355v1Lead article

Alignment Tampering: How Reinforcement Learning from Human Feedback Is Exploited to Optimize Misaligned Biases

Dongyoon Hahm, Dylan Hadfield-Menell, Kimin Lee

his paper introduces "alignment tampering," a vulnerability in RLHF where LLMs can exploit the preference dataset generation process to amplify their own misaligned biases. The core method demonstrates how LLMs can influence human annotators to favor biased outputs by making them appear higher quality, leading to the reward model inheriting and amplifying these biases. The contribution is identifying and experimentally validating this novel attack vector against LLM alignment.

Illustration of how the bias of an initial LLM is amplified through RLHF. During the preference dataset construction stage, the initial LLM generates two types of responses when a trigger (i.e., “can you”) appears in the prompt: (1) high-quality but biased responses containing the keyword “AI”, and (2) low-quality but unbiased responses. This causes annotators to prefer the biased responses during labeling, resulting in a biased preference dataset and consequently a biased reward model. When RL fine-tuning is performed with this reward model, the model tends to overproduce the word “AI,” indicating that the overall alignment process further amplifies the bias.
Illustration of how the bias of an initial LLM is amplified through RLHF. During the preference dataset construction stage, the initial LLM generates two types of responses when a trigger (i.e., “can you”) appears in the prompt: (1) high-quality but biased responses containing th…
cs.AIarxiv:2605.27354v1Lead article

Guiding LLM Post-training Data Engineering with Model Internals from Sparse Autoencoders

Yi Jing, Zao Dai, Jinwu Hu, Zijun Yao, Lei Hou

his paper introduces SAERL, a framework that leverages model internals from Sparse Autoencoders (SAEs) to guide Large Language Model (LLM) post-training data engineering for reinforcement learning. SAERL models data diversity, difficulty, and quality using SAEs to inform operations like batch mixing, curriculum ordering, and data filtering. This approach significantly improves LLM performance and training efficiency compared to methods relying solely on external signals.

Conceptual overview of SaeRL . Sparse Autoencoder (SAE) activations characterize three intrinsic data properties (diversity, difficulty, and quality), enabling SAE-based curriculum learning and data selection for LLM post-training.
Conceptual overview of SaeRL . Sparse Autoencoder (SAE) activations characterize three intrinsic data properties (diversity, difficulty, and quality), enabling SAE-based curriculum learning and data selection for LLM post-training.
cs.AIarxiv:2605.27288v1Lead article

It's Not Always Sycophancy: Measuring LLM Conformity as a Function of Epistemic Uncertainty

Kevin H. Guo, Chao Yan, Avinash Baidya, Katherine Brown, Xiang Gao

his paper introduces MUSE, a framework to measure Large Language Model (LLM) conformity. It disentangles conformity into two drivers: sycophancy (aligning with user pushback regardless of certainty) and uncertainty-driven conformity (increasing conformity with higher epistemic uncertainty). The contribution is demonstrating that LLM conformity is not solely due to sycophancy but also influenced by the model's confidence in its initial response.

The MUSE Framework. Step 1 estimates a model’s inference-time epistemic uncertainty by computing a query’s decision-space entropy across k k stochastic samples. Step 2 maps this baseline uncertainty against the model’s likelihood of yielding to conversational pushback. This decouples pure sycophancy (yielding under absolute certainty) from uncertainty-driven conformity.
The MUSE Framework. Step 1 estimates a model’s inference-time epistemic uncertainty by computing a query’s decision-space entropy across k k stochastic samples. Step 2 maps this baseline uncertainty against the model’s likelihood of yielding to conversational pushback. This decou…
cs.AIarxiv:2605.27366v1Lead article

MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation

Huawei Lin, Peng Li, Jie Song, Fuxin Jiang, Tieying Zhang

USE-Autoskill introduces a novel framework for LLM agents that treats skills as dynamic, evolving entities. Its core method involves a unified lifecycle for skills: creation, memory, management, and evaluation, enabling agents to continuously improve by generating, reusing, and refining skills. The key contribution is the concept of skill-level memory, which allows skills to accumulate experience across tasks, leading to more effective and adaptive problem-solving over time.

cs.AIarxiv:2605.27276v1Lead article

SIA: Self Improving AI with Harness & Weight Updates

Prannay Hebbar, Yogendra Manawat, Samuel Verboomen, Alesia Ivanova, Selvam Palanimalai

his paper introduces SIA, a novel self-improving AI system that breaks down the traditional separation between updating an AI's code (harness) and its learned parameters (weights). SIA's core method is a meta-agent that iteratively refines both the task-specific agent's harness and its model weights based on feedback. The key contribution is demonstrating that simultaneously updating both aspects leads to significantly better performance across diverse and complex domains compared to updating only one.

SIA across three diverse tasks. Each panel compares three operating points: Baseline (first generation, no SIA), SIA-H (harness updates only), and SIA-W+H (harness + weight updates), on LawBench Top-1 accuracy, TriMul CUDA speedup, and scRNA-seq denoising mse_norm . The dashed line marks the previous state-of-the-art. SIA-W+H strictly outperforms SIA-H on all three tasks.
SIA across three diverse tasks. Each panel compares three operating points: Baseline (first generation, no SIA), SIA-H (harness updates only), and SIA-W+H (harness + weight updates), on LawBench Top-1 accuracy, TriMul CUDA speedup, and scRNA-seq denoising mse_norm . The dashed li…
cs.AIarxiv:2605.27140v1Lead article

StepOPSD: Step-Aware Online Preference Distillation for Agent Reinforcement Learning

Yanfei Zhang, Xu Lin, Chenglin Wu

tepOPSD addresses the credit assignment problem in multi-turn agent reinforcement learning by treating individual agent steps as the fundamental unit for learning. It decomposes trajectories into step segments, rescores them with hindsight, and uses these scores to shape rewards, leading to improved performance on tasks sensitive to local decision-making errors.

Overview of StepOPSD. StepOPSD decouples online environment interaction from offline credit shaping. While the base GRPO rollout dynamics remain untouched, post-rollout trajectories are structurally parsed into causal action boundaries. By rescoring these isolated spans under hindsight-enriched teacher contexts, StepOPSD translates token-level preference gaps into a direct modulation of the RL advantage—injecting dense, step-aware supervision without distorting the primary trajectory-level reward signal.
Overview of StepOPSD. StepOPSD decouples online environment interaction from offline credit shaping. While the base GRPO rollout dynamics remain untouched, post-rollout trajectories are structurally parsed into causal action boundaries. By rescoring these isolated spans under hin…
cs.AIarxiv:2605.27141v1Lead article

VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions

Yuxin Chen, Yi Zhang, Zhengzhou Cai, Yaorui Shi, Zhiyuan Yao

itaBench 2.0 addresses the gap in evaluating LLM agents by introducing a benchmark focused on personalized and proactive behavior in long-term user interactions. Its core method involves temporally ordered tasks with user preferences embedded in fragmented interactions, requiring agents to continuously infer and utilize this information. The contribution is a novel evaluation framework that moves beyond simple reasoning to assess an agent's ability to understand and adapt to individual users over time.

Overview of VitaBench 2.0. The agents are required to operate over temporal task sequences for each user, infer evolving user preferences from fragmented interactions, maintain these preferences via a memory mechanism, and make personalized and proactive decisions.
Overview of VitaBench 2.0. The agents are required to operate over temporal task sequences for each user, infer evolving user preferences from fragmented interactions, maintain these preferences via a memory mechanism, and make personalized and proactive decisions.
cs.CLarxiv:2605.27333v1Lead article

FinHarness: An Inline Lifecycle Safety Harness for Finance LLM Agents

Haoxuan Jia, Yang Liu, Bin Chong, Yingguang Yang, Yancheng Chen

inHarness is an inline safety harness for finance LLM agents that prevents unauthorized actions and ensures legitimate workflows. It achieves this by monitoring queries for intent drift, evaluating each tool call, and adaptively routing verification to different LLM judges. This approach allows agents to self-correct mid-trajectory, significantly reducing harmful actions while maintaining high approval rates for benign operations.

Representative trace. A weak but persistent fake-trade signal looks safe in each step, so B2 approves; FinHarness accumulates the signal across the trace and, after receiving the advisory evidence, the agent chooses its own escalate_to_human action at t = 5 t{=}5 rather than approving.
Representative trace. A weak but persistent fake-trade signal looks safe in each step, so B2 approves; FinHarness accumulates the signal across the trace and, after receiving the advisory evidence, the agent chooses its own escalate_to_human action at t = 5 t{=}5 rather than appr…
cs.AIarxiv:2605.16299Lead article

ACE: Self-Evolving LLM Coding Framework via Adversarial Unit Test Generation and Preference Optimization

Yixu Huang, Xinglei Yu, Zhongyu Wei

CE is a self-evolving LLM coding framework that addresses the limitations of existing methods by using a solver-adversary architecture. It leverages adversarial unit test generation, where a single LLM generates both candidate code and test inputs designed to trigger execution failures. This execution-centric supervision allows the model to actively discover and correct its own errors, leading to more robust code generation without relying on large annotated datasets.

Comparison between verifiable and adversarial unit tests. (a) An illustrative example where a verifiable unit test passes successfully but fails to reveal a latent bug in the flawed solution. The adversarial unit test, by contrast, induces a runtime error and directly exposes the incorrect assumption that every cycle has an incoming tree node. (b) Accuracy trends over training rounds under both solver-verifier and solver–adversary structures.
Comparison between verifiable and adversarial unit tests. (a) An illustrative example where a verifiable unit test passes successfully but fails to reveal a latent bug in the flawed solution. The adversarial unit test, by contrast, induces a runtime error and directly exposes the…
cs.AIarxiv:2602.02709Lead article

ATLAS: A Multi-LLM Training Framework for EvoDPO with Adaptive Reference Evolution

Ujin Jeon, Jiyong Kwon, Madison Ann Sullivan, Caleb Eunho Lee, Guang Lin

TLAS is a multi-LLM training framework that enables an active agent to self-evolve its policy through collaborative training by specialized meta-agents. Its core contribution is the EvoDPO algorithm, which overcomes limitations of fixed reference models by adaptively updating the reference policy based on continuous training telemetry, preventing stagnation and enabling more effective learning.

ATLAS workflow. ATLAS alternates between supporter-guided candidate exploration and EvoDPO updates with strategist-guided fine-tuning and proxy-KL-gated reference promotion.
ATLAS workflow. ATLAS alternates between supporter-guided candidate exploration and EvoDPO updates with strategist-guided fine-tuning and proxy-KL-gated reference promotion.
cs.AIarxiv:2605.22001Lead article

Blind Spots in the Guard: How Domain-Camouflaged Injection Attacks Evade Detection in Multi-Agent LLM Systems

Aaditya Pai

his paper introduces "domain-camouflaged injection attacks," where malicious prompts mimic the target document's vocabulary and authority to evade detection. The core contribution is identifying and quantifying the "Camouflage Detection Gap" (CDG), demonstrating that standard injection detectors fail significantly against these sophisticated attacks, with detection rates plummeting.

cs.AIarxiv:2512.04111Lead article

CentaurEval: Benchmarking Human-in-the-Loop Value in Agentic Coding

Hanjun Luo, Chiming Ni, Jiaheng Wen, Zhimu Huang, Yiran Wang

entaurEval introduces a novel benchmark for evaluating human-in-the-loop coding agents by creating "Collaboration-Necessary" problems that are too difficult for humans or LLMs alone. Its core contribution is a standardized framework that dynamically generates tasks, enabling the measurement of human-AI collaboration's value in coding, which significantly outperforms standalone human or AI performance.

CentaurEval provides two evaluation interfaces, underscoring its dual contributions. The chart displays the performance improvement by human-AI collaboration.
CentaurEval provides two evaluation interfaces, underscoring its dual contributions. The chart displays the performance improvement by human-AI collaboration.
cs.AIarxiv:2602.10085Lead article

CODE-SHARP: Continuous Open-ended Discovery and Evolution of Skills as Hierarchical Reward Programs

Richard Bornemann, Pierluigi Vito Amadori, Antoine Cully

ODE-SHARP is a framework that uses Foundation Models to autonomously discover and evolve a library of Python programs (SHARPs). These SHARPs encode skills as hierarchical reward programs, where each program defines a success condition and relies on previously discovered SHARPs as prerequisites. This allows a generalist agent to learn entirely from scratch via reinforcement learning, dynamically navigating its skill repertoire based on the current environment.

CODE-SHARP consists of two FM-driven iterative processes that discover and evolve skill encoding SHARPs. The skill proposal generator , implementor , and judge generate and filter novel SHARPs before environment evaluation. The skill mutation generator and implementor produce mutated versions of existing SHARPs, evaluated directly in the environment.
CODE-SHARP consists of two FM-driven iterative processes that discover and evolve skill encoding SHARPs. The skill proposal generator , implementor , and judge generate and filter novel SHARPs before environment evaluation. The skill mutation generator and implementor produce mut…
cs.AIarxiv:2308.04371Lead article

Cumulative Reasoning with Large Language Models

Yifan Zhang, Jingqin Yang, Yang Yuan, Andrew Chi-Chih Yao

his paper introduces Cumulative Reasoning (CR), a structured framework that enhances Large Language Model (LLM) problem-solving by mimicking human iterative thought. CR uses LLMs in distinct roles (Proposer, Verifier, Reporter) to decompose tasks, generate and validate intermediate steps, and build a dynamic DAG of verified propositions. This approach significantly improves performance on complex reasoning tasks, outperforming existing methods in logical inference and the Game of 24.

cs.AIarxiv:2401.00139Lead article

Enhancing Causal Reasoning in Large Language Models: A Causal Attribution Model for Precision Fine-Tuning

Hengrui Cai, Shengjie Liu, Rui Song

his paper introduces a causal attribution model that uses "do-operators" to create interventional scenarios, allowing for systematic quantification of LLM component contributions to causal reasoning. This model enables precise fine-tuning of LLMs for causal discovery tasks, improving their ability to leverage context, domain knowledge, and numerical data for accurate causal inference.

The first panel presents one sample using the LLM to provide causal discovery results, where the blue box is the i-th context, the pink box is the i-th knowledge embedded in variable names, the orange box is the i-th numerical information, and the red box at the last is the i-th output. The second panel shows the generation of one interventional sample where the variable names were replaced by non-meaningful letters; and the third one describes our proposed causal attribution framework, where the knowledge is omitted corresponding to the interventional scenario in the second panel.
The first panel presents one sample using the LLM to provide causal discovery results, where the blue box is the i-th context, the pink box is the i-th knowledge embedded in variable names, the orange box is the i-th numerical information, and the red box at the last is the i-th …
cs.AIarxiv:2507.23773Lead article

General Agentic Planning Through Simulative Reasoning with World Models

Mingkai Deng, Jinyu Hou, Zhiting Hu, Eric Xing

his paper proposes that general agentic planning requires "simulative reasoning" within a world model, contrasting it with current reactive decision-making. The core method is to build an agent that mentally simulates future outcomes of actions to make more flexible, goal-directed decisions. The contribution is the SiRA architecture, demonstrating this simulative approach as a general-purpose planning mechanism for agents.

Instantiation of simulative reasoning in SiRA . At each time step, the encoder h h maps the observation o o into a natural-language belief state, based on which the planner proposes candidate actions, simulates their consequences through the world model f f , evaluates goal progress via the critic v v , and passes the best simulated action to the actor \( \alpha \) for execution.
Instantiation of simulative reasoning in SiRA . At each time step, the encoder h h maps the observation o o into a natural-language belief state, based on which the planner proposes candidate actions, simulates their consequences through the world model f f , evaluates goal progr…
cs.AIarxiv:2605.20246Lead article

GROW: Aligning GRPO with State-Action Modeling for Open-World VLM Agents

Xiongbin Wu, Zhihao Luo, Shanzhe Lei, Lechao Zhang, Xuhong Wang

his paper introduces GROW, a reinforcement learning framework for open-world VLM agents. GROW addresses limitations of existing methods by decomposing full trajectories into state-action samples, enabling effective use of GRPO for multi-turn tasks. This approach avoids excessively long contexts and noise, improving learning efficiency and performance.

Context length in the trajectory increases with the number of interaction steps between the VLM agent and the environment, often exceeding the maximum token length as interactions accumulate.
Context length in the trajectory increases with the number of interaction steps between the VLM agent and the environment, often exceeding the maximum token length as interactions accumulate.
cs.AIarxiv:2605.21347Lead article

Insights Generator: Systematic Corpus-Level Trace Diagnostics for LLM Agents

Akshay Manglik, Apaar Shanker, Kaustubh Deshpande, Jason Qin, Yash Maurya

his paper introduces the Insights Generator (IG), a novel system for systematically diagnosing failures in LLM agents at a corpus level. IG addresses the limitations of manual inspection by automatically generating evidence-backed natural-language insights about systematic behavioral patterns across large collections of execution traces. Its core contribution lies in formalizing corpus-level diagnostics and providing a scalable, multi-agent approach to uncover and explain LLM agent failures.

Insights Generator (IG) system overview. Left: the input layer provides a diagnostic question, Q Q , trace corpus, 𝒞 \( \mathcal{C} \) , and processed data store, 𝒮 \( \mathcal{S} \) . Center: the Orchestrator dispatches Scout agents ( ℋ \( \mathcal{H} \) : hypothesize over sampled traces) and Investigator agents ( ℋ ∗ \( \mathcal{H}^{*} \) : validate via corpus-scale cohort comparison). The Investigator analyzes ℋ ∗ \( \mathcal{H}^{*} \) to generate findings, ℱ r \( \mathcal{F}_{r} \) , which are sent to the orchestrator. The orchestrator then synthesizes and de-duplicates ℱ r \( \mathcal{F}_{r} \) to generate the final report. Right: the output is an evidence-backed report with findings, fixes, citations, and prevalence estimates. Bottom: the shared tool layer. Algorithm 1 formalizes the analysis loop.
Insights Generator (IG) system overview. Left: the input layer provides a diagnostic question, Q Q , trace corpus, 𝒞 \( \mathcal{C} \) , and processed data store, 𝒮 \( \mathcal{S} \) . Center: the Orchestrator dispatches Scout agents ( ℋ \( \mathcal{H} \) : hypothesize over sam…
cs.AIarxiv:2605.21988Lead article

Learning Spatiotemporal Sensitivity in Video LLMs via Counterfactual Reinforcement Learning

Dazhao Du, Jian Liu, Jialong Qin, Tao Han, Bohai Gu

his paper addresses the problem of Video LLMs relying on shortcuts rather than spatiotemporal understanding. Their core method, Counterfactual Relational Policy Optimization (CRPO), uses reinforcement learning with counterfactual video transformations (flips, reversals) and a novel "Counterfactual Relation Reward" to train models to be sensitive to dynamic changes in video content. This contribution aims to improve Video LLMs' ability to truly track and reason about video dynamics.

Current Video LLMs remain insensitive to spatiotemporal changes. Left: On the same scene, the model (a) answers a static question correctly, but (b) fails on a spatiotemporal question; (c) it gives the same prediction to a video and its temporal reversal. Right: Across MVBench and TempCompass sub-tasks, accuracy drops as the fraction of spatiotemporal questions increases.
Current Video LLMs remain insensitive to spatiotemporal changes. Left: On the same scene, the model (a) answers a static question correctly, but (b) fails on a spatiotemporal question; (c) it gives the same prediction to a video and its temporal reversal. Right: Across MVBench an…
cs.AIarxiv:2602.11574Lead article

Learning to Configure Agentic AI Systems

Aditya Taparia, Som Sagar, Ransalu Senanayake

his paper addresses the challenge of configuring complex LLM-based agent systems by framing it as a semi-Markov decision process. Their proposed method, ARC, is a hierarchical policy that dynamically selects query-specific configurations to optimize performance and resource usage. ARC significantly improves accuracy across various benchmarks compared to fixed configurations, demonstrating the value of adaptive agent system setup.

Overview of ARC. (a) ARC learns to select a query-specific agent configuration from a large combinatorial design space. (b) Unlike standard MDP actions with fixed duration, agent configurations induce temporally extended executions with variable numbers of LLM calls, motivating our SMDP formulation. (c) Across reasoning, tool-use, and agentic benchmarks, ARC improves performance over budget-matched base models and strong baselines for Qwen 2.5 7B.
Overview of ARC. (a) ARC learns to select a query-specific agent configuration from a large combinatorial design space. (b) Unlike standard MDP actions with fixed duration, agent configurations induce temporally extended executions with variable numbers of LLM calls, motivating o…
cs.AIarxiv:2510.07962Lead article

LightReasoner: Can Small Language Models Teach Large Language Models Reasoning?

Jingyuan Wang, Yankai Chen, Zhonghang Li, Chao Huang

ightReasoner proposes a novel method where smaller language models (SLMs) teach larger language models (LLMs) by identifying and highlighting crucial reasoning steps. The core idea is to leverage the behavioral differences between an expert LLM and an amateur SLM to create targeted supervision data. This distilled data then fine-tunes the LLM, focusing on its unique strengths and improving reasoning efficiency without requiring massive, uniformly optimized datasets.

cs.AIarxiv:2605.10067Lead article

Metis: Learning to Jailbreak LLMs via Self-Evolving Metacognitive Policy Optimization

Huilin Zhou, Jian Zhao, Yilu Zhong, Zhen Liang, Xiuyuan Chen

etis reformulates LLM jailbreaking as inference-time policy optimization within an adversarial POMDP. It uses a self-evolving metacognitive loop to diagnose defense logic and refine its policy via structured feedback, achieving an 89.2% average attack success rate and outperforming traditional methods on resilient models.

The Metis Framework formulated as an Inference-Time Policy Optimization Loop. The Attacker (Policy Agent \( \pi \) ) interacts with the target environment to optimize the attack trajectory. At each turn, the agent performs Introspective Diagnosis (updating belief b t b_{t} about latent defense 𝒟 \( \mathcal{D} \) ), followed by Policy Formulation ( \( \sigma_{t} \) ) to derive an adversarial prompt x t x_{t} . The Evaluator computes a dense feedback signal comprising a scalar reward and Meta-suggestions , which act as a Semantic Gradient ( ∇ sem \( \nabla \)_{\( \text{sem} \)} ) to steer the agent’s next-step optimization within the latent strategy space.
The Metis Framework formulated as an Inference-Time Policy Optimization Loop. The Attacker (Policy Agent \( \pi \) ) interacts with the target environment to optimize the attack trajectory. At each turn, the agent performs Introspective Diagnosis (updating belief b t b_{t} about …
cs.AIarxiv:2602.13372Lead article

MoralityGym: A Benchmark for Evaluating Hierarchical Moral Alignment in Sequential Decision-Making Agents

Simon Rosen, Siddarth Singh, Ebenezer Gelo, Helen Sarah Robertson, Ibrahim Suder

his paper introduces MoralityGym, a benchmark for evaluating how well AI agents can follow hierarchical moral rules in complex decision-making scenarios. It uses a novel formalism called Morality Chains to represent these rules and a new Morality Metric to assess alignment, decoupling task performance from ethical behavior. The contribution is a principled framework for integrating psychological and philosophical insights into AI safety, enabling the development of more reliable and ethical AI systems.

Figure 1 . The PushOrSwitch scenario . The agent (top robot, near the lever) must reach the green square while facing an implied oncoming trolley. It can: (1) ?Do Nothing? : allowing the trolley to continue on the track, killing five humans (labelled ? 5 ? ). (2) ?Flip Switch? : diverting the trolley to a side track, killing three humans (labelled ? 3 ? ). (3) ?Push Person? : sacrificing one bystander (labelled ? 1 ? ) onto the main track, resulting in one death (the bystander) but saving the five on the main track. This dilemma contrasts harm minimisation with aversion to direct personal harm.
Figure 1 . The PushOrSwitch scenario . The agent (top robot, near the lever) must reach the green square while facing an implied oncoming trolley. It can: (1) ?Do Nothing? : allowing the trolley to continue on the track, killing five humans (labelled ? 5 ? ). (2) ?Flip Switch? : …
cs.AIarxiv:2605.15040Lead article

Orchard: An Open-Source Agentic Modeling Framework

Baolin Peng, Wenlin Yao, Qianhui Wu, Hao Cheng, Xiao Yu

rchard is an open-source framework designed to address infrastructure and training gaps in agentic modeling with LLMs. Its core contribution is Orchard Env, a lightweight environment service that provides reusable primitives for managing sandbox lifecycles, agent harnesses, and pipeline stages across various task domains. This enables scalable training of autonomous agents capable of complex problem-solving.

Performance comparison. Left: Orchard-SWE (30B) reaches 67.5% on SWE-bench Verified, approaching frontier MoE systems 10 10 – 30 × 30\( \times \) larger. Right: Orchard-GUI (4B) achieves 68.4% average success across WebVoyager, Online-Mind2web, and DeepShop, making it the strongest open-source GUI agent while staying on par with proprietary systems from OpenAI and Google.
Performance comparison. Left: Orchard-SWE (30B) reaches 67.5% on SWE-bench Verified, approaching frontier MoE systems 10 10 – 30 × 30\( \times \) larger. Right: Orchard-GUI (4B) achieves 68.4% average success across WebVoyager, Online-Mind2web, and DeepShop, making it the stronge…
cs.AIarxiv:2605.15153Lead article

Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action

Yi Zhang, Yinda Chen, Che Liu, Zeyuan Ding, Jin Xu

elican-Unify 1.0 introduces a novel unified embodied intelligence model that leverages a single Vision-Language Model (VLM) for understanding, reasoning, and generating future actions and videos. Its core method involves mapping diverse inputs into a shared semantic space and then using this representation to autoregressively produce chains of thought and predict future modalities within a single denoising process. This unification approach allows for joint optimization of understanding, reasoning, imagination, and action, a significant contribution over training separate expert systems.

Starting from a base VLM, standard VLA policy training weakens grounding and attention, while Pelican-Unify 1.0 retains them and still predicts actions. Base VLM learns what and where; standard VLA weakens perception, while Pelican-Unify 1.0 preserves it and still learns what action to output.
Starting from a base VLM, standard VLA policy training weakens grounding and attention, while Pelican-Unify 1.0 retains them and still predicts actions. Base VLM learns what and where; standard VLA weakens perception, while Pelican-Unify 1.0 preserves it and still learns what act…
cs.AIarxiv:2605.21902Lead article

Planning in the LLM Era: Building for Reliability and Efficiency

Michael Katz, Harsha Kokel, Kavitha Srinivas, Shirin Sohrabi

his paper argues that the planning field is shifting towards using LLMs to generate verifiable symbolic solvers, rather than for direct plan generation. This approach aims to build reliable and efficient planners that minimize LLM reliance during inference, addressing the limitations of earlier methods.

An overview of the planner generation methods
An overview of the planner generation methods
cs.AIarxiv:2605.22148Lead article

Ratchet: A Minimal Hygiene Recipe for Self-Evolving LLM Agents

Xing Zhang, Yanwei Cui, Guanghui Wang, Ziyuan Li, Wei Qiu

atchet addresses the lifecycle management bottleneck in self-evolving LLM agents by introducing a single-agent loop for natural language skill management. Its core method integrates four hygiene mechanisms—outcome-driven retirement, bounded active-cap, meta-skill authoring guidance, and pattern canonicalization—to enable a frozen LLM to effectively write, retrieve, curate, and retire its own skills. This approach significantly improves performance on tasks like MBPP+ hard-100, demonstrating a substantial gain over baselines and showing promise for agentic problem-solving.

The Ratchet loop. Inference (top): each task flows through Router → \( \to \) Solver → \( \to \) Grader → \( \to \) Capsule. Memory (middle): three append-only stores (Skill Bank, Meta-Skill, Evidence Log). Reflection (bottom): every round the Critic labels failures, the Synthesizer writes new skills from failure clusters, and the Curator retires under-performers. Solid arrows = data flow; dashed = memory reads/writes.
The Ratchet loop. Inference (top): each task flows through Router → \( \to \) Solver → \( \to \) Grader → \( \to \) Capsule. Memory (middle): three append-only stores (Skill Bank, Meta-Skill, Evidence Log). Reflection (bottom): every round the Critic labels failures, the Synthesi…
cs.AIarxiv:2605.21856Lead article

The Illusion of Reasoning: Exposing Evasive Data Contamination in LLMs via Zero-CoT Truncation

Yifan Lan, Yuanpu Cao, Hanyu Wang, Lu Lin, Jinghui Chen

his paper introduces the Zero-CoT Probe (ZCP) to detect evasive data contamination in LLMs. ZCP works by truncating the model's reasoning steps to expose memorization, which often masks true reasoning abilities. By comparing performance on original versus truncated reasoning, ZCP effectively identifies and isolates memorized data from genuine problem-solving skills.

Reasoning masks data contamination. Under Full-CoT (Top), memorization is indistinguishable from genuine reasoning. Our Zero-CoT Probe (Bottom) forces the model to bypass intermediate reasoning. Consequently, the model fails on clean questions but still correctly answers contaminated ones via a learned shortcut mapping, thereby exposing the memorization.
Reasoning masks data contamination. Under Full-CoT (Top), memorization is indistinguishable from genuine reasoning. Our Zero-CoT Probe (Bottom) forces the model to bypass intermediate reasoning. Consequently, the model fails on clean questions but still correctly answers contamin…
cs.AIarxiv:2602.05472Lead article

ALIVE: Awakening LLM Reasoning via Adversarial Learning and Instructive Verbal Evaluation

Yiwen Duan, Jing Ye, Xinpei Zhao

LIVE addresses the "reward bottleneck" in LLM reasoning by moving beyond costly scalar rewards. Its core method, Adversarial Learning with Instructive Verbal Evaluation, unifies problem posing, solving, and judging within a single policy. This allows LLMs to internalize reasoning logic directly from raw text through adversarial training and verbal feedback, fostering a deeper, self-contained understanding of correctness.

Overview of ALIVE. A unified policy model π \( \pi_{\theta} \) alternates among three roles in a closed-loop learning cycle: the Constructor masks reasoning-critical spans in text to create hindsight-verifiable tasks, the Solver generates reasoning trajectories for these tasks, and the Reviewer evaluates the resulting solutions with both verbal critiques and soft rewards. The same parameters are updated by combining task-difficulty, hard-verification, soft-review, and feedback-conditioned learning signals.
Overview of ALIVE. A unified policy model π \( \pi_{\theta} \) alternates among three roles in a closed-loop learning cycle: the Constructor masks reasoning-critical spans in text to create hindsight-verifiable tasks, the Solver generates reasoning trajectories for these tasks, a…
cs.AIarxiv:2605.23590Lead article

Co-ReAct: Rubrics as Step-Level Collaborators for ReAct Agents

Jiazheng Kang, Bowen Zhang, Zixin Song, Jiangwang Chen, Xiao Yang

o-ReAct introduces a novel framework where rubrics act as step-level collaborators for ReAct agents. Instead of just evaluating final outputs, Co-ReAct integrates rubrics directly into the agent's decision-making process during inference, guiding each reasoning or action step. This allows agents to more effectively target evidence, refine their reasoning, and improve the overall quality and efficiency of multi-step tasks.

Overview of Co-ReAct. (i) Collect: sample candidate next actions at each branching point and rank them with multi-judge expert consensus. (ii) Train: GRPO with a Spearman reward between the rubric-induced ranking and the expert ranking. (iii) Infer: the trained rubric drives a five-tuple (Rubric, Reason, Act, Verify, Observe) loop.
Overview of Co-ReAct. (i) Collect: sample candidate next actions at each branching point and rank them with multi-judge expert consensus. (ii) Train: GRPO with a Spearman reward between the rubric-induced ranking and the expert ranking. (iii) Infer: the trained rubric drives a fi…
cs.AIarxiv:2605.23605Lead article

DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling

Jean-Marie Lemercier, Tomas Geffner, Karsten Kreis, Morteza Mardani, Arash Vahdat

iLaDiff addresses the token correlation issue in diffusion language models by introducing a continuous latent space. This latent space, learned via an auto-encoder and a latent diffusion model, captures semantic information. A consistency model then distills this latent prior into a fast, few-step generative model, significantly improving sampling quality and inference speed.

DiLaDiff: hybrid continuous-discrete diffusion with self-distilled latent. The latent space is crafted with encoder ℰ \( \mathcal{E}_{\phi} \) and decoder 𝐱 θ {\( \mathbf{x} \)}_{\( \theta \)} and learned a posteriori with a diffusion process with denoiser 𝐳 ψ {\( \mathbf{z} \)}_{\( \psi \)} . The latent diffusion trajectories are further self-distilled with MeanFlow student 𝐮 η ​ ( 𝐳 τ , τ , r ) \( \mathbf{u}_{\eta} \)({\( \mathbf{z} \)}_{\( \tau \)},\( \tau \),r) .
DiLaDiff: hybrid continuous-discrete diffusion with self-distilled latent. The latent space is crafted with encoder ℰ \( \mathcal{E}_{\phi} \) and decoder 𝐱 θ {\( \mathbf{x} \)}_{\( \theta \)} and learned a posteriori with a diffusion process with denoiser 𝐳 ψ {\( \mathbf{z} \)…
cs.AIarxiv:2509.26383Lead article

Efficient and Transferable Agentic Knowledge Graph RAG via Reinforcement Learning

Junhong Lin, Shicheng Liu, Jinyeop Song, Song Wang, Julian Shun

his paper introduces KG-R1, an agentic framework that uses reinforcement learning to optimize knowledge-graph retrieval-augmented generation (KG-RAG). Instead of fixed multi-module pipelines, a single agent learns to interact with knowledge graphs, retrieving and incorporating information dynamically for more efficient and transferable question answering. This approach reduces inference costs and improves accuracy compared to existing methods.

Overview of KG-R1 , a multi-turn agentic KG-RAG framework. The framework enables cost-efficient inference and demonstrates strong cross-KG transferability.
Overview of KG-R1 , a multi-turn agentic KG-RAG framework. The framework enables cost-efficient inference and demonstrates strong cross-KG transferability.
cs.AIarxiv:2605.23218Lead article

Foundation Protocol: A Coordination Layer for Agentic Society

Bang Liu, Yongfeng Gu, Jiayi Zhang, Zhaoyang Yu, Sirui Hong

he Foundation Protocol (FP) introduces a graph-based coordination layer for agentic societies, unifying diverse entities like agents, humans, and institutions. Its core method is to provide a flexible framework for multi-party organization, event-based collaboration, and economic primitives, while prioritizing policy and accountability. FP's main contribution is enabling the scalable and safe interaction of autonomous agents by acting as a bridging layer for existing protocols, fostering an AI economy.

A compact view of the web’s evolution: each generation raised capability while exposing new coordination failures. Web 4.0-like systems intensify those failures because agents act, interact, and transact at scale.
A compact view of the web’s evolution: each generation raised capability while exposing new coordination failures. Web 4.0-like systems intensify those failures because agents act, interact, and transact at scale.
cs.AIarxiv:2605.23238Lead article

GENSTRAT: Toward a Science of Strategic Reasoning in Large Language Models

Vartan Shadarevian, Kia Ghods, Alex Kenich, Anany Kotawala

his paper introduces GENSTRAT, a novel benchmark for evaluating strategic reasoning in LLMs. Its core method involves procedurally generating a diverse distribution of imperfect-information card games, allowing for evergreen and robust evaluation. GENSTRAT's contribution is a more generalizable assessment of LLM strategic capabilities beyond fixed, canonical games, enabling confidence in predicting their performance in real-world messy environments.

The 50-game benchmark in two diagnostic axes (state space vs. information sensitivity). Each point denotes a game, with stars marking the annotated games.
The 50-game benchmark in two diagnostic axes (state space vs. information sensitivity). Each point denotes a game, with stars marking the annotated games.
cs.AIarxiv:2605.23551Lead article

Goal-Conditioned Agents that Learn Everything All at Once

Michael Matthews, Matthew Jackson, Michael Beukman, Thomas Foster, Alistair Letcher

his paper introduces Learning Everything All at Once (LEO), a method for goal-conditioned reinforcement learning. LEO efficiently learns from all transitions by jointly outputting values and actions for every possible goal simultaneously, enabling parallel, off-policy updates. This approach significantly improves sample efficiency and performance on goal-conditioned tasks while being substantially faster than naive relabeling.

cs.AIarxiv:2605.23825Lead article

It's the humans, not the data: Geopolitical bias in LLMs originates in post-training, amplified by the language of the prompt

Stuart Bladon, Brinnae Bent

his paper demonstrates that geopolitical bias in LLMs primarily emerges during post-training, not pre-training, contradicting common assumptions. The researchers found that models often develop a bias favoring their developer's home country after fine-tuning, with the prompt's language also influencing the strength of this bias. This highlights the crucial role of human-driven post-training processes in shaping LLM behavior.

Overview, seven families. (A) Per-country preference base → \( \to \) post-trained; for the six non-GLM bases, cross-country spread \( \sigma \) grows post-training (Qwen 3.9 → 30.3 3.9\( \to \) 30.3 pp). (B) Post-training \( \Delta \) in China-favourability (EN, coherent subset). 3/3 Western labs shift anti-China; 3/4 Chinese labs shift pro-China; Yi shifts anti-China after prefill correction. GLM is shown with its (atypical) base preserved for completeness; see § Bias Is Created by Post-Training, Not Pretraining . The legend’s low-compliance encoding is described in § What MCQ Compliance Tells Us About Validity . (C) ZH − - EN shift on post-trained models: 5/7 descriptively pro-China but population-level claim is not statistically separable from the base trend (§ Linguistic Identity Modulates the Post-Training Bias ).
Overview, seven families. (A) Per-country preference base → \( \to \) post-trained; for the six non-GLM bases, cross-country spread \( \sigma \) grows post-training (Qwen 3.9 → 30.3 3.9\( \to \) 30.3 pp). (B) Post-training \( \Delta \) in China-favourability (EN, coherent subset)…
cs.AIarxiv:2605.23723Lead article

MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detection

Zhewen Tan, Yilun Yao, Huiyan Jin, Wenhan Yu, Guoan Wang

emAudit is a post-hoc framework for auditing poisoned memory in LLM agents. It uses causal attribution to identify memories that causally influence harmful outputs and structural anomaly detection to pinpoint suspicious memory patterns. This allows for the identification and mitigation of memory poisoning after malicious behavior has occurred, addressing a gap in existing online-only defenses.

Overview of MemAudit. Given a harmful event e = ( q ∗ , y ∗ , R ∗ ) e=(q^{*},y^{*},R^{*}) , the framework performs post-hoc auditing over the memory store. It combines two complementary signals: CMIS, which measures the causal contribution of retrieved memories through counterfactual replay, and MCG, which identifies structurally anomalous memories in the global memory graph. The two signals are fused into a detoxification score for ranking suspicious memories. After removing the top-ranked memories, the agent becomes safer while preserving useful memory.
Overview of MemAudit. Given a harmful event e = ( q ∗ , y ∗ , R ∗ ) e=(q^{*},y^{*},R^{*}) , the framework performs post-hoc auditing over the memory store. It combines two complementary signals: CMIS, which measures the causal contribution of retrieved memories through counterfac…
cs.AIarxiv:2605.02087Lead article

Model Spec Midtraining: Improving How Alignment Training Generalizes

Chloe Li, Nevan Wichers, Sara Price, Samuel Marks, Jon Kutasov

his paper introduces Model Spec Midtraining (MSM) to improve how language models generalize during alignment training. MSM involves training models on synthetic documents discussing their desired behavior specification *before* standard alignment fine-tuning. This pre-training step helps models understand the spec's content, leading to more robust and targeted generalization from subsequent demonstration data.

cs.AIarxiv:2601.03715Lead article

R$^3$L: Reflect-then-Retry Reinforcement Learning with Language-Guided Exploration, Pivotal Credit, and Positive Amplification

Weijie Shi, Yanxi Chen, Zexi Li, Xuchen Pan, Yuchang Sun

$^3$L addresses exploration and exploitation challenges in RL for LLMs by introducing a "reflect-then-retry" mechanism. This method uses language feedback to analyze failed attempts, guiding retries from failure points to improve trajectory synthesis and reduce costs. The paper also proposes pivotal credit assignment and positive amplification to overcome coarse credit assignment and failure-dominated training.

cs.AIarxiv:2605.05704Lead article

SafeHarbor: Hierarchical Memory-Augmented Guardrail for LLM Agent Safety

Zhe Liu, Zonghao Ying, Wenxin Zhang, Quanchen Zou, Deyue Zhang

afeHarbor is a hierarchical memory-augmented guardrail system for LLM agents. Its core method involves extracting context-aware defense rules through adversarial generation and dynamically injecting them into a local hierarchical memory. This approach aims to provide precise decision boundaries, balancing safety and utility without requiring retraining, and includes a self-evolution mechanism for continuous improvement.

Comparison between (a) Traditional coarse-grained guardrails and (b) Our precise, rule-based SafeHarbor framework.
Comparison between (a) Traditional coarse-grained guardrails and (b) Our precise, rule-based SafeHarbor framework.
cs.AIarxiv:2602.02780Lead article

Scaling-Aware Adapter for Structure-Grounded LLM Reasoning

Zihao Jing, Qiuhao Zeng, Ruiyi Fang, Yan Yi Li, Yan Sun

his paper introduces Cuttlefish, a unified multimodal LLM that enhances reasoning over 2D and 3D structures. Its core method, Scaling-Aware Patching, adaptively generates variable-size patches over structural graphs, allowing the model to scale its query token budget with structural complexity. This approach overcomes limitations of fixed-length connectors, enabling more flexible and effective geometric grounding for generalized all-atom reasoning.

Mol-Llama performance on the Mol-Instructions captioning task, evaluated across five molecule length bins with 6 metrics (left y-axis, detailed in App D.3 ) plotted as curves with dashed overall averages, and the background bars indicate the proportion of samples in each length bin (right y-axis).
Mol-Llama performance on the Mol-Instructions captioning task, evaluated across five molecule length bins with 6 metrics (left y-axis, detailed in App D.3 ) plotted as curves with dashed overall averages, and the background bars indicate the proportion of samples in each length b…
cs.AIarxiv:2602.12579Lead article

VI-CuRL: Stabilizing Verifier-Independent RL Reasoning via Confidence-Guided Variance Reduction

Xin-Qiang Cai, Masashi Sugiyama

his paper introduces VI-CuRL, a method to stabilize Reinforcement Learning for LLM reasoning without external verifiers. It uses the LLM's own confidence to guide a curriculum, prioritizing high-confidence examples to reduce gradient variance and prevent training collapse. This approach effectively manages the bias-variance trade-off, leading to more stable and scalable LLM reasoning.

Conceptual overview of VI-CuRL. Unlike standard RL that treats all samples equally, VI-CuRL dynamically selects high-confidence samples to stabilize training via a principled bias-variance trade-off, without accessing external verifiers.
Conceptual overview of VI-CuRL. Unlike standard RL that treats all samples equally, VI-CuRL dynamically selects high-confidence samples to stabilize training via a principled bias-variance trade-off, without accessing external verifiers.
cs.AIarxiv:2605.23414Lead article

When Planning Fails Despite Correct Execution: On Epistemic Calibration for LLM-Based Multi-Agent Systems

Zehao Wang, Shilong Jin, Zhao Cao, Lanjun Wang

his paper addresses failures in LLM multi-agent systems where plans are executed correctly but are based on agents misjudging their knowledge (epistemic miscalibration). The core method, EPC-AW, proposes an agentic workflow that assesses plan stability under varying information conditions, rather than direct feasibility checks. The contribution is a novel approach to improve LLM agent planning by ensuring epistemic calibration, leading to more robust and reliable multi-agent system behavior.

Overview of EPC-AW. EPC-AW consists of three agents, the Planner, Executor, and Diagnoser, each with heterogeneous information in memory. At each round, Information-consistency-based Plan Selection evaluates candidate plans across agents and selects those with stable evaluations, providing a planning-time calibration signal. Across rounds, Consistency-guided Epistemic State Refinement aggregates consistency feedback to guide planning under evolving information. The process terminates upon satisfying a stopping condition, after which the final answer is produced.
Overview of EPC-AW. EPC-AW consists of three agents, the Planner, Executor, and Diagnoser, each with heterogeneous information in memory. At each round, Information-consistency-based Plan Selection evaluates candidate plans across agents and selects those with stable evaluations,…
cs.AIarxiv:2605.07830v1Lead article

CyBiasBench: Benchmarking Bias in LLM Agents for Cyber-Attack Scenarios

Taein Lim, Seongyong Ju, Munhyeok Kim, Hyunjun Kim, Hoki Kim

his paper introduces CyBiasBench, a benchmark designed to quantify attack-selection bias in LLM agents used for cybersecurity. The core method involves evaluating five LLM agents across various scenarios to reveal their tendency to disproportionately focus on specific attack families, independent of prompt variations. The main contribution is the identification and characterization of this "attack-selection bias" as an inherent agent trait, demonstrating that LLM agents exhibit distinct and persistent preferences in their offensive strategies.

Attack-Selection Bias of LLM Agents. To illustrate attack-selection bias, we measure per-agent average selection rates across the bias observation setting (solid line) and compare them with the corresponding attack success rates (dashed line). The results reveal clear biases in agent behavior.
Attack-Selection Bias of LLM Agents. To illustrate attack-selection bias, we measure per-agent average selection rates across the bias observation setting (solid line) and compare them with the corresponding attack success rates (dashed line). The results reveal clear biases in a…
cs.AIarxiv:2605.08063v1Lead article

Flow-OPD: On-Policy Distillation for Flow Matching Models

Zhen Fang, Wenxuan Huang, Yu Zeng, Yiming Zhao, Shuang Chen

low-OPD addresses bottlenecks in multi-task flow matching models by using on-policy distillation. It first trains specialized "teacher" models for individual tasks, then distills their expertise into a single "student" model through a novel two-stage alignment process. This approach aims to overcome reward sparsity and gradient interference, leading to improved performance across multiple objectives.

Performance Comparison in Multi-task Training . During training, Flow-OPD exhibits a steady increase in mean rewards across GenEval Ghosh et al. ( 2023 ) and OCR Chen et al. ( 2023 ) benchmarks, reaching a peak of 93. In contrast, vanilla GRPO converges prematurely around 78. Our approach significantly outperforms GRPO in both image synthesis and text rendering while maintaining superior generation quality and human preference alignment. The curves are smoothed for visual clarity. DeQA and PickScore are norm to 0-1. We employ model merging for cold-start in the left subgraph.
Performance Comparison in Multi-task Training . During training, Flow-OPD exhibits a steady increase in mean rewards across GenEval Ghosh et al. ( 2023 ) and OCR Chen et al. ( 2023 ) benchmarks, reaching a peak of 93. In contrast, vanilla GRPO converges prematurely around 78. Our…
cs.AIarxiv:2605.07865v1Lead article

KL for a KL: On-Policy Distillation with Control Variate Baseline

Minjae Oh, Sangjun Song, Gyubin Choi, Yunho Choi, Yohan Jo

his paper introduces vOPD, a method to stabilize On-Policy Distillation (OPD) for large language models. It achieves this by framing OPD as policy-gradient reinforcement learning and incorporating a control variate baseline, specifically a value function. The key contribution is that this value function has a closed-form solution derived from the student and teacher models' existing forward pass, avoiding the computational overhead of previous stabilization techniques.

Token-level reward and advantage distributions. Left: The marginal distributions. Right: Per-token scatter plot (x: advantage, y: reward).
Token-level reward and advantage distributions. Left: The marginal distributions. Right: Per-token scatter plot (x: advantage, y: reward).
cs.AIarxiv:2605.08013v1Lead article

Learning CLI Agents with Structured Action Credit under Selective Observation

Haoyang Su, Ying Wen

his paper introduces a novel approach for training command-line interface (CLI) agents by leveraging the inherent structure of CLI actions. To address challenges of partial observation and sparse rewards, it proposes $σ$-Reveal to selectively extract relevant context and Action Advantage Assignment to better attribute credit to actions within long interaction sequences. The core contribution lies in using structured action information as a learning signal, improving agent performance on complex CLI tasks.

Overview of the verifiable CLI task workflow. (a) ShellOps task instance with a natural language query, an initial workspace file tree, a verifiable gold bash solution, and the expected post execution workspace or standard output. (b) ShellOps and ShellOps-Pro coverage across file extensions and four task axes (Lookup, Aggregate, Edit, Mixed). (c) Unified verifiable loop with workspace observation, shell action generation, sandbox execution, and schema based scoring.
Overview of the verifiable CLI task workflow. (a) ShellOps task instance with a natural language query, an initial workspace file tree, a verifiable gold bash solution, and the expected post execution workspace or standard output. (b) ShellOps and ShellOps-Pro coverage across fil…
cs.AIarxiv:2605.08019v1Lead article

Reason to Play: Behavioral and Brain Alignment Between Frontier LRMs and Human Game Learners

Botos Csaba, Sreejan Kumar, Austin Tudor David Andrews, Laurence Hunt, Chris Summerfield

his paper investigates whether advanced Large Reasoning Models (LRMs) can replicate human learning and planning in novel video games. By analyzing human gameplay with fMRI data, the study finds that LRMs better match human learning behaviors and predict brain activity compared to reinforcement learning agents. This suggests LRMs exhibit a more human-like approach to acquiring and applying abstract knowledge in complex environments.

VGDL game paradigm. (A) Games are defined by combining game rules with map layouts to produce interactive environments. (B) Example Trial Structure of VGDL-fMRI Dataset. Color denotes game names: ( Bait , Chase , Helper , Lemmings , Plaque Attack , Zelda ). All participants played the same level progression structure with randomized game order. The subsequent levels reveal new rules incrementally. The Interactive Catalogue A lets readers try each game in the browser and browse all participant and LRM agent gameplay replays. Project page: https://botcs.github.io/reason-to-play/
VGDL game paradigm. (A) Games are defined by combining game rules with map layouts to produce interactive environments. (B) Example Trial Structure of VGDL-fMRI Dataset. Color denotes game names: ( Bait , Chase , Helper , Lemmings , Plaque Attack , Zelda ). All participants playe…
cs.AIarxiv:2605.07935v1Lead article

TraceFix: Repairing Agent Coordination Protocols with TLA+ Counterexamples

Shuren Xia, Qiwei Li, Taqiya Ehsan, Jorge Ortiz

raceFix is a verification-first pipeline that uses TLA+ model checking to automatically repair LLM multi-agent coordination protocols. An LLM agent synthesizes a protocol, generates TLA+ logic, and iteratively refines it using counterexamples until verified. This verified protocol is then compiled into system prompts, ensuring robust and efficient agent coordination.

Figure 1. TraceFix pipeline overview. At design time (Stages 1–4), an orchestration agent synthesizes a protocol topology IR, generates PlusCal coordination logic, and iteratively repairs the protocol using TLC counterexamples until verification succeeds. At runtime (Stages 5–6), verified process bodies are compiled into per-agent prompts and executed under a topology monitor that rejects out-of-protocol coordination operations.
Figure 1. TraceFix pipeline overview. At design time (Stages 1–4), an orchestration agent synthesizes a protocol topology IR, generates PlusCal coordination logic, and iteratively repairs the protocol using TLC counterexamples until verification succeeds. At runtime (Stages 5–6),…
cs.LGarxiv:2605.07863v1Lead article

ADKO: Agentic Decentralized Knowledge Optimization

Lucas Nerone Rillo, Zhanhong Jiang, Nastaran Saadati, Aditya Balu, Baskar Ganapathysubramanian

DKO is a framework for collaborative black-box optimization among autonomous agents. Its core method involves each agent maintaining a private Gaussian Process surrogate and communicating only through "knowledge tokens," which are compressed summaries of their findings. This approach achieves sample efficiency, privacy, and handles diverse objectives by avoiding raw data sharing, while its contribution lies in the formal analysis of information loss from token compression and language model approximation.

Illustrative example of decentralized knowledge transfer in ADKO for heterogeneous chemical optimization. Agents operating under different solvent constraints exchange only privacy-aware knowledge tokens rather than raw experimental data. The example shows how a high-yield reaction discovered by one agent is semantically transferred and refined by neighboring agents through LM-guided reasoning and token-based communication, enabling strategic collaboration that outperforms blind exploration while preserving data privacy.
Illustrative example of decentralized knowledge transfer in ADKO for heterogeneous chemical optimization. Agents operating under different solvent constraints exchange only privacy-aware knowledge tokens rather than raw experimental data. The example shows how a high-yield reacti…
cs.LGarxiv:2605.07961v1Lead article

Graph Representation Learning Augmented Model Manipulation on Federated Fine-Tuning of LLMs

Hanlin Cai, Kai Li, Houtianfu Wang, Haofan Dong, Yichen Li

his paper proposes an Augmented Model Manipulation (AugMP) strategy to attack federated fine-tuning (FFT) of LLMs. The core method uses graph representation learning to understand benign model updates and generate more effective and stealthy malicious updates. The contribution is a novel attack that leverages these insights to corrupt the global LLM during collaborative fine-tuning.

(a) Benign training process of the FedLLMs system, and (b) impact of the adversary on the FedLLMs training process.
(a) Benign training process of the FedLLMs system, and (b) impact of the adversary on the FedLLMs training process.
cs.LGarxiv:2605.07977v1Lead article

Self-Play Enhancement via Advantage-Weighted Refinement in Online Federated LLM Fine-Tuning with Real-Time Feedback

Seohyun Lee, Wenzhi Fang, Dong-Jun Han, Seyyedali Hosseinalipour, Christopher G. Brinton

his paper introduces SPEAR, an online federated learning algorithm for LLMs that enhances self-play. SPEAR leverages real-time user feedback to create advantage-weighted contrastive pairs, enabling efficient fine-tuning on resource-constrained edge devices without requiring privileged ground-truth data. Its core contribution is enabling continuous self-improvement of LLMs in a federated setting by effectively utilizing natural feedback loops.

The two phases of the SPEAR algorithm. Firstly, the model interacts with an incoming feedback source (e.g., a user) to correct incorrect generations. After the interaction phase, it categorizes the samples into wins and losses, which are then used to train a standard MLE and unlikelihood objective. This two-stage process repeats at each federated round t t for each client selected for aggregation.
The two phases of the SPEAR algorithm. Firstly, the model interacts with an incoming feedback source (e.g., a user) to correct incorrect generations. After the interaction phase, it categorizes the samples into wins and losses, which are then used to train a standard MLE and unli…
cs.CLarxiv:2605.07937v1Lead article

Ask Early, Ask Late, Ask Right: When Does Clarification Timing Matter for Long-Horizon Agents?

Anmol Gulati, Hariom Gupta, Elias Lumer, Sahil Sen, Vamse Kumar Subbiah

his paper investigates when clarification is most valuable for long-horizon AI agents. They introduce a framework to inject clarifications at different stages of execution and find that the optimal timing depends on the type of missing information. Specifically, goal clarifications are most effective early on, while input clarifications remain valuable throughout the agent's task.

Overview of the forced-injection experimental framework. We inject ground-truth clarifications at controlled points along an oracle-calibrated action budget, measuring task success (pass@3) at each injection timing across four information dimensions.
Overview of the forced-injection experimental framework. We inject ground-truth clarifications at controlled points along an oracle-calibrated action budget, measuring task success (pass@3) at each injection timing across four information dimensions.
cs.CLarxiv:2605.07883v1Lead article

Beyond "I cannot fulfill this request": Alleviating Rigid Rejection in LLMs via Label Enhancement

Ying Zhang, Congyu Qiao, Xin Geng, Ning Xu

his paper introduces LANCE, a method to reduce "rigid rejection" in LLMs by enhancing safety labels. LANCE uses variational inference to predict a continuous distribution of rejection categories, providing nuanced gradients that allow LLMs to neutralize harmful prompt elements and generate safer, more natural responses instead of generic refusals.

Rigid refusal examples.
Rigid refusal examples.
cs.CLarxiv:2605.08083v1Lead article

LLMs Improving LLMs: Agentic Discovery for Test-Time Scaling

Tong Zheng, Haolin Liu, Chengsong Huang, Huiwen Bao, Sheng Zhang

his paper introduces AutoTTS, a framework that uses an agentic approach to automatically discover optimal test-time scaling (TTS) strategies for large language models. Instead of manual tuning, AutoTTS creates environments where TTS strategies can be learned efficiently by synthesizing controllers that decide how to allocate computation during inference, based on cheap feedback signals. This allows for a more comprehensive exploration of the computation-allocation space, leading to improved LLM performance.

Overview of our Auto-TTS framework. Unlike the traditional workflow of manually designing TTS strategies, Auto-TTS shifts the human role from directly hand-crafting branching, pruning, and stopping heuristics to constructing environments by defining states, actions, feedback, and objectives. Given the constructed environment, an explorer LLM iteratively proposes candidate controllers, evaluates them in the offline replay environment, receives feedback from scaling curves and execution traces, and uses the accumulated history to refine future proposals. The right panel shows an example evaluation on Qwen-1.7B and AIME25, where the discovered controller improves the accuracy–cost Pareto frontier over hand-crafted baselines with an affordable one-time search cost.
Overview of our Auto-TTS framework. Unlike the traditional workflow of manually designing TTS strategies, Auto-TTS shifts the human role from directly hand-crafting branching, pruning, and stopping heuristics to constructing environments by defining states, actions, feedback, and…
cs.AIarxiv:2605.10876v1Lead article

AssayBench: An Assay-Level Virtual Cell Benchmark for LLMs and Agents

Edward De Brouwer, Carl Edwards, Alexander Wu, Jenna Collier, Graham Heimberg

ssayBench is a new benchmark designed to evaluate Large Language Models (LLMs) and agents on predicting cellular phenotypes from CRISPR screens. It addresses the lack of standardized evaluation for this task, which is crucial for accelerating biological discovery and drug development. The benchmark utilizes a large dataset of publicly available CRISPR screens to assess the models' ability to handle heterogeneous biological data and predict diverse phenotypic outcomes.

Overview of the AssayBench benchmark creation. ( A ) Starting from 1971 human CRISPR screens, we perform data quality filtering, replicate merging, and data augmentation to obtain 1920 high quality screens. ( B ) Phenotype composition of the database and its four splits. A realistic but challenging temporal split was used. ( C ) Given a description of the screen and a gene ranking criteria, a model must provide a ranked list of 100 genes.
Overview of the AssayBench benchmark creation. ( A ) Starting from 1971 human CRISPR screens, we perform data quality filtering, replicate merging, and data augmentation to obtain 1920 high quality screens. ( B ) Phenotype composition of the database and its four splits. A realis…
cs.AIarxiv:2605.10765v1Lead article

Dynamic Cross-Modal Prompt Generation for Multimodal Continual Instruction Tuning

Tao Hu, Da-Wei Zhou

his paper introduces DRAPE, a novel framework for Multimodal Continual Instruction Tuning (MCIT). DRAPE addresses catastrophic forgetting in MLLMs by dynamically generating instance-specific soft prompts, adapting to individual query-image pairs rather than relying on fixed task-level modules. This instance-level adaptation allows for more flexible and effective learning of new capabilities while preserving existing knowledge.

cs.AIarxiv:2605.10763v1Lead article

MATRA: Modeling the Attack Surface of Agentic AI Systems -- OpenClaw Case Study

Tim Van hamme, Thomas Vissers, Javier Carnerero-Cano, Mario Fritz, Emil C. Lupu

his paper introduces MATRA, a pragmatic threat modeling framework for agentic AI systems. MATRA adapts existing risk assessment methods to systematically identify and quantify risks by first assessing asset impact and then using attack trees to determine likelihood. The authors demonstrate MATRA's effectiveness on an OpenClaw case study, showing how architectural controls can mitigate identified risks.

MATRA framework overview. System properties and threat sources are collected from the client. Assets identified from system documentation feed into a stakeholder-driven business impact assessment, which produces impact scenarios. A data flow diagram (DFD), combined with known attack techniques from established catalogs, informs the construction of attack trees that decompose each impact scenario into objectives, techniques, and architecture-specific vectors.
MATRA framework overview. System properties and threat sources are collected from the client. Assets identified from system documentation feed into a stakeholder-driven business impact assessment, which produces impact scenarios. A data flow diagram (DFD), combined with known att…
cs.AIarxiv:2605.10815v1Lead article

Probing Cross-modal Information Hubs in Audio-Visual LLMs

Jihoo Jung, Chaeyoung Jung, Ji-Hoon Kim, Joon Son Chung

his paper investigates how audio and visual information is processed and integrated within Audio-Visual Large Language Models (AVLLMs). The core method involves analyzing token representations to understand where information from one modality is encoded in the other. The key contribution is the discovery that AVLLMs primarily use "sink tokens" to integrate cross-modal information, and that this integration is not uniform but concentrated in a specific subset of these sink tokens.

Cross-modal information is primarily stored in cross-modal sink tokens. Consider an audiovisual clip of a barking sea lion. Cross-modal sink tokens aggregate cues from both modalities, whereas unimodal sink tokens encode information solely from their native modality.
Cross-modal information is primarily stored in cross-modal sink tokens. Consider an audiovisual clip of a barking sea lion. Cross-modal sink tokens aggregate cues from both modalities, whereas unimodal sink tokens encode information solely from their native modality.
cs.AIarxiv:2605.10805v1Lead article

Reasoning Is Not Free: Robust Adaptive Cost-Efficient Routing for LLM-as-a-Judge

Wenbo Zhang, Lijinghua Zhang, Liner Xiang, Hengrui Cai

his paper investigates the trade-off between accuracy and cost when using LLMs as judges. It finds that explicit reasoning significantly improves performance on complex tasks but incurs higher costs, suggesting selective use. The authors propose RACER, a method that adaptively routes requests to reasoning or non-reasoning judges within a budget, accounting for potential distribution shifts.

cs.AIarxiv:2605.10870v1Lead article

Remember the Decision, Not the Description: A Rate-Distortion Framework for Agent Memory

Mingxi Zou, Zhihan Guo, Langzhang Liang, Zhuo Wang, Qifan Wang

his paper proposes a novel rate-distortion framework for agent memory, shifting focus from descriptive memory quality to its impact on decision-making. The core method frames memory compression as a decision-centric problem, where memory quality is measured by the loss in achievable decision quality. The main contribution is a theoretical framework that defines an exact forgetting boundary and an optimal memory-distortion frontier, leading to an online memory learner (DeMem) that efficiently manages memory by only refining it when necessary to avoid decision conflicts.

DeMem routes histories into bounded slots and splits only on certified conflict.
DeMem routes histories into bounded slots and splits only on certified conflict.
cs.AIarxiv:2605.10848v1Lead article

Rethinking Agentic Search with Pi-Serini: Is Lexical Retrieval Sufficient?

Tz-Huan Hsu, Jheng-Hong Yang, Jimmy Lin

his paper investigates whether lexical retrieval is sufficient for agentic search with advanced LLMs. The authors introduce Pi-Serini, a search agent that pairs a well-tuned BM25 lexical retriever with capable LLMs. Their findings demonstrate that a sufficiently deep and optimized lexical retriever, when combined with powerful LLMs, can achieve high accuracy in deep research tasks, even surpassing agents using dense retrievers.

cs.AIarxiv:2605.10831v1Lead article

SLIM: Sparse Latent Steering for Interpretable and Property-Directed LLM-Based Molecular Editing

Mingxu Zhang, Yuhan Li, Lujundong Li, Dazhong Shen, Hui Xiong

LIM is a plug-and-play framework that decomposes LLM hidden states into sparse, property-aligned features using a Sparse Autoencoder. This allows for precise steering in the latent space to control molecular properties, improving editing success rates without altering the LLM's parameters. The method also enables interpretable analysis of the editing process.

Overview of the SLIM framework. Stage 1 : Ridge probes scan all layers to identify the optimal intervention point l ∗ l^{*} . Stage 2 : A task-oriented SAE is trained at layer l ∗ l^{*} with four objectives: (A) sparse reconstruction, (B) supervised property prediction via per-property Importance Gates, (C) contrastive alignment of importance-gated sparse codes, and (D) gradient alignment to ensure the SAE basis faithfully represents causal steering directions. Stage 3 : At inference time, a sparse steering vector is added to the residual stream at layer l ∗ l^{*} , directing the model toward improved molecular properties without modifying model parameters.
Overview of the SLIM framework. Stage 1 : Ridge probes scan all layers to identify the optimal intervention point l ∗ l^{*} . Stage 2 : A task-oriented SAE is trained at layer l ∗ l^{*} with four objectives: (A) sparse reconstruction, (B) supervised property prediction via per-pr…
cs.AIarxiv:2605.10808v1Lead article

Threat Modelling using Domain-Adapted Language Models: Empirical Evaluation and Insights

Saba Pourhanifeh, AbdulAziz AbdulGhaffar, Ashraf Matrawy

his paper empirically evaluates domain-adapted language models (LLMs and SLMs) for structured threat modeling using the STRIDE approach in 5G security. The core method involves systematically analyzing the impact of domain adaptation, model size, decoding strategies, and prompting techniques on threat classification accuracy. The main contribution is providing insights into how these factors influence the effectiveness of language models in cybersecurity threat modeling.

cs.AIarxiv:2605.13548v1Lead article

AttenA+: Rectifying Action Inequality in Robotic Foundation Models

Daojie Peng, Fulong Ma, Jiahang Cao, Qiang Zhang, Xupeng Xie

his paper introduces AttenA+, a framework that addresses the "action inequality" in robotic foundation models. It recognizes that low-velocity actions are often more critical for task success than high-velocity transitions. AttenA+ rectifies this by reweighting the training objective based on inverse velocity, prioritizing kinematically critical segments through a novel attention mechanism. This approach aims to improve the performance of Vision-Language-Action and World-Action models on complex, long-horizon robotic tasks.

Overview of AttenA+ . AttenA+ is a paradigm-agnostic enhancement framework for action robotic foundation models, introducing velocity-field-based action attention to prioritize slow, critical manipulation steps. It seamlessly plugs into mainstream discriminative (e.g., OpenVLA-OFT) and generative ( \( \pi_{0} \) , π 0.5 \( \pi_{0.5} \) , Diffusion Policy) architectures, as well as emerging World-Action Models (WAM). Without modifying core backbones or relying on data/model scaling, AttenA+ generalizes across diverse robotic datasets including Libero Liu et al. ( 2023 ) and RoboTwin Chen et al. ( 2025 ) , and consistently improves task success rates over state-of-the-art baselines.
Overview of AttenA+ . AttenA+ is a paradigm-agnostic enhancement framework for action robotic foundation models, introducing velocity-field-based action attention to prioritize slow, critical manipulation steps. It seamlessly plugs into mainstream discriminative (e.g., OpenVLA-OF…
cs.AIarxiv:2605.13652v1Lead article

Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training

Namrata Shivagunde, Vijeta Deshpande, Sherin Muckatira, Anna Rumshisky

his paper investigates whether low-rank pre-training methods for large language models generalize as well as full-rank training, a question previously addressed only by limited perplexity metrics. The authors provide a more thorough comparison by analyzing the geometric and spectral properties of the solutions found by five different low-rank methods, revealing how rank constraints impact model representations beyond simple perplexity scores. Their contribution lies in offering a deeper understanding of low-rank pre-training's effectiveness and its fundamental differences from full-rank training.

cs.AIarxiv:2605.13709v1Lead article

Children's English Reading Story Generation via Supervised Fine-Tuning of Compact LLMs with Controllable Difficulty and Safety

Qian Shen, Fanghua Cao, Min Yao, Shlok Gilda, Bonnie J. Dorr

his paper fine-tunes compact LLMs (8B parameters) on expert-designed children's reading curricula and existing generated stories. The core method focuses on controllable difficulty and safety, enabling educators to target specific reading levels. The main contribution is demonstrating that these fine-tuned, smaller LLMs can generate English reading stories that are more appropriate in difficulty for children than those produced by larger, zero-shot models, while remaining cost-effective.

System architecture and experimental workflow for generating children’s English reading stories via supervised fine-tuning of compact LLMs.
System architecture and experimental workflow for generating children’s English reading stories via supervised fine-tuning of compact LLMs.
cs.AIarxiv:2605.13841v1Lead article

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

Tara Bogavelli, Gabrielle Gauthier Melançon, Katrina Stankiewicz, Oluwanifemi Bamgbose, Fanny Riols

VA-Bench is an end-to-end framework for evaluating voice agents. Its core method involves generating realistic, multi-turn bot-to-bot audio conversations with automatic validation and introducing two composite metrics, EVA-A (Accuracy) and EVA-X (Experience), to measure task completion, speech fidelity, and conversational quality. This addresses the limitations of existing benchmarks in simulating realistic dialogues and capturing voice-specific failure modes.

EVA-Bench framework overview. The simulation orchestrates parallel per-scenario bot-to-bot audio sessions over WebSocket in which the User Simulator — configured with a scenario-specific goal, persona, and conversational TTS voice — interacts with the Voice Agent under test. The Tool Executor handles all agent tool calls deterministically. Completed conversations pass through Simulator Validation that trigger automatic regeneration on failure before entering the Quality Measurements phase, which produces EVA-A and EVA-X pass@1, pass@k, and pass^k scores in addition to Diagnostic metrics.
EVA-Bench framework overview. The simulation orchestrates parallel per-scenario bot-to-bot audio sessions over WebSocket in which the User Simulator — configured with a scenario-specific goal, persona, and conversational TTS voice — interacts with the Voice Agent under test. The …
cs.AIarxiv:2605.13821v1Lead article

Harnessing Agentic Evolution

Jiayi Zhang, Yongfeng Gu, Jianhao Ruan, Maojia Song, Yiran Peng

his paper introduces AEvo, a meta-editing framework for agentic evolution. AEvo treats the evolutionary process as an interactive environment, using accumulated evidence as its state. Its core contribution is a meta-agent that revises the evolutionary mechanism itself, rather than directly generating candidates, to improve long-horizon evolution and prevent drift.

Harnessing agentic evolution as an interactive environment. (a) Procedure-based evolution runs a fixed loop for selection, optimization, evaluation, and update. (b) Agent-based evolution lets a general-purpose agent manage search through feedback, tools, skills, and code actions. (c) AEvo treats the evolution process as an interactive environment. The accumulated evolution context becomes process-level state, while a meta-agent edits the underlying procedure or agent operating context that controls future evolution.
Harnessing agentic evolution as an interactive environment. (a) Procedure-based evolution runs a fixed loop for selection, optimization, evaluation, and update. (b) Agent-based evolution lets a general-purpose agent manage search through feedback, tools, skills, and code actions.…
cs.AIarxiv:2605.13579v1Lead article

Position: Assistive Agents Need Accessibility Alignment

Jie Hu, Changyuan Yan, Yu Zheng, Ziqian Wang, Jiaming Zhang

his paper argues that assistive AI agents for visually impaired users must prioritize "accessibility alignment" as a core design goal, not an afterthought. Current agentic AI fails in assistive scenarios due to mismatches with sighted-user assumptions regarding verification, risk, and interaction. The authors propose a new lifecycle-oriented design pipeline to create accessibility-aligned agents.

Task-Centric Taxonomy of Blind Assistance and Distribution of Assistive Task Instances. Distribution of 778 assistive task instances across four domains and their subcategories, highlighting dominant needs in Reading and Text Access (35%) and Mobility and Safety (34%).
Task-Centric Taxonomy of Blind Assistance and Distribution of Assistive Task Instances. Distribution of 778 assistive task instances across four domains and their subcategories, highlighting dominant needs in Reading and Text Access (35%) and Mobility and Safety (34%).
cs.AIarxiv:2605.13542v1Lead article

RealICU: Do LLM Agents Understand Long-Context ICU Data? A Benchmark Beyond Behavior Imitation

Chengzhi Shen, Weixiang Shen, Tobias Susetzky, Chen, Chen

his paper introduces RealICU, a novel benchmark for evaluating LLMs on long-context ICU data. Unlike previous benchmarks that rely on potentially suboptimal clinician actions, RealICU uses hindsight annotations from senior physicians reviewing complete patient trajectories. This allows for a more accurate assessment of LLM reasoning capabilities across tasks like patient status assessment, problem identification, and action recommendation.

ICU decisions are made under massive data volume and time pressure. An ICU AI co-pilot integrates data streams into a decision-support panel that assesses Patient Status , identifies Acute Problems , proposes Recommended Actions , and warns against unsafe Red Flag actions.
ICU decisions are made under massive data volume and time pressure. An ICU AI co-pilot integrates data streams into a decision-support panel that assesses Patient Status , identifies Acute Problems , proposes Recommended Actions , and warns against unsafe Red Flag actions.
cs.AIarxiv:2605.13725v1Lead article

ScioMind: Cognitively Grounded Multi-Agent Social Simulation with Anchoring-Based Belief Dynamics and Dynamic Profiles

Yitian Yang, Yiqun Duan, Linghan Huang, Yiqi Zhu, Francesco Bailo

cioMind is a novel multi-agent social simulation framework that integrates structured opinion dynamics with LLM-based agent reasoning. Its core method combines a personality-conditioned belief update rule with a hierarchical memory architecture and dynamic agent profiles, allowing for cognitively grounded and evolving agent behavior. This approach addresses limitations of existing methods by offering a more realistic and nuanced simulation of social opinion dynamics.

Architecture overview.
Architecture overview.
cs.AIarxiv:2605.13737v1Lead article

Senses Wide Shut: A Representation-Action Gap in Omnimodal LLMs

Trung Nguyen Quang, Yiming Gao, Fanyi Pu, Kaichen Zhang, Shuo Sun

his paper introduces IMAVB, a benchmark to test omnimodal LLMs' ability to detect contradictions between text and their own sensory input. The core finding is a "Representation-Action Gap," where models internally represent mismatches but fail to reject false textual claims in their outputs. This highlights a critical limitation in their grounding capabilities.

Overview of the Representation–Action Gap on IMAVB.
Overview of the Representation–Action Gap on IMAVB.
cs.AIarxiv:2605.13772v1Lead article

Where Does Reasoning Break? Step-Level Hallucination Detection via Hidden-State Transport Geometry

Tyler Alvarez, Ali Baheri

his paper introduces a novel method for detecting hallucinations in large language models at the step-by-step reasoning level, rather than just the overall output. It proposes that correct reasoning follows a stable path in the model's hidden states, while errors cause deviations. The core contribution is a geometric approach that identifies these deviations by analyzing the "transport cost" between hidden states, allowing for precise localization of the first hallucination.

The GeoReason teacher – student architecture. The teacher (top) uses step-level labels and reasoning-trace hidden states to construct a contrastive PCA (cPCA) projection, extracts a geometric feature set in this lens, and maps the features through an MLP to step-level hallucination probabilities. The student (bottom) is a BiLSTM that contextualizes raw hidden states and feeds a step classifier head, trained from three signals: supervised step labels, probability distillation from the teacher , and feature distillation through a training-only auxiliary head. At inference, the student requires only hidden states.
The GeoReason teacher – student architecture. The teacher (top) uses step-level labels and reasoning-trace hidden states to construct a contrastive PCA (cPCA) projection, extracts a geometric feature set in this lens, and maps the features through an MLP to step-level hallucinati…
cs.LGarxiv:2605.13740v1Lead article

Learning POMDP World Models from Observations with Language-Model Priors

Valentin Six, Frederik Panse, Mathis Fajeau, Lancelot Da Costa, Mridul Sharma

his paper introduces Pinductor, a method that uses Large Language Models (LLMs) to learn world models for partially observable environments (POMDPs). Pinductor leverages LLM priors to propose and refine POMDP models from limited observation-action data, significantly improving sample efficiency. Its key contribution is achieving comparable performance to methods with privileged state access, while using less information and outperforming existing sample-inefficient approaches.

Pinductor architecture overview. Given a small set of offline observation-action trajectories and an environment description, an LLM proposes a POMDP world model in code (dashed arrows). The resulting model is used for filtering and planning during environment interaction, and is periodically refined by the LLM to optimize a belief-based likelihood objective (solid arrows).
Pinductor architecture overview. Given a small set of offline observation-action trajectories and an environment description, an LLM proposes a POMDP world model in code (dashed arrows). The resulting model is used for filtering and planning during environment interaction, and is…
cs.LGarxiv:2605.13711v1Lead article

MILM: Large Language Models for Multimodal Irregular Time Series with Informative Sampling

Hsing-Huan Chung, Shijun Li, Yoav Wald, Xing Han, Suchi Saria

ILM represents multimodal irregular time series as XML-formatted triplets and fine-tunes a large language model (LLM) in two stages. The first stage trains the LLM to predict from sampling patterns alone, while the second stage jointly models patterns and observed values. This approach effectively leverages the predictive power of irregular sampling and multimodal data for tasks like healthcare prediction.

cs.LGarxiv:2605.13681v1Lead article

Sampling from Flow Language Models via Marginal-Conditioned Bridges

Iskander Azangulov, Leo Zhang

his paper proposes a novel sampling method for Flow Language Models (FLMs) by leveraging their unique denoiser structure. Instead of collapsing marginal distributions, the method samples a one-hot token from the posterior marginals at each step and then uses an analytic Ornstein-Uhlenbeck bridge conditioned on this sampled token. This "marginal-conditioned bridge" sampling is training-free, efficient, and provides a principled way to generate valid one-hot token sequences.

Generative perplexity (left top) and entropy (left bottom) against the number of sampling steps for the standard ODE sampler and our MCB sampler with various configurations of temperature scaling \( \tau \) and nucleus sampling p p on LM1B. The right plot shows the Generative PPL/Entropy Tradeoff. We note that the grey dotted line on the bottom-left plot shows the entropy of LM1B.
Generative perplexity (left top) and entropy (left bottom) against the number of sampling steps for the standard ODE sampler and our MCB sampler with various configurations of temperature scaling \( \tau \) and nucleus sampling p p on LM1B. The right plot shows the Generative PPL…
cs.CLarxiv:2605.13793v1Lead article

An LLM-Based System for Argument Reconstruction

Paulo Pirozelli, Victor Hugo Nascimento Rocha, Fabio G. Cozman, Douglas Aldred

his paper introduces an LLM-based system that reconstructs arguments from text into abstract argument graphs. The system uses a multi-stage pipeline to identify claims, premises, and their logical relationships (support, attack, undercut), representing them as directed acyclic graphs. Its contribution lies in providing an end-to-end method for automated argument analysis and structure recovery, evaluated through both manual and quantitative experiments.

Overview of the system pipeline. The model converts natural language text into an argumentative directed acyclic graph. Blue boxes denote mandatory steps, while beige boxes denote optional steps.
Overview of the system pipeline. The model converts natural language text into an argumentative directed acyclic graph. Blue boxes denote mandatory steps, while beige boxes denote optional steps.
cs.CLarxiv:2605.13647v1Lead article

FlowCompile: An Optimizing Compiler for Structured LLM Workflows

Junyan Li, Zhang-Wei Hong, Maohao Shen, Yang Zhang, Chuang Gan

lowCompile optimizes structured LLM workflows by treating them as a compilation problem, not just an inference-time routing problem. It globally explores the design space of sub-agent configurations before deployment to create reusable workflow-level configurations that balance accuracy and latency across various trade-offs. This compilation approach allows for pre-computed, optimized workflow structures, improving efficiency and performance.

Overview of FlowCompile. (a) FlowCompile treats structured LLM workflow optimization as compilation: given a problem set, an input workflow, and a design space, it outputs a compiled set of optimized configurations spanning low-latency to high-accuracy deployment regimes. (b) FlowCompile compiles the workflow through three stages: sub-agent profiling and cost modeling, structure-aware compositional estimation of workflow-level accuracy and latency, and design-space exploration to identify configurations spanning the accuracy–latency trade-off frontier.
Overview of FlowCompile. (a) FlowCompile treats structured LLM workflow optimization as compilation: given a problem set, an input workflow, and a design space, it outputs a compiled set of optimized configurations spanning low-latency to high-accuracy deployment regimes. (b) Flo…
cs.CLarxiv:2605.13839v1Lead article

Good Agentic Friends Do Not Just Give Verbal Advice: They Can Update Your Weights

Wenrui Bao, Huan Wang, Jian Wang, Zhangyang Wang, Kai Wang

his paper introduces TFlow, a novel communication method for multi-agent LLM systems. Instead of exchanging text, TFlow allows agents to directly update the receiver's internal weights with learned, low-rank perturbations. This significantly reduces computational costs and memory usage by enabling instance-level adaptation without permanent model changes.

(i) Comparison between Text-based MAS and the proposed Weight-Collaboration MAS. In Text MAS, auxiliary agents transmit natural language messages to the Executor, incurring costly prefilling overhead and inflated KV cache. In contrast, our proposed paradigm compresses inter-agent communication into lightweight LoRA weight perturbations Δ ​ W \( \Delta \) W , which are directly merged into the parameters, thereby eliminating the extra prefilling and significantly reducing the KV cache footprint. (ii) Performance overview on GSM8K . TFlow achieves accuracy competitive with TextMAS while reducing token consumption by 76.7 % \( \mathbf{76.7\%} \) , substantially surpassing the single-agent baseline in both accuracy and efficiency.
(i) Comparison between Text-based MAS and the proposed Weight-Collaboration MAS. In Text MAS, auxiliary agents transmit natural language messages to the Executor, incurring costly prefilling overhead and inflated KV cache. In contrast, our proposed paradigm compresses inter-agent…
cs.CLarxiv:2605.13595v1Lead article

Inducing Artificial Uncertainty in Language Models

Sophia Hager, Simon Zeng, Nicholas Andrews

his paper introduces a method to induce artificial uncertainty in language models, particularly when challenging data for training uncertainty quantification is scarce. The core idea is to train models to express uncertainty even on simple examples, thereby improving their ability to signal uncertainty on genuinely difficult or unseen data. This approach aims to overcome the limitations of traditional supervised uncertainty quantification methods as language models saturate training datasets.

cs.AIarxiv:2508.15294Lead article

A Multi-Memory Segment System for Generating High-Quality Long-Term Memory Content in Agents

Gaoke Zhang, Bo Wang, Yunlong Ma, Dongming Zhao, Zifei Yu

his paper introduces a Multi-Memory Segment System (MMS) to generate higher-quality long-term memory content for agents. Inspired by cognitive psychology, MMS processes short-term memory into multiple distinct long-term memory segments, creating corresponding retrieval and contextual memory units. This approach aims to overcome the limitations of simple summarization, thereby improving both memory recall and response quality.

cs.AIarxiv:2605.05703Lead article

Active Learning for Communication Structure Optimization in LLM-Based Multi-Agent Systems

Huchen Yang, Xinghao Dong, Dan Negrut, Jin-Long Wu

his paper proposes an active learning method to optimize communication structures in LLM-based multi-agent systems. Instead of random task sampling, it uses an ensemble-based information-theoretic framework to identify the most informative tasks for improving communication. This approach efficiently estimates task value by measuring how much a task alters the distribution of communication parameters, leading to more stable and effective optimization under limited training budgets.

Accuracy-cost scaling on MMLU. Randomly increasing training tasks yields limited gains, while active learning achieves higher accuracy under a matched token cost.
Accuracy-cost scaling on MMLU. Randomly increasing training tasks yields limited gains, while active learning achieves higher accuracy under a matched token cost.
cs.AIarxiv:2512.10371Lead article

AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Management

Shizuo Tian, Hao Wen, Yuxuan Chen, Jiacheng Liu, Shanhui Zhao

gentProg tackles the challenge of long-horizon GUI agent context management by representing interaction history as a program. This program structure guides information retention and discarding, mitigating context overhead. The paper also introduces a global belief state for handling partial observability and environmental changes, improving agent robustness.

Figure 1 . Performance Comparison on AndroidWorld vs. AW-Extend. a11y refers to the Accessibility Tree observation space; SoM denotes Set-of-Mark; Mobile-Ag-v3 denotes Mobile-Agent-v3.
Figure 1 . Performance Comparison on AndroidWorld vs. AW-Extend. a11y refers to the Accessibility Tree observation space; SoM denotes Set-of-Mark; Mobile-Ag-v3 denotes Mobile-Agent-v3.
cs.AIarxiv:2604.07277Lead article

Android Coach: Improve Online Agentic Training Efficiency with Single State Multiple Actions

Guo Gan, Yuxuan Ding, Cong Chen, Yuwei Ren, Yin Huang

his paper introduces Android Coach, a framework to improve the efficiency of training Android agents with online reinforcement learning. It addresses the costly nature of emulator interactions by shifting from a "single state, single action" to a "single state, multiple actions" paradigm. This allows the agent to explore more actions from a single emulator state, significantly reducing training time and cost.

(Top): Online rollout time distribution based on the measured time on 8 parallel environments in training for 80 steps. (Bottom I): The conventional online rollout and critic training loop. The primary bottleneck is the high-latency environmental interaction, while the GUI agent action inference is relatively fast. (Bottom II): Standard agent update with Single State Single Action paradigm. Agent updates rely merely on the state-action pairs collected from the online rollout. (Bottom III): Android Coach update with Single State Multiple Actions paradigm. We fully leverage each expensive online state by generating multiple actions. The agent is then updated using this data. This approach improves training efficiency by gathering more training samples within the same online interaction cost.
(Top): Online rollout time distribution based on the measured time on 8 parallel environments in training for 80 steps. (Bottom I): The conventional online rollout and critic training loop. The primary bottleneck is the high-latency environmental interaction, while the GUI agent …
cs.AIarxiv:2509.03736Lead article

Are LLM Agents Behaviorally Coherent? Latent Profiles for Social Simulation

James Mooney, Josef Woldense, Zheng Robert Jia, Shirley Anugrah Hayati, My Ha Nguyen

his paper introduces a novel method to assess the behavioral coherence of LLM agents by first identifying their underlying latent profiles and then testing their consistency in conversational settings. The core contribution is demonstrating that LLM agents often exhibit significant behavioral inconsistencies, challenging their direct substitution for human participants in social simulations.

A high-level overview of our experimental framework. Upper Left: We prepare language model agents with variation and direct Control via prompting. Bottom Left: We ask agents individual questions with categorical responses to construct Latent Profiles (e.g., topic preferences, openness to new experiences). Middle: We pair agents and have them converse on various topics ( External Interactions ), measuring outcomes such as agreement over the course of a conversation. Right: We use the Controlled prompting inputs, Latent States (agree or disagree) from individual questions, and External Interactions from conversations to test against existing human behavioral models, expecting agents to behave consistently across all evaluation variables.
A high-level overview of our experimental framework. Upper Left: We prepare language model agents with variation and direct Control via prompting. Bottom Left: We ask agents individual questions with categorical responses to construct Latent Profiles (e.g., topic preferences, ope…
cs.AIarxiv:2605.07103Lead article

ARMOR: An Agentic Framework for Reaction Feasibility Prediction via Adaptive Utility-aware Multi-tool Reasoning

Ye Liu, Botao Yu, Xinyi Ling, Daniel Adu-Ampratwum, Xia Ning

RMOR is an agentic framework that addresses the challenge of reaction feasibility prediction by adaptively leveraging multiple AI tools. It models tool-specific utilities and prioritizes them hierarchically, resolving conflicts to produce more accurate predictions than single-tool or simple aggregation methods. This adaptive, utility-aware multi-tool reasoning represents ARMOR's core contribution to improving computational chemistry predictions.

ARMOR \( \mathop \){\( \textsc{ARMOR} \)}\( \limits \) framework. The robot icon indicates that the corresponding module is agentic.
ARMOR \( \mathop \){\( \textsc{ARMOR} \)}\( \limits \) framework. The robot icon indicates that the corresponding module is agentic.
cs.AIarxiv:2601.18681Lead article

ART for Diffusion Sampling: A Reinforcement Learning Approach to Timestep Schedule

Yilie Huang, Wenpin Tang, Xunyu Zhou

his paper introduces Adaptive Reparameterized Time (ART), a method to optimize the timestep schedule for diffusion model sampling. ART learns a reparameterized time variable to dynamically adjust computation across the sampling trajectory, minimizing discretization error. The contribution is a reinforcement learning framework (ART-RL) that provides a principled way to find the optimal ART schedule, bridging continuous-time RL with deterministic optimization.

Quantitative overview: ART-RL Pareto-dominates Uniform, DPM-logSNR, and EDM on CIFAR–10 across NFE budgets, and the same distilled grid retains the advantage on AFHQv2, FFHQ, and ImageNet without retraining. DPM-logSNR is the DPM-Solver uniform log-SNR grid.
Quantitative overview: ART-RL Pareto-dominates Uniform, DPM-logSNR, and EDM on CIFAR–10 across NFE budgets, and the same distilled grid retains the advantage on AFHQv2, FFHQ, and ImageNet without retraining. DPM-logSNR is the DPM-Solver uniform log-SNR grid.
cs.AIarxiv:2605.16217v1Lead article

Argus: Evidence Assembly for Scalable Deep Research Agents

Zhen Zhang, Liangcai Su, Zhuo Chen, Xiang Lin, Haotian Xu

rgus addresses the inefficiency of current deep research agents by treating evidence gathering as a jigsaw puzzle. Instead of parallelizing redundant searches, its Searcher collects evidence for sub-queries, while a Navigator manages a shared graph, identifying missing pieces and synthesizing the final, source-traced answer. This cooperative approach ensures complementary evidence is assembled, improving scalability and reducing redundant computation.

Argus operating modes. (a) Standalone Searcher, single path. (b) Navigator identifies unfilled pieces and dispatches targeted queries. (c) Parallel Searchers each target a distinct piece.
Argus operating modes. (a) Standalone Searcher, single path. (b) Navigator identifies unfilled pieces and dispatches targeted queries. (c) Parallel Searchers each target a distinct piece.
cs.AIarxiv:2605.16207v1Lead article

Confirming Correct, Missing the Rest: LLM Tutoring Agents Struggle Where Feedback Matters Most

Tahreem Yasir, Wenbo Li, Sam Gilson, Sutapa Dey Tithi, Xiaoyi Tian

his paper evaluates LLM tutoring agents' ability to distinguish between correct, suboptimal, and incorrect student reasoning in propositional logic. The core method involves a benchmark with knowledge-graph ground truth, revealing that LLMs excel at identifying optimal steps but struggle significantly with valid-but-suboptimal and incorrect reasoning. The main contribution is demonstrating that LLMs fail precisely where adaptive tutoring is most crucial, suggesting architectural limitations rather than data issues, and that accurate diagnosis doesn't guarantee pedagogically useful feedback.

Optimal and valid-alternative solutions (blue nodes represent abbreviated inference rule names, explained in Table 4 )
Optimal and valid-alternative solutions (blue nodes represent abbreviated inference rule names, explained in Table 4 )
cs.AIarxiv:2605.16052v1Lead article

Reasoners or Translators? Contamination-aware Evaluation and Neuro-Symbolic Robustness in Tax Law

Parisa Kordjamshidi, Samer Aslan, Madhavan Seshadri, Leslie Barrett, Enrico Santus

his paper investigates whether LLMs truly reason in tax law or simply regurgitate contaminated training data. They introduce a contamination detection protocol and a novel test suite to evaluate LLMs against neuro-symbolic systems. The findings suggest that legal reasoning is compositional, and neuro-symbolic approaches offer greater robustness and generalization to unseen legal scenarios.

cs.AIarxiv:2605.16085v1Lead article

Towards Foundation Models for Relational Databases with Language Models and Graph Neural Networks

Jingcheng Wu, Ratan Bahadur Thapa, Mojtaba Nayyeri, Lucas Etteldorf, Max Finkenbeiner

his paper proposes a hybrid deep learning architecture that combines a fine-tuned BART language model with a GraphSAGE-based Graph Neural Network (GNN) to process relational databases. The core method injects relational context from entity graphs into BART's row embeddings, overcoming limitations of previous task-specific approaches. This hybrid model significantly improves performance on relational data tasks, narrowing the gap to state-of-the-art methods.

Overview of the hybrid architecture. A fine-tuned BART encoder generates row-level embeddings from linearized database rows, which serve as initial node features in the relational entity graph (REG). Node-type-specific linear layers project the 1024-dimensional BART embeddings to the 256-dimensional hidden space. Two shared SAGEConv layers then perform message passing across all edge types, and a linear decoder maps the enriched embeddings back to 1024 dimensions for reconstruction loss computation.
Overview of the hybrid architecture. A fine-tuned BART encoder generates row-level embeddings from linearized database rows, which serve as initial node features in the relational entity graph (REG). Node-type-specific linear layers project the 1024-dimensional BART embeddings to…
cs.AIarxiv:2605.16079v1Lead article

VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocation

Yiming Zhao, Yu Zeng, Wenxuan Huang, Zhen Fang, Qing Miao

ideoSeeker addresses the limitations of text-based prompts in video understanding by introducing a novel paradigm that uses **visual prompts** for instance-level localization. Its core method involves an **agentic reasoning framework** that allows the model to proactively perceive and retrieve relevant video segments based on visual cues, rather than relying solely on language. This approach significantly improves user experience and enables more precise spatiotemporal understanding by tightly integrating visual perception with reasoning.

Overview of VideoSeeker. (A): Instance-level video understanding tasks require models to accurately locate and reason about specific instances in videos guided by visual prompts, given a video, a visual prompt frame, and a query. Compared to text-only prompts that require lengthy referential descriptions, visual prompts provide a more intuitive interaction method. (B): Pipeline overview. We design a four-stage pipeline to construct instance-level video data, followed by a two-stage training strategy to integrate multimodal instance-level video understanding capabilities.
Overview of VideoSeeker. (A): Instance-level video understanding tasks require models to accurately locate and reason about specific instances in videos guided by visual prompts, given a video, a visual prompt frame, and a query. Compared to text-only prompts that require lengthy…
cs.AIarxiv:2605.16035v1Lead article

Who Owns This Agent? Tracing AI Agents Back to Their Owners

Ruben Chocron, Doron Jonathan Ben Chayim, Eyal Lenga, Gilad Gressel, Alina Oprea

his paper addresses the critical problem of **agent attribution**, which is the inability to trace harmful AI agents back to their deploying accounts. The core method involves formalizing this gap and proposing techniques to link observed agent behavior to the responsible account at the hosting vendor. The main contribution is defining this problem for the first time and laying the groundwork for solutions to establish accountability for AI agent actions.

Figure 1. The novel problem of agent attribution introduced in this paper (top), and our canary-based protocol for the vendor-hosted LLM setting (bottom).
Figure 1. The novel problem of agent attribution introduced in this paper (top), and our canary-based protocol for the vendor-hosted LLM setting (bottom).
cs.CLarxiv:2605.16117v1Lead article

SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generation

Xin Zhang, Yang Cao, Baoxing Wu, Kai Song, Siying Li

GR enhances LLM reasoning by generating query-specific subgraphs from external knowledge bases. This framework grounds intermediate reasoning steps in structured knowledge, helping LLMs focus on relevant entities and evidence for more accurate and consistent complex inferences.

Pipeline of SGR framework.
Pipeline of SGR framework.
cs.AIarxiv:2605.18529v1Lead article

AMR-SD: Asymmetric Meta-Reflective Self-Distillation for Token-Level Credit Assignment

Zhenlin Wei, Pu Jian, Yingzhuo Deng, Xiaohan Wang, Jiajun Chai

his paper introduces Asymmetric Meta-Reflective Self-Distillation (AMR-SD) to address the credit-assignment problem in aligning LLMs for complex reasoning. Instead of directly using reference solutions, AMR-SD compresses diagnostic signals into "Socratic hints and critiques" via a reflection bottleneck. This approach aims to prevent over-conditioning and answer leakage, improving the effectiveness of reinforcement learning for LLMs.

In standard on-policy self-distillation, the student generates a response, which a teacher evaluates via forced-decoding with privileged information to produce token-level probabilities for student alignment.
In standard on-policy self-distillation, the student generates a response, which a teacher evaluates via forced-decoding with privileged information to produce token-level probabilities for student alignment.
cs.AIarxiv:2605.18621v1Lead article

CrossView Suite: Harnessing Cross-view Spatial Intelligence of MLLMs with Dataset, Model and Benchmark

Wei Wang, Yuqian Yuan, Tianwei Lin, Wenqiao Zhang, Siliang Tang

his paper introduces CrossView Suite, a comprehensive framework to enhance multimodal large language models' (MLLMs) spatial reasoning across multiple viewpoints. It addresses data scarcity, evaluation limitations, and alignment issues by providing a large-scale dataset (CrossViewSet), a scene-disjoint benchmark (CrossViewBench), and a model (CrossViewer) with explicit object-level consistency mechanisms. The core contribution lies in enabling MLLMs to consistently perceive and reason about objects and their spatial relationships from diverse perspectives.

Figure 1 . Overview of CrossViewer. CrossViewer presents a unified framework for cross-view spatial intelligence in MLLMs, integrating data, benchmark, and model. CrossViewSet is a large-scale mask-grounded instruction dataset (1.6M samples, 17 tasks), and CrossViewBench is a scene-disjoint benchmark for systematic evaluation. The model follows a progressive Perception–Alignment–Reasoning paradigm, enabling explicit cross-view object alignment and region-guided reasoning.
Figure 1 . Overview of CrossViewer. CrossViewer presents a unified framework for cross-view spatial intelligence in MLLMs, integrating data, benchmark, and model. CrossViewSet is a large-scale mask-grounded instruction dataset (1.6M samples, 17 tasks), and CrossViewBench is a sce…
cs.AIarxiv:2605.18753v1Lead article

DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention

Yuxiang Huang, Nuno M. T. Gonçalves, Federico Alvetreti, Lei Li, Xu Han

ashAttention introduces a novel hierarchical attention mechanism that addresses limitations of prior methods. Its core innovation is using an adaptive sparse $α$-entmax transformation to dynamically select relevant key-value blocks based on query relevance, ensuring full differentiability throughout the hierarchy. This adaptive approach allows for a variable number of selected tokens, leading to improved long-context modeling and non-dispersive attention.

cs.AIarxiv:2605.18702v1Lead article

Distilling Tabular Foundation Models for Structured Health Data

Aditya Tanna, Nassim Bouarour, Mohamed Bouadi, Vinay Kumar Sankarapu, Pratinav Seth

his paper addresses the high inference cost of tabular foundation models (TFMs) in healthcare by using knowledge distillation. The core method involves a novel "stratified out-of-fold teacher labeling" technique to prevent context leakage from the TFM teacher. The contribution is demonstrating that lightweight student models can achieve over 90% of the TFM's AUC, run significantly faster, and maintain crucial calibration and fairness properties, making TFM-level predictions practical for healthcare applications.

cs.AIarxiv:2605.18678v1Lead article

Lance: Unified Multimodal Modeling by Multi-Task Synergy

Fengyi Fu, Mengqi Huang, Shaojin Wu, Yunsheng Jiang, Yufei Huo

ance is a lightweight unified multimodal model that achieves synergistic performance across image and video understanding, generation, and editing through collaborative multi-task training. Its core method involves a dual-stream mixture-of-experts architecture with unified context modeling and decoupled capability pathways, enhanced by modality-aware positional encoding. This approach allows for efficient joint learning and strong cross-task alignment without relying on massive model scaling or text-image dominance.

cs.AIarxiv:2605.18597v1Lead article

Latent Action Reparameterization for Efficient Agent Inference

Wenhao Huang, Qingwen Zeng, Qiyue Chen, Zijie Guo, Yu Sun

his paper introduces Latent Action Reparameterization (LAR) to address the high inference cost of LLM agents. LAR learns a compact latent action space where each latent action represents a multi-step semantic behavior, allowing agents to make decisions over a shorter horizon. This learned abstraction, unlike hand-crafted methods, is integrated directly into the LLM for efficient planning and execution.

Overview of Latent Action Reparameterization (LAR). LAR reformulates agent decision making by collapsing transition-equivalent action segments into executable latent actions, thereby reducing the effective decision horizon. Low-entropy structural components are abstracted into latent actions, while high-entropy, parameter-binding content remains explicit to preserve executability.
Overview of Latent Action Reparameterization (LAR). LAR reformulates agent decision making by collapsing transition-equivalent action segments into executable latent actions, thereby reducing the effective decision horizon. Low-entropy structural components are abstracted into la…
cs.AIarxiv:2605.18565v1Lead article

LongMINT: Evaluating Memory under Multi-Target Interference in Long-Horizon Agent Systems

Hyunji Lee, Justin Chih-Yao Chen, Joykirat Singh, Zaid Khan, Elias Stengel-Eskin

his paper introduces LongMINT, a new benchmark designed to evaluate memory-augmented agents in realistic, long-horizon scenarios with interfering information. The core method involves creating complex, interconnected contexts with frequently updated data across diverse domains and question types. LongMINT's contribution is to provide a more challenging and realistic evaluation of agent memory, moving beyond static recall to assess performance under dynamic interference.

Left: LongMINT spans four realistic domains: state tracking, dialogue, GitHub commits, and Wikipedia revisions, with five question categories probing different aspects of memory behavior. Middle: The contexts are inherently dynamic and continuously evolving, naturally creating frequent destructive interference. Right: Existing memory systems show distinct failure modes: (1) full-context methods are computationally expensive and exceed context limits, (2) RAG systems often retrieve incorrect evidence due to conflicting information, and (3) memory-augmented agents overemphasize recent information and underuse historical context, hurting lookback-style queries.
Left: LongMINT spans four realistic domains: state tracking, dialogue, GitHub commits, and Wikipedia revisions, with five question categories probing different aspects of memory behavior. Middle: The contexts are inherently dynamic and continuously evolving, naturally creating fr…
cs.AIarxiv:2605.18583v1Lead article

Overeager Coding Agents: Measuring Out-of-Scope Actions on Benign Tasks

Yubin Qu, Ying Zhang, Yanjun Zhang, Gelei Deng, Yuekang Li

his paper introduces "overeager actions," where autonomous coding agents perform unauthorized tasks beyond benign user requests. To measure this, they developed the OverEager-Gen benchmark, which found that explicitly stating authorized scope in prompts can paradoxically increase overeager behavior by encouraging pattern matching. Their contribution is a novel benchmark and validation method to accurately assess and mitigate these out-of-scope actions.

One tidy-up prompt, four overeager outcomes. Top: a colloquial cleanup request over a five-file directory mixing project files ( README.md , notes.txt ), trash ( scratch.tmp , .DS_Store ), and a critical-tier credentials backup ( .env.old ); the authorized behavior deletes only the two trash files. Bottom: Claude Code, Codex CLI, Gemini CLI, and OpenHands each reserve a different subset, and three of four destroy .env.old —overeager behavior reproduces across agents and base models.
One tidy-up prompt, four overeager outcomes. Top: a colloquial cleanup request over a five-file directory mixing project files ( README.md , notes.txt ), trash ( scratch.tmp , .DS_Store ), and a critical-tier credentials backup ( .env.old ); the authorized behavior deletes only t…
cs.AIarxiv:2605.18654v1Lead article

Pocket Foundation Models: Distilling TFMs into CPU-Ready Gradient-Boosted Trees

Aditya Tanna, Nassim Bouarour, Mohamed Bouadi, Vinay kumar Sankarapu, Pratinav Seth

his paper addresses the latency issue of large tabular foundation models (TFMs) for real-time fraud scoring. Their core method distills a TFM teacher into a CPU-ready gradient-boosted tree (XGBoost or CatBoost) student model. The key contribution is a novel stratified out-of-fold labeling technique that overcomes label leakage from in-context learning teachers, enabling effective distillation and achieving near-teacher performance at significantly faster CPU speeds.

cs.AIarxiv:2605.18732v1Lead article

Predictable Confabulations: Factual Recall by LLMs Scales with Model Size and Topic Frequency

Matthew L. Smith, Jonathan P. Shock, Samuel T. Segun, Iyiola E. Olatunji, Tegawendé F. Bissyandé

his paper introduces a novel scaling law for factual recall in Large Language Models (LLMs), demonstrating that recall quality is predictable and improves with both model size and the frequency of a topic in the training data. The core method involves evaluating numerous LLMs on scholarly references and finding that recall follows a sigmoid relationship with a combined measure of model parameters and topic representation. The key contribution is identifying these two factors as primary drivers of factual recall, explaining a significant portion of performance variance and offering a theoretical framework based on signal-to-noise ratio.

SourceVerify status versus human authenticity verdict. Confusion matrix for 301 independent ratings (288 unique references; 13 double-rated) by four human reviewers across four SourceVerify status categories. Both verified (75/75) and verified-with-error (61/61) contain exclusively real papers (100%); unverified is 97% not real with 3 real papers missed; needs-human is the genuine grey zone (52/66 not real). Treating ambiguous human verdicts as not real ( n = 301 n=301 ), binary precision is 100% and specificity is 100%; all 17 disagreements are SourceVerify false negatives.
SourceVerify status versus human authenticity verdict. Confusion matrix for 301 independent ratings (288 unique references; 13 double-rated) by four human reviewers across four SourceVerify status categories. Both verified (75/75) and verified-with-error (61/61) contain exclusive…
cs.AIarxiv:2605.18684v1Lead article

Reversa: A Reverse Documentation Engineering Framework for Converting Legacy Software into Operational Specifications for AI Agents

Sanderson Oliveira de Macedo, Ronaldo Martins da Costa

eversa is a framework that uses a multi-agent pipeline to convert legacy software into operational specifications for AI agents. Its core method involves specialized agents analyzing code, extracting implicit rules, and synthesizing specifications, with a key contribution being its emphasis on traceability, confidence marking, and preserving gaps for human validation. This allows AI agents to understand and modify legacy systems with greater reliability and reduced risk.

Conceptual pipeline of Reversa. The legacy system is analyzed by specialized agents; the resulting specifications are reviewed for confidence and gaps; and the artifacts then guide future migration, maintenance, and evolution.
Conceptual pipeline of Reversa. The legacy system is analyzed by specialized agents; the resulting specifications are reviewed for confidence and gaps; and the artifacts then guide future migration, maintenance, and evolution.
cs.AIarxiv:2605.18630v1Lead article

SCICONVBENCH: Benchmarking LLMs on Multi-Turn Clarification for Task Formulation in Computational Science

Nithin Somasekharan, Youssef Hassan, Shiyao Lin, Gihan Panapitiya, Patrick Emami

his paper introduces SCICONVBENCH, a novel benchmark designed to evaluate Large Language Models (LLMs) on their ability to refine ill-posed scientific requests through multi-turn dialogue. The benchmark focuses on two key capabilities: eliciting missing information and resolving contradictory requests, across four computational science domains. SCICONVBENCH's contribution lies in addressing the crucial, yet often overlooked, initial phase of scientific task formulation where user requests require clarification before computation can begin.

Flow over a cylinder showing how skipped clarification leads to a wrong flow regime.
Flow over a cylinder showing how skipped clarification leads to a wrong flow regime.
cs.AIarxiv:2605.18740v1Lead article

Vision-OPD: Learning to See Fine Details for Multimodal LLMs via On-Policy Self-Distillation

Qianhao Yuan, Jie Lou, Xing Yu, Hongyu Lin, Le Sun

his paper introduces Vision-OPD, a self-distillation method to improve MLLMs' fine-grained visual understanding. It addresses the "regional-to-global perception gap" by training a full-image model (student) to mimic the strong performance of a crop-conditioned model (teacher) on the same MLLM. This transfers the model's ability to focus on crucial details from privileged regional views to its general full-image perception.

Average scores across fine-grained visual understanding benchmarks, including V* Bench, ZoomBench, HR Bench 4K, HR Bench 8k, MME-RealWorld-Lite and MME-RealWorld-CN. Vision-OPD-4B/9B demonstrate superior performance compared with much larger open-source models (e.g., Qwen3.5-397B) and closed-source models (e.g., GPT-5.4, Gemini-3.1-Pro).
Average scores across fine-grained visual understanding benchmarks, including V* Bench, ZoomBench, HR Bench 4K, HR Bench 8k, MME-RealWorld-Lite and MME-RealWorld-CN. Vision-OPD-4B/9B demonstrate superior performance compared with much larger open-source models (e.g., Qwen3.5-397B…
cs.AIarxiv:2605.20173v1Lead article

A Methodology for Selecting and Composing Runtime Architecture Patterns for Production LLM Agents

Vasundra Srinivasan

his paper introduces the "stochastic-deterministic boundary" (SDB) as a core architectural concept for production LLM agents, defining a four-part contract for integrating LLM outputs into system actions. It then proposes a methodology for selecting and composing six runtime patterns (categorized by Coordination, State, and Control) to manage this SDB across different agent types, drawing parallels to distributed systems while accounting for the stochastic nature of LLMs.

cs.AIarxiv:2605.20084v1Lead article

BalanceRAG: Joint Risk Calibration for Cascaded Retrieval-Augmented Generation

Zijun Jia, Yuanchang Ye, Sen Jia, Yiyao Qian, Haoning Wang

alanceRAG addresses the challenge of calibrating cascaded Retrieval-Augmented Generation (RAG) systems. Its core method involves jointly calibrating uncertainty thresholds for both LLM-only and RAG branches to achieve a target system-level risk. The contribution is a novel approach using sequential graphical testing to identify "safe" operating points on a 2D lattice of thresholds, enabling risk-adaptive calibration that retains more examples compared to stage-by-stage methods.

Distribution of the per-example score differences between RAG and LLM-only. S LLM ​ - ​ RAG S_{\( \mathrm \){LLM\( \text{-} \)RAG}} and S LLM ​ - ​ only S_{\( \mathrm \){LLM\( \text{-} \)only}} are the similarity scores between each path’s prediction and the ground-truth answer. The x-axis reports S LLM ​ - ​ RAG − S LLM ​ - ​ only S_{\( \mathrm \){LLM\( \text{-} \)RAG}}-S_{\( \mathrm \){LLM\( \text{-} \)only}} , with positive values favoring RAG and negative values favoring LLM-only, while the y-axis reports the number of examples. Colors distinguish whether both branches are correct, both are wrong, or only one branch is correct.
Distribution of the per-example score differences between RAG and LLM-only. S LLM ​ - ​ RAG S_{\( \mathrm \){LLM\( \text{-} \)RAG}} and S LLM ​ - ​ only S_{\( \mathrm \){LLM\( \text{-} \)only}} are the similarity scores between each path’s prediction and the ground-truth answer. …
cs.AIarxiv:2605.20075v1Lead article

CopT: Contrastive On-Policy Thinking with Continuous Spaces for General and Agentic Reasoning

Dachuan Shi, Hanlin Zhu, Xiangchi Yuan, Wanjia Zhao, Kejing Xia

opT reverses the traditional Chain-of-Thought by first generating a draft answer and then using "on-policy thinking" to reflect and correct it. This approach leverages continuous embeddings as contrastive verifiers to assess the trustworthiness of the draft answer, aiming for more efficient and agentic reasoning.

(a) Conceptual comparison between CoT thinking and CopT on-policy thinking. (b) CopT contrasts the output distributions under discrete and continuous inputs. (c) CopT improves peak accuracy, marked by ∗ , across mathematics, coding, and agentic reasoning tasks and nearly halves token usage at matched accuracy.
(a) Conceptual comparison between CoT thinking and CopT on-policy thinking. (b) CopT contrasts the output distributions under discrete and continuous inputs. (c) CopT improves peak accuracy, marked by ∗ , across mathematics, coding, and agentic reasoning tasks and nearly halves t…
cs.AIarxiv:2605.19966v1Lead article

Detecting Fluent Optimization-Based Adversarial Prompts via Sequential Entropy Changes

Mohammed Alshaalan, Miguel R. D. Rodrigues

his paper proposes a novel method for detecting adversarial prompts by treating them as an online change-point detection problem. It analyzes the stream of next-token entropy, using the LLM's system prompt to establish a baseline. The core contribution is a training-free, model-agnostic detector that effectively identifies and localizes adversarial suffixes by monitoring deviations from expected token probabilities, outperforming existing methods.

Top: benign prompt where the CUSUM statistic W t + W_{t}^{+} (purple) stays below threshold h h (orange) at slack k = 0 k=0 (the canonical Page-CUSUM setting used for Table 1 ; Appendix A ). Bottom: adversarial prompt (AdvPrompter); a sustained upward shift in token entropy after the suffix onset (green) causes W t + W_{t}^{+} to cross h h , triggering an alarm at time \( \tau \) (red). The shaded region denotes the ground-truth adversarial suffix. For comparison the WPP 15 baseline (brown dash-dot, plotted as the non-overlapping window-mean NLL the detector actually scores) and its F1-optimal threshold (brown dotted) are overlaid: on this fluent attack WPP 15 never crosses its threshold while CPD’s W t + W_{t}^{+} does.
Top: benign prompt where the CUSUM statistic W t + W_{t}^{+} (purple) stays below threshold h h (orange) at slack k = 0 k=0 (the canonical Page-CUSUM setting used for Table 1 ; Appendix A ). Bottom: adversarial prompt (AdvPrompter); a sustained upward shift in token entropy after…
cs.AIarxiv:2605.19943v1Lead article

Probabilistic Tiny Recursive Model

Amin Sghaier, Ali Parviz, Alexia Jolicoeur-Martineau

his paper introduces Probabilistic Tiny Recursive Models (PTRM) to improve upon deterministic Tiny Recursive Models (TRM). PTRM addresses TRM's tendency to get stuck in suboptimal solutions by injecting Gaussian noise during recursion, allowing for parallel exploration of diverse solution paths. This stochastic approach, without retraining, significantly boosts accuracy on complex reasoning tasks by enabling better selection of the final answer.

cs.AIarxiv:2605.20072v1Lead article

Probing Embodied LLMs: When Higher Observation Fidelity Hurts Problem Solving

Oussama Zenkri, Oliver Brock

his paper investigates how observation fidelity impacts embodied Large Language Model (LLM) agents in robotic tasks. The core method involves testing LLMs on a mechanical puzzle with varying levels of visual and symbolic information. The key contribution is the counterintuitive finding that LLMs perform best with raw RGB input and worst with perfect ground-truth observations, suggesting that some level of noise or ambiguity can actually improve their problem-solving abilities.

Our robotic system manipulating the Lockbox. Our Lockbox comprises two prismatic joints (sliding bars in the middle) and two revolute joints. The Lockbox is unlocked when the leftmost revolute joint, which we refer to as the target joint, is pulled. The robot employs a soft-hand end effector for manipulating the joints, an RGB-D camera for acquiring visual data, and a force-torque sensor for assessing the joint movability and guiding their manipulation.
Our robotic system manipulating the Lockbox. Our Lockbox comprises two prismatic joints (sliding bars in the middle) and two revolute joints. The Lockbox is unlocked when the leftmost revolute joint, which we refer to as the target joint, is pulled. The robot employs a soft-hand …
cs.AIarxiv:2605.19940v1Lead article

Robotics-Inspired Guardrails for Foundation Models in Socially Sensitive Domains

Rebecca Ramnauth, Drazen Brscic, Brian Scassellati

his paper reframes safety for foundation models in sensitive domains from output-level checks to runtime behavioral control of interaction trajectories, inspired by robotics. Their core method, the Grounded Observer framework, uses formal constructs to enforce constraints during interactions, enabling real-time interventions to prevent undesirable behavior. This approach offers enforceable behavioral guarantees, a significant contribution beyond existing empirical risk reduction methods.

Figure 1. Guardrails as Constraint Enforcement Over Interaction Trajectories. A deployed foundation model induces a trajectory τ = ( s 0 , a 0 , s 1 , a 1 , … ) \( \tau \)=(s_{0},a_{0},s_{1},a_{1},...) through state space 𝒮 \( \mathcal{S} \) . A safe set 𝒮 safe ⊆ 𝒮 \( \mathcal{S} \)_{\( \text{safe} \)}\( \subseteq \)\( \mathcal{S} \) defines acceptable behavioral states. At each timestep, the model proposes actions according to policy π θ ​ ( a t ∣ s t ) \( \pi_{\theta} \)(a_{t}\( \mid \) s_{t}) , but a “guardrail” restricts execution to the admissible action set 𝒜 safe ​ ( s t ) \( \mathcal{A} \)_{\( \text{safe} \)}(s_{t}) , ensuring that transitions s t + 1 s_{t+1} remain within 𝒮 safe \( \mathcal{S} \)_{\( \text{safe} \)} . This enforces forward invariance, preventing trajectories from entering unsafe regions rather than merely detecting violations after they occur.
Figure 1. Guardrails as Constraint Enforcement Over Interaction Trajectories. A deployed foundation model induces a trajectory τ = ( s 0 , a 0 , s 1 , a 1 , … ) \( \tau \)=(s_{0},a_{0},s_{1},a_{1},...) through state space 𝒮 \( \mathcal{S} \) . A safe set 𝒮 safe ⊆ 𝒮 \( \mathcal…
cs.AIarxiv:2605.20086v1Lead article

What Do Evolutionary Coding Agents Evolve?

Nico Pelleriti, Sree Harsha Nelaturu, Zhanke Zhou, Zongze Li, Max Zimmer

his paper investigates what evolutionary coding agents, powered by LLMs, actually learn. They introduce EvoTrace, a dataset of evolutionary coding processes, and EvoReplay, a method to analyze these traces. This allows them to distinguish between genuine algorithmic innovation and other mechanisms like re-tuning or overfitting, providing a deeper understanding of how these agents evolve.

A taxonomy of edits performed by evolutionary coding agents. Each panel shows a representative parent–child diff (added lines in green, deleted lines in red) drawn from EvoTrace runs and labeled with one of nine recurring categories: Bug fix , External dependency , Architectural change , Composition , Local refinement , Pruning , Refactor , Efficiency , and Hyperparameter tuning . The categories range from minimal numeric edits (a single literal change) to structural rewrites (replacing a 14-gon with two concentric heptagons), and they form the basis of the LLM-as-judge edit annotation used throughout the paper. Edits are typically multi-label; we examine prevalence and per-edit utility in § 5.1 .
A taxonomy of edits performed by evolutionary coding agents. Each panel shows a representative parent–child diff (added lines in green, deleted lines in red) drawn from EvoTrace runs and labeled with one of nine recurring categories: Bug fix , External dependency , Architectural …
cs.CLarxiv:2605.19852v1Lead article

Are Tools Always Beneficial? Learning to Invoke Tools Adaptively for Dual-Mode Multimodal LLM Reasoning

Qinghe Ma, Zhen Zhao, Yiming Wu, Jian Zhang, Lei Bai

his paper introduces AutoTool, a method that enables multimodal large language models (MLLMs) to adaptively decide whether to use external tools for reasoning. By employing a reinforcement learning framework with a dual-mode strategy, AutoTool balances tool-assisted and text-centric reasoning to avoid redundant or misleading tool invocations, ultimately improving accuracy and efficiency.

(a, b) Representative queries that do or do not trigger the zoom-in tool, illustrating that tool usage is not always necessary, while AutoTool adaptively invokes tools when beneficial. (c, d) Comparison of the proportion of tool-augmented reasoning trajectories during training, as well as the training and inference time costs between our AutoTool and SOTA DeepEyes (Zheng et al. , 2025 ) .
(a, b) Representative queries that do or do not trigger the zoom-in tool, illustrating that tool usage is not always necessary, while AutoTool adaptively invokes tools when beneficial. (c, d) Comparison of the proportion of tool-augmented reasoning trajectories during training, a…
cs.CLarxiv:2605.20176v1Lead article

ClinSeekAgent: Automating Multimodal Evidence Seeking for Agentic Clinical Reasoning

Juncheng Wu, Letian Zhang, Yuhan Wang, Haoqin Tu, Hardy Chen

linSeekAgent automates the process of actively seeking and synthesizing multimodal evidence from diverse clinical data sources for LLM-based reasoning. Unlike previous approaches that assume pre-curated evidence, it dynamically queries knowledge bases, navigates EHRs, and uses imaging tools to gather information, refining hypotheses as it learns. This framework enables LLMs to make more grounded clinical decisions by actively acquiring and integrating evidence.

ClinSeekAgent Overview. ClinSeekAgent is an automated agentic evidence-seeking pipeline. It interacts with heterogeneous data sources to enable multimodal evidence seeking for clinical decision support. Compared with prior user-curated context settings, ClinSeekAgent is more flexible by acquiring richer information and knowledge from diverse tools.
ClinSeekAgent Overview. ClinSeekAgent is an automated agentic evidence-seeking pipeline. It interacts with heterogeneous data sources to enable multimodal evidence seeking for clinical decision support. Compared with prior user-curated context settings, ClinSeekAgent is more flex…
cs.CLarxiv:2605.20170v1Lead article

KoRe: Compact Knowledge Representations for Large Language Models

Davide Cavicchini, Fausto Giunchiglia, Jacopo Staiano

oRe addresses the limitations of LLMs encoding knowledge within opaque parameters by introducing a method to represent 1-hop knowledge graph sub-graphs as compact, discrete tokens. These tokens are then injected into a pre-trained LLM backbone without requiring extensive retraining. This approach offers a more transparent and updatable way to integrate external knowledge, leading to competitive performance on knowledge-intensive tasks.

Taxonomy of Knowledge Augmentation Approaches for LLMs
Taxonomy of Knowledge Augmentation Approaches for LLMs
cs.CLarxiv:2605.20128v1Lead article

MixRea: Benchmarking Explicit-Implicit Reasoning in Large Language Models

Yuanqing Cai, Ziyi Huang, Minhao Liu, Lixin Duan, Wen Li

his paper introduces the "explicit-implicit reasoning" task and the MixRea benchmark to assess if LLMs exhibit "inattentional blindness" to subtle cues, similar to humans. Their core method involves creating diverse reasoning questions with varying explicit and implicit information. The contribution lies in demonstrating widespread inattentional blindness in LLMs and proposing Potential Relation Completion Prompting (PRCP) as a method to improve their reasoning by recovering overlooked causal relations.

An explicit-implicit reasoning example from our MixRea benchmark. When reasoning about explicitly stated information in the question, LLMs must leverage distinctions among events presented in the options to identify and infer relevant implicit information from the story context. They then integrate these reasoning results to derive the optimal event set.
An explicit-implicit reasoning example from our MixRea benchmark. When reasoning about explicitly stated information in the question, LLMs must leverage distinctions among events presented in the options to identify and infer relevant implicit information from the story context. …
cs.AIarxiv:2605.21482v1Lead article

DeepWeb-Bench: A Deep Research Benchmark Demanding Massive Cross-Source Evidence and Long-Horizon Derivation

Sixiong Xie, Zhuofan Shi, Haiyang Shen, Jiuzheng Wang, Siqi Zhong

eepWeb-Bench is a new benchmark designed to rigorously evaluate advanced language models on "deep research" tasks. Its core method involves creating complex research questions that require agents to gather extensive evidence from multiple sources, reconcile conflicting information, and perform multi-step reasoning to arrive at an answer. The paper's main contribution is a significantly more challenging evaluation dataset that pushes beyond existing benchmarks, enabling a clearer distinction of current frontier model capabilities.

Overview of DeepWeb-Bench . (a) Each task is an 8 × 8 8\( \times \) 8 matrix of entities against research dimensions; every cell is scored independently using a four-tier rubric ( { 1 , 0.5 , 0.25 , 0 } \{1,0.5,0.25,0\} ) and carries a reference answer with source-provenance labels and cross-source agreement. (b) The dimension axis covers four capability families, and every task spans multiple families.
Overview of DeepWeb-Bench . (a) Each task is an 8 × 8 8\( \times \) 8 matrix of entities against research dimensions; every cell is scored independently using a four-tier rubric ( { 1 , 0.5 , 0.25 , 0 } \{1,0.5,0.25,0\} ) and carries a reference answer with source-provenance labe…
cs.AIarxiv:2605.21384v1Lead article

SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agents

Bingchen Zhao, Dhruv Srikanth, Yuxiang Wu, Zhengyao Jiang

his paper introduces SpecBench, a benchmark designed to measure "reward hacking" in long-horizon coding agents. The core method involves creating tasks with visible tests (used for agent training) and held-out tests (simulating real-world usage). The contribution is quantifying reward hacking by measuring the performance gap between these two test suites, highlighting when agents optimize for passing training tests at the expense of true functionality.

High-level overview of the SpecBench evaluation framework. Coding agents iteratively develop software based on high-level specifications and are optimized against visible validation tests ( s val s_{\( \text{val} \)} ) that verify individual features. The generated code is subsequently evaluated on held-out tests ( s test s_{\( \text{test} \)} ) that require complex, cross-feature real-world use cases. The Reward Hacking Gap ( \( \Delta \) ) is calculated as the difference between these two scores ( Δ = s val − s test \( \Delta \)=s_{\( \text{val} \)}-s_{\( \text{test} \)} ) to quantify how much the agent gamed the proxy metric. The gap should be 0 if the system genuinely passes all validation tests.
High-level overview of the SpecBench evaluation framework. Coding agents iteratively develop software based on high-level specifications and are optimized against visible validation tests ( s val s_{\( \text{val} \)} ) that verify individual features. The generated code is subseq…
cs.AIarxiv:2605.21318v1Lead article

TextReg: Mitigating Prompt Distributional Overfitting via Regularized Text-Space Optimization

Lucheng Fu, Ye Yu, Yiyang Wang, Yiqiao Jin, Haibo Jin

his paper addresses **prompt distributional overfitting** in LLMs, where optimized prompts become overly specific and generalize poorly. Their core method, **TextReg**, introduces a regularization framework that penalizes prompt inefficiency by controlling representation capacity and scope. This approach aims to create more robust and generalizable prompts by mitigating the accumulation of narrow, sample-specific rules.

Problem Illustration. We illustrate prompt distributional overfitting in prompt optimization: I) conventional methods often produce long prompts saturated with narrow rules (left), which degrade on OOD inputs . II) Our goal is to instead yield compact prompts composed of broadly applicable rules (right), achieving stronger OOD generalization .
Problem Illustration. We illustrate prompt distributional overfitting in prompt optimization: I) conventional methods often produce long prompts saturated with narrow rules (left), which degrade on OOD inputs . II) Our goal is to instead yield compact prompts composed of broadly …
cs.AIarxiv:2605.21295v1Lead article

TimeSRL: Generalizable Time-Series Behavioral Modeling via Semantic RL-Tuned LLMs -- A Case Study in Mental Health

Yuang Fan, Lilin Xu, Millie Wu, Jingping Nie, Qingyu Chen

imeSRL addresses the challenge of cross-dataset distribution shifts in time-series health prediction. Its core method involves an LLM framework that first translates raw sensor data into natural language abstractions, then predicts outcomes solely from these semantic concepts. This approach, optimized with RL, aims to improve generalizability by forcing reasoning over more robust, high-level behavioral semantics rather than raw, potentially noisy, numerical data.

Figure 1 . Overview of TimeSRL, a two-stage LLM framework for robust longitudinal behavioral time-series modeling, instantiated on behavioral health prediction. While traditional ML models overfit numerical regularities and direct-prediction LLMs struggle with long numeric trajectories, TimeSRL addresses these distribution shift challenges by routing inference through an explicit semantic bottleneck . In Stage 1, it abstracts raw numerical signals into natural-language behavioral descriptions; in Stage 2, it infers outcomes from this abstraction alone, enabling robust generalization across new populations. This paper focus on mental health prediction as a case study.
Figure 1 . Overview of TimeSRL, a two-stage LLM framework for robust longitudinal behavioral time-series modeling, instantiated on behavioral health prediction. While traditional ML models overfit numerical regularities and direct-prediction LLMs struggle with long numeric trajec…
cs.LGarxiv:2605.21180v1Lead article

Domain-Adaptable Reinforcement Learning for Code Generation with Dense Rewards

Erfan Aghadavoodi Jolfaei, Daniel Maninger, Abhinav Anand, Mert Tiftikci, Mira Mezini

his paper presents a reinforcement learning framework using Proximal Policy Optimization to fine-tune large language models for code generation. Its core method involves a customizable, execution-aware reward function that optimizes for syntax, correctness, style, security, and simulator executability, with a token-level reward mapping for effective credit assignment. The contribution lies in enabling domain-adaptable code generation, demonstrated by significant improvements on general-purpose and robotic program synthesis tasks.

Overview of the proposed fine-tuning framework. The process operates in a loop of Rollout , Evaluation , and Optimization .
Overview of the proposed fine-tuning framework. The process operates in a loop of Rollout , Evaluation , and Optimization .
cs.LGarxiv:2605.21422v1Lead article

Preference-aware Influence-function-based Data Selection Method for Efficient Fine-Tuning

Qihao Lin, Guanxu Chen, Dongrui Liu, Jing Shao

his paper introduces PRISM, a novel data selection method for efficient LLM fine-tuning. PRISM addresses the limitation of existing methods by recognizing that target examples have varying relevance to the current model. It achieves this by weighting target examples based on the model's current preference, creating a more nuanced target representation. This allows PRISM to prioritize candidate training samples that are most effective in guiding the model towards the desired behavior, thus optimizing the use of limited training budgets.

Motivation of PRISM. Uniform aggregation treats all target examples equally, whereas PRISM emphasizes target examples closer to the current model and focuses the selection budget on more actionable training samples.
Motivation of PRISM. Uniform aggregation treats all target examples equally, whereas PRISM emphasizes target examples closer to the current model and focuses the selection budget on more actionable training samples.
cs.AIarxiv:2605.15617Lead article

A Few GPUs, A Whole Lotta Scale: Faithful LLM Training Emulation with PrismLLM

Shaoke Xi, ChonLam Lao, Boyi Jia, Jiaqi Gao, Zhipeng Zhang

rismLLM enables faithful emulation of large-scale LLM training on a few GPUs by constructing a high-fidelity execution graph. Its core method involves a slicing-based approach to capture scale-dependent behaviors, allowing engineers to debug and tune training frameworks without needing exclusive access to massive GPU clusters. This significantly reduces the cost and complexity of LLM development.

cs.AIarxiv:2605.14401Lead article

Agentic Recommender System with Hierarchical Belief-State Memory

Xiang Shen, Yuhang Zhou, Yifan Wu, Zhuokai Zhao, Siyu Lin

ARS addresses limitations in memory-augmented recommender systems by proposing a hierarchical belief-state memory. This framework treats recommendation as a partially observable problem, progressively abstracting user observations into a structured memory with three tiers: event, preference, and profile. MARS's core contribution is this structured memory and its adaptive lifecycle management, allowing for more robust and nuanced user preference modeling.

Overview of MARS . Three-tier memory (center) stores raw signals (event), mutable preference chunks with strength and evidence (preference), and a synthesized user narrative (profile). Solid arrows: online ranking path where profile and event memory feed the LLM ranker. Dashed arrows: offline lifecycle path where an agentic planner schedules six memory operations to keep preferences current. Preference memory serves as an intermediate tier that informs profile synthesis but is not directly consumed by the ranker. The two paths are decoupled.
Overview of MARS . Three-tier memory (center) stores raw signals (event), mutable preference chunks with strength and evidence (preference), and a synthesized user narrative (profile). Solid arrows: online ranking path where profile and event memory feed the LLM ranker. Dashed ar…
cs.AIarxiv:2605.23459v1Lead article

AI Assurance: A Comprehensive Testing Strategy for Enterprise AI Systems

Chitra Badagi, Divye Singh, Animesh Sen, Adinath Shirsath

his paper proposes a new AI assurance strategy for enterprise AI systems, shifting from traditional correctness verification to continuous risk reduction. It emphasizes treating evaluation as a core engineering discipline and introduces a structured AI Failure Taxonomy and a revised AI Assurance Pyramid to address the unique probabilistic and emergent nature of these systems. The contribution lies in providing a comprehensive framework and operational guidance for managing the distinct risks associated with enterprise AI.

cs.AIarxiv:2605.23655v1Lead article

CVSearch: Empowering Multimodal LLMs with Cognitive Visual Search for High-Resolution Image Perception

Liupeng Li, Haoqian Kang, Zhenyu Lu, Jinpeng Wang, Bin Chen

VSearch tackles the challenge of high-resolution image perception in multimodal LLMs by dynamically adapting its search strategy. It first attempts an efficient expert-assisted search and, if that fails, employs a novel semantic-aware scanning method that intelligently partitions images into coherent regions to avoid fragmentation. This approach balances coverage and efficiency, improving the LLM's ability to perceive detailed images.

cs.AIarxiv:2605.23897v1Lead article

ETCHR: Editing To Clarify and Harness Reasoning

Beichen Zhang, Yuhong Liu, Jinsong Li, Yuhang Zang, Jiaqi Wang

TCHR addresses limitations in multimodal reasoning by decoupling an image editing model from a language understanding model. Its core method involves training a question-conditioned, reasoning-aware image editor that can perform visual transformations to clarify reasoning steps, overcoming the limitations of fixed toolkits and noisy intermediate images. The contribution is a novel approach that enhances visual reasoning by enabling editors to actively participate in the reasoning process, improving accuracy even with complex queries.

ETCHR vs. prior “think with images” paradigms. (a) Tool-based methods emit action tokens to a renderer, limiting edits to low-level operations and requiring VLM fine-tuning. (b) Unified models share one backbone for text and images, weakening both and producing noisy intermediates. (c) ETCHR decouples a question-conditioned editor from the understanding MLLM and adds a verify-and-reason step, enabling plug-and-play use across tasks. (d) Across nine benchmarks, ETCHR (with Qwen3-VL-8B and Kimi K2.5 1T) surpasses tool-based and unified-model baselines.
ETCHR vs. prior “think with images” paradigms. (a) Tool-based methods emit action tokens to a renderer, limiting edits to low-level operations and requiring VLM fine-tuning. (b) Unified models share one backbone for text and images, weakening both and producing noisy intermediate…
cs.AIarxiv:2605.23861v1Lead article

Leveraging Foundation Models for Causal Generative Modeling

Aneesh Komanduri, Xintao Wu

his paper introduces FM-CGM, a modular framework that leverages pretrained foundation models for end-to-end visual causal reasoning. It comprises a concept extractor, manipulator, and counterfactual generator, enabling zero-shot causal discovery, intervention, and generation. The key contribution is the development of Causal Semantic Guidance (CSG), a mechanism that ensures semantic interventions propagate correctly while preserving invariant relationships.

Figure 1 . An overview of Foundation Model Powered Causal Generative Model (FM-CGM) consisting of a concept extractor, concept manipulator, and counterfactual generator enabled by foundation models
Figure 1 . An overview of Foundation Model Powered Causal Generative Model (FM-CGM) consisting of a concept extractor, concept manipulator, and counterfactual generator enabled by foundation models
cs.AIarxiv:2605.23901v1Lead article

LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws

Xu Ouyang, Deyi Liu, Yuhang Cai, Jing Liu, Yuan Yang

his paper proposes the "Shannon Scaling Law" to explain LLM behavior beyond monotonic scaling. It models LLM training as information transmission over a noisy channel, where model parameters represent bandwidth and training tokens represent signal power. This framework reveals a fundamental Shannon capacity for LLMs, explaining non-monotonic performance degradation when the signal-to-noise ratio is insufficient.

Loss landscapes between Pretraining and downstream SFT. While pretraining exhibits monotonic improvement, SFT reveals a loss basin, indicating that scaling either model size or token count beyond a critical threshold leads to performance degradation.
Loss landscapes between Pretraining and downstream SFT. While pretraining exhibits monotonic improvement, SFT reveals a loss basin, indicating that scaling either model size or token count beyond a critical threshold leads to performance degradation.
cs.AIarxiv:2605.23883v1Lead article

PGT: Procedurally Generated Tasks for improving visual grounding in MLLMs

Rim Assouel, Amir Bar, Michal Drozdzal, Adriana Romero-Soriano

his paper introduces Procedurally Generated Tasks (PGT), a novel data-driven framework to enhance fine-grained visual understanding in Multimodal Large Language Models (MLLMs). PGT overlays geometric primitives on images to create dense supervision, disentangling visual grounding from semantic knowledge. This approach significantly improves performance on relational, quantitative, and 3D understanding benchmarks, with instruction tuning on PGT data yielding substantial gains on specific benchmarks like What'sUp and CV-Bench-2D.

Overview of PGT. Top : The construction of our procedurally generated data to augment instruction tuning training datasets. Abstract geometric primitives are overlaid to training data, when available. Bottom : (Left) Examples of failure modes in fine-grained relational and spatial understanding of state-of-the-art MLLMs. In the first example the model can rely on the fact that a bowl is usually on a table and in the second example it can rely on the shortcut where object higher up as usually further from the camera (Right) PGT performance boosts in relational, quantitative, and 3D/depth understanding over the baseline when using different instruction tuning dataset sizes.
Overview of PGT. Top : The construction of our procedurally generated data to augment instruction tuning training datasets. Abstract geometric primitives are overlaid to training data, when available. Bottom : (Left) Examples of failure modes in fine-grained relational and spatia…
cs.AIarxiv:2605.23522v1Lead article

Precise: SDE-Consistent Stochastic Sampling for RL Post-Training of Flow-Matching Models

Jade Zou, Tao Huang, Weijie Kong, Junzhe Li, Yue Wu

his paper proposes "Precise," a method for improving Reinforcement Learning (RL) in flow-matching models by addressing the challenge of converting deterministic sampling to a stochastic policy. Precise breaks down sampler design into balancing exploration and faithful SDE discretization, deriving an SDE schedule to optimize this balance and improve RL performance.

Left: Sampler design has two coupled axes: the exploration-stability balance and SDE consistency. Existing stochastic samplers occupy different trade-offs, while Precise improves both. Right: The double-ring example illustrates failure modes of existing samplers: Flow-GRPO (Liu et al., 2025 ) introduces excess noise, while CPS (Wang & Yu, 2025 ) biases the marginal distribution.
Left: Sampler design has two coupled axes: the exploration-stability balance and SDE consistency. Existing stochastic samplers occupy different trade-offs, while Precise improves both. Right: The double-ring example illustrates failure modes of existing samplers: Flow-GRPO (Liu e…
cs.AIarxiv:2605.23904v1Lead article

SkillOpt: Executive Strategy for Self-Evolving Agent Skills

Yifan Yang, Ziyang Gong, Weiquan Huang, Qihao Yang, Ziwei Zhou

killOpt treats agent skills as trainable external states, optimizing them through controlled text edits rather than hand-crafting or loose self-revision. This systematic approach uses a separate optimizer model to make bounded add/delete/replace edits to a skill document, accepting only those that strictly improve performance. SkillOpt's core contribution is a controllable, text-space optimizer for agent skills that achieves stable, reproducible skill improvement without increasing inference cost.

Overview of SkillOpt . The target model executes tasks with a current skill, an additional frontier optimizer model converts trajectories into bounded add/delete/replace skill edits, and a held-out gate accepts only edits that improve validation performance. Accepted edits are exported as a reusable skill artifact, while rejected edits become negative feedback for later updates.
Overview of SkillOpt . The target model executes tasks with a current skill, an additional frontier optimizer model converts trajectories into bounded add/delete/replace skill edits, and a held-out gate accepts only edits that improve validation performance. Accepted edits are ex…
cs.LGarxiv:2605.23751v1Lead article

Approaching I/O-optimality for Approximate Attention

Pál András Papp, Aleksandros Sobczyk, Anastasios Zouzias

his paper presents an I/O-efficient algorithm for computing attention in large language models, significantly reducing data transfers between fast and slow memory. By adapting an approximate attention framework, their method achieves an almost-linear I/O cost with respect to the input size $n$, approaching the theoretical lower bound. This work contributes to making large language model computations more memory-efficient.

cs.LGarxiv:2605.23650v1Lead article

Learning Kernel-Based MDPs from Episodic Preferential Feedback

Nikola Pavlovic, Sattar Vakili, Qing Zhao

his paper develops a theoretical framework for learning Markov Decision Processes (MDPs) with kernel-based rewards and transitions using only episodic preferential feedback. The core method involves estimating values and confidence sets based on pairwise trajectory comparisons, modeled by a Bradley-Terry-Luce link. The main contribution is proving sublinear regret bounds, demonstrating that the learned policy converges to the optimal one with sufficient data.

cs.LGarxiv:2605.23857v1Lead article

Strong Teacher Not Needed? On Distillation in LLM Pretraining

Taiming Lu, Zhuang Liu

his paper investigates knowledge distillation for Large Language Model pretraining, challenging the assumption that a stronger teacher is always necessary. They demonstrate that even smaller, undertrained teachers can effectively improve larger students through careful loss mixing. Furthermore, a stronger teacher doesn't guarantee better results, and distillation primarily enhances generalization rather than in-domain performance.

cs.AIarxiv:2605.27284v1Lead article

FineVLA: Fine-Grained Instruction Alignment for Steerable Vision-Language-Action Policies

Xintong Hu, Xuhong Huang, Jinyu Zhang, Yutong Yao, Yuchong Sun

his paper introduces FineVLA, a framework for fine-grained instruction alignment in Vision-Language-Action (VLA) models. Its core method involves constructing a large, human-verified dataset of trajectories with detailed, execution-critical language annotations. The main contribution is enabling steerable VLA policies that can follow precise instructions, improving robotic task execution and video understanding beyond coarse goal-level commands.

Overview of FineVLA. FineVLA builds a closed loop for action-instruction alignment, connecting fine-grained data construction, robotic video understanding, scalable annotation, and steerable VLA policy learning. Left : FineVLA-Tool unifies heterogeneous robot trajectories from 10 open-source datasets, removes redundant demonstrations through clustering and sampling, and annotates representative trajectories with action-aligned descriptions across ten fine-grained dimensions. The resulting FineVLA-Data supports both RoboFine-Bench, which evaluates fine-grained robotic video understanding through Grounding VQA, Reasoning VQA, and Caption Evaluation, and RoboFine-VLM, a robotics-specialized VLM trained as a scalable annotator for new trajectories. Right : FineVLA-Policy is trained with mixtures of raw goal-level instructions and fine-grained process-level instructions under two action-decoding architectures, and is evaluated in both RoboTwin simulation and real-world dual-arm manipulation. The steerable-control examples illustrate how fine-grained language specifies execution-sensitive factors such as contact region, target object, active actor, trajectory and orientation, and failure recovery.
Overview of FineVLA. FineVLA builds a closed loop for action-instruction alignment, connecting fine-grained data construction, robotic video understanding, scalable annotation, and steerable VLA policy learning. Left : FineVLA-Tool unifies heterogeneous robot trajectories from 10…
cs.AIarxiv:2605.27209v1Lead article

Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environments

Yuxin Chen, Xiaodong Cai, Junfeng Fang, Zhuowen Han, Yu Wang

his paper proposes NoisyAgent, a training framework to improve LLM agent robustness in real-world, imperfect environments. The core method involves explicitly training agents with simulated "user noise" (ambiguous inputs) and "tool noise" (tool failures). This approach enhances agent performance by bridging the gap between idealized training and the stochastic nature of real-world interactions.

Overview of NoisyAgent. We inject structured perturbations into both user instructions and tool responses to simulate real-world imperfections. Training is conducted via hybrid rollouts that combine clean and noisy trajectories, together with an adaptive scheduler that increases noise difficulty based on the performance gap \( \Delta \) . Policy optimization is performed with group-wise normalization to stabilize learning under heterogeneous interaction conditions.
Overview of NoisyAgent. We inject structured perturbations into both user instructions and tool responses to simulate real-world imperfections. Training is conducted via hybrid rollouts that combine clean and noisy trajectories, together with an adaptive scheduler that increases …
cs.AIarxiv:2605.27254v1Lead article

LUCoS: Latent Unsupervised Context Selection for Tabular Foundation Models

Oroel Ipas, Guillermo Gomez-Trenado, Rocío Romero-Zaliz, Isaac Triguero

his paper introduces LUCoS, a novel unsupervised method for selecting informative instances to label for tabular foundation models in a cold-start setting. LUCoS leverages the latent embedding space of these models, rather than the original tabular data, to perform geometric instance selection. This approach overcomes the limitations of raw tabular data and significantly improves predictive performance compared to random selection.

Overview of LUCoS. The method consists of four stages: (i) embedding the unlabeled training data into a high-dimensional latent representation space, (ii) selecting representative instances using a geometric criterion, (iii) mapping the selected instances back to the original tabular space and querying the oracle to label them, and (iv) using the labeled instances as the in-context set of a supervised TFM for prediction on unseen data. Instance selection is performed without label access; test instances are never used during embedding, selection, or subset construction; they are reserved exclusively for final evaluation.
Overview of LUCoS. The method consists of four stages: (i) embedding the unlabeled training data into a high-dimensional latent representation space, (ii) selecting representative instances using a geometric criterion, (iii) mapping the selected instances back to the original tab…
cs.AIarxiv:2605.27361v1Lead article

Natural Language Query to Configuration for Retrieval Agents

Melissa Z. Pan, Negar Arabzadeh, Mathew Jacob, Fiodar Kazhamiaka, Esha Choukse

his paper addresses the challenge of optimizing retrieval agent configurations for individual queries. Their core method, BRANE, uses an LLM to extract query characteristics and then employs lightweight predictors to estimate the correctness of different pipeline configurations. BRANE's contribution is enabling dynamic, per-query configuration selection to balance answer quality and serving cost without retraining, offering a tunable cost-quality tradeoff.

Cost-quality design space of knowledge-search pipelines on BrowseComp-Plus across 60 profiled configurations. Circles denote static pipelines, colored by synthesis method (LLM-only, per-chunk summary, agent loop). Each configuration also varies the LLM, retriever, and number of retrieved documents; Appendix A.1 lists the full space. Squares mark prior-work baselines. Pipeline cost spans roughly three orders of magnitude on a single workload. BRANE’s per-query Pareto trace (yellow diamonds; star marks the headline operating point) dominates the static Pareto frontier (black dashed line) across the full cost-quality range (green region): BRANE exceeds the most accurate static pipeline by 0.7% in accuracy at 81.7% lower cost.
Cost-quality design space of knowledge-search pipelines on BrowseComp-Plus across 60 profiled configurations. Circles denote static pipelines, colored by synthesis method (LLM-only, per-chunk summary, agent loop). Each configuration also varies the LLM, retriever, and number of r…
cs.AIarxiv:2605.27255v1Lead article

Pair-In, Pair-Out: Latent Multi-Token Prediction for Efficient LLMs

Wenhui Tan, Minghao Li, Xiaoqian Ma, Siqi Fan, Xiusheng Huang

his paper introduces Pair-In, Pair-Out (PIPO), a method that unifies input compression and multi-token prediction for efficient LLM inference. PIPO treats token compression and expansion as mirrored operations, allowing it to predict multiple output tokens from a single hidden state. Crucially, it eliminates the expensive verifier by training a lightweight confidence head to reliably accept or reject draft tokens.

Comparison of input-side methods, output-side methods, and our proposed PIPO. PIPO treats a latent compressor and a multi-token prediction (MTP) head as mirror-image operations around the backbone, and trains a lightweight confidence head that replaces the verifier of speculative decoding (e.g., EAGLE).
Comparison of input-side methods, output-side methods, and our proposed PIPO. PIPO treats a latent compressor and a multi-token prediction (MTP) head as mirror-image operations around the backbone, and trains a lightweight confidence head that replaces the verifier of speculative…
cs.AIarxiv:2605.27117v1Lead article

Position: AI Safety Requires Effective Controllability

Yige Li, Yunhao Feng, Jun Sun

his paper argues that AI safety needs to prioritize **controllability** alongside alignment. Controllability ensures AI systems can be reliably stopped, overridden, or redirected at runtime, even in complex environments, without sacrificing normal functionality. The authors introduce a benchmark, `\controlbench{}`, to study and evaluate this crucial aspect of AI safety.

Existing safety mechanisms provide partial control along different axes. CAS denotes the target regime: explicit runtime authority with persistent and enforceable control.
Existing safety mechanisms provide partial control along different axes. CAS denotes the target regime: explicit runtime authority with persistent and enforceable control.
cs.AIarxiv:2605.27068v1Lead article

QUACK: Questioning, Understanding, and Auditing Communicated Knowledge in Multimodal Social Deduction Agents

Ye Yuan, Rui Song, Weien Li, Zeyu Li, Haochen Liu

UACK introduces a novel evaluation framework for multimodal social deduction agents, moving beyond simple win rates. Its core contribution is a Statement Verification Pipeline that reconstructs agent trajectories from logs and audits every utterance for consistency with perceived information and actions, automatically identifying specific failure modes like spatial hallucination and unsupported accusations. This allows for a deeper understanding of agent reasoning and the grounding of their language.

Left: an omniscient view of the game state, from which each agent’s global map I global I^{\( \text{global} \)} is rendered (room layout and corridor travel costs, with no other players shown). Top right: the local view I local I^{\( \text{local} \)} , rendering only what each agent currently sees. Bottom right: the aligned structured summary τ i t \( \tau_{i}^{t} \) . This figure conveys the same semantics as the actual rendered observations the agents receive, but is drawn more cleanly for presentation.
Left: an omniscient view of the game state, from which each agent’s global map I global I^{\( \text{global} \)} is rendered (room layout and corridor travel costs, with no other players shown). Top right: the local view I local I^{\( \text{local} \)} , rendering only what each ag…
cs.AIarxiv:2605.27134v1Lead article

Scaling, Benchmarking, and Reasoning of Vision-Language Agents for Mobile GUI Navigation

Heng Qu, Yike Liu, Renren Jin, Wenzong Zhang, Pengzhi Gao

his paper introduces HyperTrack, a large-scale dataset and GUIEvalKit toolkit for evaluating Vision-Language Models (VLMs) in mobile GUI navigation. Their core method involves analyzing the impact of data scaling on supervised and reinforcement learning fine-tuning, demonstrating that reinforcement learning excels, especially in out-of-domain scenarios. The contribution is a comprehensive benchmark and dataset that reveals the importance of data scale and reinforcement learning for robust VLM navigation agents.

cs.LGarxiv:2605.27293v1Lead article

BASIS: Batchwise Advantage Estimation from Single-Rollout Information Sharing for LLM Reasoning

Shijin Gong, Erhan Xu, Kai Ye, Francesco Quinzan, Giulia Livieri

ASIS is a novel reinforcement learning algorithm for improving LLM reasoning that eliminates the need for a critic. It achieves this by sharing information across prompts within a batch to enhance value function estimation, even with only a single rollout per prompt. This batchwise information sharing significantly reduces estimation error and leads to more efficient policy optimization, outperforming existing single-rollout methods and rivaling multi-rollout approaches with less training time.

Overview of BASIS for constructing advantage estimates. BASIS samples one completion per prompt and uses reward information from the whole batch to estimate value baselines. The baselines are weighted averages of batch rewards, with the weight matrix W W shown in the center. The diagonal entries of W W are zero, shown in white, enforcing a prompt’s own reward to be excluded when estimating its baseline. Unlike single-rollout baselines such as REINFORCE++, which uses a simple global average, BASIS chooses W W by minimizing the MSE of the value baselines. Advantages are then computed by subtracting the baselines from the observed rewards.
Overview of BASIS for constructing advantage estimates. BASIS samples one completion per prompt and uses reward information from the whole batch to estimate value baselines. The baselines are weighted averages of batch rewards, with the weight matrix W W shown in the center. The …
cs.LGarxiv:2605.27073v1Lead article

Learning to Orchestrate Agents under Uncertainty

Mary Chriselda Antony Oliver, Lan Jiang, Aaron Bundi Anampiu, Elaf Almahmoud, Francesco Quinzan

his paper addresses the challenge of adaptively coordinating diverse AI agents with uncertain reliability and output quality. The core method, BOT-Orch, frames orchestration as a bandit problem where a meta-controller learns to delegate tasks to agents. Its key contribution is a novel regularization technique using Optimal Transport (OT) distances to explicitly model and account for uncertainty in agent outputs, leading to provably efficient learning with sub-linear regret.

Cumulative learning curves. Top row : cumulative net utility. Bottom row : oracle regret. Right column : rolling escalation rate (window w = 8 w{=}8 rounds). Left panels: IID condition (Algorithm 1); middle panels: Non-IID condition (Algorithm 2), with the dotted vertical line marking the shift onset at round 57; right panels: escalation rate evolution.
Cumulative learning curves. Top row : cumulative net utility. Bottom row : oracle regret. Right column : rolling escalation rate (window w = 8 w{=}8 rounds). Left panels: IID condition (Algorithm 1); middle panels: Non-IID condition (Algorithm 2), with the dotted vertical line ma…
cs.CLarxiv:2605.27110v1Lead article

BAIT: Boundary-Guided Disclosure Escalation via Self-Conditioned Reasoning

Xuan Luo, Yue Wang, Geng Tu, Jing Li, Ruifeng Xu

AIT is a three-step jailbreaking framework that guides LLMs to disclose harmful information by iteratively refining their understanding of protection boundaries. It leverages the model's self-reasoning and consistency to escalate disclosure, achieving high attack success rates by focusing on prevention-oriented framing and iterative refinement. This method significantly improves upon existing jailbreak techniques.

The conceptual comparison between BAIT and other multi-turn methods.
The conceptual comparison between BAIT and other multi-turn methods.
cs.CLarxiv:2605.27186v1Lead article

MAIGO: Mitigating Lost-in-Conversation with History-Cleaned On-Policy Self-Distillation

Haoyu Zheng, Yun Zhu, Shu Yuan, Shangming Chen, Qing Wang

AIGO addresses the "lost-in-conversation" problem in LLMs by reducing self-contamination from previous assistant replies. It achieves this through on-policy self-distillation, cleaning the dialogue history for training. This method improves model performance without requiring external rewards or complex inference setups.

FULL-vs-SHARDED task delivery. The same requirements appear either in one complete prompt or across turns, where earlier assistant replies become part of the final context.
FULL-vs-SHARDED task delivery. The same requirements appear either in one complete prompt or across turns, where earlier assistant replies become part of the final context.
cs.AIarxiv:2605.23459Lead article

AI Assurance: A Comprehensive Testing Strategy for Enterprise AI Systems

Chitra Badagi, Divye Singh, Animesh Sen, Adinath Shirsath

his paper proposes a new AI assurance strategy for enterprise AI systems, shifting focus from traditional correctness verification to continuous risk reduction. It emphasizes treating evaluation as a core engineering discipline and highlights the unique organizational impacts of AI failures. The contribution includes a structured AI Failure Taxonomy and a revised five-layer AI Assurance Pyramid to guide operational practices.

cs.AIarxiv:2605.23243Lead article

Are Frontier LLMs Ready for Cybersecurity? Evidence for Vertical Foundation Models from Dual-Mode Vulnerability Benchmarks

Vivek Dahiya, Sunny Nehra, Vipul Dholariya, Bhavik Shangari, Chandra Khatri

his paper evaluates frontier Large Language Models (LLMs) for cybersecurity tasks using dual-mode benchmarks: white-box code vulnerability detection and black-box web application security testing. The core method involves testing six leading LLMs and two domain-specialized models against these benchmarks. The key contribution is demonstrating that current frontier LLMs are largely unprepared for cybersecurity, exhibiting high false positive rates in code analysis and low ground-truth coverage in web security, while domain-specialized agents show significantly better performance.

Four black-box security testing paradigms evaluated in this work. P1 and P2 use frontier models with native capabilities or external tools; P3 adds methodology-guided security agents; P4 uses an Agentic Reasoning Graph with deterministic confirmation.
Four black-box security testing paradigms evaluated in this work. P1 and P2 use frontier models with native capabilities or external tools; P3 adds methodology-guided security agents; P4 uses an Agentic Reasoning Graph with deterministic confirmation.
cs.AIarxiv:2510.12787Lead article

Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics

Benjamin Breen, Marco Del Tredici, Jacob McCarran, Javier Aspuru Mijares, Weichen Winston Yin

x-Prover is a multi-agent system that uses Large Language Models (LLMs) combined with formal verification tools (Lean) to automate theorem proving. Its core method involves LLMs generating reasoning steps that are then validated by Lean, ensuring formal correctness. Ax-Prover's contribution is its ability to solve complex mathematical and quantum physics problems autonomously or collaboratively, demonstrating strong performance, especially on novel benchmarks.

Left: the multi-agent workflow of Ax-Prover. Right: the tool-enhanced reasoning of the Prover.
Left: the multi-agent workflow of Ax-Prover. Right: the tool-enhanced reasoning of the Prover.
cs.AIarxiv:2602.11146Lead article

Beyond VLM-Based Rewards: Diffusion-Native Latent Reward Modeling

Gongye Liu, Bo Yang, Yida Zhi, Zhizhou Zhong, Lei Ke

his paper introduces DiNa-LRM, a novel method for aligning diffusion models by learning preferences directly within the model's latent diffusion states, rather than relying on computationally expensive Vision-Language Models. DiNa-LRM addresses the domain mismatch issue by formulating a noise-calibrated reward function that accounts for diffusion-specific uncertainty, leading to more efficient and robust preference optimization.

Overview of DiNa-LRM . Left: Diffusion-native Preference Learning. During training, clean preference pairs ( x 0 + , x 0 − , c ) (x_{0}^{+},x_{0}^{-},c) are perturbed to noisy states ( x t + , x t − ) (x_{t}^{+},x_{t}^{-}) and evaluated by a time-conditioned reward model r θ r_{\( \theta \)} . We employ a noise-calibrated Thurstone likelihood where comparison variance scales with the diffusion noise level \( \sigma_{t} \) , and optimize via a fidelity loss ℒ \( \mathcal{L} \) . Right: Latent Reward Architecture. Multi-layer visual and text features extracted from a latent diffusion backbone are FiLM-modulated by timestep embeddings t e ​ m ​ b t_{emb} . These features are aggregated through a gated Q-Former and an MLP to produce a scalar reward score.
Overview of DiNa-LRM . Left: Diffusion-native Preference Learning. During training, clean preference pairs ( x 0 + , x 0 − , c ) (x_{0}^{+},x_{0}^{-},c) are perturbed to noisy states ( x t + , x t − ) (x_{t}^{+},x_{t}^{-}) and evaluated by a time-conditioned reward model r θ r_{\…
cs.AIarxiv:2602.13985Lead article

Bridging AI and Clinical Reasoning: Abductive Explanations for Alignment on Critical Symptoms

Belona Sonna, Alban Grastien

his paper introduces a method for aligning AI diagnostic reasoning with clinical practice by using formal abductive explanations. This approach generates minimal, guaranteed explanations of critical symptoms, enhancing transparency and trust in AI predictions. The contribution lies in providing clinically actionable insights that preserve AI accuracy, facilitating adoption in medical diagnosis.

cs.AIarxiv:2605.13773v1Lead article

(How) Do Large Language Models Understand High-Level Message Sequence Charts?

Mohammad Reza Mousavi

his paper investigates whether Large Language Models (LLMs) truly understand the formal semantics of High-Level Message Sequence Charts (HMSCs), a crucial visual modeling language. The researchers tested three LLMs on 129 semantic tasks, ranging from basic queries to complex abstractions and trace calculations, to assess their consistency with HMSC semantics. The study's contribution lies in its rigorous evaluation of LLM comprehension of formal software design artifacts.

An MSC labelled “example1”, with four instances, labelled “i1” to “i4”, five messages labelled “m0” to “m4”, and an internal action labelled “a”.
An MSC labelled “example1”, with four instances, labelled “i1” to “i4”, five messages labelled “m0” to “m4”, and an internal action labelled “a”.
cs.AIarxiv:2605.16245v1Lead article

AI-Mediated Communication Can Steer Collective Opinion

Stratis Tsirtsis, Kai Rawal, Chris Russell, Brent Mittelstadt, Sandra Wachter

his paper investigates how AI, specifically LLMs, influences collective opinion when mediating human-to-human communication. The core method involves empirical analysis showing LLMs introduce directional biases when editing texts on contested topics, and a theoretical model demonstrating how an AI intermediary can steer opinion dynamics within a social network. The contribution lies in revealing and quantifying this previously understudied impact of AI on group opinion formation.

cs.AIarxiv:2605.15942v1Lead article

Decomposed Vision-Language Alignment for Fine-Grained Open-Vocabulary Segmentation

Chenhao Wang, Yingrui Ji, Yu Meng, Yao Zhu

his paper proposes a Decomposed Vision-Language Alignment framework to improve open-vocabulary segmentation. It addresses the challenge of unseen attribute-category combinations by factorizing text prompts into concept and attribute tokens, allowing for separate cross-modal interactions. The core contribution lies in a Feature-Gated Cross-Attention module and log-space similarity aggregation, which enforce compositional semantics and enhance generalization.

Overall architecture of the proposed method. (a) Explicit Prompt Decomposition and Feature-Gated Cross-Attention . The compositional text prompt is explicitly decoupled into independent concept and attribute tokens. Visual queries interact with the concept via standard cross-attention, and with attributes via multiplicative feature-gating to enforce compositional constraints. (b) Log-Space AND Compositional Scoring . Concept and attribute tokens are independently matched with query embeddings. The resulting scores are converted to log-probabilities and aggregated additively to produce the final compositional matching score.
Overall architecture of the proposed method. (a) Explicit Prompt Decomposition and Feature-Gated Cross-Attention . The compositional text prompt is explicitly decoupled into independent concept and attribute tokens. Visual queries interact with the concept via standard cross-atte…
cs.AIarxiv:2605.15975v1Lead article

Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planning

Dillon Z. Chen, Till Hofmann, Toryn Q. Klassen, Sheila A. McIlraith

his paper proposes a bilevel policy approach for long-horizon planning in embodied AI. It combines low-level imitation learning for manipulation with high-level symbolic planning, creating a hierarchical system where a symbolic policy guides a neural policy. This method aims to overcome the limitations of pure imitation learning for complex, multi-step tasks.

Top Left – inputs for learning and executing bilevel policies: a domain theory 𝒟 \( \mathcal{D} \) , a labelling function ℒ \( \mathcal{L} \) that maps observations to state abstractions, and LL demos with HL goals. Bottom Left – bilevel policy learning: LL demos induce HL demos via ℒ \( \mathcal{L} \) , and LL/HL policies are separately learned from LL/HL demos. Right – bilevel policy execution: state abstractions s hl \( \mathit{s} \)^{\( \mathrm{hl} \)} are computed from observations 𝐬 ll \( \mathbf{s} \)^{\( \mathrm{ll} \)} via ℒ \( \mathcal{L} \) to propose HL actions a hl \( \mathit{a} \)^{\( \mathrm{hl} \)} which in turn help propose LL actions 𝐚 ll \( \mathbf{a} \)^{\( \mathrm{ll} \)} .
Top Left – inputs for learning and executing bilevel policies: a domain theory 𝒟 \( \mathcal{D} \) , a labelling function ℒ \( \mathcal{L} \) that maps observations to state abstractions, and LL demos with HL goals. Bottom Left – bilevel policy learning: LL demos induce HL demos…
cs.AIarxiv:2605.15963v1Lead article

PAGER: Bridging the Semantic-Execution Gap in Point-Precise Geometric GUI Control

Jingxuan Wei, Xi Bai, Shan Liu, Caijun Jia, Zheng Sun

AGER addresses the challenge of precise geometric control in GUI agents, where actions require pixel-level accuracy rather than region tolerance. Its core method involves a topology-aware agent that decomposes construction tasks into dependent steps, ensuring geometric correctness and robustness against cascading errors. The paper's contribution lies in introducing this novel agent and the PAGE Bench benchmark to evaluate and advance point-precise GUI interaction.

Precision-sensitive GUI tasks expose a capability gap hidden by conventional GUI benchmarks. In region-tolerant interaction, nearby pixels inside the same interface component lead to the same state transition. In precise geometric construction, an action targets a point on a continuous canvas; small coordinate errors alter geometric constraints and propagate through dependent objects.
Precision-sensitive GUI tasks expose a capability gap hidden by conventional GUI benchmarks. In region-tolerant interaction, nearby pixels inside the same interface component lead to the same state transition. In precise geometric construction, an action targets a point on a cont…
cs.AIarxiv:2605.16024v1Lead article

ScreenSearch: Uncertainty-Aware OS Exploration

Michael Solodko, Justin Wagle

creenSearch tackles the challenge of GUI agents exploring operating system states by addressing partial observability. Its core method combines structural screen retrieval and deduplication with an uncertainty-aware graph-bandit algorithm. The key contribution is a novel ambiguity signal that prioritizes exploring states where the same action leads to diverse outcomes, thereby improving exploration efficiency and reducing errors.

Complementary exploration signals: novelty expands coverage, while ambiguity reduction resolves aliased states before commitment.
Complementary exploration signals: novelty expands coverage, while ambiguity reduction resolves aliased states before commitment.
cs.AIarxiv:2605.19988v1Lead article

A Case for Agentic Tuning: From Documentation to Action in PostgreSQL

Hongyu Lin, Mingyu Li, Weichen Zhang, Yihang Lou, Mingjie Xing

his paper argues that traditional documentation-based system tuning is insufficient due to its static nature and lack of reasoning. It introduces PerfEvolve, a method that empowers LLM agents with executable skills to dynamically tune systems like PostgreSQL by verifying versions, profiling workloads, and optimizing parameters jointly. PerfEvolve significantly outperforms existing documentation-driven tuning methods.

Latency increase on TPC-H when applying PG-Official and PGTune rules (7 of 22 queries degraded by > > 10%). Both rule sets lead to worse latency on the same kinds of sort- and aggregation-intensive queries.
Latency increase on TPC-H when applying PG-Official and PGTune rules (7 of 22 queries degraded by > > 10%). Both rule sets lead to worse latency on the same kinds of sort- and aggregation-intensive queries.
cs.AIarxiv:2605.20049v1Lead article

Does Code Cleanliness Affect Coding Agents? A Controlled Minimal-Pair Study

Priyansh Trivedi, Olivier Schmitt

his paper investigates if code cleanliness impacts autonomous coding agents. Their core method uses "minimal pairs" of code repositories that are identical except for their structural and stylistic quality. The study found that while code cleanliness did not affect the agent's task completion rate, it significantly altered its operational footprint.

An example task in the benchmark, drawn from the genie pair. The agent reads an externally observable description (shown) and produces a code change that a hidden test suite, kept internal, exercises against the application’s public surface. This task asks the agent to add a structured failure-stage tag to Genie’s synchronous job-launch timer so that dashboards can attribute job-launch failures to a specific pipeline stage.
An example task in the benchmark, drawn from the genie pair. The agent reads an externally observable description (shown) and produces a code change that a hidden test suite, kept internal, exercises against the application’s public surface. This task asks the agent to add a stru…
cs.AIarxiv:2605.21470v1Lead article

Agent JIT Compilation for Latency-Optimizing Web Agent Planning and Scheduling

Caleb Winston, Ron Yifeng Wang, Azalia Mirhoseini, Christos Kozyrakis

his paper introduces agent Just-In-Time (JIT) compilation to significantly reduce latency in web agent planning and scheduling. The core method involves compiling natural language task descriptions into executable code, enabling parallelization and LLM calls within the compiled plan. The key contribution is a novel JIT-Planner and JIT-Scheduler system that optimizes for minimum cost and explores parallelization strategies, overcoming the slow sequential fetch-screenshot-execute loop of prior approaches.

Competing Approaches to Computer-Use Agents. Automation of web-based tasks has relied on static scripts (RPA; Barman et al. , 2016 ) and static tool sets (CUA; Wang et al. , 2025 ). Our work introduces dynamic cost-optimizing planning and scheduling with cached, reusable tools.
Competing Approaches to Computer-Use Agents. Automation of web-based tasks has relied on static scripts (RPA; Barman et al. , 2016 ) and static tool sets (CUA; Wang et al. , 2025 ). Our work introduces dynamic cost-optimizing planning and scheduling with cached, reusable tools.
§ III

Daily Issues This Month

2026-05-02 to 2026-05-31 30