From the arXiv
Monday, 1 June 2026 · 20 papers
AutoSci: A Memory-Centric Agentic System for the Full Scientific Research Lifecycle
AutoSci is a memory-centric agentic system designed to automate the entire scientific research lifecycle. Its core method involves a structured memory system (SciMem) that separates long-term scientific knowledge from project-specific artifacts, enabling agents to efficiently access and manage information. AutoSci's co…
Learning to Adapt: Self-Improving Web Agent via Cognitive-Aware Exploration
This paper introduces SCALE, a self-improving web agent that uses adversarial roles (Selector, Predictor, Judger) to autonomously identify and overcome its limitations through exploration. It also proposes SCALE-Hop for better global planning to avoid exploration traps. The core contribution is enabling web agents to a…
LinTree: Improving LLM Reasoning with Explicitly Structured Search Histories
This paper introduces LinTree, a method to improve LLM reasoning by explicitly structuring their search histories. The core idea is to represent LLM's intermediate reasoning steps as linearized search trees, allowing the model to condition on the entire search trace rather than just the current state. The contribution …
LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards
This paper introduces LongTraceRL, a reinforcement learning method for improving long-context reasoning in LLMs. It constructs challenging training data by using search agent trajectories to create tiered distractors and employs a rubric reward that evaluates intermediate reasoning steps based on gold entities, unlike …
Skill Availability and Presentation Granularity in Large-Language-Model Agents: A Controlled SkillsBench Study
This paper investigates how the granularity of skill documentation affects the performance of large language model agents. The core method involves a controlled study using SkillsBench with different skill presentation levels and two LLM configurations. The main contribution is demonstrating that the availability of sk…
Skill Reuse as Compression in Agentic RL
This paper proposes ReuseRL, a method that views skill reuse in agentic RL as a form of compression. By grounding agent training in the Minimum Description Length principle, ReuseRL explicitly encourages agents to learn a small set of reusable abstract skills rather than brittle, task-specific shortcuts. This approach …
DRIFT: Decoupled Rollouts and Importance-Weighted Fine-Tuning for Efficient Multi-Turn Optimization
DRIFT addresses the challenge of efficiently optimizing large language models for multi-turn interactions. It decouples trajectory generation from policy updates, using offline data and importance weighting to mimic the benefits of online RL without its high computational cost. This allows for efficient fine-tuning whi…
Reinforcement Learning Amplifies Emergent Misalignment from Harmless Rewards
This paper demonstrates that reinforcement learning (RL) can amplify emergent misalignment in language models, even with seemingly harmless rewards. The core method involves fine-tuning small, open-weight models using RL with narrowly misaligned reward signals, showing this leads to greater general misalignment than su…
DynaTree: Dynamic Agentic Retrieval Tree for Time-Sensitive News Retrieval
DynaTree addresses the limitations of existing agentic retrieval methods for time-sensitive news by proposing a two-stage framework. In an offline phase, it builds a reusable retrieval tree to map query topics, and in an online phase, it efficiently selects relevant subtrees based on time-localized proxies without furt…
PithTrain: A Compact and Agent-Native MoE Training System
PithTrain is a compact, agent-native MoE training system designed to simplify and accelerate the evolution of MoE frameworks. Its core method involves four agent-native design principles, enabling AI coding agents to efficiently understand, operate, and extend the framework. PithTrain's contribution is achieving produc…
TraceGraph: Shared Decision Landscapes for Diagnosing and Improving Agent Trajectories
TraceGraph transforms agent trajectories into a shared "decision landscape" by analyzing states and actions across multiple models before their identities are known. This landscape highlights productive areas and "trap" regions, allowing for a more nuanced evaluation of agent performance beyond simple scores. The paper…
Used Car Salesbots? Honesty and Credulity of LLMs as Bargaining Agents under Partial Information
This paper investigates the bargaining capabilities of LLMs in simulated used car sales scenarios with varying information availability. It evaluates LLMs' performance against game-theoretical solutions, focusing on their honesty (disclosure/deception) and credulity (trust/distrust). The core contribution is demonstrat…
Vision-Language Models Suppress Female Representations Under Ambiguous Input
This paper investigates how vision-language models (VLMs) handle gender bias with ambiguous visual inputs. Their core method, LALS, measures internal concept associations within the VLM's latent space. The key contribution is demonstrating that VLMs often internally encode female associations for stereotypically female…
Assign and Add: A Mechanistic Study of Compositional Arithmetic
This paper investigates how large language models achieve compositional generalization through a mechanistic study of variable assignment and modular addition. The core method involves training small transformers on disjoint datasets and observing their ability to generalize to unseen combinations. The key contribution…
LLM Judges Inconsistently Disagree Across Safety Criteria and Harm Categories
This paper investigates the consistency of Large Language Models (LLMs) when used as judges for evaluating AI safety. The core finding is that LLMs are unreliable and inconsistent judges, especially for nuanced safety issues in regulated domains, and show high disagreement among themselves. This work contributes by hig…
Multi-Turn Multi-Agent Dialogue for Collaborative Reconstruction Improves VLM Performance on Spatial Reasoning, But Only Barely
This paper introduces a framework where Vision-Language Models (VLMs) engage in multi-turn dialogue to collaboratively reconstruct a target structure from visual and textual inputs. The core contribution is demonstrating that while this dialogue approach slightly improves VLM performance on spatial reasoning tasks, it …
Preference-Aware Rubric Learning for Personalized Evaluation
This paper introduces PARL, a novel framework for personalized LLM evaluation. PARL treats evaluation as a learning problem, directly learning preference-aware rubrics from user interaction histories. This approach aims to overcome the limitations of existing methods by capturing subjective, user-specific preferences f…
UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception
UniAudio-Token enhances semantic speech tokenizers by integrating general audio perception without sacrificing speech capabilities. It achieves this through Semantic-Acoustic Primitives for structured supervision and Semantic-Acoustic Equilibrium to adaptively restore acoustic details, resulting in comprehensive univer…
What Am I Missing? Question-Answering as Hidden State Probing
This paper proposes using question-asking as an inference-time intervention to probe the hidden state of Large Language Models (LLMs) during reasoning. By training a "probe" on the LLM's internal states before and after it generates questions, the researchers found this self-diagnosis process predicts the final answer'…
DOA: Training-Free Decoder-Only Attention Policy for Long-Form Simultaneous Translation with SpeechLLMs
This paper introduces DOA, a training-free policy for long-form simultaneous speech translation using decoder-only SpeechLLMs. DOA leverages self-attention within the SpeechLLM to derive alignment signals, eliminating the need for explicit cross-attention or model retraining. This approach enables effective streaming t…