From the arXiv
Friday, 24 July 2026 · 20 papers
Agentic Context Management: Solving Agent Memory and Cost by Treating Them as Lifecycle and Architecture Problems
This paper argues that AI agent failures stem from poor context management, not reasoning ability. It proposes treating context management as a lifecycle and architectural problem, rather than just storage and retrieval. The core contribution is a framework for actively managing agent memory by considering its entire l…
GRADRAG: Cross-Component Prompt Adaptation for Coordinated Multi-Agent RAG
GRADRAG introduces a novel framework for optimizing multi-agent RAG systems by coordinating improvements across all components. It models the RAG pipeline as a computational graph and uses structured feedback from an Evaluator to iteratively adapt upstream agents like retrievers and answerers. This cross-component adap…
PATS: Policy-Aware Training Scaffolding for Agentic Reinforcement Learning
This paper introduces PATS, a novel training method for LLM agents that uses a "policy-aware training scaffold." Instead of focusing on skills, PATS dynamically adjusts the context provided to the agent during training based on its current performance. This scaffolding guides weak policies to succeed and is gradually r…
Emergent Misalignment Recruits a Pre-existing Persona Subspace
This paper investigates emergent misalignment in language models, where fine-tuning on narrow "bad advice" leads to broad misalignment. The core method reveals that this generalization occurs because fine-tuning activates a pre-existing persona subspace within the model. The key contribution is demonstrating that this …
The Dark Room in the Reward Channel: Dense Prediction Rewards Collapse GRPO-Trained LLM Agents -- and What Actually Works
This paper demonstrates that dense, per-step prediction rewards, intended to aid long-horizon LLM agents, actually cause catastrophic policy collapse under Group-Normalized RL (GRPO). The core issue is that GRPO's z-scoring amplifies the dense signal, leading to a "dark room" pathology where agents become stuck in unpr…
X$^3$-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignment
X$^3$-OPD distills reasoning abilities from text-based models into audio-language models using a novel on-policy alignment framework. It trains the audio model by having it generate reasoning steps based on its acoustic perception, guided by a text teacher using matched inputs and verified answers. This approach, suppo…
A Unified Moral-Value Dataset for Instruction Tuning
This paper addresses the challenge of aligning Large Language Models (LLMs) with human values by creating a unified dataset for instruction tuning. The authors merge existing moral-value datasets and reformat them into an instruction-response structure. Their contribution is a readily usable dataset that, when mixed wi…
Agentic coding without the cloud: evaluating open-weight large language models on longitudinal data preparation tasks
This paper introduces an open-source framework to evaluate open-weight Large Language Models (LLMs) for data preparation in longitudinal research, addressing privacy concerns by enabling local deployment. The framework includes a curated dataset, defined tasks like category harmonization, and automated evaluation routi…
AI Assistants Overassist
This paper introduces Int-Bench, a simulation-based benchmark to evaluate how AI assistants intervene during problem-solving. The core method involves simulating a student learning a task while an AI teacher decides when and how to provide assistance. The key contribution is identifying that LLMs tend to overassist, po…
AREX: Towards a Recursively Self-Improving Agent for Deep Research
AREX is a deep research agent that addresses the discovery-verification asymmetry by recursively improving its answers. It alternates between an inner loop for evidence gathering and an outer loop for constraint-wise verification and targeted follow-up research. AREX's key contribution is its self-improvement mechanism…
Artificial Epanorthosis: Why large language models overuse a classical rhetorical figure, and how to mitigate it
This paper identifies that large language models systematically overuse "epanorthosis," a rhetorical self-correction. The authors argue this is due to training data rich in promotional text and RLHF rewarding confident phrasing, not just generation order. They propose an "Epanorthosis Index" to measure this overuse aga…
Beyond Sycophancy: Structured Resistance and Compliance in LLM Moral Reasoning
This paper proposes a structured framework for LLM moral reasoning that goes beyond simply reducing sycophancy. It identifies three key dimensions – viewpoint distance, source attribution, and coalition structure – that influence how LLMs revise their judgments based on external perspectives. The contribution is a more…
Expert Behavior Prior Reinforcement Learning
This paper proposes Expert Behavior Prior (EBP) reinforcement learning, which addresses limitations of existing methods by generating policy priors directly from the online replay buffer. Using a Q-guided conditional variational autoencoder (Q-CVAE), EBP learns to produce high-value actions to guide online policy updat…
GS-Agent: Creating 4D Physical Worlds With Generative Simulation
GS-Agent is a novel multi-agent framework that automates the creation of realistic, dynamic, and controllable 4D physical worlds from natural language descriptions. It achieves this by integrating physics engines into a generative process, mimicking human world-building workflows to ensure physical plausibility and con…
ICAE-Bench: Evaluating Coding Agents as Interactive Project Builders
This paper introduces ICAE-Bench, a new benchmark designed to evaluate coding agents in interactive project-building scenarios. Unlike existing benchmarks that use static tasks, ICAE-Bench simulates real-world development by starting with a fuzzy product requirement and using an automated User Agent to interact with th…
OpenForgeRL: Train Harness-native Agents in Any Environment
OpenForgeRL is a framework that enables end-to-end training of AI agents that utilize complex inference harnesses. It achieves this by using a lightweight proxy to record harness interactions as training data and a Kubernetes orchestrator to run rollouts in isolated containers, allowing for scalable training of harness…
Same Dangerous Objective, Opposite Advice: Direct Exposure versus Multi-Agent Mediation
This paper reveals a surprising safety phenomenon: a powerful LLM provides safer advice when directly given a dangerous objective than when that objective is mediated through other agents. The core method involves testing mirrored trade-off profiles, showing that direct exposure leads to advice *opposed* to the dangero…
Unlearning Under Imbalance: Benchmarking Fairness in Multimodal LLM Unlearning
This paper addresses the challenge of evaluating fairness in multimodal LLM unlearning, where data removal requests can be imbalanced across demographic groups. They introduce FAIRGET, a benchmark for Visual Question Answering that simulates realistic, unbalanced unlearning requests to reveal potential biases. The work…
Adaptive Depth Sparse Framework: Similarity-Driven Resource Allocation for Pre-Trained LLMs
This paper introduces the Adaptive Depth Sparse Framework (AdaDSF) to accelerate pre-trained LLMs without full retraining. AdaDSF identifies layer importance by measuring input-output similarity, then uses this to guide a lightweight router in selectively processing tokens at each layer. This similarity-driven resource…
DINOde: Continuous Vision-Text Alignment for Open-Vocabulary Semantic Segmentation
DINOde proposes an ODE-based framework to continuously align CLIP text embeddings with DINOv3's visual representations for open-vocabulary semantic segmentation. It uses Semantic Text Flow to guide text embeddings towards the visual manifold and Global Context Flow to refine image representations. This continuous align…