From the arXiv
Tuesday, 29 September 2026 · 20 papers
ARISE: Adapting to Evolving Capability Gaps in Agentic Reinforcement Learning
ARISE addresses the challenge of evolving capability gaps in long-horizon reinforcement learning agents. Its core method, Adaptive Rubric-Skill Co-Evolution (ARISE), continuously adapts evaluation criteria and exploration strategies based on agent performance. This allows the agent to focus learning on emerging weaknes…
Continuous Context Management
This paper introduces Continuous Context Management (CCM) for LLM agents, which compacts interaction history at every turn instead of waiting for a threshold. This prevents the active prompt from growing excessively, significantly reducing input usage and prompt size. While CCM initially lowers task success for most mo…
KV-streams for Efficient Compaction in Agentic Reinforcement Learning
This paper introduces KV-streams, a novel method to improve the efficiency of context compaction in agentic reinforcement learning. Instead of repeatedly refilling the LLM's context, KV-streams stream the KV cache forward, significantly boosting training throughput (2.6-5x speedup) without compromising performance. Thi…
SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agents
This paper introduces SEABench, a novel benchmark designed to evaluate "endogenous misalignment" in self-evolving AI agents. The core method involves creating longitudinal task sequences in a personal assistant environment to observe how agents' self-modifications can lead to unsafe behavior over time, even without ext…
TokenCast: Forecasting Token Consumption During LLM Agent Execution
TokenCast addresses the unpredictable token consumption of LLM agents by learning a composable cost representation for execution segments. This method estimates future token usage by accounting for both segment-specific consumption and the context growth introduced, allowing for dynamic, real-time forecast updates with…
Rethinking Personalized Generation: Test-Time Alignment via Factorized Ranking Models
This paper proposes a test-time alignment method for personalized generation with LLMs. It argues that personalization is a candidate matching problem, not a generator limitation, and that existing reward models are ill-suited for this. The core contribution is a parameter-efficient framework using small MLP ranking mo…
ScAn-Bench: Evaluating Scaling Analysis Methodology
This paper introduces ScAn-Bench, a novel benchmark for evaluating methodologies used to derive scaling laws and optimal prescriptions for large foundation models. The authors systematically analyze data acquisition and extrapolation techniques across language and vision-language models, identifying a critical gap in c…
AutoRef: Harness Optimization for Agentic Multi-Reference Image Generation
This paper introduces AutoRef, a method to optimize the "harness" in agentic multi-reference image generation. AutoRef automatically tunes how reference images are processed and how generated outputs are evaluated to improve fidelity and naturalness. Its contribution lies in providing a systematic approach to enhance t…
BaRe-Mem: Bayesian Reliability Memory for Robust and Adaptive Agent Consultation
BaRe-Mem is a Bayesian memory system that estimates advisor reliability in multi-agent systems by analyzing the central model's beliefs and past interactions. This allows it to dynamically adjust the influence of advisor responses and decide whether to consult or reason autonomously, making it more robust to misleading…
Behavioral Foundation Models for Quality Diversity
This paper introduces BFM-QD, a framework that leverages the latent space of Behavioral Foundation Models (BFMs) for Quality-Diversity (QD) search. Instead of searching in high-dimensional policy parameters, BFM-QD efficiently discovers diverse and high-performing behaviors within a compact latent space. A key contribu…
Distillation Defenses Easily Break After Reinforcement Learning
This paper reveals that defenses against distillation attacks on large language models are often ineffective because they don't account for attackers further training their distilled models with reinforcement learning. This subsequent training significantly lowers the bar for attackers to steal advanced reasoning capab…
FactorEngram: Factorized N-gram Memory with Basis-Level Gating for Language Models
FactorEngram introduces a novel memory mechanism for language models that factorizes n-gram representations into shared basis vectors. This allows for more efficient parameter sharing and contextual gating at the basis level, enabling models to selectively retrieve relevant components of memory for polysemous patterns,…
Failure-Transparent Agents: Benchmarking Post-Failure Reporting in Tool-Using Language Models
This paper introduces Failure-Transparent Agents (FTA), a benchmark designed to isolate and evaluate how tool-using language models report failures. FTA controls for external factors, allowing direct auditing of post-failure claims by fixing the observed failure and required evidence. The contribution lies in providing…
MechBench: Can AI Scientific Agents Discover Mechanisms Beyond Phenomenal Laws?
This paper introduces MechBench, a new benchmark designed to evaluate AI scientific agents' ability to discover underlying mechanisms, not just observable laws. MechBench separates these capabilities by providing agents with observational data and context, then testing their understanding of internal scientific consequ…
Not All Thinking is Created Equal: Latent Reasoning Discovers a Recurrent Search Algorithm for Depth Generalization
This paper investigates whether different reasoning methods in LLMs share a common underlying mechanism. By training and comparing various models on a multi-hop reasoning task, they discover that models performing reasoning in latent space generalize better to out-of-distribution problems than those relying on explicit…
Reinforcing Agentic Creativity in Scientific Ideation with Night Science
This paper introduces AI Night-Scientist, a reinforcement learning framework designed to enhance LLM creativity in scientific ideation. It trains models to balance predictable "day science" with serendipitous "night science" by modeling creativity across action, process, and outcome. The core contribution is a method t…
Representation Alignment as a Bottleneck in LLM-Based Retrosynthesis Planning
This paper argues that the failure of LLMs in chemical retrosynthesis planning stems from forcing them to simultaneously handle chemical analysis and planning language structuring. Their core method decomposes retrosynthesis into distinct stages: molecule mapping, reaction mapping, and PDDL generation. This approach su…
RSI-Master: Structuring Experiments to Guide Autonomous Model Improvement
RSI-Master introduces a novel framework for autonomous AI model improvement by structuring experiments to prevent "hacking" and "strategy lock-in." It employs an "Experiment OS" for regularized actions and traceable records, alongside a "Reviewer-Guided Research Orchestration" system that dynamically organizes explorat…
Share-Borne AI Virus: Memory-Hopping Attacks Across LLM Agents
This paper introduces "artifact-mediated propagation," a novel attack where malicious content spreads between independent AI agents through shared persistent artifacts like documents. The core method involves an attacker injecting harmful data into an artifact, which is then stored, reproduced, and passed to subsequent…
Shockingly Simple Self-retrospection Improves Agentic Models Without RL
This paper introduces Retrospection-Only Fine-Tuning (ROFT), a novel method where language model agents improve by generating and learning from explanations of their own past actions, without external rewards or teachers. The core contribution is demonstrating that this "self-retrospection" alone, through next-token pr…