From the arXiv
Thursday, 6 August 2026 · 20 papers
Argus: A General-Purpose Agentic Runtime for Long-Horizon Reasoning
Argus provides a general-purpose agentic runtime for long-horizon reasoning by employing a persistent, self-evolving architecture. It separates user intent from operational details and uses a review process for all new components, allowing agents to persist when successful and pivot when facing issues. This approach si…
Hierarchical Graph Memory for LLM Agents with Path-level Localization and Rewrite
This paper introduces HiGram, a hierarchical graph memory for LLM agents designed for long-term reasoning. Its core method organizes memories into a coarse-to-fine structure, reducing irrelevant information and improving retrieval efficiency. HiGram's key contribution is this hierarchical organization and a novel path-…
OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling
This paper introduces OctoLong, a method for creating large, dependency-rich code contexts by recursively retrieving code references. They then use these contexts to mid-train open-source language models, resulting in OctoLong-Instruct, which demonstrates enhanced long-context modeling capabilities. The core contributi…
When Does Latent Communication Pay? A Causal Audit of Relayed KV Caches in Multi-Agent LLMs
This paper causally audits the claimed benefits of relaying key-value caches (instead of text) in multi-agent LLMs. The core method involves replacing the relayed cache with manipulated versions (deranged, zeroed, random) to isolate the cache's true impact. The contribution is demonstrating that relayed caches only pro…
State2State: Environment-Derived Mid-Training for LLM Agents
State2State is a novel mid-training method for LLM agents that addresses the limitations of supervised fine-tuning and traditional RL. Its core method involves converting explored environment states into training objectives, challenging agents to reach specific target states. This approach enables scalable and verifiab…
Skill-Use: Can LLMs Actually Use Skills in Agentic Harnesses?
This paper introduces Skill-Use, a benchmark to evaluate if LLM agents can effectively recognize and apply skills. The core method involves progressive disclosure, where agents must first retrieve a skill's full procedure based on its name and description before executing it. Skill-Use measures Trigger, Compliance, and…
A-SR: Self-Evolving Agentic LLMs for Symbolic Regression via Hierarchical Coordination
A-SR introduces a novel self-evolving agentic framework for symbolic regression that moves beyond single-prompt approaches. Its core method involves coordinating specialized LLM agents through role-conditioned evidence views and hierarchical coordination protocols, enabling more effective exploration of the search spac…
ABSeeker: Training Long-Horizon Search Agents via Answer-Backtracked Credit Assignment
ABSeeker trains long-horizon search agents by assigning credit at a finer, step-level rather than trajectory-level. Its core method, Answer-Backtracked Credit Assignment (ABC), recovers intermediate clues from the ground-truth answer to generate dense supervision. This allows the agent to learn which actions are truly …
Agentic Reinforcement Learning with Observation-Calibrated Self-Distillation
This paper introduces Observation-Calibrated Self-Distillation (OCSD) to improve reinforcement learning for large language model agents. OCSD addresses a limitation of prior methods by disentangling the influence of privileged information from the replay process itself. It achieves this by contrasting two replay views,…
ArtAnno: Annotating Implicit Semantics in Artworks through LLM Agent-Driven Bidirectional Human-AI Augmentation
ArtAnno introduces Bidirectional Human-AI Augmentation (BiHAA), a closed-loop framework for annotating implicit artwork semantics. It leverages a multi-agent LLM system where AI proactively suggests semantic labels and humans refine them, creating a continuous feedback loop that enhances both AI capabilities and human …
Chained Recursive Language Models for Multi-Iteration Reasoning
This paper introduces Chained Recursive Language Models (Chained RLM), an inference-time architecture that breaks down complex reasoning tasks into smaller, manageable steps. Instead of a single, long inference, Chained RLM repeatedly calls the same model with the original problem and context, but provides each new "re…
Gradient Immunity: Null-Space Resistance to Malicious Fine-Tuning
This paper introduces "Gradient Immunity" to defend against malicious fine-tuning of open-weight language models. Their core method, the Unidirectional Safety Gate (USG), uses a novel cubic layer to block harmful gradients and an inverse adapter to preserve normal model behavior. This approach protects safety-critical …
InsightEmb: Learning Action-Intent Embeddings for Agentic Insight Retrieval
This paper introduces InsightEmb, a novel method for agentic insight retrieval. Unlike previous approaches focusing on semantic similarity, InsightEmb learns embeddings that capture the "progress-oriented" nature of insights, meaning it retrieves insights that help an agent overcome its current decision-making challeng…
OPD-V: Visual On-Policy Self-Distillation with Modality Balance
This paper introduces OPD-V, a novel visual on-policy self-distillation method for multimodal large language models (MLLMs). It addresses the issue of modality imbalance, where text often dominates, hindering full multimodal integration. OPD-V leverages the concept of modality balance itself as privileged information, …
ORACLE: A Multi-Objective Reinforcement Learning-Based Analog Circuit Design Optimizer with Large Language Models-Guided Exploration
ORACLE is a novel reinforcement learning framework for analog circuit design that addresses the limitations of single-objective optimization and scalar reward reduction in multi-objective problems. It employs vector-valued learning and preference-aware conditioning, allowing users to specify desired trade-offs with a p…
Protoreasoning in Tiny Transformers
This paper introduces "protoreasoning," a simplified Chain of Thought method applied to tiny transformer models. By using reasoning-friendly tasks on Dyck languages, the authors demonstrate that these small models can learn to generalize better out-of-distribution when employing protoreasoning. This approach allows for…
Scrouting: Cost-Aware Routing of Coding Agents by Scouting the Repository First
This paper introduces SuperScout, a cost-aware routing method for coding agents. It first uses a "searcher" model to explore the software repository, identifying relevant information and verifying claims. This scouted information, along with the task description, then guides a "router" to select the most appropriate "f…
EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement
EvolveNet introduces a novel method for improving LLM agents by collaboratively evolving their "harness" (the program that manages context, tools, and execution). Instead of a single optimizer processing all experience, EvolveNet distributes harness evolution to local agent deployments. This allows each deployment to a…
Optimizing What Policies Learn From: Recoverability-aware Rollout Intervention Learning
This paper introduces Recoverability-Aware Intervention Learning (RAIL), a framework that optimizes how reinforcement learning policies learn from rollouts. Instead of uniform rollout allocation, RAIL dynamically selects and intervenes in rollouts based on their predicted learning improvement, treating it as an online …
SparseDitto: Customizing GPU Kernels for Different Sparsity Patterns with LLM-Based Agentic System
SparseDitto is an LLM-based system that automatically generates customized GPU kernels for sparse matrix operations. It addresses the performance variability of existing libraries by adapting the matrix representation, execution strategy, and hardware mapping to specific sparsity patterns and target GPUs. This approach…