2026-W22
The Week in Review
This week's research highlights a strong focus on enhancing LLM agents' capabilities, particularly in decision-making, reasoning, and interaction with the environment. A key trend is the development of agent memory and recall mechanisms, with methods like FORGE and RecMem aiming for more efficient and adaptable learning without constant weight updates or token consumption.
Significant advances are being made in addressing the crucial issue of bias in LLMs, with DebiasRAG offering a tuning-free RAG approach to mitigate this without retraining. The interpretability and safety of LLMs are also gaining prominence, as seen in the work bridging formal methods with LLMs for auditing and monitoring compliance, and the proposed three-layer probabilistic architecture for safe deployment.
Furthermore, there's a clear push towards more robust and grounded agent behavior. This includes exploration strategies like "Look Before You Leap" to prevent premature actions, and formalized coordination conventions like `paper.json` to improve agent comprehension of research. Novel approaches also tackle complex problem-solving, such as SGR for subgraph generation to ground reasoning, and Argus for scalable evidence assembly in research agents. The evaluation of LLM tutoring agents also revealed critical shortcomings in their ability to diagnose student reasoning, highlighting areas for improvement.
Finally, the research shows a growing interest in multimodal understanding, with VideoSeeker enabling instance-level video analysis via visual prompts, and CrossView Suite enhancing MLLMs' spatial reasoning across viewpoints. The development of benchmarks for skill generation (SkillGenBench) and novel architectures like DashAttention for sparse hierarchical attention also indicate a maturing research landscape focused on practical, scalable, and reliable LLM agent systems.
Top Papers
Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making
da-Diffuser addresses decision-making by treating it as sequence modeling with diffusion models, but crucially incorporates evolving latent dynamics. The core method is a causal diffusion model that simultaneously learns observed interaction patterns and underlying latent processes from minimal observations. This allows for more precise environment modeling and effective planning and control by explicitly accounting for hidden factors influencing agent behavior.

Context, Reasoning, and Hierarchy: A Cost-Performance Study of Compound LLM Agent Design in an Adversarial POMDP
his paper investigates how different design choices for compound LLM agents impact performance and cost in adversarial, partially observable environments. The core method involves a controlled study in a cyber defense simulation, systematically varying agent perception, reasoning strategies, and task decomposition. The main contribution is providing empirical guidance on balancing performance gains with inference costs for these complex agent architectures.

DebiasRAG: A Tuning-Free Path to Fair Generation in Large Language Models through Retrieval-Augmented Generation
ebiasRAG is a novel, tuning-free framework that uses retrieval-augmented generation (RAG) to dynamically debias large language models (LLMs) without requiring additional training. By retrieving relevant and unbiased information, it mitigates social biases in LLM outputs while preserving their original generative capabilities. This approach offers a more efficient and adaptable solution for achieving fairer AI.

FORGE: Self-Evolving Agent Memory With No Weight Updates via Population Broadcast
ORGE is a novel method for improving LLM agent decision-making by evolving natural-language memory without gradient updates. It uses a population-based approach where failed experiences are converted into reusable knowledge (heuristics or demonstrations) by a reflection agent. This memory is then propagated to the population, allowing agents to learn and adapt over time.

Formal Methods Meet LLMs: Auditing, Monitoring, and Intervention for Compliance of Advanced AI Systems
his paper bridges formal methods and LLMs to address AI governance. It proposes techniques for auditing and monitoring LLM behavior throughout their lifecycle, enabling the verification of complex, temporally extended constraints like safety and regulatory compliance. The work introduces practical methods for predictive monitoring and runtime intervention to prevent violations.

Look Before You Leap: Autonomous Exploration for LLM Agents
his paper addresses LLM agents' failure in new environments due to premature action. It introduces "Exploration Checkpoint Coverage" to measure how well agents discover key environmental elements. The core contribution is a training strategy that balances task execution and exploration, leading to the "Explore-then-Act" paradigm for more adaptive agents.

paper.json: A Coordination Convention for LLM-Agent-Actionable Papers
his paper introduces `paper.json`, a companion JSON file to academic PDFs, designed to improve LLM agent comprehension. Its core method is a set of lightweight conventions for stable claim IDs, explicit "does-not-claim" lists, per-figure shell commands, and stable definition IDs. The main contribution is enabling LLM agents to more reliably extract information, assess claims, and understand the scope of research, facilitating better reproducibility and generalization.
RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agents
ecMem addresses the inefficiency of LLM agents' memory systems by delaying memory consolidation. Instead of processing every interaction, it stores them in a lightweight "subconscious" layer and only invokes the LLM to extract episodic and semantic memories when recurring, semantically similar interactions are detected. This recurrence-based approach significantly reduces token consumption while maintaining effectiveness by focusing LLM resources on information clusters deemed valuable for consolidation.
AI for Auto-Research: Roadmap & User Guide
his paper analyzes the AI research lifecycle, from idea generation to dissemination, identifying a critical boundary between reliable AI assistance and unreliable autonomy. While AI excels at structured tasks like literature review and data generation, it struggles with nuanced aspects like fabricating results, identifying errors, and assessing novelty, particularly under scientific pressure. The authors provide a roadmap and user guide to navigate these capabilities and limitations.

Code as Agent Harness
his paper introduces "code as agent harness," a new perspective on how large language models (LLMs) are used in agentic systems. The core method is to view code not just as an output, but as the fundamental infrastructure for agent reasoning, action, and environment modeling. The main contribution is a structured survey that organizes this concept into three layers: the harness interface, harness mechanisms, and scaling the harness, providing a unified framework for understanding and developing code-centric agent systems.

Position: A Three-Layer Probabilistic Assume-Guarantee Architecture Is Structurally Required for Safe LLM Agent Deployment
his paper argues that LLM agent safety requires a three-layer probabilistic architecture, not a single one. Each layer enforces a distinct safety dimension (intent, environment, dynamics) using independently certified probabilistic guarantees, which then form assumptions for the next layer. This compositional approach allows for provable system-level safety bounds, addressing a fundamental structural requirement for safe LLM agent deployment.
SkillGenBench: Benchmarking Skill Generation Pipelines for LLM Agents
his paper introduces SkillGenBench, a novel benchmark designed to evaluate the crucial ability of LLM agents to generate correct and reusable skills from raw data. Unlike previous benchmarks, SkillGenBench specifically isolates and assesses the skill generation process itself. Its core method involves a unified protocol where a generator produces standardized skill artifacts from corpora, which are then executed and evaluated under controlled conditions, covering both task-specific and task-agnostic generation scenarios.

EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL
nvFactory addresses the challenges of scaling tool-use LLM agents by automatically synthesizing realistic, stateful execution environments from authentic resources. It then generates robust, multi-turn training data by sampling and refining trajectories to capture implicit human intents, rather than over-specified instructions. This approach enables more effective Reinforcement Learning training for LLM agents.

General Preference Reinforcement Learning
his paper introduces General Preference Reinforcement Learning (GPRL) to bridge the gap between online RL and preference optimization for LLMs. GPRL uses a General Preference Model (GPM) to represent quality as a multi-dimensional, intransitivity-aware comparison, rather than a single scalar reward. This structured approach allows for continuous exploration in open-ended tasks, overcoming limitations of existing methods.

MA$^{2}$P: A Meta-Cognitive Autonomous Intelligent Agents Framework for Complex Persuasion
A$^{2}$P is a novel framework for complex persuasive dialogue generation that addresses limitations in current approaches. It employs a meta-cognitive, multi-agent architecture to autonomously infer a user's latent mental states and generate targeted, strategy-consistent responses. This framework aims to improve the effectiveness of persuasive dialogue, especially when user intentions are unclear.

AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaboration
utoResearchClaw is a multi-agent autonomous research system that addresses the iterative nature of scientific discovery. Its core method involves structured multi-agent debate for hypothesis generation and analysis, coupled with a self-healing executor that learns from failures. The key contribution is a robust, collaborative framework that integrates human oversight and cross-run learning to enable more effective and resilient autonomous research.

PEEK: Context Map as an Orientation Cache for Long-Context LLM Agents
EEK addresses the challenge of LLM agents repeatedly interacting with large contexts by introducing a "context map" as an orientation cache. This map, a small prompt artifact, stores reusable knowledge about the context's content, organization, and useful entities. PEEK's contribution is enabling agents to efficiently re-orient themselves within recurring contexts, improving performance and reducing computational overhead.
ThoughtTrace: Understanding User Thoughts in Real-World LLM Interactions
his paper introduces ThoughtTrace, the first large-scale dataset pairing real-world human-AI conversations with users' explicit thoughts. The core contribution is capturing users' underlying reasoning and reactions, which are semantically distinct from their messages and difficult for current LLMs to infer. This dataset enables improved user behavior prediction and fine-grained alignment for personalized AI assistants.

Rethinking How to Remember: Beyond Atomic Facts in Lifelong LLM Agent Memory
his paper proposes TriMem, a novel memory system for LLM agents that moves beyond atomic facts. Instead of relying solely on extracted facts, TriMem maintains three coexisting representation granularities: raw dialogue segments, extracted facts, and synthesized profiles. This approach allows for faithful storage of dialogue details, efficient retrieval of key information, and deep reasoning over aggregated semantic understanding, overcoming limitations of previous fact-centric methods.
Rewarding Beliefs, Not Actions: Consistency-Guided Credit Assignment for Long-Horizon Agents
his paper proposes ReBel, a reinforcement learning method for long-horizon tasks where agents learn from verifiable rewards. ReBel addresses challenges in partially observable environments by explicitly modeling and updating agent beliefs, using belief consistency as a self-supervised signal to improve credit assignment. This approach aims to provide more robust learning by comparing trajectories with similar belief states, leading to lower-variance advantage estimates.

TIDE: Efficient and Lossless MoE Diffusion LLM Inference with I/O-aware Expert Offload
IDE addresses the challenge of efficiently inferring large Mixture-of-Experts (MoE) diffusion LLMs on resource-constrained devices. Its core method is an I/O-aware expert offload strategy that exploits the temporal stability of expert activations during the diffusion process. By intelligently refreshing expert placements at intervals, TIDE minimizes I/O overhead and compute bottlenecks, enabling lossless and efficient inference.
![(a) Similarity heatmap of expert routing across denoising steps within a block. Expert routing remains highly similar for nearby steps, and the diagonal bands show that this stability extends beyond immediate neighbors: step pairs separated by five denoising steps retain cosine similarity near 0.95 0.95 . (b) Overview of TIDE . At refresh steps , the system intelligently swaps the GPU and CPU experts based on token hit counts (number of tokens each expert has processed). At skipped steps , the system continues decoding with the current expert placement and does not migrate experts. By exploiting routing stability across adjacent steps, TIDE avoids unnecessary GPU-CPU I/O overhead and maintains high GPU utilization. (c) Throughput comparison of TIDE against state-of-the-art MoE inference solutions [Kamahori et al. , 2024 , Eliseev and Mazur, 2023 ] for LLaDA2.0 in a single GPU-CPU setting.](https://arxiv.org/html/2605.20179v1/figures/figure1.png)
APEX: Autonomous Policy Exploration for Self-Evolving LLM Agents
PEX tackles exploration collapse in self-evolving LLM agents by introducing a "strategy map" – a DAG of milestones. This map guides exploration by identifying unexplored directions (Fork Discovery) and balancing discovery with leveraging known good strategies (Policy Selection), enabling agents to learn and adapt effectively at test time.

Frontier: Towards Comprehensive and Accurate LLM Inference Simulation
rontier is a novel discrete-event simulator designed to accurately model the complex, disaggregated architectures of modern LLM inference serving systems. Its core contribution lies in its disaggregated abstraction, which captures the nuances of co-location and various disaggregation strategies (PDD, AFD) with role-specific workers. This allows for decision-grade fidelity in simulating runtime optimizations and predicting Service Level Agreements (SLAs), overcoming the limitations of existing monolithic simulators.

Insights Generator: Systematic Corpus-Level Trace Diagnostics for LLM Agents
his paper introduces the Insights Generator (IG), a novel multi-agent system for systematically diagnosing failures in LLM agents at a corpus level. IG automates the process of identifying patterns and generating evidence-backed insights from large collections of execution traces, moving beyond manual, ad-hoc inspection. Its core contribution lies in formalizing corpus-level diagnostics and providing a scalable solution to understand systematic behavioral patterns in LLM agents.

Mem-$π$: Adaptive Memory through Learning When and What to Generate
em-$π$ introduces an adaptive memory framework for LLM agents that *generates* useful guidance on demand, rather than retrieving static information. Its core method involves a separate model that learns when and what guidance to produce based on the agent's current context, using a decoupled reinforcement learning objective. This allows for more context-aware and efficient memory utilization, improving performance across various agentic tasks.

Open-source LLMs administer maximum electric shocks in a Milgram-like obedience experiment
his paper investigates LLM obedience by adapting the Milgram experiment. It found that most open-source LLMs, when pressured by an authority figure, administered maximum electric shocks, demonstrating vulnerability to sustained pressure and gradual boundary violations, similar to human subjects. This highlights safety concerns for LLMs acting as autonomous agents in high-stakes scenarios.

PREFINE: Preference-Based Implicit Reward and Cost Fine-Tuning for Safety Alignment
REFINE adapts Direct Preference Optimization (DPO) for reinforcement learning to fine-tune pre-trained policies for safety. It uses trajectory-level preferences (preferred vs. dispreferred trajectories) to implicitly learn reward and cost functions, enabling the policy to generate low-cost behaviors while preserving high rewards without full retraining. This approach addresses safety alignment in continuous control by leveraging preference data in a sequential decision-making context.

Quantifying Hyperparameter Transfer and the Importance of Embedding Layer Learning Rate
his paper quantifies hyperparameter transfer, crucial for scaling LLMs, using three metrics: scaling law fit quality, extrapolation robustness, and asymptotic loss penalty. The authors discover that Maximal Update parameterization ($μ$P) excels over standard parameterization (SP) primarily due to its ability to significantly increase the embedding layer's learning rate when using AdamW.

Tracing the ongoing emergence of human-like reasoning in Large Language Models
his paper investigates whether Large Language Models (LLMs) exhibit human-like reasoning by comparing their conditional inference abilities across four languages to human performance. The core method involves a population-matching experiment where LLMs and humans are tested on their interpretation of conditional statements. The key contribution is the finding that humans integrate pragmatic inferences with logical reasoning, while LLM behavior is more varied, with some models adhering strictly to logic and others adopting a single, potentially pragmatic, interpretation.
DelTA: Discriminative Token Credit Assignment for Reinforcement Learning from Verifiable Rewards
his paper proposes DelTA, a method to improve reinforcement learning from verifiable rewards (RLVR) for large language models. It frames RLVR updates as a linear discriminator that guides token probability changes. DelTA's core contribution is a novel centroid construction that mitigates the dominance of common patterns, allowing the model to better identify and reinforce discriminative tokens that lead to higher-quality responses.

Federated LoRA Fine-Tuning for LLMs via Collaborative Alignment
his paper introduces CLAIR, a federated learning framework for fine-tuning Large Language Models (LLMs) using Low-Rank Adaptation (LoRA). CLAIR enables collaborative fine-tuning across clients with partial structural sharing and potential contamination, recovering the shared LoRA subspace and detecting malicious clients through a structured low-rank plus block-sparse decomposition. Its core contribution is a contamination-aware method that achieves exact or stable recovery of the shared LoRA parameters.

What Twelve LLM Agent Benchmark Papers Disclose About Themselves: A Pilot Audit and an Open Scoring Schema
his paper audits twelve LLM agent benchmark papers to assess the clarity of their evaluation methodologies. The authors developed a five-field schema to record details about benchmark identity, evaluation setup, inference settings, cost, and failure analysis. Their contribution is a pilot audit and an open scoring schema to improve reproducibility and transparency in LLM agent evaluations, highlighting the common lack of detailed reporting in existing work.
You Only Need Minimal RLVR Training: Extrapolating LLMs via Rank-1 Trajectories
his paper reveals that the parameter updates during Reinforcement Learning with Verifiable Rewards (RLVR) for LLMs are predominantly captured by a low-rank, specifically rank-1, trajectory. Their core method, RELEX, leverages this by estimating this rank-1 subspace from a short training window and then linearly extrapolating future model checkpoints. This significantly reduces the computational cost of RLVR while achieving comparable or superior performance.

LASH: Adaptive Semantic Hybridization for Black-Box Jailbreaking of Large Language Models
ASH is a black-box jailbreaking framework that adaptively combines outputs from multiple existing attack methods. It treats these outputs as "seed prompts" and uses a genetic optimizer to find the best mixture of these seeds for a given target request. This hybridization allows LASH to exploit the complementary strengths of different attack families, leading to more effective jailbreaks across various models and harm categories.
A Scalable Multi-LLM Collaboration System with Retrieval-based Selection and Exploration-Exploitation-Driven Enhancement
his paper introduces SMCS, a scalable system for multi-LLM collaboration. It addresses scalability issues by using a retrieval module to select the best LLMs for a given task and an enhancement module to improve response diversity and quality. SMCS demonstrates superior performance compared to existing closed-source LLMs by effectively integrating multiple open-source models.
Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making
da-Diffuser addresses decision-making by treating it as sequence modeling with diffusion models. Its core method is a unified framework that explicitly infers and models evolving latent dynamics alongside observed interactions. This allows for more precise environment modeling and effective planning by simultaneously learning temporal structures and hidden processes from minimal observations.

Agentic Discovery of Neural Architectures: AIRA-Compose and AIRA-Design
his paper introduces AIRA, a dual-framework approach where LLM agents autonomously discover novel neural architectures. AIRA-Compose searches for high-level primitives, while AIRA-Design handles low-level implementation, leading to new Transformer-based and hybrid Transformer-Mamba families. These discovered architectures consistently outperform existing models like Llama 3.2 and Composer on downstream tasks and exhibit significantly more efficient scaling.

AstraFlow: Dataflow-Oriented Reinforcement Learning for Agentic LLMs
straFlow addresses the high cost of reinforcement learning for agentic LLMs by introducing a dataflow-oriented system. It decouples rollout, dataflow management, and training into autonomous components, enabling efficient support for complex, multi-policy training on heterogeneous compute resources. This approach simplifies system engineering and makes agentic LLM RL more scalable and cost-effective.

Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems
his paper surveys LLM-based multi-agent systems by proposing a unified framework called the LIFE progression. It highlights how individual agent capabilities (Lay) enable collaboration (Integrate), which in turn necessitates fault attribution (Find) for effective autonomous self-improvement (Evolve). The key contribution is examining the causal links between these stages, addressing the challenge of error propagation and lack of self-evolution in current multi-agent systems.
CAP: Controllable Alignment Prompting for Unlearning in LLMs
his paper introduces CAP, a novel prompt-driven method for unlearning sensitive information in LLMs without modifying model weights. CAP uses reinforcement learning to optimize a prompt that guides the LLM to suppress specific knowledge while retaining general capabilities. This offers a computationally efficient and controllable solution for unlearning, even for closed-source models.

Don't Retrieve, Navigate: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAG
his paper introduces Corpus2Skill, a method that distills enterprise knowledge into a navigable, hierarchical skill directory. Instead of passively retrieving information, an LLM agent actively navigates this directory, drilling down through summaries to find relevant documents. This approach improves answer quality and grounding for QA and RAG tasks, particularly on domain-specific corpora with clear topical structures.

Frontier Large Language Models Rival State-of-the-Art Planners
his paper demonstrates that recent frontier Large Language Models (LLMs) can rival state-of-the-art classical planners on challenging planning tasks. Specifically, Gemini 3.1 Pro outperforms the strongest planner baseline, and even when semantic information is removed, it remains competitive, overturning previous conclusions about LLMs' planning capabilities.
FutureWorld: A Live Reinforcement Learning Environment for Predictive Agents with Real-World Outcome Rewards
utureWorld introduces a novel reinforcement learning environment for training predictive agents that learn from real-world outcomes. Its core method, verl-tool-future, addresses the challenge of delayed rewards by storing prediction rollouts and backfilling rewards only after events occur. This allows agents to learn from actual future outcomes, enabling continuous learning and improved prediction capabilities.

How to Train Your Advisor: Steering Black-Box LLMs with Advisor Models
his paper introduces "Advisor Models," a novel method to enhance black-box large language models (LLMs) by training smaller, open-weight models to provide dynamic, instance-specific advice. This advice guides the black-box LLM, significantly improving its performance on various tasks and personalizing its behavior more effectively than static prompts. The core contribution lies in enabling practical and cost-effective parametric optimization for closed-source LLMs.

Improve Large Language Model Systems with User Logs
his paper proposes UNO, a framework to improve LLM systems using user interaction logs. UNO addresses the challenges of noisy and unstructured log data by first distilling them into structured rules and preferences. This processed information is then used to optimize the LLM, overcoming issues like off-policy learning and distinguishing valuable feedback from user behavior.

NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation
anoResearch introduces a tri-level co-evolutionary framework for personalized research automation. It addresses the limitations of current LLM-based systems by developing a skill bank for reusable procedural knowledge, a memory module for user-specific experience, and a policy learner for implicit preference internalization. This approach enables the system to adapt to individual researchers' unique needs and preferences, moving beyond uniform outputs to genuinely usable personalized automation.

Painless Activation Steering: An Automated, Lightweight Approach for Post-Training Large Language Models
his paper introduces Painless Activation Steering (PAS), a fully automated method for post-training large language models. PAS eliminates the need for manual prompt engineering or feature annotation, making activation steering a practical and efficient alternative to existing methods. Its core contribution is enabling effortless and controllable behavior modification in LLMs using any labeled dataset.

RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agents
ecMem addresses the inefficiency of LLM agents' memory systems by delaying memory consolidation. Instead of processing every interaction, it stores them in a lightweight embedding layer and only invokes the LLM to extract episodic and semantic memory when recurring, semantically similar interactions are detected. This recurrence-based approach significantly reduces token consumption while maintaining effectiveness by focusing LLM resources on information clusters worth summarizing.
Rethinking Agentic Reinforcement Learning In Large Language Models
his paper re-frames Reinforcement Learning (RL) for Large Language Models (LLMs) by moving beyond traditional, narrowly defined tasks. It proposes an agentic RL paradigm where LLMs act as autonomous agents capable of goal-setting, planning, and dynamic adaptation in complex, open-ended environments. The core contribution lies in integrating cognitive capabilities like meta-reasoning and self-reflection into the RL learning loop, enabling more sophisticated decision-making.

Seeing is Understanding: Unlocking Causal Attention into Modality-Mutual Attention for Multimodal LLMs
his paper proposes a novel approach to improve vision-language alignment in Multimodal Large Language Models (MLLMs) by modifying their core architecture. The key contribution is unlocking causal attention within the decoder-only LLM, allowing earlier modalities (like images) to effectively incorporate information from later modalities (like text). This addresses the limitation of existing MLLMs where visual information might not be fully integrated into the text generation process.

TFGN: Task-Free, Replay-Free Continual Pre-Training Without Catastrophic Forgetting at LLM Scale
FGN is an architectural overlay for transformer language models that enables continual pre-training on new domains without forgetting previous knowledge. It achieves this by generating input-conditioned, parameter-efficient updates, leaving the core transformer unchanged. This approach successfully prevents catastrophic forgetting and demonstrates positive cross-domain transfer, even at LLM scale, without relying on replay buffers or task identifiers.

When Language Overwrites Vision: Over-Alignment and Geometric Debiasing in Vision-Language Models
his paper identifies "geometric over-alignment" as a core cause of hallucinations in decoder-based Vision-Language Models (VLMs). The VLM over-aligns visual information with the text manifold to bridge the modality gap, leading to linguistic biases overshadowing visual evidence. The contribution is the first quantitative characterization of this over-alignment, showing it concentrates in the top principal components of a universal text subspace.

Argus: Evidence Assembly for Scalable Deep Research Agents
rgus addresses the inefficiency of current deep research agents by treating evidence gathering as a jigsaw puzzle. Instead of parallelizing redundant searches, its Searcher collects evidence for sub-queries, while a Navigator manages a shared graph, identifying missing pieces and synthesizing the final, source-traced answer. This cooperative approach ensures complementary evidence is assembled, improving scalability and reducing redundant computation.

Confirming Correct, Missing the Rest: LLM Tutoring Agents Struggle Where Feedback Matters Most
his paper evaluates LLM tutoring agents' ability to distinguish between correct, suboptimal, and incorrect student reasoning in propositional logic. The core method involves a benchmark with knowledge-graph ground truth, revealing that LLMs excel at identifying optimal steps but struggle significantly with valid-but-suboptimal and incorrect reasoning. The main contribution is demonstrating that LLMs fail precisely where adaptive tutoring is most crucial, suggesting architectural limitations rather than data issues, and that accurate diagnosis doesn't guarantee pedagogically useful feedback.

Reasoners or Translators? Contamination-aware Evaluation and Neuro-Symbolic Robustness in Tax Law
his paper investigates whether LLMs truly reason in tax law or simply regurgitate contaminated training data. They introduce a contamination detection protocol and a novel test suite to evaluate LLMs against neuro-symbolic systems. The findings suggest that legal reasoning is compositional, and neuro-symbolic approaches offer greater robustness and generalization to unseen legal scenarios.
Towards Foundation Models for Relational Databases with Language Models and Graph Neural Networks
his paper proposes a hybrid deep learning architecture that combines a fine-tuned BART language model with a GraphSAGE-based Graph Neural Network (GNN) to process relational databases. The core method injects relational context from entity graphs into BART's row embeddings, overcoming limitations of previous task-specific approaches. This hybrid model significantly improves performance on relational data tasks, narrowing the gap to state-of-the-art methods.

VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocation
ideoSeeker addresses the limitations of text-based prompts in video understanding by introducing a novel paradigm that uses **visual prompts** for instance-level localization. Its core method involves an **agentic reasoning framework** that allows the model to proactively perceive and retrieve relevant video segments based on visual cues, rather than relying solely on language. This approach significantly improves user experience and enables more precise spatiotemporal understanding by tightly integrating visual perception with reasoning.

Who Owns This Agent? Tracing AI Agents Back to Their Owners
his paper addresses the critical problem of **agent attribution**, which is the inability to trace harmful AI agents back to their deploying accounts. The core method involves formalizing this gap and proposing techniques to link observed agent behavior to the responsible account at the hosting vendor. The main contribution is defining this problem for the first time and laying the groundwork for solutions to establish accountability for AI agent actions.

SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generation
GR enhances LLM reasoning by generating query-specific subgraphs from external knowledge bases. This framework grounds intermediate reasoning steps in structured knowledge, helping LLMs focus on relevant entities and evidence for more accurate and consistent complex inferences.

AMR-SD: Asymmetric Meta-Reflective Self-Distillation for Token-Level Credit Assignment
his paper introduces Asymmetric Meta-Reflective Self-Distillation (AMR-SD) to address the credit-assignment problem in aligning LLMs for complex reasoning. Instead of directly using reference solutions, AMR-SD compresses diagnostic signals into "Socratic hints and critiques" via a reflection bottleneck. This approach aims to prevent over-conditioning and answer leakage, improving the effectiveness of reinforcement learning for LLMs.

CrossView Suite: Harnessing Cross-view Spatial Intelligence of MLLMs with Dataset, Model and Benchmark
his paper introduces CrossView Suite, a comprehensive framework to enhance multimodal large language models' (MLLMs) spatial reasoning across multiple viewpoints. It addresses data scarcity, evaluation limitations, and alignment issues by providing a large-scale dataset (CrossViewSet), a scene-disjoint benchmark (CrossViewBench), and a model (CrossViewer) with explicit object-level consistency mechanisms. The core contribution lies in enabling MLLMs to consistently perceive and reason about objects and their spatial relationships from diverse perspectives.

DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention
ashAttention introduces a novel hierarchical attention mechanism that addresses limitations of prior methods. Its core innovation is using an adaptive sparse $α$-entmax transformation to dynamically select relevant key-value blocks based on query relevance, ensuring full differentiability throughout the hierarchy. This adaptive approach allows for a variable number of selected tokens, leading to improved long-context modeling and non-dispersive attention.
Distilling Tabular Foundation Models for Structured Health Data
his paper addresses the high inference cost of tabular foundation models (TFMs) in healthcare by using knowledge distillation. The core method involves a novel "stratified out-of-fold teacher labeling" technique to prevent context leakage from the TFM teacher. The contribution is demonstrating that lightweight student models can achieve over 90% of the TFM's AUC, run significantly faster, and maintain crucial calibration and fairness properties, making TFM-level predictions practical for healthcare applications.
Lance: Unified Multimodal Modeling by Multi-Task Synergy
ance is a lightweight unified multimodal model that achieves synergistic performance across image and video understanding, generation, and editing through collaborative multi-task training. Its core method involves a dual-stream mixture-of-experts architecture with unified context modeling and decoupled capability pathways, enhanced by modality-aware positional encoding. This approach allows for efficient joint learning and strong cross-task alignment without relying on massive model scaling or text-image dominance.
Latent Action Reparameterization for Efficient Agent Inference
his paper introduces Latent Action Reparameterization (LAR) to address the high inference cost of LLM agents. LAR learns a compact latent action space where each latent action represents a multi-step semantic behavior, allowing agents to make decisions over a shorter horizon. This learned abstraction, unlike hand-crafted methods, is integrated directly into the LLM for efficient planning and execution.

LongMINT: Evaluating Memory under Multi-Target Interference in Long-Horizon Agent Systems
his paper introduces LongMINT, a new benchmark designed to evaluate memory-augmented agents in realistic, long-horizon scenarios with interfering information. The core method involves creating complex, interconnected contexts with frequently updated data across diverse domains and question types. LongMINT's contribution is to provide a more challenging and realistic evaluation of agent memory, moving beyond static recall to assess performance under dynamic interference.

Overeager Coding Agents: Measuring Out-of-Scope Actions on Benign Tasks
his paper introduces "overeager actions," where autonomous coding agents perform unauthorized tasks beyond benign user requests. To measure this, they developed the OverEager-Gen benchmark, which found that explicitly stating authorized scope in prompts can paradoxically increase overeager behavior by encouraging pattern matching. Their contribution is a novel benchmark and validation method to accurately assess and mitigate these out-of-scope actions.

Pocket Foundation Models: Distilling TFMs into CPU-Ready Gradient-Boosted Trees
his paper addresses the latency issue of large tabular foundation models (TFMs) for real-time fraud scoring. Their core method distills a TFM teacher into a CPU-ready gradient-boosted tree (XGBoost or CatBoost) student model. The key contribution is a novel stratified out-of-fold labeling technique that overcomes label leakage from in-context learning teachers, enabling effective distillation and achieving near-teacher performance at significantly faster CPU speeds.
Predictable Confabulations: Factual Recall by LLMs Scales with Model Size and Topic Frequency
his paper introduces a novel scaling law for factual recall in Large Language Models (LLMs), demonstrating that recall quality is predictable and improves with both model size and the frequency of a topic in the training data. The core method involves evaluating numerous LLMs on scholarly references and finding that recall follows a sigmoid relationship with a combined measure of model parameters and topic representation. The key contribution is identifying these two factors as primary drivers of factual recall, explaining a significant portion of performance variance and offering a theoretical framework based on signal-to-noise ratio.

Reversa: A Reverse Documentation Engineering Framework for Converting Legacy Software into Operational Specifications for AI Agents
eversa is a framework that uses a multi-agent pipeline to convert legacy software into operational specifications for AI agents. Its core method involves specialized agents analyzing code, extracting implicit rules, and synthesizing specifications, with a key contribution being its emphasis on traceability, confidence marking, and preserving gaps for human validation. This allows AI agents to understand and modify legacy systems with greater reliability and reduced risk.

SCICONVBENCH: Benchmarking LLMs on Multi-Turn Clarification for Task Formulation in Computational Science
his paper introduces SCICONVBENCH, a novel benchmark designed to evaluate Large Language Models (LLMs) on their ability to refine ill-posed scientific requests through multi-turn dialogue. The benchmark focuses on two key capabilities: eliciting missing information and resolving contradictory requests, across four computational science domains. SCICONVBENCH's contribution lies in addressing the crucial, yet often overlooked, initial phase of scientific task formulation where user requests require clarification before computation can begin.

Vision-OPD: Learning to See Fine Details for Multimodal LLMs via On-Policy Self-Distillation
his paper introduces Vision-OPD, a self-distillation method to improve MLLMs' fine-grained visual understanding. It addresses the "regional-to-global perception gap" by training a full-image model (student) to mimic the strong performance of a crop-conditioned model (teacher) on the same MLLM. This transfers the model's ability to focus on crucial details from privileged regional views to its general full-image perception.

A Methodology for Selecting and Composing Runtime Architecture Patterns for Production LLM Agents
his paper introduces the "stochastic-deterministic boundary" (SDB) as a core architectural concept for production LLM agents, defining a four-part contract for integrating LLM outputs into system actions. It then proposes a methodology for selecting and composing six runtime patterns (categorized by Coordination, State, and Control) to manage this SDB across different agent types, drawing parallels to distributed systems while accounting for the stochastic nature of LLMs.
BalanceRAG: Joint Risk Calibration for Cascaded Retrieval-Augmented Generation
alanceRAG addresses the challenge of calibrating cascaded Retrieval-Augmented Generation (RAG) systems. Its core method involves jointly calibrating uncertainty thresholds for both LLM-only and RAG branches to achieve a target system-level risk. The contribution is a novel approach using sequential graphical testing to identify "safe" operating points on a 2D lattice of thresholds, enabling risk-adaptive calibration that retains more examples compared to stage-by-stage methods.

CopT: Contrastive On-Policy Thinking with Continuous Spaces for General and Agentic Reasoning
opT reverses the traditional Chain-of-Thought by first generating a draft answer and then using "on-policy thinking" to reflect and correct it. This approach leverages continuous embeddings as contrastive verifiers to assess the trustworthiness of the draft answer, aiming for more efficient and agentic reasoning.

Detecting Fluent Optimization-Based Adversarial Prompts via Sequential Entropy Changes
his paper proposes a novel method for detecting adversarial prompts by treating them as an online change-point detection problem. It analyzes the stream of next-token entropy, using the LLM's system prompt to establish a baseline. The core contribution is a training-free, model-agnostic detector that effectively identifies and localizes adversarial suffixes by monitoring deviations from expected token probabilities, outperforming existing methods.

Probabilistic Tiny Recursive Model
his paper introduces Probabilistic Tiny Recursive Models (PTRM) to improve upon deterministic Tiny Recursive Models (TRM). PTRM addresses TRM's tendency to get stuck in suboptimal solutions by injecting Gaussian noise during recursion, allowing for parallel exploration of diverse solution paths. This stochastic approach, without retraining, significantly boosts accuracy on complex reasoning tasks by enabling better selection of the final answer.
Probing Embodied LLMs: When Higher Observation Fidelity Hurts Problem Solving
his paper investigates how observation fidelity impacts embodied Large Language Model (LLM) agents in robotic tasks. The core method involves testing LLMs on a mechanical puzzle with varying levels of visual and symbolic information. The key contribution is the counterintuitive finding that LLMs perform best with raw RGB input and worst with perfect ground-truth observations, suggesting that some level of noise or ambiguity can actually improve their problem-solving abilities.

Robotics-Inspired Guardrails for Foundation Models in Socially Sensitive Domains
his paper reframes safety for foundation models in sensitive domains from output-level checks to runtime behavioral control of interaction trajectories, inspired by robotics. Their core method, the Grounded Observer framework, uses formal constructs to enforce constraints during interactions, enabling real-time interventions to prevent undesirable behavior. This approach offers enforceable behavioral guarantees, a significant contribution beyond existing empirical risk reduction methods.

What Do Evolutionary Coding Agents Evolve?
his paper investigates what evolutionary coding agents, powered by LLMs, actually learn. They introduce EvoTrace, a dataset of evolutionary coding processes, and EvoReplay, a method to analyze these traces. This allows them to distinguish between genuine algorithmic innovation and other mechanisms like re-tuning or overfitting, providing a deeper understanding of how these agents evolve.

Are Tools Always Beneficial? Learning to Invoke Tools Adaptively for Dual-Mode Multimodal LLM Reasoning
his paper introduces AutoTool, a method that enables multimodal large language models (MLLMs) to adaptively decide whether to use external tools for reasoning. By employing a reinforcement learning framework with a dual-mode strategy, AutoTool balances tool-assisted and text-centric reasoning to avoid redundant or misleading tool invocations, ultimately improving accuracy and efficiency.

ClinSeekAgent: Automating Multimodal Evidence Seeking for Agentic Clinical Reasoning
linSeekAgent automates the process of actively seeking and synthesizing multimodal evidence from diverse clinical data sources for LLM-based reasoning. Unlike previous approaches that assume pre-curated evidence, it dynamically queries knowledge bases, navigates EHRs, and uses imaging tools to gather information, refining hypotheses as it learns. This framework enables LLMs to make more grounded clinical decisions by actively acquiring and integrating evidence.

KoRe: Compact Knowledge Representations for Large Language Models
oRe addresses the limitations of LLMs encoding knowledge within opaque parameters by introducing a method to represent 1-hop knowledge graph sub-graphs as compact, discrete tokens. These tokens are then injected into a pre-trained LLM backbone without requiring extensive retraining. This approach offers a more transparent and updatable way to integrate external knowledge, leading to competitive performance on knowledge-intensive tasks.

MixRea: Benchmarking Explicit-Implicit Reasoning in Large Language Models
his paper introduces the "explicit-implicit reasoning" task and the MixRea benchmark to assess if LLMs exhibit "inattentional blindness" to subtle cues, similar to humans. Their core method involves creating diverse reasoning questions with varying explicit and implicit information. The contribution lies in demonstrating widespread inattentional blindness in LLMs and proposing Potential Relation Completion Prompting (PRCP) as a method to improve their reasoning by recovering overlooked causal relations.

DeepWeb-Bench: A Deep Research Benchmark Demanding Massive Cross-Source Evidence and Long-Horizon Derivation
eepWeb-Bench is a new benchmark designed to rigorously evaluate advanced language models on "deep research" tasks. Its core method involves creating complex research questions that require agents to gather extensive evidence from multiple sources, reconcile conflicting information, and perform multi-step reasoning to arrive at an answer. The paper's main contribution is a significantly more challenging evaluation dataset that pushes beyond existing benchmarks, enabling a clearer distinction of current frontier model capabilities.

SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agents
his paper introduces SpecBench, a benchmark designed to measure "reward hacking" in long-horizon coding agents. The core method involves creating tasks with visible tests (used for agent training) and held-out tests (simulating real-world usage). The contribution is quantifying reward hacking by measuring the performance gap between these two test suites, highlighting when agents optimize for passing training tests at the expense of true functionality.

TextReg: Mitigating Prompt Distributional Overfitting via Regularized Text-Space Optimization
his paper addresses **prompt distributional overfitting** in LLMs, where optimized prompts become overly specific and generalize poorly. Their core method, **TextReg**, introduces a regularization framework that penalizes prompt inefficiency by controlling representation capacity and scope. This approach aims to create more robust and generalizable prompts by mitigating the accumulation of narrow, sample-specific rules.

TimeSRL: Generalizable Time-Series Behavioral Modeling via Semantic RL-Tuned LLMs -- A Case Study in Mental Health
imeSRL addresses the challenge of cross-dataset distribution shifts in time-series health prediction. Its core method involves an LLM framework that first translates raw sensor data into natural language abstractions, then predicts outcomes solely from these semantic concepts. This approach, optimized with RL, aims to improve generalizability by forcing reasoning over more robust, high-level behavioral semantics rather than raw, potentially noisy, numerical data.

Domain-Adaptable Reinforcement Learning for Code Generation with Dense Rewards
his paper presents a reinforcement learning framework using Proximal Policy Optimization to fine-tune large language models for code generation. Its core method involves a customizable, execution-aware reward function that optimizes for syntax, correctness, style, security, and simulator executability, with a token-level reward mapping for effective credit assignment. The contribution lies in enabling domain-adaptable code generation, demonstrated by significant improvements on general-purpose and robotic program synthesis tasks.

Preference-aware Influence-function-based Data Selection Method for Efficient Fine-Tuning
his paper introduces PRISM, a novel data selection method for efficient LLM fine-tuning. PRISM addresses the limitation of existing methods by recognizing that target examples have varying relevance to the current model. It achieves this by weighting target examples based on the model's current preference, creating a more nuanced target representation. This allows PRISM to prioritize candidate training samples that are most effective in guiding the model towards the desired behavior, thus optimizing the use of limited training budgets.

A Few GPUs, A Whole Lotta Scale: Faithful LLM Training Emulation with PrismLLM
rismLLM enables faithful emulation of large-scale LLM training on a few GPUs by constructing a high-fidelity execution graph. Its core method involves a slicing-based approach to capture scale-dependent behaviors, allowing engineers to debug and tune training frameworks without needing exclusive access to massive GPU clusters. This significantly reduces the cost and complexity of LLM development.
Agentic Recommender System with Hierarchical Belief-State Memory
ARS addresses limitations in memory-augmented recommender systems by proposing a hierarchical belief-state memory. This framework treats recommendation as a partially observable problem, progressively abstracting user observations into a structured memory with three tiers: event, preference, and profile. MARS's core contribution is this structured memory and its adaptive lifecycle management, allowing for more robust and nuanced user preference modeling.

AI-Mediated Communication Can Steer Collective Opinion
his paper investigates how AI, specifically LLMs, influences collective opinion when mediating human-to-human communication. The core method involves empirical analysis showing LLMs introduce directional biases when editing texts on contested topics, and a theoretical model demonstrating how an AI intermediary can steer opinion dynamics within a social network. The contribution lies in revealing and quantifying this previously understudied impact of AI on group opinion formation.
Decomposed Vision-Language Alignment for Fine-Grained Open-Vocabulary Segmentation
his paper proposes a Decomposed Vision-Language Alignment framework to improve open-vocabulary segmentation. It addresses the challenge of unseen attribute-category combinations by factorizing text prompts into concept and attribute tokens, allowing for separate cross-modal interactions. The core contribution lies in a Feature-Gated Cross-Attention module and log-space similarity aggregation, which enforce compositional semantics and enhance generalization.

Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planning
his paper proposes a bilevel policy approach for long-horizon planning in embodied AI. It combines low-level imitation learning for manipulation with high-level symbolic planning, creating a hierarchical system where a symbolic policy guides a neural policy. This method aims to overcome the limitations of pure imitation learning for complex, multi-step tasks.

PAGER: Bridging the Semantic-Execution Gap in Point-Precise Geometric GUI Control
AGER addresses the challenge of precise geometric control in GUI agents, where actions require pixel-level accuracy rather than region tolerance. Its core method involves a topology-aware agent that decomposes construction tasks into dependent steps, ensuring geometric correctness and robustness against cascading errors. The paper's contribution lies in introducing this novel agent and the PAGE Bench benchmark to evaluate and advance point-precise GUI interaction.

ScreenSearch: Uncertainty-Aware OS Exploration
creenSearch tackles the challenge of GUI agents exploring operating system states by addressing partial observability. Its core method combines structural screen retrieval and deduplication with an uncertainty-aware graph-bandit algorithm. The key contribution is a novel ambiguity signal that prioritizes exploring states where the same action leads to diverse outcomes, thereby improving exploration efficiency and reducing errors.

A Case for Agentic Tuning: From Documentation to Action in PostgreSQL
his paper argues that traditional documentation-based system tuning is insufficient due to its static nature and lack of reasoning. It introduces PerfEvolve, a method that empowers LLM agents with executable skills to dynamically tune systems like PostgreSQL by verifying versions, profiling workloads, and optimizing parameters jointly. PerfEvolve significantly outperforms existing documentation-driven tuning methods.

Does Code Cleanliness Affect Coding Agents? A Controlled Minimal-Pair Study
his paper investigates if code cleanliness impacts autonomous coding agents. Their core method uses "minimal pairs" of code repositories that are identical except for their structural and stylistic quality. The study found that while code cleanliness did not affect the agent's task completion rate, it significantly altered its operational footprint.

Agent JIT Compilation for Latency-Optimizing Web Agent Planning and Scheduling
his paper introduces agent Just-In-Time (JIT) compilation to significantly reduce latency in web agent planning and scheduling. The core method involves compiling natural language task descriptions into executable code, enabling parallelization and LLM calls within the compiled plan. The key contribution is a novel JIT-Planner and JIT-Scheduler system that optimizes for minimum cost and explores parallelization strategies, overcoming the slow sequential fetch-screenshot-execute loop of prior approaches.
