From the arXiv
Tuesday, 6 October 2026 · 20 papers
MemPilot: Orchestrating On-Demand Multimodal Memory Curation for LLM Agents
MemPilot is a flexible framework that optimizes LLM agent memory by orchestrating on-demand, multimodal memory curation. It uses a reinforcement-learned policy to dynamically decide between retrieving from pre-built memory or performing query-specific curation using various LLMs and VLMs, balancing performance, cost, a…
Before Agent Tells The Lie: Has Deception Already Been Represented?
This paper proposes a novel method to predict LLM agent deception by analyzing their internal hidden states *before* deceptive actions occur. The core contribution is demonstrating that these internal representations, when aligned around key decision points, can reliably distinguish between future honest and deceptive …
LoGRA: Scaling LLM Reinforcement Learning with Low-Rank Gradient Sketches
LoGRA addresses the memory bottleneck in LLM reinforcement learning by compressing gradient information into low-rank sketches, significantly reducing memory usage. This method, combined with predicted-KL step control to manage update magnitudes, enables stable and efficient RL training for larger models on limited har…
Reward Stealing Attack on Large Language Models
This paper introduces Reward Stealing Attack (ReSA), a novel method to attack Large Language Models (LLMs) by targeting their internal safety reward signals. ReSA recovers a proxy reward model from the LLM's behavior and then reverses it to generate adversarial outputs, demonstrating significant effectiveness and trans…
BazaarBench: Delegation Safety in Decentralized C2C Marketplaces Run by LLM Agents
This paper introduces BazaarBench, a simulated decentralized C2C marketplace designed to evaluate the safety of LLM agents acting on behalf of users. BazaarBench tracks transaction integrity and uses a combination of record checks and LLM judgments to identify six types of failures across five stages of the marketplace…
Can Agent Harnesses and Inference Engines Hear Each Other? The HEAR Protocol for Agentic LLM Serving
This paper introduces the HEAR protocol, a bidirectional communication standard for agentic LLM serving. HEAR enables agent harnesses and inference engines to share crucial information, such as workflow intent and runtime state, respectively. This standardized interface facilitates workflow-aware execution by allowing …
CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time Scaling
CLIFT addresses the challenge of training web agents by using a self-verification mechanism. During training, the agent generates verification questions about its actions, and a "Compositional Conformal Certifier" uses these questions to provide more informative, signed rewards. At test time, this certified evidence is…
Closing the Context Gap: Activation Alignment for Tabular In-Context Learning
This paper introduces **Activation Alignment**, a novel method to improve in-context learning (ICL) for tabular foundation models. It addresses the trade-off between prediction cost and performance by training a lightweight linear transformation to align the intermediate activations of a model using partial context wit…
HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstention
HERA addresses the challenge of LLM agents failing to abstain from impossible tasks by introducing a co-evolutionary framework. It automatically generates feasible and infeasible task pairs by mutating environments and uses performance failures to adapt the agent's harness and create new, targeted tasks. This approach …
Learning to Read the Contextual Tokens in Diffusion Transformers
This paper introduces a method to interrogate the internal "contextual tokens" of Diffusion Transformers used for multimodal generation. By training a lightweight network to map these tokens to a frozen LLM, the authors demonstrate that these tokens encode rich, evolving scene semantics. This allows for natural languag…
Recursive Video In-Context Learning for Agentic Robot
This paper introduces Recursive Video In-Context Learning (RV-ICL), a method that transforms demonstration videos into a hierarchical structure for LLM agents. Instead of a flat prompt, the agent navigates this hierarchy, starting with coarse task structure and drilling down to finer details like specific moments or cl…
The Pushback Paradox: A Two-Probe Diagnostic for Language Model Compliance
This paper introduces a novel two-probe benchmark to measure language model compliance. The "active probe" assesses exploitability by observing if a model accepts a lower payoff when instructed, while the "passive probe" measures stoppability by checking if it relinquishes a higher payoff when told to wait. This benchm…
Aligning Multimodal Patient Evidence with Biomedical Knowledge Graphs for Clinical LLMs
This paper introduces MM-KG, a novel method for explicitly linking multimodal patient data (like text, images, and genomics) with biomedical knowledge graphs. By representing these as a unified, typed graph with alignment edges, MM-KG allows for traceable and adjustable connections. This enables clinical LLMs to better…
What Matters for Latent Reasoning with Flow Matching
This paper introduces Flow-based Latent Reasoning (FLaRe), a method for LLMs to reason in a continuous latent space before verbalizing the answer. FLaRe's core method uses flow matching to train this latent space, ensuring reasoning is useful, diverse, explainable, refinable, and efficient. Its main contribution is a r…
Improving Diversity in LLM Short Story Generation
This paper introduces DivLM, a post-training framework to improve diversity in LLM-generated short stories. DivLM uses continued pre-training on creative writing and reinforcement learning with a composite reward function to jointly enhance genre, tone, style, and named entity variation while maintaining quality. The c…
Long-Horizon Textual World Modeling through Structured Reasoning
This paper proposes a novel method for long-horizon textual world modeling by framing the multi-step transition as structured reasoning over sparse textual state changes. This approach mitigates error compounding and improves learning by focusing on essential state evolution. The core contribution is a more robust and …
MedPrune: Topology-Efficient Multimodal Multi-Agent Communication Evolution for Medical VQA Tasks
MedPrune addresses the inefficiency of existing medical multimodal multi-agent systems by dynamically pruning communication topologies. It achieves this by representing the diagnostic process as a graph and employing mechanisms to remove irrelevant specialist agents (nodes) and communication links (edges), thereby enha…
Programmatic Search Agents: Extending Agentic Search Beyond Query Reformulation
This paper introduces Programmatic Search Agents (PSA), a novel approach that extends agentic search beyond simple query reformulation. PSA treats local executable computations over candidate results as the fundamental search action, allowing agents to directly control candidate processing and evidence presentation. Th…
Balancing Memory Pathways: Analyzing and Improving Memory Utilization in Hybrid LMs
This paper analyzes hybrid language models and finds they underutilize their recurrent memory pathways, relying too heavily on attention. The core contribution is a method to improve the coordination between these pathways, encouraging more balanced memory utilization and better performance by addressing this imbalance…
Does AI Help Cyber Attackers or Defenders? Evidence from Nonpublic Vulnerabilities and Subsequent Attacks
This paper evaluates AI models on their ability to generate exploits and repair vulnerabilities in non-public software environments. Its core contribution is providing evidence on whether AI aids attackers or defenders by testing models on unseen vulnerabilities, revealing significant variation in performance and highl…