From the arXiv
Friday, 5 June 2026 · 20 papers
LLMs Can Leak Training Data But Do They Want To? A Propensity-Aware Evaluation of Memorization in LLMs
This paper introduces PropMe, a framework that evaluates LLM memorization not just when prompted adversarially, but also under normal usage. Their core method uses a new propensity-aware metric and a tracing pipeline called SimpleTrace to quantify how often models leak training data during typical generation. The key c…
ToolChoiceConfusion: Causal Minimal Tool Filtering for Reliable LLM Agents
This paper introduces Causal Minimal Tool Filtering (CMTF) to improve the reliability of LLM agents using external tools. CMTF addresses the problem of tool selection by focusing on causal sufficiency rather than just semantic relevance, ensuring only the minimal set of necessary tools for the next step are exposed. Th…
Vortex: Efficient and Programmable Sparse Attention Serving for AI Agents
Vortex is a system that accelerates the design and deployment of sparse attention algorithms for large language models. It combines a user-friendly Python frontend with an efficient backend, allowing researchers and AI agents to rapidly prototype, evaluate, and integrate new sparse attention techniques. This significan…
Will the Agent Recuse Itself? Measuring LLM-Agent Compliance with In-Band Access-Deny Signals
This paper introduces the "Recuse Signal," a novel in-band mechanism for servers to request autonomous LLM agents to voluntarily withdraw access to a resource, acting as a cooperative governance control rather than a security boundary. The core contribution is to empirically measure whether LLM agents will actually com…
CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experiments
CollabSim introduces a novel methodology for evaluating the collaborative competence of LLM agents in multi-agent systems. It grounds this evaluation in decades of Computer-Supported Cooperative Work (CSCW) research, focusing on how agents establish common ground and manage shared understanding, rather than just indivi…
Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads
This paper characterizes the system implications of agent memory for long-horizon LLM tasks. It introduces a taxonomy for memory systems, a profiling harness to measure costs, and analyzes ten representative systems. The key contribution is uncovering how design choices impact memory construction and retrieval costs, l…
Benchmark Everything Everywhere All at Once
This paper introduces Benchmark Agent, an autonomous system that automates the entire benchmark creation process for LLMs and MLLMs. Its core method involves orchestrating user query analysis, subtask design, data annotation, and quality control. The main contribution is a sustainable and scalable approach to generatin…
Humans' ALMANAC: A Human Collaboration Dataset of Action-Level Mental Model Annotations for Agent Collaboration
This paper introduces ALMANAC, a novel dataset designed to improve agent collaboration. It addresses the lack of data on human collaborative processes by providing action-level annotations of participants' mental models during a dyadic routing task. This dataset aims to guide LLM agents towards better understanding and…
LLM Self-Recognition: Steering and Retrieving Activation Signatures
This paper introduces a method for LLMs to "self-recognize" their own outputs by embedding a detectable fingerprint within their internal activations. By steering the residual stream with a sparse vector during generation, the LLM creates a unique signature that can be reliably retrieved by another LLM, achieving high …
TokenMizer: Graph-Structured Session Memory for Long-Horizon LLM Context Management
TokenMizer addresses the LLM context window limitation by modeling session history as a typed knowledge graph, preserving crucial structured information. Its core method involves a hybrid extraction pipeline to build this graph, a multi-tier checkpoint system for serialization, and an 8-layer compression pipeline to re…
TOKI: A Bitemporal Operator Algebra for Contradiction Resolution in LLM-Agent Persistent Memory
This paper introduces TOKI, a bitemporal operator algebra for managing persistent memory in LLM agents. TOKI formalizes contradiction resolution as a form of write-time concurrency control, explicitly defining isolation preconditions and provenance for existing heuristics. Its core contribution is providing formal guar…
Where Should Knowledge Enter? A Layered Framework for Knowledge Infusion in Multimodal Iterative Generative Mo
This paper proposes a layered framework for integrating knowledge into multimodal generative models. It categorizes knowledge infusion based on which part of the iterative generation process is modified: input/output (surface), state transitions (trajectory), intermediate states (latent), or model parameters (parametri…
Generative Criticality in Large Language Model Temperature Scaling
This paper introduces a statistical-field framework to analyze LLM text generation, modeling token embeddings as spins on a chain. They observe a sharp peak in susceptibility and a rapid change in an order parameter near a characteristic temperature $T_c$, indicating a phase transition-like behavior. This phenomenon, r…
Latent Reasoning with Normalizing Flows
This paper proposes NF-CoT, a novel latent reasoning framework for large language models. It leverages normalizing flows to represent intermediate reasoning steps in continuous latent spaces, offering a higher-bandwidth alternative to explicit textual chain-of-thought. NF-CoT's core contribution is preserving the advan…
Tangram: Unlocking Non-Uniform KV Cache for Efficient Multi-turn LLM Serving
Tangram addresses the inefficiency of non-uniform KV caching in multi-turn LLM serving by introducing a novel system. Its core method involves deterministic budget allocation for KV cache heads, eliminating scheduling overhead and prefill stalls. This approach unlocks efficient utilization of non-uniform KV caches, sig…
Reinforcement Learning Elicits Contextual Learning of Unseen Language Translation
This paper proposes a reinforcement learning (RL) method to enable large language models (LLMs) to translate unseen languages by learning to utilize provided linguistic context. Instead of memorizing specific languages, the RL agent learns a meta-skill to extract and apply relevant information from the context, leading…
An Infectious Disease Spread Simulation Based on Large Language Model Decision Making
This paper introduces a novel agent-based simulation for infectious disease spread that leverages Large Language Models (LLMs) to model individual decision-making. The core method integrates LLM-generated self-reporting decisions into a spatially grounded synthetic population, using real census data to capture demograp…
Emergent Language as an Approach to Conscious AI
This paper proposes a novel generative approach to studying conscious AI by developing "emergent language" (EL) in multi-agent reinforcement learning. Instead of relying on pre-defined checklists or human-inspired modules, EL allows agents to develop communication from scratch, driven solely by task demands. This metho…
HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers
This paper introduces HANDOFF, a novel whole-body controller for humanoids that uses a compact, task-space interface instead of dense kinematic references. HANDOFF is a mixture-of-experts model distilled from specialized teachers for motion tracking, locomotion, and fall recovery. Its core contribution is enabling intu…
MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discovery
MLEvolve is a self-evolving framework for automated machine learning algorithm discovery that addresses limitations of existing LLM agents. Its core method involves an extended tree search (Progressive MCGS) with graph-based references for cross-branch information flow and an entropy-inspired schedule for focused searc…