From the arXiv
Monday, 28 September 2026 · 20 papers
ActKV: Efficient LLM Agents through Action-Guided KV Cache Management
ActKV addresses the memory burden of LLM agents by prioritizing KV cache entries crucial for action generation. Its core method employs action-oriented eviction and confidence-driven budget allocation to retain relevant information, enabling more efficient and higher-throughput agentic inference. This contributes the f…
DIAL: Position-Debiased LLM Judges with Adaptive Human Preference Calibration
DIAL addresses the limitations of LLM judges by developing a framework that combines LLM and human comparisons. It separates position biases in LLM judgments, learns their underlying preferences, and then adaptively calibrates these to align with human preferences. This approach offers a theoretically grounded and empi…
Game Arena: Strategic LLM Evaluation in Competitive Environments
The paper introduces Kaggle Game Arena, a platform for evaluating LLMs through competitive gameplay. Its core method involves head-to-head matchups in structured game environments, allowing for dynamic performance assessment as models improve. The contribution lies in providing a robust, transparent, and reproducible s…
PriceBench: A Diagnostic Benchmark for Price, Quality, and Brand Preferences in LLM Booking Agents
This paper introduces PriceBench, a benchmark designed to diagnose the price, quality, and brand preferences of Large Language Models (LLMs) acting as booking agents. By analyzing LLM booking choices using a logit model, the benchmark reveals that more capable LLMs exhibit stronger, more consistent preferences, while l…
Nonparametric In-Context Learning under Growing Geometric Complexity: Minimax Optimality and Local Geometry-Adaptivity of Transformers
This paper analyzes how Transformers perform in-context learning on data with complex, varying geometric structures. The core method involves developing a novel local-polynomial estimator that adapts to these heterogeneous manifolds. The key contribution is establishing minimax optimality for this type of learning, dem…
AgentXploit: Autonomous Repository-to-Runtime Red-Teaming for AI Agents
AgentXploit is an autonomous system for pre-deployment red-teaming of AI agents. It uses a two-agent approach: an Analyzer Agent discovers potential attack paths within the agent's code repository, and an Exploiter Agent translates these paths into concrete runtime attacks, refining them with feedback. This system's co…
Beyond Approved Actions: Runtime Validation of Persistent Outcomes in Agent Workflows
This paper introduces EffectMatch, a runtime validation system for LLM agents that interact with software. Its core method is to collect and compare persistent changes made by an agent's actions against the approved outcomes for the current state. EffectMatch's contribution is to prevent unapproved side effects from be…
Compact Documentation for Coding Agents: A Benchmark, an Optimizer, and Why It Does Not Transfer
This paper introduces a benchmark for evaluating code documentation by testing if regenerated code passes original tests, finding completeness, not length, is key. They developed an optimizer that creates highly faithful documentation, but surprisingly, this improved documentation did not help coding agents resolve rea…
DeepEdu-v1: Efficient and Scalable Agentic LLMs for Vietnamese Education
This paper introduces DeepEdu-v1, an AI tutoring system for Vietnamese education designed to address data sovereignty and curriculum alignment issues. Its core method, the SCALE framework, innovates by improving context-aware learning and self-improvement. This contributes a scalable, efficient agentic LLM that overcom…
Evaluating Cultural Awareness of LLMs for Haitian Creole
This paper introduces the first systematic evaluation of cultural awareness in LLMs for Haitian Creole. It uses a benchmark of culturally relevant prompts to assess specificity, bias, diversity, and variation, revealing significant gaps compared to French and highlighting issues like French linguistic interference and …
Highlight-Then-Summarize: Learning to Compress Evidence for Long-Context Understanding
This paper introduces Highlight-Then-Summarize (H2S), a novel compress-then-reason approach for long-context understanding. H2S first identifies relevant evidence from lengthy documents and then generates a compact, question-conditioned summary of this evidence before producing the final answer. This method, trained wi…
Multi-agent Scaling Across Disjunctive and Compensatory Tasks
This paper introduces Steiner's taxonomy of group tasks to analyze how multi-agent LLM performance scales with team size, focusing on disjunctive and compensatory tasks. The authors model agents as conditionally independent and derive theoretical limits for plurality voting and averaging. Their empirical findings show …
Prompt Minimization: Reducing Input Redundancy Without Sacrificing Output Fidelity
This paper introduces "prompt minimization," a method to find the shortest possible prompts for large language models that still produce accurate outputs. By removing redundant information, their approach reduces computational costs and improves model performance. The core contribution is demonstrating that these minim…
Statistical attribute alignment for black-box generative AI via output post-processing
This paper addresses the challenge of aligning generative AI outputs with user-specified attribute distributions in a black-box setting. The core method involves post-processing generated outputs to statistically match a target distribution for a specific attribute. The key contribution is the development of query-effi…
Towards Mitigating Fabricated Consensus: The Active Provenance Gate for Multi-Agent Debate Synthesis
This paper introduces the Active Provenance Gate (APG), a post-debate verification layer for multi-agent debate systems. The APG analyzes debate logs, audits claims, and self-corrects to prevent fabricated consensus, ensuring summaries are grounded in the debate's history. Its core contribution is a mechanism to enhanc…
ViSTA: A Simple Bridge Extends Visual Alignment to Clinical Time-Series Understanding in Multimodal LLMs
ViSTA is a compact adapter that bridges clinical time-series data with multimodal large language models by learning corrections to visual tokens representing numerical measurements. This approach allows pretrained vision-language models to accurately predict clinical outcomes from structured patient data without alteri…
New LoRA Skills Should Read but Never Write
This paper introduces READ, a method for combining multiple LoRA adapters without interference. READ rewrites each adapter into a canonical form that preserves its original update, allowing them to be merged into a single model. This approach avoids the issues of weight-space interference, expensive retraining, and com…
PIA: A Personal Intelligence Agent Turning Health Conversations into Records and Records into Understanding
PIA, a personal intelligence agent, addresses the limitations of general summarization for health data. Its core method involves a four-control memory harness (extraction, memory, retrieval, understanding) that converts health conversations into structured clinical records and then synthesizes these records into user u…
Stale-Document Poisoning: When Outdated Retrieval Overrides Correct Model Answers
This paper introduces "stale-document poisoning," a vulnerability in Retrieval-Augmented Generation (RAG) where outdated retrieved information causes models to provide incorrect answers, even if they would have been correct otherwise. The authors created a benchmark of knowledge reversals and demonstrated that outdated…
Agentic Limit Order Books: Phase Transitions and Market Impact
This paper introduces a novel framework of Limit Order Books populated solely by autonomous reinforcement-learning agents. The core method involves simulating agent interactions within an order-matching engine to study emergent market phenomena. The key contribution is the discovery of distinct phase transitions in tra…