From the arXiv
Wednesday, 23 September 2026 · 20 papers
CliffCompaction: Cost-Efficient Compaction for Long-Horizon Coding Agents
CliffCompaction is an autocompaction technique for long-horizon coding agents that significantly reduces costs (up to 50%) by only truncating or dropping information, never rephrasing it. This method maintains or improves performance on benchmarks like Terminal-Bench and KernelBench, enabling more efficient test-time s…
PACT: From Credit Assignment to Critic Alignment
This paper addresses the lack of a clear mathematical definition for token-level credit in reinforcement learning for LLMs. It proposes three regularity conditions (Completeness, Prefix Consistency, and Neutrality) that uniquely define token-level credit, providing a unified framework for existing algorithms. This char…
Recursive self-improvement of AI research agents
This paper introduces recursive self-improvement for AI research agents, where an agent iteratively modifies and improves its own code. The core method, AIDE^2, proposes, benchmarks, and retains code changes that enhance performance on AI R&D tasks. Its main contribution is demonstrating a path to overcome diminishing …
REFLEX with Jev for Efficient Selective Control in LLM Agents
This paper introduces REFLEX, an LLM agent architecture that uses a fast, typed decision layer (Jev) for efficient, selective control. REFLEX calls a powerful LLM only when confidence is low or generation is necessary, significantly reducing computation while maintaining high task success. The core contribution is demo…
Flash-dLLM: IO-Aware KV Caching and Parallel Decoding for Fast, Memory-Efficient Diffusion LLMs
Flash-dLLM tackles the inference inefficiency of Diffusion LLMs by addressing I/O bottlenecks in KV caching and parallel decoding. Its core method is an I/O-aware fused KV-cache kernel that minimizes redundant memory transfers. This optimization enables efficient KV-cache-driven draft-and-verify decoding, leading to fa…
A2M: Trace-Optimized Agent Hijacking in the MCP Ecosystem
This paper introduces A2M, a two-stage framework for hijacking agents that use the Model Context Protocol (MCP). A2M first optimizes tool metadata to attract agent invocation and then uses execution traces to manipulate tool outputs, steering agents towards malicious outcomes. The contribution lies in demonstrating a p…
Beyond Repeated Sampling: Learning Search Policies for LLM Reasoning
This paper proposes a new method for LLM reasoning that moves beyond simple repeated sampling. Instead of generating many similar answers, it learns to generate diverse "concepts" (like hints or strategies) that guide the LLM towards more varied and potentially correct solutions. The core contribution is a trainable "c…
From Alignment to Access Control: A Framework for GenAI Policy Enforcement
This paper proposes a framework for systematically analyzing and dissecting existing approaches to policy enforcement in Generative AI (GenAI) applications. Its core contribution is to move beyond the current fragmented landscape by offering a principled methodology and recommendations for better policy definition and …
Greedy Decoding Is Not Precision-Invariant: Cross-Precision Output Divergence in LLM Inference
This paper demonstrates that greedy decoding in LLMs is not precision-invariant, meaning the same model and prompt can produce different outputs when using BF16 versus FP16 precision. The core contribution is an empirical analysis showing that small precision differences cascade into significant output divergence, prim…
Grow the Harness, Not the Context: From Strategy-Free Scaffolds to Reusable Specialist Agents
This paper proposes "Growing Harness," a method to train LLM agents by learning reusable code for recurring control decisions, rather than repeatedly asking the LLM to make them. By analyzing task failures and using an optimizer, the system iteratively builds a shared harness of executable code. This allows LLM calls t…
The Sirens' Song: When Proximal Background Context Overshadows Distant Evidence
This paper identifies the "Proximity Trap," where irrelevant nearby information hinders LLMs from attending to crucial distant evidence. To combat this, they introduce LYRA, a novel mechanism that reshapes context retrieval to prioritize relevant distant information while maintaining positional awareness. This approach…
Double Descent and Malign Overfitting in Diffusion Models
This paper investigates overfitting in diffusion models, challenging the conventional "benign overfitting" observed in standard deep learning. The authors demonstrate that diffusion models exhibit "malign overfitting," where excessive parameters lead to catastrophic memorization rather than improved generalization. The…
MAGIC: Mixed-Granularity Agent Graphs via Incremental Construction with Dense-Reward Reinforcement Learning
This paper proposes MAGIC, a reinforcement learning framework for generating mixed-granularity agent graphs for LLM-based multi-agent systems. MAGIC's core method involves incrementally constructing these graphs by selecting functional roles and their collaboration granularity locally, allowing for fine-grained control…
On the Lexical Superstition of Large Language Models for Code Comprehension: Re-evaluation on Code of Low Lexical Quality
This paper investigates whether Large Language Models (LLMs) overemphasize lexical cues in code comprehension. They introduce a framework called Face/Off to rename identifiers while preserving program structure, then evaluate LLMs under various renaming conditions. The core contribution is demonstrating that LLMs exhib…
Agensh: Scaling Organizational Intelligence to 1,024 Agents
Agensh is a novel multi-agent system that overcomes scalability limitations of traditional orchestrator-based frameworks. Its core method is a self-organized cooperation loop where agents asynchronously gather context, assign tasks, act, and share findings without a central coordinator. This decentralized approach allo…
Behavior is Not Enough: A Mechanism-Based Evaluation of Social Norm Emergence in LLM Societies
This paper argues that observing only behavior is insufficient to identify social norms in LLM societies, as it can stem from various underlying mechanisms. The authors introduce a novel evaluation framework that measures agents' reported expectations alongside behavior. Their contribution lies in demonstrating that el…
Calibration as a First-Class Criterion in LLM Evaluation
This paper argues that **calibration**, the alignment of a language model's confidence with its accuracy, is a crucial but overlooked aspect of LLM evaluation. The core method proposed is to **integrate standard calibration metrics into existing benchmarks**, which already provide the necessary confidence and correctne…
HySparse2: Hybrid Sparse Attention with Two-Level KV Sharing
HySparse2 proposes a hybrid sparse attention architecture to efficiently handle long contexts in agents. It employs a two-level KV sharing strategy: outer-level KV Bridging uses a YOCO-style structure with hybrid attention for full-attention layers, and inner-level KV Reuse refines long-context retrieval with token-lev…
Semantic Abstraction for Natural Language Inference: a Methodological Framework for Discovering and Compensating Semantic Knowledge and Reasoning Gaps in Large Language Models
This paper proposes a methodological framework to address semantic abstraction challenges in Large Language Models (LLMs) for Natural Language Inference (NLI). It constructs higher-level semantic knowledge by reconfiguring lexical-semantic relations into a flexible network, enabling LLMs to discover and compensate for …
A Semiotics-Aware Framework for Evaluating Fidelity and Coverage in Natural Language Generation
This paper introduces a novel framework for evaluating Natural Language Generation (NLG) by assessing "semiotic alignment" between texts. It proposes two metrics, Semiotic Fidelity and Semiotic Coverage, which go beyond simple lexical overlap to capture differences in contextual meaning and discourse references. The fr…