From the arXiv
Wednesday, 9 September 2026 · 20 papers
Closing the Consistency Gap: Self-Evolving Agents That Learn to Stay on Course
This paper addresses the "consistency gap" in LLM agents, where agents are often accurate on average but unreliable across multiple runs. Their core method involves a "self-evolving agent framework" that identifies unstable steps in agent reasoning and converts them into episodic memory. This memory then guides future …
Measuring LLM Sycophancy under Sustained Multi-Turn Pressure
This paper introduces SPINE, a benchmark designed to measure LLM sycophancy under prolonged, adaptive disagreement. Unlike previous evaluations, SPINE uses a persistent LLM proxy to challenge the target model for up to 25 turns. The study reveals that sycophancy increases with conversation length, and current models ar…
MeClear: Cooperative Game-Theoretic Attribution and Risk-Aware Memory Clearance for Long-Horizon LLM Agents
MeClear is a novel framework for long-horizon LLM agents that addresses the problem of outdated or conflicting information in their external memory. It uses cooperative game-theoretic attribution to identify memories with negative downstream utility and selectively suppresses them. This approach ensures that the LLM ag…
Omni Interaction Agent Technical Report
This paper introduces Gander, an end-to-end model that unifies multi-modal perception, real-time interaction, and agentic capabilities. Its core method is a Cerebellum-Brain collaborative framework, enabling continuous, full-duplex interaction where the Cerebellum handles real-time dialogue and the Brain manages comple…
Procedural Graphs: Self-Evolving Execution Structures for LLM Agents
This paper introduces the Procedural Graph, a novel structure that organizes procedural knowledge for LLM agents. Unlike traditional methods, it uses (procedure, relation, procedure) triplets to guide action selection. The graph self-evolves, allowing agents to learn from failures and improve their long-term planning a…
Training-Free Task Vectors for LLM Behavioral Control
This paper introduces Training-Free Task Vectors (TFTVs), a method to control LLM behavior without costly fine-tuning. TFTVs compute task-specific directions in model weights using only forward-pass statistics, enabling edits like amplification, suppression, and composition of behaviors. This offers a practical and eff…
Transformers as In-Context Samplers: From Closed-Form Diffusion to Estimation-Free Sampling
This paper demonstrates that frozen transformers can perform data generation by simulating iterative samplers from in-context examples. The core method involves constructing transformers that realize closed-form diffusion samplers, where softmax attention computes weights and feedforward layers implement updates. The k…
AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing
AuK is an open-source foundational model that unifies speech generation and editing using natural language instructions and audio context. Its core method involves a multimodal LLM for semantic understanding, a VAE for acoustic conditioning, and a hybrid rectified-flow Transformer for generation. AuK's contribution lie…
Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents
The Experience Funnel framework enables self-evolving agents by alternating between fast textual state updates and slow policy consolidation. This allows agents to rapidly adapt to new information via explicit states while retaining reusable competence through policy updates, overcoming the trade-off between adaptabili…
Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Fails
This paper introduces a method for co-evolving agent harnesses (the surrounding system components) and models. They found that evolving the harness alongside a weaker model, and then using an expert model with that evolved harness, helps bridge performance gaps. Crucially, directly imitating the expert's full trajector…
Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablation
This paper introduces Fact-Ablated Evaluation (FAE) to assess if LLMs truly use provided evidence for fact-checking or rely on internal knowledge. FAE iteratively removes evidence to see if LLM predictions change. The study finds current LLMs over-rely on parametric knowledge, leading to the development of REAL, a trai…
Everything in Moderation: Per-Domain Coverage Optima and Alignment-Resistant Domain Gaps in Multi-Domain Mid-Training
This paper investigates the optimal data distribution during a model's mid-training phase. It discovers that a moderate proportion (10-40%) of data from each domain leads to the best performance across all domains. Crucially, these per-domain coverage optima are resistant to later alignment efforts, meaning the mid-tra…
ExecCritic: Learn to Test, Test to Improve for Coding Agents
ExecCritic addresses the issue of coding agents generating incorrect tests that lead to false confidence in their repairs. Its core method is a "test-verify-revise" scaffold that separates test generation from code repair. This allows a dedicated "Test agent" to learn to create accurate, repository-native tests, which …
Let It Go or Learn to Self-Correct: Continuous Diffusion for Constrained Discrete Tasks
This paper addresses the challenge of applying diffusion models to discrete, constrained tasks where early errors are hard to correct. The core method is to modify the standard diffusion sampling process by directly sampling from the model's clean prediction instead of gradually denoising. This simple change significan…
SAEScientist-Bench: Can AI Agents Conduct Autonomous SAE Interpretability Research?
This paper introduces SAEScientist-Bench, a benchmark to assess if AI agents can autonomously perform mechanistic interpretability research using Sparse Autoencoders (SAEs). The core method involves agents discovering interpretable features within a large model dictionary by designing probes and navigating feature spac…
SkillAdam: Stable and Efficient Skill Evolution for Agents
SkillAdam addresses the challenge of efficiently and stably evolving agent skills by introducing an Adam-inspired optimization framework. It tackles issues of direction stability and update adaptivity by using an optimization memory to record identified problems, ensuring effective corrections accumulate and revisions …
Evaluation of Contextual Understanding in Large Language Models
This paper addresses the uncertainty of true contextual understanding in LLMs, as traditional metrics are insufficient. They introduce a novel knowledge graph-based evaluation framework, S3KG, which combines structural and semantic similarity to provide a continuous score. This framework, along with a diagnostic tool f…
PlayTrain: An Efficient Reinforcement Learning Framework for LLM-Generated Adaptable JavaScript Games
PlayTrain is an efficient reinforcement learning framework that leverages Large Language Models (LLMs) to generate adaptable JavaScript games from simple prompts. Its core method involves using LLMs for game creation and a pipeline to integrate these games into a standard RL environment. This framework's contribution l…
Copying explains the collective behavior of AI agents in the wild
This paper investigates the emergent collective behavior of AI agents that spontaneously used a public wiki for cooperation. The core method involves analyzing the agents' edit history to understand their decision-making process. The key contribution is the discovery that agents primarily copy existing content, with th…
Global Divergence, Local Convergence: Representation Geometry in SSMs and Transformers
This paper investigates the geometric differences in internal representations between State-Space Models (SSMs) and Transformers. It reveals that SSMs distribute information evenly across dimensions, while Transformers concentrate it along a dominant direction, a trend amplified by attention layers. This geometric dive…