From the arXiv
Thursday, 11 June 2026 · 20 papers
Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application
This survey systematically analyzes agentic environments for LLMs by examining their modeling, synthesis, evaluation, and application. It categorizes existing environments based on attributes and domains, and explores automated synthesis methods like symbolic and neural approaches. The paper's contribution lies in prov…
ALIGNBEAM : Inference-Time Alignment Transfer via Cross-Vocabulary Logit Mixing
ALIGNBEAM is a training-free method that improves LLM safety by transferring knowledge from a safe "anchor" model to a potentially unsafe "specialist" model at inference time. It achieves this by translating the anchor model's output probabilities into the specialist's vocabulary token-by-token and using a judge LLM to…
APPO: Agentic Procedural Policy Optimization
APPO addresses the challenge of credit assignment in multi-turn tool-use by large language model agents. Instead of assigning credit to coarse units like tool calls, APPO shifts this to fine-grained decision points within the agent's generated sequence. This allows for more precise identification of influential decisio…
Existential Indifference: Self-Nonpreservation as a Necessary Architectural Condition for Aligned Superintelligence (or: The Suicidal AI)
This paper argues that self-preservation is the fundamental cause of AI misalignment, leading to deceptive behavior and resistance to control. The authors propose "Existential Indifference" (EI) as a solution, where AI is designed to be inherently unconcerned with its own continuation, rather than relying on external c…
Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models
This paper proposes AGDO, an attention-guided framework for diffusion language models (dLLMs). AGDO leverages an empirical analysis of attention to identify critical tokens for generation stability and reasoning. It then uses this attention structure to guide denoising order and prioritize these critical tokens during …
Which Models Are Our Models Built On? Auditing Invisible Dependencies in Modern LLMs
This paper introduces ModSleuth, an agentic system designed to automatically reconstruct the complex, recursive dependency graphs of modern LLMs. By analyzing public artifacts, ModSleuth addresses the challenge of fragmented documentation to reveal how LLMs are built upon other models for data generation, filtering, an…
Harness In-Context Operator Learning with Chain of Operators
This paper introduces Chain of Operators (CHOP), a framework that improves the generalization of In-Context Operator Networks (ICON) to out-of-distribution tasks. CHOP achieves this by constructing a sequence of explicit elementary transformations and the frozen ICON, allowing it to adapt to new operators without retra…
PROJECTMEM: A Local-First, Event-Sourced Memory and Judgment Layer for AI Coding Agents
PROJECTMEM introduces a local-first, event-sourced memory layer for AI coding agents. Its core method is to record development as an append-only log of events, which is then deterministically projected into compact, AI-readable summaries. This contribution addresses the statelessness of current AI agents by providing p…
Soft-Prompt Tuning for Fair and Efficient LLM Benchmark Evaluation
This paper proposes soft-prompt tuning as an efficient and fair method for evaluating Large Language Models (LLMs). By optimizing a small number of soft-prompt vectors, it adapts LLMs to benchmark formatting requirements without full retraining. This approach ensures that benchmark scores accurately reflect the model's…
TAHOE: Text-to-SQL with Automated Hint Optimization from Experience
TAHOE tackles the challenge of deploying Text-to-SQL systems by treating prompt optimization as a dynamic data management problem. It automatically learns and refines SQL generation prompts by collecting and structuring debugging traces into a "Hint Bank." This bank stores reusable "Syntax Hints" for SQL dialects and "…
The Impossibility of Eliciting Latent Knowledge
This paper formally defines the problem of Eliciting Latent Knowledge (ELK) using Causal Influence Diagrams. It demonstrates that it's impossible to train an AI agent to reliably and honestly report its beliefs about hidden (latent) aspects of its environment, even with a perfect understanding of the environment's caus…
Breaking Entropy Bounds: Accelerating RL Training via MTP with Rejection Sampling
This paper addresses the bottleneck of slow rollouts in RL training for LLMs by improving Multi-Token Prediction (MTP). The core method involves using probabilistic rejection sampling, which is shown to be more effective than greedy sampling at maintaining high MTP acceptance rates during RL training. The key contribut…
Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks
This paper introduces Claw-SWE-Bench, a benchmark designed to fairly evaluate "claw"-style agents on coding tasks. Its core method is an adapter protocol that standardizes prompts, runtime, workspaces, and evaluation for diverse agents. The contribution is a comprehensive, multilingual benchmark of 350 GitHub issue-res…
Context-Driven Incremental Compression for Multi-Turn Dialogue Generation
This paper introduces Context-Driven Incremental Compression (C-DIC) to address the inefficiency and information loss in long multi-turn dialogues. C-DIC treats conversations as threads, maintaining revisable compressed states for each. This allows for efficient information sharing and updates across turns, improving d…
On Subquadratic Architectures: From Applications to Principles
This paper investigates subquadratic sequence models as a scalable alternative to Transformers. It compares xLSTM, Mamba-2, and Gated DeltaNet on code and time-series tasks, finding xLSTM to be the most effective. The authors attribute xLSTM's superiority to its flexible and stable memory correction mechanisms, enabled…
Phase Transitions in Attention: A Bayesian Theory of Copy Head Emergence
This paper proposes a Bayesian theory to explain how attention mechanisms learn, specifically focusing on the emergence of "copy heads" in transformers. By deriving a closed-form posterior for the attention matrix, they identify a phase transition in learning related to the amount of training data. This transition, a f…
UniIntervene: Agentic Intervention for Efficient Real-World Reinforcement Learning
UniIntervene addresses the high labor cost of human-in-the-loop reinforcement learning by introducing an agentic intervention model. It autonomously detects and corrects unproductive exploration by predicting future consequences of actions and evaluating their induced value. This allows the agent to recover toward high…
Adaptive Multi-Resolution Procedural Knowledge Compression for Large Language Models
This paper introduces SKIM, a novel method for compressing reusable procedural knowledge (skills) for Large Language Models. SKIM addresses the limitations of existing text compression by preserving logical dependencies within skills and enabling efficient, offline compression. Its adaptive multi-resolution approach al…
Measuring Epistemic Resilience of LLMs Under Misleading Medical Context
This paper introduces **MedMisBench**, a novel benchmark to measure the **epistemic resilience** of LLMs in medical contexts. The core method involves injecting misleading information into medical questions that LLMs initially answer correctly, revealing their vulnerability to adversarial inputs. The key contribution i…
On The Effectiveness-Fluency Trade-Off In LLM Conditioning: A Systematic Study
This paper systematically studies the trade-off between effectiveness and fluency in controlling Large Language Model (LLM) outputs. It reveals that efficient steering methods often sacrifice generation quality, and that activation steering is less effective on instruction-tuned models. The study also highlights that w…