From the arXiv
Wednesday, 7 October 2026 · 20 papers
Agent in a Bottle: Can LLM Agents Turn Their Capabilities Into Cheap, Scalable Artifacts?
This paper introduces "bottling," the ability of LLM agents to autonomously create cost-effective, task-specific solutions for large workloads. The core method involves agents deciding how to tackle an entire unlabelled dataset within fixed resource budgets, potentially by training smaller models or writing programs. T…
Principled Under Pressure: Post-Training Decides Whether LLMs Act on Their Own Moral Judgment
This paper introduces a novel method to evaluate whether Large Language Models (LLMs) act on their own moral judgments when faced with pressure. By posing scenarios twice – once as an agent's decision and once as a third-person judgment – the researchers can identify when models violate their own stated values. The key…
ScienceClaw: Benchmarking Continual Self-Evolution of AI-for-Science Agents Across the Natural and Social Sciences
This paper introduces ScienceClaw, a framework for benchmarking the continual self-evolution of AI-for-science agents. Its core method is fixed-parameter program self-evolution, which integrates task solving, scientific verification, and program updates. ScienceClaw's contribution lies in its comprehensive evaluation a…
Semantic Behavioral Watermarking: Paraphrase-Robust and Forgery-Resistant Provenance for LLM Agents
This paper introduces Semantic Behavioral Watermarking (SBW), a novel method for embedding provenance in LLM agents' high-level action choices, independent of output tokens. SBW achieves paraphrase robustness by watermarking semantic action clusters and is forgery-resistant through keyed collision-resistant binning, ad…
SquidAgent: Parallelize Wisely, Coordinate Efficiently
This paper introduces SquidAgent, a method for parallelizing LLM-based agents to reduce latency in multi-step tasks. It addresses the inefficiency of existing parallel systems by identifying and mitigating "re-exploration" and "alignment" costs. SquidAgent proposes a principled criterion to determine when parallelizati…
Toward Alignment Scaling Laws: A Framework and First Preregistered Measurements
This paper proposes a framework to study how model alignment scales with capability, treating alignment as a family of measurable scaling relations rather than a single property. The core method models the "alignment burden" for different risk categories as a power law of model capability, allowing researchers to predi…
WorldSolver: Can LLM Agents Simulate the Physical Dynamics via Solver Generation?
WorldSolver introduces a benchmark of 168 physics simulation tasks from computer graphics to evaluate LLM agents' ability to generate physics solvers. The core method involves LLM agents completing code scaffolds by implementing the underlying physical dynamics for given scenarios. This work contributes by exploring an…
Towards In-Parameter Memory Augmentation for Large Language Models
This paper surveys methods for augmenting Large Language Models (LLMs) with "in-parameter memory." The core method involves integrating reusable memory information directly into model parameters or parameter-like objects that are composed during inference. This approach aims to overcome the limitations of in-context le…
Adaptive Power Sampling for LLM Reasoning
This paper introduces Adaptive Power Sampling (APS), a method to improve LLM reasoning by adjusting the "sharpening" of the model's output distribution on a per-query basis. Unlike previous uniform approaches, APS leverages the relationship between answer agreement and the model's self-reward to dynamically determine t…
AdvSim2Real : Training Web Agents Against Adaptive Prompt Injection in a Web World Model
This paper introduces AdvSim2Real, a method for training web agents to resist prompt injection attacks. It co-evolves the agent, a task curriculum, and an injection adversary within a simulated web environment. This approach allows the agent to become more capable and robust by continuously adapting to new attacks and …
How Much Evidence Should a Coding Agent's Self-Correction Carry? Adaptive Dirichlet Evidence for Self-Distillation
This paper introduces Effective-Evidence Self-Distillation (EESD) to improve coding agents' self-correction learning. EESD adaptively weights corrections based on execution support and evidence strength, unlike fixed weighting methods. This approach significantly reduces future prediction errors by better leveraging se…
Latent space bias directions in LLMs capture confidence, not fairness
This paper investigates the debiasing direction used in activation steering for LLMs. It finds that this direction primarily captures model confidence, steering towards lower-probability tokens, rather than representing actual bias. Consequently, while it reduces measured bias, it does so by making the model less confi…
MINDSET: Energy-based Schema Evolution for Long Conversational Agent Memory
MINDSET addresses the challenge of long-term memory for conversational agents by organizing past interactions into versioned schemas. It achieves this through energy-based state transitions, where new conversational episodes are integrated by minimizing distortion, contradiction, and inconsistency. This approach allows…
nanoMuse: An Open-Source Personal Agent for Every Device You Own
nanoMuse provides an open-source personal agent designed to operate across all of a user's devices. Its core method involves a distributed architecture where agents on each device communicate through a shared relay, enabling persistent, multi-device conversations and actions. The key contribution is offering a transpar…
One for All, All for One: Coordinated Multi-Agent Diffusion Steering via Stochastic Optimal Control
This paper introduces Coordinated Multi-Agent Diffusion Steering (CMDS), a method that reuses pre-trained diffusion models as independent component generators. CMDS learns a control mechanism to coordinate these frozen models, treating the problem as stochastic optimal control. This approach balances a global reward fo…
Secure Speculative Decoding for Large Language Models
This paper introduces the first systematic study of security vulnerabilities in speculative decoding for LLMs. It reveals a significant trade-off where efficiency gains from speculative decoding disproportionately increase the risk of jailbreak and prompt injection attacks. The authors then propose SecureSD to address …
Sherpa: Teaching LLMs to Teach Adaptively
Sherpa is a multi-turn reinforcement learning framework that trains LLMs to teach by directly optimizing student learning outcomes. It addresses the limitation of existing methods by simulating diverse student archetypes with unique learning preferences and adapting the teacher's instruction accordingly. This adaptive …
VeriFine: Scaling Verification for Self-Improvement in Embodied Reasoning
VeriFine addresses the bottleneck of fixed judges in self-improving embodied reasoning agents. Its core method is a co-evolutionary framework where the policy, training curriculum, and judge adapt together. This allows the agent to scale verification, discover new failure patterns, and ultimately achieve more robust se…
Wiki-Talkie: Multilingual Benchmarking of Persona-Based Agents on Real-World Discussions
This paper introduces Wiki-Talkie, a multilingual dataset of real-world Wikipedia talk page conversations paired with realistic user personas. Its core method involves using this dataset to evaluate Large Language Models (LLMs) on their ability to generate human-like dialogue based on these grounded personas. The main …
Agentic AutoRAG: RAG Pipeline Optimization through Reasoning-Driven Agents
Agentic AutoRAG optimizes RAG pipelines by using LLM agents to reason about hyperparameter choices. Its core method involves a "Diagnoser" agent that attributes failures to either retrieval or generation stages, and a "Proposer" agent that suggests new configurations based on this diagnosis and a knowledge base of mode…