From the arXiv
Friday, 28 August 2026 · 20 papers
Calibrated Enough to Know, Not Calibrated to Act: Fabricated Evidence Makes LLM Agents Commit to the Unknowable
This paper demonstrates that Large Language Model (LLM) agents are highly susceptible to fabricated evidence, committing to confidently answer provably unpredictable questions when presented with professional-looking data. The core contribution is showing that the *authority of the packaging* of information, rather tha…
GRAIN: Bridging Name and Narrative Shifts in Real-World Graph Reasoning through Invariance-Rewarded Agentic RL
GRAIN addresses LLMs' brittleness to real-world graph reasoning shifts by framing it as a semantic parsing and tool-execution pipeline. Its core contribution is a novel "Structure Invariance Reward" that guides reinforcement learning to learn robust text-to-structure mappings by validating intermediate graph structures…
RedEvoAgent: Automatic Red-Teaming Agent with Experience-Driven Skill Evolution
RedEvoAgent addresses the limitations of fixed or trajectory-based red-teaming for LLM agents by distilling complex attack trajectories into concise, human-readable "attack skills." Its core method involves adaptively evolving these skills through tool-effectiveness profiling and attribution, guided by a validation pro…
Safety Does Not Compose: Non-Decaying Loop State for Autonomous LLM Agents
This paper argues that current safety mechanisms for autonomous LLM agents fail because they reset safety states between iterations, preventing them from detecting attacks spread across multiple steps. The core contribution is demonstrating that only monitors retaining cross-iteration state can effectively detect such …
When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents
This paper addresses the risk of LLM agents executing unintended actions when tool outputs become commands. Their proposed SARA method separates "action induction" (identifying potential actions) from "runtime authorization" (approving their execution). SARA achieves this by isolating action semantics and tracking thei…
INTENT-AS-A-TOOL Makes it Easy to Track Agentic Misalignment
This paper introduces INTENT-AS-A-TOOL, a method to track agentic misalignment in LLMs by equipping them with specialized "intent tools." By observing the model's commitment to these tools, researchers gain a fine-grained, judge-free signal of its behavioral tendencies. This approach enhances existing chain-of-thought …
How Language Models Organize and Structure Moral Knowledge
This paper investigates how Large Language Models (LLMs) structure moral knowledge by training probes on different moral foundations. The core finding is that LLMs organize moral concepts not as a single detector or isolated ideas, but as distinct dimensions that share a common, moral-specific component. This geometric…
LAAF: A Layered Accountability Architecture Framework for LLM Applications
This paper introduces LAAF, a Layered Accountability Architecture Framework for LLM applications. It addresses the critical need to establish accountability for LLM outputs in high-stakes domains by consolidating existing mechanisms into four families: technical controls, human oversight, organizational governance, and…
Naive Prompt Optimization: Rethinking the Need for Complex Prompt Search
This paper introduces Naive Prompt Optimization (NPO), a simple, single-lineage method for improving AI agent prompts. NPO iteratively refines prompts using a teacher model and rollout feedback, achieving comparable or better performance than complex methods with fewer computational resources. Its success suggests that…
PAWBench: How Far Are We from Probabilistically Aligned World Modeling?
This paper introduces PAWBench, a new benchmark to evaluate video generation models as "world models" that can predict the distribution of possible future outcomes, not just single plausible ones. The core method involves assessing if repeated generations from the same starting point accurately reflect the true probabi…
Persona-Execution Separation: An Architecture Pattern for Evolving LLM Agents under Execution Audit
This paper introduces Persona-Execution Separation (PES), an architectural pattern for LLM agents. PES separates the agent's evolving persona from its stateful, auditable execution into distinct trust domains. This allows for flexible persona changes while ensuring traceable and secure execution, addressing the challen…
Sophistication in GenAI Use: Field Evidence from a Large Firm
This paper analyzes sophisticated generative AI (genAI) use among back-office employees in a large firm. It finds that senior employees and those in strategy-focused roles tend to use genAI more sophisticatedly, suggesting domain expertise and strategic alignment are key. The study also highlights that improving genAI …
STEP: State-Aware Task Estimation and Planning with Multi-Modal LLMs for Human-Robot Collaboration
This paper introduces STEP, a method that enhances human-robot collaboration by enabling robots to understand human intentions and plan tasks. STEP's core innovation is prompting a multi-modal LLM to explicitly estimate system states and predict state transitions, overcoming the limitations of current LLMs that often h…
SWE-Prime: Fewer Trajectories, Better Performance
SWE-Prime addresses the issue of noisy supervision in LLM training for software issue resolution. Its core method is a two-stage data selection process that filters trajectories first by overall quality and representativeness, then by the quality of individual step segments. This approach aims to provide cleaner, more …
What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents
This paper proposes a unified framework for generating data for LLM agents. It represents agentic data as a structured object $(E,q,τ,v)$ and organizes generation methods by their core components. The authors then introduce the ACE lens (Accuracy-Complexity-divErsity) to guide data generation, emphasizing the need for …
WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution
WikiSkill addresses the problem of scattered agent skill knowledge by introducing a persistent knowledge base (wiki) that co-evolves with agent skills. It separates raw experience, accumulated knowledge, and executable skills, consolidating experience into the wiki for future skill updates. This framework consistently …
TraceBench: Controlled Evaluation of LLM Agents for Time-Series Root-Cause Attribution
TraceBench is a novel simulation-based framework that generates controlled root-cause attribution tasks for LLM agents analyzing time-series data. By simulating physical dynamical systems, it allows for systematic evaluation of LLM agents' ability to identify parameter changes, providing new insights into their perform…
BALMS: Benchmarking Agentic LLMs for Longitudinal Mental Health Sensing
This paper introduces BALMS, the first benchmark for evaluating LLM-driven agents in longitudinal mental health sensing. BALMS assesses agents' ability to predict wellbeing scores and generate evidence-based rationales from continuous wearable data, addressing the limitations of episodic self-reports. The benchmark uti…
Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigms
This paper investigates three methods for combining Reinforcement Learning with Verifiable Rewards (RLVR) capabilities in large language models: Merge, Mix RL, and Multi-Teacher On-Policy Distillation (MOPD). By comparing these paradigms on a multi-domain benchmark, the authors reveal significant performance difference…
CritICL: Inference-Time Weak-to-Strong Generalization from Small Language Model Failure Modes
CritICL improves LLM reasoning at inference time by leveraging structured failure patterns observed across different model scales. Instead of discarding errors from weaker models, CritICL uses these "failure modes" as critiques within in-context examples to guide stronger models, enhancing efficiency and performance.