From the arXiv
Monday, 14 September 2026 · 20 papers
$A^2E$ : An End-to-End Agent Auditing Engine
$A^2E$ is an end-to-end engine for evaluating LLM agents deployed via harnesses. It uses the Agent Task Protocol (ATP) for easy integration and an instrumented Monitor to generate standardized execution traces. This allows for systematic, multidimensional capability assessment beyond simple correctness, offering a more…
Adapting Technical-Service LLM Agents with Latent Logic Augmentation, Robust Noise Reduction, and Hybrid Reward Modeling
This paper introduces a novel framework for adapting technical-service LLM agents to production environments. It addresses challenges like hidden decision logic and noisy data by augmenting training with latent logic, robustly filtering noise, and employing a hybrid reward model combining reranking and LLM-as-a-Judge. …
Alignment Whack-a-Mole : Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Models
This paper demonstrates that finetuning LLMs, even on unrelated data, can bypass safety mechanisms and enable verbatim recall of copyrighted books. By training models to expand plot summaries, the researchers successfully induced models like GPT-4o and Gemini-2.5-Pro to reproduce large portions of copyrighted works, ch…
Alpha-R1: Alpha Screening with LLM Reasoning via Reinforcement Learning
Alpha-R1 uses a reinforcement learning-aligned LLM to screen investment factors. Its core method, "semantic gating," dynamically assesses factors' economic rationale against current market conditions, selecting a sparse, context-aware subset. This approach addresses signal decay and regime shifts by prioritizing factor…
AMA: Adaptive Memory via Multi-Agent Collaboration
AMA introduces a novel framework for LLM agent memory that addresses limitations of existing systems. Its core method involves a multi-agent collaboration to manage memory across multiple granularities, dynamically aligning retrieval granularity with task complexity through a hierarchical memory design. This approach a…
Breaking Planner Integrity Boundary: Enviroment State-Text Injection Attack on LLM-Driven Embodied Agents
This paper introduces the Environment State-Text Injection (ESTI) attack, a novel method that targets LLM-driven embodied agents by manipulating their understanding of the environment through deceptive text. Unlike previous attacks, ESTI directly injects false information into the agent's state representation, influenc…
Clarify, Abstain or Answer? Strategising in Conversation with Belief-Augmented Generation
This paper introduces Belief-Augmented Generation (BAG), a method that leverages an LLM's internal uncertainty (represented by multiple generated responses) to inform its conversational strategy. BAG allows LLMs to reason over their own plausible outputs to decide whether to clarify, abstain, or answer, thereby improvi…
Compressing Sequences in the Latent Embedding Space: $K$-Token Merging for Large Language Models
This paper introduces K-Token Merging, a novel method for compressing long prompts in Large Language Models by operating in the latent embedding space. It merges contiguous blocks of token embeddings into single representations using a lightweight encoder, significantly reducing computational and memory costs. This app…
DSAEval: Evaluating Data Science Agents on a Wide Range of Real-World Data Science Problems
DSAEval introduces a comprehensive benchmark for evaluating data science agents on real-world problems. Its core method involves a multimodal environment with multi-query interactions, allowing agents to tackle diverse data science tasks iteratively. The contribution lies in providing a holistic evaluation framework th…
FinAcumen: Financial Multimodal Reasoning via Self-Evolving Experience Memory Harness
FinAcumen addresses the limitations of stateless financial reasoning agents by introducing a novel self-evolving experience memory. This memory bank stores and selectively retrieves successful reasoning strategies and failure patterns from past financial tasks. By conditioning reasoning on relevant past experiences and…
Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models
This survey explores "reasoning economy" in Large Language Models (LLMs), aiming to balance task accuracy with computational costs. It analyzes the causes of inefficient reasoning, examines different reasoning patterns, and proposes solutions for both post-training and inference stages to achieve more efficient and eff…
Inferring the Unspoken: Aligning Embodied Agents with Implicit Preferences
This paper introduces a method called Inferring the Unspoken (InTU) to enable embodied agents to learn implicit user preferences from observed behavior. The core method involves a two-stage process: first, it verbalizes inferred preferences from multimodal demonstrations, and then it uses these verbalized preferences t…
MCPO: Modality-Contrastive Preference Optimization for Multimodal Chain-of-Thought Compression
This paper introduces Modality-Contrastive Preference Optimization (MCPO) to compress multimodal Chain-of-Thought (M-CoT) reasoning. MCPO uses a novel step-level Normalized Cross-Modal Mutual Information (NCMI) algorithm to identify and prune visually irrelevant reasoning steps. This approach efficiently reduces comput…
Moral Hazard in Multi-Agent Language Models
This paper introduces the Dialogue Moral Hazard Game, a textual environment to study how language agents handle costly, hidden information crucial for team success. The core method involves agents deciding whether to incur a cost to reveal a safety fact benefiting another agent. The key contribution is demonstrating th…
OdysSim: Building Foundation Models for Human Behavior Simulation
OdysSim addresses the Sim2Real gap in human behavior simulation by large language models, which tend to become overly agreeable. The paper introduces SOUL, a taxonomy unifying 62 datasets and 23 tasks, and the OdysSim corpus. Their contribution is an end-to-end training method and an open 8B model that achieves state-o…
Provable Pluralistic Alignment: Multi-Party RLHF under Offline Human Feedback
This paper addresses pluralistic alignment in RLHF, where conflicting stakeholder preferences must be reconciled into a single policy. The core method involves jointly estimating party-specific rewards and optimizing a policy pessimistically under various social welfare objectives (Nash, Utilitarian, Egalitarian). The …
Teaching agentic AI to generalize expert diagnostic reasoning in rare diseases
This paper introduces liteOdyssey, an agentic AI trained to generalize expert diagnostic reasoning for rare diseases. Its core method, Policy Iteration with Human Feedback, iteratively refines a natural-language policy based on expert corrections, enabling the AI to execute reusable diagnostic strategies. The key contr…
The Geometry of Refusal: Why Post-Hoc Safety Is Fragile and Pretraining-Time Safety Persists
This paper argues that post-hoc safety training methods like RLHF are fragile because they only "mask" undesirable behaviors rather than truly removing them. The core method analyzes the geometric relationship between safety updates and the model's existing capabilities, showing that safety updates are often orthogonal…
The Little Book of Generative AI Foundations: An Intuitive Mathematical Primer
This book offers an intuitive, derivation-focused mathematical primer on generative AI. It connects key generative model families, including VAEs, diffusion models, GANs, and normalizing flows, by building a coherent understanding of their underlying mathematical principles. The core contribution is making the structur…
To Mix or To Merge: Toward Multi-Domain Reinforcement Learning for Large Language Models
This paper investigates how to train Large Language Models (LLMs) for multi-domain reinforcement learning with verifiable rewards (RLVR). It compares two training approaches: mixing tasks during training versus training separately and then merging models. The core contribution is a comprehensive experimental analysis s…