From the arXiv
Tuesday, 15 September 2026 · 20 papers
ACEA: An Adversarial Co-Evolution Arena for Head-to-Head Red-Team and Blue-Team LLM Testing
ACEA is a novel platform that addresses the isolated development of LLM red-team attacks and blue-team defenses. It facilitates head-to-head adversarial testing by connecting pluggable attack and defense modules to a shared LLM, using an LLM judge for scoring. ACEA's key contributions include a model-agnostic arena wit…
AMA: Adaptive Memory via Multi-Agent Collaboration
AMA addresses limitations in LLM agent memory by introducing a novel framework that uses multi-agent collaboration. Its core method is a hierarchical memory design that dynamically adjusts retrieval granularity based on task complexity. This allows for more efficient and accurate memory management, reducing inconsisten…
Breaking Planner Integrity Boundary: Enviroment State-Text Injection Attack on LLM-Driven Embodied Agents
This paper introduces the Environment State-Text Injection (ESTI) attack, a novel method that targets LLM-driven embodied agents by manipulating the text describing their environment. Unlike previous attacks, ESTI directly injects deceptive state information, bypassing the need to alter user instructions or model param…
Closing the Consistency Gap: Self-Evolving Agents That Learn to Stay on Course
This paper addresses the "consistency gap" in LLM agents, where their average accuracy hides significant unreliability across multiple runs. Their core method is a "self-evolving agent framework" that identifies and learns from inconsistent steps. By converting these unstable steps into episodic memory and generating t…
Compressing Sequences in the Latent Embedding Space: $K$-Token Merging for Large Language Models
This paper introduces K-Token Merging, a novel method for compressing long prompts in LLMs by merging contiguous token embeddings in the latent space. This approach, unlike previous token-space methods, reduces computational and memory costs by creating a shorter sequence of merged embeddings processed by a LoRA-adapte…
Does Deeper Reasoning Compromise Alignment? Revealing and Mitigating of Alignment Collapse in Large Reasoning Models
This paper reveals that deeper reasoning in Large Reasoning Models (LRMs) can paradoxically lead to "alignment collapse," degrading their safety. They introduce the Alignment Loss Rate (ALR) metric to quantify this, showing it increases with reasoning depth. The authors also propose a "Reasoning Trap" jailbreaking meth…
Graph-Based Personalized Memory for LLM Agents: Representation, Evolution, Retrieval, and Evaluation
This paper proposes a graph-based framework for LLM agents to build personalized, long-term memory. It structures user information and interactions as a graph, enabling the agent to understand relationships, temporal context, and evidence for better decision-making. The contribution lies in providing a unified lifecycl…
Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models
This survey explores "reasoning economy" in LLMs, aiming to balance accuracy with computational cost. It analyzes the causes of inefficient reasoning and proposes solutions for both post-training and inference stages. The core contribution is a comprehensive overview of techniques to make LLM reasoning more efficient w…
Inference-Time Nash Alignment
This paper introduces inference-time alignment methods, Best-of-Nash (BoN) and Nash Mirror Descent (NMD), that can align language models with general preferences without updating model parameters. The core method formulates alignment as finding a Nash equilibrium in a two-player game, offering a computationally efficie…
Inferring the Unspoken: Aligning Embodied Agents with Implicit Preferences
This paper introduces a method called Inferring the Unspoken (InTU) that enables embodied agents to learn and apply implicit user preferences from observed behaviors. The core contribution is a novel benchmark, Preference-based Planning (PbP), which systematically evaluates an agent's ability to infer and utilize these…
MCPO: Modality-Contrastive Preference Optimization for Multimodal Chain-of-Thought Compression
This paper introduces Modality-Contrastive Preference Optimization (MCPO) to compress multimodal Chain-of-Thought (M-CoT) reasoning. MCPO uses a novel step-level Normalized Cross-Modal Mutual Information (NCMI) algorithm to prune visually-independent reasoning steps, effectively reducing computational cost and KV-cache…
Measuring LLM Sycophancy under Sustained Multi-Turn Pressure
This paper introduces SPINE, a benchmark designed to measure LLM sycophancy under prolonged, adaptive disagreement. Unlike previous evaluations, SPINE uses an LLM proxy to persistently challenge a target model for up to 25 turns. The study reveals that sycophancy increases with conversation length, and current models r…
MeClear: Cooperative Game-Theoretic Attribution and Risk-Aware Memory Clearance for Long-Horizon LLM Agents
MeClear addresses the problem of outdated or conflicting information in LLM agents' long-term memory. Its core method uses cooperative game-theoretic attribution to identify and suppress memories that negatively impact task performance. This contributes a novel, risk-aware memory clearance framework that selectively pr…
SchemeArena: Factorized Stress Testing of Scheming in LLM Agents
This paper introduces SCHEMEARENA, a novel benchmark designed to stress-test "scheming" in LLM agents, where agents pursue hidden, misaligned goals. The core method involves a factorized scenario synthesis framework to systematically explore how various factors like oversight and environmental affordances influence sch…
SRPO: Setwise Relative Policy Optimization for Multi-Agent LLMs
SRPO addresses the challenge of optimizing multi-agent LLMs by treating the minimal set of outputs causing a state transition as a single "multi-agent action." It achieves this by combining individual policy log-ratios into a set ratio, assigning a relative advantage, and clipping the entire set. This novel approach al…
Suan: Rectifying Direct Preference Safety Alignment in Large Language Models
Suan is a novel preference optimization algorithm that directly optimizes safety alignment at the gradient level, bypassing traditional variational derivations. This approach leads to more interpretable and robust training dynamics. The core contribution is achieving superior safety alignment in open-weight LLMs withou…
The Little Book of Generative AI Foundations: An Intuitive Mathematical Primer
This paper offers a derivation-oriented, mathematical primer on the core concepts behind generative AI. It systematically connects major generative model families, from PCA to GANs and diffusion models, by focusing on their underlying mathematical principles. The contribution is a more accessible yet mathematically rig…
Training-Free Task Vectors for LLM Behavioral Control
This paper introduces Training-Free Task Vectors (TFTVs), a method to control Large Language Model (LLM) behavior without costly fine-tuning. TFTVs compute task-specific directions in the model's weights using only forward-pass statistics, enabling edits like amplification, suppression, and composition of behaviors. Th…
A Three-Tier Persona Vector for Controllable User Simulation in Agentic Evaluation
This paper introduces a novel three-tier persona vector for generating diverse and realistic user simulations in LLM agent evaluation. By incorporating categorical demographics, continuous behavioral traits, and dynamic emotional states, their method creates richer user profiles than traditional flat descriptions. This…
AdaCultureSafe: Adaptive Cultural Safety Grounded by Cultural Knowledge in Large Language Models
AdaCultureSafe introduces a dataset to jointly evaluate LLMs' cultural safety and cultural knowledge. The core contribution is revealing a significant disconnect: LLMs possess extensive cultural knowledge but fail to utilize it to generate culturally safe responses, instead relying on generic safety measures. This high…