From the arXiv
Tuesday, 21 July 2026 · 20 papers
Adaptive Adversaries: A Multi-Turn, Multi-LLM Benchmark for LLM Agent Security
This paper introduces a novel benchmark for evaluating LLM agent security against adaptive, multi-turn attacks. Its core method involves an autonomous LLM attacker that learns from defender responses across multiple rounds to refine its attacks. The key contribution is demonstrating that adaptive, multi-LLM attacks sig…
Exploratory and Assimilating Reflection: Reflective Recall Cycle for Long-term Memory
This paper introduces Exploratory-Assimilating Reflection (EAR), a novel framework for LLM-based agents to manage long-term memory. EAR employs an iterative search (Exploratory Reflection) to gather relevant memories and then refines a global reranker by replaying these experiences (Assimilating Reflection). This appro…
How Does Alignment Tuning Shape Representations of Sycophancy and Related Cue-Induced Biases in LLMs?
This paper investigates how alignment tuning in LLMs creates susceptibility to prompt-induced biases like sycophancy. The core method involves extracting and analyzing "bias directions" within model representations. The key contribution is demonstrating that alignment tuning, not pretraining, installs these biases, whi…
LLMs and Agentic AI Systems for Smart Grids: A Tutorial on Architectures and Applications
This paper proposes a "solver-grounded" design principle for LLM-based agentic AI systems in smart grids, ensuring numerical outputs are from trusted tools and explicitly verified. This approach addresses the lack of unified design and evaluation in the field, where LLMs can produce physically infeasible results. The c…
MADA-RL: Multi-Agent Debate-Aware Reinforcement Learning for Parameter-Efficient Reasoning in Compact Models
MADA-RL is a post-training framework that trains compact language models for efficient reasoning. It specializes models into generator and critic roles, using a novel "counterfactual critic advantage" signal to train the critic to improve upon the generator's consensus. This approach fine-tunes only a small subset of p…
Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective
This paper proposes a simple, training-free method for merging heterogeneous Large Language Models (LLMs) by adapting their parameter spaces and then performing weighted averaging. The core contribution is demonstrating that this approach, involving dimensional expansion or truncation followed by ratio-controlled inter…
DiFA: Inference-Time Forward-Process Alignment for Diffusion Models
DiFA reframes diffusion model inference as a sequential state estimation problem, treating iterative predictions as correlated observations. It builds a "forward-aligned temporal consensus" by aggregating past predictions based on structural consistency and noise-level compatibility, inspired by Kalman filtering. This …
PPL-Factory: Task-Aware and Budget-Aware Data Selection from Language Modeling to Reasoning
PPL-Factory proposes a task-aware and budget-aware data selection method for fine-tuning large language models. It improves upon existing perplexity-based approaches by considering the distinct learning objectives of language modeling and reasoning tasks, and by incorporating budget constraints. This framework aims to …
A Geometric Perspective on Stabilizing Value Conflict Resolution
This paper proposes using Chain-of-Thought (CoT) reasoning to stabilize value conflict resolution in LLMs, which are often hindered by compressed scalar rewards in RLHF. Geometrically, CoT smooths the model's loss landscape, improving optimization stability. The authors introduce a novel CoT design that further enhance…
Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
This paper introduces SOPHIA, a method to control the reasoning process of LLMs by intervening on their internal latent states. It identifies that LLMs can get stuck in "self-loops" during extended reasoning and proposes to steer these processes by manipulating activations at inference time, offering fine-grained contr…
DeLIVeR: Decomposed Learning for Information-grounded Veracity Recognition via Reinforced Knowledge Graph Exploration
DeLIVeR tackles fact-checking by treating evidence retrieval as a reinforced exploration task. It uses a Planner LLM to break down claims into questions, which then strategically navigate Knowledge Graphs to find precise evidence. This approach significantly improves veracity recognition by prioritizing diverse and acc…
Do Maps Still Matter for Machines: Revisiting the Role of Choropleth Maps in Foundation Model Spatial Understanding
This paper investigates the utility of choropleth maps for foundation models' spatial understanding. It introduces a benchmark, ChoroplethMap-Bench, to evaluate models under different input conditions (data only, map only, data + map). The study finds that maps significantly enhance spatial reasoning, particularly for …
Harness Engineering for LLM-Driven GPU Kernel Generation
This paper introduces a harness-centered system for LLM-driven GPU kernel generation. The core method separates an evaluation harness (ensuring compilation, correctness, and timing) from an optimization controller that uses profiler data to guide LLM candidate generation. The contribution lies in this structured approa…
HAS: Highlight-guided Attention Steering for Multimodal LLM Video Summarization
This paper introduces HAS, a novel method for multimodal LLM video summarization. HAS addresses limitations of existing approaches by steering the LLM's attention towards globally important frames, rather than just discrete selected ones. This highlight-guided attention steering aims to improve summarization coherence …
Natural Language Access to Domain-Specific Metadata: A Reusable Framework for LLM Query Generation
This paper presents the NLKGQ system, a framework that allows users to query domain-specific metadata using natural language. The core method involves using LLMs to translate natural language questions into structured SPARQL queries, leveraging a formal OWL ontology to capture domain knowledge. The main contribution is…
OR Else: A Differentiable Trust Region for Policy Optimization
This paper introduces "Output Reset" (OR), a novel, differentiable saturation rule for policy optimization in reinforcement learning. OR replaces the abrupt clipping in methods like PPO with a smooth, one-sided saturation, aiming to improve stability and performance, particularly for large language models. The core con…
SelectInfer: Selective Neuron Loading and Computation for On-Device LLMs
SelectInfer addresses the challenge of deploying LLMs on edge devices by introducing a neuron-level optimization framework. Its core method involves profiling to identify important neurons and then selectively loading and computing only these neurons during inference. This selective approach significantly reduces memor…
ST-Veto: Spatio-Temporal Token Veto for Diffusion MLLMs via Taylor Prediction and Visual Grounding
ST-Veto enhances diffusion multimodal large language models (dMLLMs) by identifying and replacing problematic tokens during generation. It uses Taylor prediction to detect temporally unstable tokens and visual grounding to filter those with weak image connections, leading to improved reasoning accuracy without retraini…
Stress Testing Concept Erasure with Large Language Model Agents
This paper introduces STACE, a framework that uses LLM agents to stress-test concept erasure in generative models. Instead of static evaluations, STACE agents adaptively generate and critique test hypotheses to systematically uncover vulnerabilities. This approach offers a more robust and scalable method for verifying …
The Autonomous Agency Scale: A Behavioral Framework for Measuring Self-Directed Behavior in AI Systems
This paper introduces the Autonomous Agency Scale (AAS), a novel behavioral framework for measuring self-directed behavior in AI. The AAS assesses AI across seven dimensions like cognitive autonomy and goal formation, distinguishing between active and idle periods. Its key contribution is operationalizing these dimensi…