From the arXiv
Monday, 31 August 2026 · 20 papers
EvoUndo: Recoverability-Constrained Self-Evolution for LLM Agent Harnesses
EvoUndo addresses the challenge of LLM agents self-modifying their systems, which can lead to irreversible changes. The framework enables the representation, synthesis, diagnosis, and verification of recoverability for these self-modifications across different states. EvoUndo significantly improves the ability to recov…
GRACE:Gradient-guided Coreset Selection for LLM Unlearning
GRACE addresses the challenge of unlearning unwanted knowledge from LLMs when only a few examples of undesired behavior are provided. Its core method is a gradient-guided coreset selection that constructs both forget and retain sets. GRACE first identifies a "forget direction" from seed examples and then selects a comp…
Learning to Use Tools: Reinforcement Learning for Tool-Integrated Mathematical Reasoning
This paper introduces a method for improving mathematical reasoning in LLMs by integrating calculator tool use. The core approach involves supervised fine-tuning to teach tool usage patterns, followed by reinforcement learning with automated rewards to optimize performance. The key contribution is demonstrating that th…
ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL
ContextPilot addresses the challenge of managing extensive context in long-horizon agentic tasks by introducing a fine-grained Reinforcement Learning (RL) framework. Its core method involves teaching agents to proactively and adaptively manage their working context using a richer toolset and more efficient exploration …
PersonaForge: Realistic Multi-Turn User Simulation for Agentic Systems
PersonaForge addresses the lack of realistic multi-turn user interaction data for training agentic systems. It synthesizes these interactions by combining a persona space, SOUL-driven behavioral control, and Reverse Deep Construction. This framework generates a novel training dataset and benchmark, significantly improv…
Finding Where the Buck Stops: An Automated Failure Attribution-Based Reflection Framework for Multi-Agent Collaboration
This paper introduces DoCtOR, an automated framework for multi-agent collaboration that addresses high failure rates. Its core method is to first identify the specific agent and step responsible for a failure through automated attribution. Then, only this identified "decisive error agent" engages in targeted reflection…
Layered LLM Defenses as an Ensemble: Access Tiers, Inference Cost, and the Measured Failure Correlation Between Defense Layers
This paper introduces a framework to analyze stacked LLM defenses as an ensemble. It proposes the Adversary Access-Tier Model (AATM) and an inference cost model to quantify defense effectiveness and overhead. The core contribution is demonstrating that the benefit of stacking defenses is highly dependent on the failure…
LLM-Based Agents for Software and Systems Security: Approaches, Applications, and Assessment
This paper systematically reviews LLM-based agents for software and systems security. It categorizes existing approaches, applications, and assessment methods to provide a coherent understanding of the field. The contribution lies in offering a structured overview to guide future research and development in this rapidl…
LongPIBench: A Long-Context Benchmark for Prompt Injection
This paper introduces LongPIBench, a novel benchmark designed to evaluate prompt injection attacks and defenses in long-context scenarios, addressing a critical gap in existing research. By creating datasets for realistic applications with thousands of tokens, LongPIBench demonstrates that current defenses are signific…
NL2AGBench: Benchmarking LLM Auto-Formalization for AlphaGeometry
This paper introduces NL2AGBench, a new benchmark designed to evaluate how well Large Language Models (LLMs) can convert informal English geometry problems into the formal language required by AlphaGeometry. The core method involves using AlphaGeometry's own theorem-proving engine for execution-based verification to as…
REINS: Refusal-Enhanced Inhibitory Steering with Sparse Autoencoder Features
This paper introduces REINS, a novel method for steering large language models towards safe refusals. REINS enhances existing sparse autoencoder (SAE) steering by simultaneously suppressing harmful continuation features and boosting safe refusal features within the same SAE space. This dual approach, validated on a new…
RetailAgent: Structured Adverse Timing in Self-Conditioned Multimodal LLM Trading Agents
This paper introduces RetailAgent, a framework to test if LLM trading agents exhibit predictable, adverse timing. By analyzing LLM decisions (long vs. flat) against subsequent price movements, the study reveals a consistent pattern of negative timing across different LLM configurations. The core contribution is demonst…
When Linguistic and Internal Confidence Diverge in Large Language Models
This paper investigates whether LLMs' linguistic expressions of confidence align with their internal confidence metrics. The core method compares linguistic confidence to internal measures (logits for classification, semantic entropy for generation) across various tasks and models. The key contribution is demonstrating…
D-TAIA: Domain-Aware LLM Adaptation for Multi-Task Predictive Process Monitoring
This paper introduces D-TAIA, a framework for adapting Large Language Models (LLMs) to Predictive Process Monitoring (PPM) tasks. D-TAIA addresses challenges like data scarcity and distributional shift by using domain-aware pre-training and an attention-based inference architecture. This allows for more accurate predic…
Efficient Online Continual Foundation Model Fine-Tuning for Predictive Process Monitoring
This paper introduces COMPASS, the first framework for online continual fine-tuning of Foundation Models (FMs) for Predictive Process Monitoring (PPM). COMPASS addresses the cold-start problem of existing methods by adapting FMs to evolving process distributions. Its core contribution is a novel approach that uses loss…
Parser States Already Know: Structure-Conditioned KV Persistence for Structured Generation
This paper introduces PASK, a method that leverages parser states to improve structured generation in LLMs. PASK uses structural signals from the parser to guide KV cache persistence, prioritizing information crucial for generating valid JSON, SQL, or function calls. This approach enhances the LLM's ability to maintain…
Sliding-window beats linear attention
This paper challenges the assumption that linear attention is the best solution for LLM memory issues. It demonstrates that Sliding Window Attention (SWA) with sinks achieves comparable or superior performance to post-trained linear attention models across various tasks. Crucially, SWA significantly outperforms linear …
SymboLLM-FE: LLM-Accelerated Symbolic Regression for Automated Feature Engineering on Tabular Data
This paper introduces SymboLLM-FE, a novel approach for automated feature engineering on tabular data. It combines symbolic regression to discover mathematically interpretable and high-utility features with large language models (LLMs) to refine these features. This hybrid method aims to overcome the limitations of tra…
AIM: Anchor Identity Features, Then Match for Multimodal Large Language Model Unlearning
This paper addresses the challenge of unlearning identity-specific information from multimodal large language models (MLLMs) without access to original training data. The core method, AIM, leverages the observation that identity and visual perception knowledge are organized differently in MLLMs. AIM first anchors an id…
Blind Men and the Elephant: Probing the Epistemic Myopia of LLMs under Long-Tail Divergent Knowledge
This paper introduces ElephantBench, a novel dataset designed to test Large Language Models' (LLMs) ability to recall divergent factual accounts. The core method involves generating questions from a graph-based pipeline that identifies naturally occurring disagreements in low-exposure web documents. The key contributio…