From the arXiv
Friday, 29 May 2026 · 20 papers
ALIVE: Awakening LLM Reasoning via Adversarial Learning and Instructive Verbal Evaluation
ALIVE addresses the "reward bottleneck" in LLM reasoning by moving beyond costly scalar rewards. Its core method, Adversarial Learning with Instructive Verbal Evaluation, unifies problem posing, solving, and judging within a single policy. This allows LLMs to internalize reasoning logic directly from raw text through a…
Co-ReAct: Rubrics as Step-Level Collaborators for ReAct Agents
Co-ReAct introduces a novel framework where rubrics act as step-level collaborators for ReAct agents. Instead of just evaluating final outputs, Co-ReAct integrates rubrics directly into the agent's decision-making process during inference, guiding each reasoning or action step. This allows agents to more effectively ta…
DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling
DiLaDiff addresses the token correlation issue in diffusion language models by introducing a continuous latent space. This latent space, learned via an auto-encoder and a latent diffusion model, captures semantic information. A consistency model then distills this latent prior into a fast, few-step generative model, si…
Efficient and Transferable Agentic Knowledge Graph RAG via Reinforcement Learning
This paper introduces KG-R1, an agentic framework that uses reinforcement learning to optimize knowledge-graph retrieval-augmented generation (KG-RAG). Instead of fixed multi-module pipelines, a single agent learns to interact with knowledge graphs, retrieving and incorporating information dynamically for more efficien…
Foundation Protocol: A Coordination Layer for Agentic Society
The Foundation Protocol (FP) introduces a graph-based coordination layer for agentic societies, unifying diverse entities like agents, humans, and institutions. Its core method is to provide a flexible framework for multi-party organization, event-based collaboration, and economic primitives, while prioritizing policy …
GENSTRAT: Toward a Science of Strategic Reasoning in Large Language Models
This paper introduces GENSTRAT, a novel benchmark for evaluating strategic reasoning in LLMs. Its core method involves procedurally generating a diverse distribution of imperfect-information card games, allowing for evergreen and robust evaluation. GENSTRAT's contribution is a more generalizable assessment of LLM strat…
Goal-Conditioned Agents that Learn Everything All at Once
This paper introduces Learning Everything All at Once (LEO), a method for goal-conditioned reinforcement learning. LEO efficiently learns from all transitions by jointly outputting values and actions for every possible goal simultaneously, enabling parallel, off-policy updates. This approach significantly improves samp…
It's the humans, not the data: Geopolitical bias in LLMs originates in post-training, amplified by the language of the prompt
This paper demonstrates that geopolitical bias in LLMs primarily emerges during post-training, not pre-training, contradicting common assumptions. The researchers found that models often develop a bias favoring their developer's home country after fine-tuning, with the prompt's language also influencing the strength of…
MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detection
MemAudit is a post-hoc framework for auditing poisoned memory in LLM agents. It uses causal attribution to identify memories that causally influence harmful outputs and structural anomaly detection to pinpoint suspicious memory patterns. This allows for the identification and mitigation of memory poisoning after malici…
Model Spec Midtraining: Improving How Alignment Training Generalizes
This paper introduces Model Spec Midtraining (MSM) to improve how language models generalize during alignment training. MSM involves training models on synthetic documents discussing their desired behavior specification *before* standard alignment fine-tuning. This pre-training step helps models understand the spec's c…
R$^3$L: Reflect-then-Retry Reinforcement Learning with Language-Guided Exploration, Pivotal Credit, and Positive Amplification
R$^3$L addresses exploration and exploitation challenges in RL for LLMs by introducing a "reflect-then-retry" mechanism. This method uses language feedback to analyze failed attempts, guiding retries from failure points to improve trajectory synthesis and reduce costs. The paper also proposes pivotal credit assignment …
SafeHarbor: Hierarchical Memory-Augmented Guardrail for LLM Agent Safety
SafeHarbor is a hierarchical memory-augmented guardrail system for LLM agents. Its core method involves extracting context-aware defense rules through adversarial generation and dynamically injecting them into a local hierarchical memory. This approach aims to provide precise decision boundaries, balancing safety and u…
Scaling-Aware Adapter for Structure-Grounded LLM Reasoning
This paper introduces Cuttlefish, a unified multimodal LLM that enhances reasoning over 2D and 3D structures. Its core method, Scaling-Aware Patching, adaptively generates variable-size patches over structural graphs, allowing the model to scale its query token budget with structural complexity. This approach overcomes…
VI-CuRL: Stabilizing Verifier-Independent RL Reasoning via Confidence-Guided Variance Reduction
This paper introduces VI-CuRL, a method to stabilize Reinforcement Learning for LLM reasoning without external verifiers. It uses the LLM's own confidence to guide a curriculum, prioritizing high-confidence examples to reduce gradient variance and prevent training collapse. This approach effectively manages the bias-va…
When Planning Fails Despite Correct Execution: On Epistemic Calibration for LLM-Based Multi-Agent Systems
This paper addresses failures in LLM multi-agent systems where plans are executed correctly but are based on agents misjudging their knowledge (epistemic miscalibration). The core method, EPC-AW, proposes an agentic workflow that assesses plan stability under varying information conditions, rather than direct feasibili…
AI Assurance: A Comprehensive Testing Strategy for Enterprise AI Systems
This paper proposes a new AI assurance strategy for enterprise AI systems, shifting focus from traditional correctness verification to continuous risk reduction. It emphasizes treating evaluation as a core engineering discipline and highlights the unique organizational impacts of AI failures. The contribution includes …
Are Frontier LLMs Ready for Cybersecurity? Evidence for Vertical Foundation Models from Dual-Mode Vulnerability Benchmarks
This paper evaluates frontier Large Language Models (LLMs) for cybersecurity tasks using dual-mode benchmarks: white-box code vulnerability detection and black-box web application security testing. The core method involves testing six leading LLMs and two domain-specialized models against these benchmarks. The key cont…
Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics
Ax-Prover is a multi-agent system that uses Large Language Models (LLMs) combined with formal verification tools (Lean) to automate theorem proving. Its core method involves LLMs generating reasoning steps that are then validated by Lean, ensuring formal correctness. Ax-Prover's contribution is its ability to solve com…
Beyond VLM-Based Rewards: Diffusion-Native Latent Reward Modeling
This paper introduces DiNa-LRM, a novel method for aligning diffusion models by learning preferences directly within the model's latent diffusion states, rather than relying on computationally expensive Vision-Language Models. DiNa-LRM addresses the domain mismatch issue by formulating a noise-calibrated reward functio…
Bridging AI and Clinical Reasoning: Abductive Explanations for Alignment on Critical Symptoms
This paper introduces a method for aligning AI diagnostic reasoning with clinical practice by using formal abductive explanations. This approach generates minimal, guaranteed explanations of critical symptoms, enhancing transparency and trust in AI predictions. The contribution lies in providing clinically actionable i…