From the arXiv
Thursday, 28 May 2026 · 20 papers
ACE: Self-Evolving LLM Coding Framework via Adversarial Unit Test Generation and Preference Optimization
ACE is a self-evolving LLM coding framework that addresses the limitations of existing methods by using a solver-adversary architecture. It leverages adversarial unit test generation, where a single LLM generates both candidate code and test inputs designed to trigger execution failures. This execution-centric supervis…
ATLAS: A Multi-LLM Training Framework for EvoDPO with Adaptive Reference Evolution
ATLAS is a multi-LLM training framework that enables an active agent to self-evolve its policy through collaborative training by specialized meta-agents. Its core contribution is the EvoDPO algorithm, which overcomes limitations of fixed reference models by adaptively updating the reference policy based on continuous t…
Blind Spots in the Guard: How Domain-Camouflaged Injection Attacks Evade Detection in Multi-Agent LLM Systems
This paper introduces "domain-camouflaged injection attacks," where malicious prompts mimic the target document's vocabulary and authority to evade detection. The core contribution is identifying and quantifying the "Camouflage Detection Gap" (CDG), demonstrating that standard injection detectors fail significantly aga…
CentaurEval: Benchmarking Human-in-the-Loop Value in Agentic Coding
CentaurEval introduces a novel benchmark for evaluating human-in-the-loop coding agents by creating "Collaboration-Necessary" problems that are too difficult for humans or LLMs alone. Its core contribution is a standardized framework that dynamically generates tasks, enabling the measurement of human-AI collaboration's…
CODE-SHARP: Continuous Open-ended Discovery and Evolution of Skills as Hierarchical Reward Programs
CODE-SHARP is a framework that uses Foundation Models to autonomously discover and evolve a library of Python programs (SHARPs). These SHARPs encode skills as hierarchical reward programs, where each program defines a success condition and relies on previously discovered SHARPs as prerequisites. This allows a generalis…
Cumulative Reasoning with Large Language Models
This paper introduces Cumulative Reasoning (CR), a structured framework that enhances Large Language Model (LLM) problem-solving by mimicking human iterative thought. CR uses LLMs in distinct roles (Proposer, Verifier, Reporter) to decompose tasks, generate and validate intermediate steps, and build a dynamic DAG of ve…
Enhancing Causal Reasoning in Large Language Models: A Causal Attribution Model for Precision Fine-Tuning
This paper introduces a causal attribution model that uses "do-operators" to create interventional scenarios, allowing for systematic quantification of LLM component contributions to causal reasoning. This model enables precise fine-tuning of LLMs for causal discovery tasks, improving their ability to leverage context,…
General Agentic Planning Through Simulative Reasoning with World Models
This paper proposes that general agentic planning requires "simulative reasoning" within a world model, contrasting it with current reactive decision-making. The core method is to build an agent that mentally simulates future outcomes of actions to make more flexible, goal-directed decisions. The contribution is the Si…
GROW: Aligning GRPO with State-Action Modeling for Open-World VLM Agents
This paper introduces GROW, a reinforcement learning framework for open-world VLM agents. GROW addresses limitations of existing methods by decomposing full trajectories into state-action samples, enabling effective use of GRPO for multi-turn tasks. This approach avoids excessively long contexts and noise, improving le…
Insights Generator: Systematic Corpus-Level Trace Diagnostics for LLM Agents
This paper introduces the Insights Generator (IG), a novel system for systematically diagnosing failures in LLM agents at a corpus level. IG addresses the limitations of manual inspection by automatically generating evidence-backed natural-language insights about systematic behavioral patterns across large collections …
Learning Spatiotemporal Sensitivity in Video LLMs via Counterfactual Reinforcement Learning
This paper addresses the problem of Video LLMs relying on shortcuts rather than spatiotemporal understanding. Their core method, Counterfactual Relational Policy Optimization (CRPO), uses reinforcement learning with counterfactual video transformations (flips, reversals) and a novel "Counterfactual Relation Reward" to …
Learning to Configure Agentic AI Systems
This paper addresses the challenge of configuring complex LLM-based agent systems by framing it as a semi-Markov decision process. Their proposed method, ARC, is a hierarchical policy that dynamically selects query-specific configurations to optimize performance and resource usage. ARC significantly improves accuracy a…
LightReasoner: Can Small Language Models Teach Large Language Models Reasoning?
LightReasoner proposes a novel method where smaller language models (SLMs) teach larger language models (LLMs) by identifying and highlighting crucial reasoning steps. The core idea is to leverage the behavioral differences between an expert LLM and an amateur SLM to create targeted supervision data. This distilled dat…
Metis: Learning to Jailbreak LLMs via Self-Evolving Metacognitive Policy Optimization
Metis reformulates LLM jailbreaking as inference-time policy optimization within an adversarial POMDP. It uses a self-evolving metacognitive loop to diagnose defense logic and refine its policy via structured feedback, achieving an 89.2% average attack success rate and outperforming traditional methods on resilient mod…
MoralityGym: A Benchmark for Evaluating Hierarchical Moral Alignment in Sequential Decision-Making Agents
This paper introduces MoralityGym, a benchmark for evaluating how well AI agents can follow hierarchical moral rules in complex decision-making scenarios. It uses a novel formalism called Morality Chains to represent these rules and a new Morality Metric to assess alignment, decoupling task performance from ethical beh…
Orchard: An Open-Source Agentic Modeling Framework
Orchard is an open-source framework designed to address infrastructure and training gaps in agentic modeling with LLMs. Its core contribution is Orchard Env, a lightweight environment service that provides reusable primitives for managing sandbox lifecycles, agent harnesses, and pipeline stages across various task doma…
Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action
Pelican-Unify 1.0 introduces a novel unified embodied intelligence model that leverages a single Vision-Language Model (VLM) for understanding, reasoning, and generating future actions and videos. Its core method involves mapping diverse inputs into a shared semantic space and then using this representation to autoregr…
Planning in the LLM Era: Building for Reliability and Efficiency
This paper argues that the planning field is shifting towards using LLMs to generate verifiable symbolic solvers, rather than for direct plan generation. This approach aims to build reliable and efficient planners that minimize LLM reliance during inference, addressing the limitations of earlier methods.
Ratchet: A Minimal Hygiene Recipe for Self-Evolving LLM Agents
Ratchet addresses the lifecycle management bottleneck in self-evolving LLM agents by introducing a single-agent loop for natural language skill management. Its core method integrates four hygiene mechanisms—outcome-driven retirement, bounded active-cap, meta-skill authoring guidance, and pattern canonicalization—to ena…
The Illusion of Reasoning: Exposing Evasive Data Contamination in LLMs via Zero-CoT Truncation
This paper introduces the Zero-CoT Probe (ZCP) to detect evasive data contamination in LLMs. ZCP works by truncating the model's reasoning steps to expose memorization, which often masks true reasoning abilities. By comparing performance on original versus truncated reasoning, ZCP effectively identifies and isolates me…