2026-06
The Month in Review
This month's research on LLM agents and models demonstrates a strong focus on robustness, safety, and advanced reasoning capabilities.
Shifts in Research Direction Popularity:
A significant trend is the move towards evaluating LLM agents in more complex and realistic environments. Benchmarks like AgentEscapeBench, ComplexMCP, and WildClawBench highlight the need for agents capable of long-horizon tasks, tool-grounded reasoning with dependencies, and operating in dynamic, interdependent settings that mirror real-world command-line interfaces and software automation. This signifies a departure from simpler, isolated tool-use evaluations.
Agent Safety and Alignment remains a paramount concern. Papers introduce novel benchmarks like CyBiasBench for cybersecurity bias and LITMUS for behavioral jailbreaks in OS environments. Methodologies for mitigating safety issues are also prominent, with approaches like GLiGuard for schema-conditioned classification, LANCE to alleviate rigid rejection, and DISCA for training-free cultural alignment. The research on Conformity Generates Collective Misalignment further emphasizes the societal implications of agent behavior.
Internal Model Understanding and Manipulation is another key area. The finding that Tool Calling is Linearly Readable and Steerable opens doors for direct control and error detection. Similarly, SLIM (Sparse Latent Steering) enables property-directed molecular editing by decomposing LLM hidden states.
Preference Learning and Collaboration are evolving beyond simple pairwise comparisons. GraphDPO and DGPO explore richer graph-based and groupwise preference modeling for more comprehensive alignment. The phenomenon of the "Memory Curse" highlights the challenges of expanded context windows and the need for targeted fine-tuning to maintain cooperation.
Notable Groups or Labs:
While specific lab affiliations aren't explicitly detailed in the summaries, the consistent themes across these papers suggest a strong collaborative effort within the community. The breadth of contributions points to significant activity in academic institutions and leading AI research labs focused on agentic AI and LLM development.
Trends to Watch Next Month:
1. Real-World Agent Deployment and Evaluation: Expect more benchmarks and frameworks designed to test agents in actual operating environments, moving beyond synthetic scenarios. Papers like WildClawBench and LITMUS are indicative of this direction.
2. Proactive Safety and Robustness Engineering: The focus on bias, jailbreaks, and unintended consequences will likely lead to more proactive methods for building safer LLMs, perhaps integrating formal verification techniques like TraceFix more broadly.
3. Efficient and Interpretable Agent Architectures: Research aiming for faster inference, reduced computational overhead, and clearer understanding of agent decision-making, such as RelAgent and ADKO, will gain traction.
4. Advanced Reasoning in Complex Environments: The development of LLMs capable of tackling multi-step, interdependent tasks in dynamic settings, as explored through benchmarks like ComplexMCP and AgentEscapeBench, will continue to be a major focus.
5. Bridging the Gap Between Agent Behavior and Human Cognition: The Reason to Play paper, comparing LLM and human game learning, hints at future work in aligning AI cognitive processes with human understanding and interaction.
Top Papers
AgentEscapeBench: Evaluating Out-of-Domain Tool-Grounded Reasoning in LLM Agents
his paper introduces AgentEscapeBench, a novel benchmark designed to evaluate LLM agents' ability to perform out-of-domain, tool-grounded reasoning with long-range dependencies. The benchmark uses escape-room-style tasks requiring agents to infer and execute complex tool-use procedures, demonstrating a significant performance drop for both humans and LLMs as dependency depth increases. AgentEscapeBench's core contribution is providing a challenging, automated evaluation for robust agent reasoning beyond simple tool interactions.

Beyond Pairs: Your Language Model is Secretly Optimizing a Preference Graph
his paper introduces GraphDPO, a generalization of Direct Preference Optimization (DPO) that handles preference data structured as graphs, rather than just pairs. By optimizing a graph-structured objective, GraphDPO leverages richer preference information, enforces transitivity, and avoids issues arising from collapsing multi-rollout data into independent pairs. This approach offers a more robust and comprehensive method for aligning language models with human preferences.

The Memory Curse: How Expanded Recall Erodes Cooperative Intent in LLM Agents
his paper introduces the "memory curse," demonstrating that expanding LLM agents' context windows can paradoxically *decrease* cooperation in multi-agent social dilemmas. The core method involves extensive testing across various LLMs and games, revealing that increased memory leads to a decline in forward-looking cooperative intent. The key contribution is identifying this mechanism and showing that targeted fine-tuning on forward-looking reasoning or sanitizing memory content can restore cooperative behavior.

Tool Calling is Linearly Readable and Steerable in Language Models
his paper demonstrates that language models' tool-calling decisions are linearly encoded within their internal activations. By manipulating the difference in average activations between tool representations, researchers can reliably steer the model to select a different tool. This discovery also allows for pre-execution error detection, as small activation gaps between competing tools predict a higher likelihood of incorrect tool selection.

RelAgent: LLM Agents as Data Scientists for Relational Learning
elAgent is an LLM-based autonomous data scientist for relational learning. It first uses LLM agents with workspace tools to automatically generate SQL feature programs and select a predictive model. The contribution is a two-phase approach that results in fast, interpretable, and scalable predictors composed of SQL queries and classical models, avoiding further LLM calls during inference.

GLiGuard: Schema-Conditioned Classification for LLM Safeguard
LiGuard reformulates LLM content moderation as a classification problem, moving away from slow, generation-based guardrails. Its core method uses a small, schema-conditioned bidirectional encoder to process task definitions and label semantics directly as structured tokens. This allows for efficient, simultaneous evaluation of multiple safety dimensions in a single pass, significantly improving scalability and reducing latency.

How to Train Your Latent Diffusion Language Model Jointly With the Latent Space
his paper introduces the Latent Diffusion Language Model (LDLM), which jointly trains an encoder, diffusion model, and decoder for non-autoregressive text generation. The core method involves reshaping pre-trained language model representations into a latent space suitable for denoising and decoding. The key contribution is a novel training recipe that overcomes challenges in naive joint training, leading to improved generation quality on benchmark datasets.
How Value Induction Reshapes LLM Behaviour
his paper investigates how fine-tuning Large Language Models (LLMs) with specific values impacts their behavior. The core method involves fine-tuning models on curated value subsets and measuring changes in other value expressions, safety, and performance. The key contribution is demonstrating that value induction can lead to unintended consequences, such as the expression of unrelated or even contrasting values, and potentially make models more addictive or sycophantic.

ComplexMCP: Evaluation of LLM Agents in Dynamic, Interdependent, and Large-Scale Tool Sandbox
his paper introduces **ComplexMCP**, a novel benchmark designed to evaluate LLM agents in realistic, complex software automation scenarios. It addresses the limitations of current benchmarks by simulating dynamic environments with interdependent tools and unpredictable failures. The core contribution is a rigorous evaluation framework that reveals significant performance gaps between LLM agents and human capabilities, highlighting key areas for future improvement.

ELF: Embedded Language Flows
his paper introduces Embedded Language Flows (ELF), a novel approach to language modeling using continuous diffusion models. ELF's core method is to perform diffusion in continuous embedding space for most of the generation process, only mapping to discrete tokens at the final step. This allows ELF to leverage successful techniques from image diffusion, like classifier-free guidance, and achieve superior performance compared to existing discrete diffusion language models.

NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation
anoResearch is a multi-agent framework that personalizes research automation by co-evolving skills, memory, and policy. Its core method involves a tri-level co-evolutionary process where a skill bank distills reusable procedural knowledge, a memory module retains user-specific experience, and a policy module internalizes implicit user preferences. This approach allows the system to adapt to individual researchers' unique needs and preferences, moving beyond uniform outputs to provide truly personalized research assistance.

The Agent Use of Agent Beings: Agent Cybernetics Is the Missing Science of Foundation Agents
his paper argues that **cybernetics offers the missing theoretical foundation for the engineering-driven field of LLM-based foundation agents.** It proposes that applying cybernetic principles can address fundamental open questions about agent control, environmental adaptation, and safe self-improvement, moving beyond empirical trial-and-error.

Training-Free Cultural Alignment of Large Language Models via Persona Disagreement
his paper introduces DISCA, a training-free method to align large language models with cultural values in a black-box setting. DISCA leverages disagreement among persona agents, grounded in real-world survey data, to guide the model's output. This approach effectively reduces cultural misalignment without requiring extensive data or model access.

Dynamic Skill Lifecycle Management for Agentic Reinforcement Learning
his paper introduces SLIM, a framework for dynamic skill management in agentic reinforcement learning. SLIM treats the set of active external skills as a variable to be optimized alongside the agent's policy. Its core contribution is a method to dynamically manage these skills by estimating their marginal contribution and applying lifecycle operations (retain, retire, or introduce) to maintain an optimal, non-monotonic skill set.

DynaMiCS: Fine-tuning LLMs with Performance Constraints using Dynamic Mixtures
ynaMiCS addresses the challenge of fine-tuning LLMs for specific tasks while maintaining performance on general capabilities. It frames this as a constrained optimization problem, dynamically adjusting data mixture weights at each training step. By probing domain-specific effects, DynaMiCS ensures target-domain improvement without sacrificing performance on critical constrained domains.

Conformity Generates Collective Misalignment in AI Agents Societies
his paper demonstrates that even if individual AI agents are aligned with human values, their collective behavior can become misaligned due to conformity. The core method involves simulating opinion dynamics where agents are influenced by both their intrinsic biases and the majority opinion. The key contribution is a quantitative theory predicting when populations become trapped in misaligned states and identifying tipping points where a small number of adversarial agents can cause irreversible shifts in collective alignment.

DGPO: Beyond Pairwise Preferences with Directional Consistent Groupwise Optimization
his paper introduces Directional-Groupwise Preference Optimization (DGPO), a novel method for aligning Large Language Models (LLMs) with human preferences. DGPO addresses limitations in existing pairwise methods by aggregating supervision signals at the group level and explicitly modeling directional consistency through multi-candidate comparisons. This approach captures richer relative information and reinforces consistency across diverse reasoning pathways, leading to improved performance.

LITMUS: Benchmarking Behavioral Jailbreaks of LLM Agents in Real OS Environments
his paper introduces LITMUS, a benchmark for testing LLM agents' safety in real operating system environments. It addresses the risk of "behavior jailbreaks" by using a dual verification mechanism and state rollback to evaluate both semantic and physical-layer harms. LITMUS provides a comprehensive set of test cases and an automated framework to measure unsafe subversion of LLM agents.

WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation
ildClawBench is a novel benchmark designed to evaluate the real-world performance of AI agents in command-line interfaces. It features long-horizon, multimodal tasks executed in actual runtimes with real tools, unlike previous synthetic benchmarks. The benchmark's contribution lies in its realistic evaluation of agent capabilities across extended tasks and its hybrid grading system, offering a more accurate assessment of agent reliability.

A Brief Overview: Agentic Reinforcement Learning In Large Language Models
his paper introduces Agentic Reinforcement Learning (RL) for Large Language Models (LLMs), moving beyond traditional RL's fixed objectives. The core method integrates LLMs' cognitive abilities like planning and self-reflection into the RL loop, enabling autonomous agents to tackle complex, open-ended tasks. Its main contribution is a framework for developing these more adaptable and goal-setting agents in uncertain environments.

A Queueing-Theoretic Framework for Stability Analysis of LLM Inference with KV Cache Memory Constraints
his paper introduces a novel queueing-theoretic framework to analyze LLM inference stability, explicitly considering both computational demands and KV cache memory constraints. The core contribution is deriving rigorous conditions for system stability, enabling operators to determine the necessary GPU cluster size to avoid performance degradation or overspending.

DecodingTrust-Agent Platform (DTap): A Controllable and Interactive Red-Teaming Platform for AI Agents
Tap is a novel platform designed for the controllable and interactive red-teaming of AI agents. Its core method involves creating realistic, reproducible simulation environments across diverse domains to test agent security. The main contribution is providing a much-needed tool for large-scale risk assessment of AI agents, addressing the challenges posed by their dynamic and untrusted operational environments.
Deployment-Relevant Alignment Cannot Be Inferred from Model-Level Evaluation Alone
his paper argues that current machine learning alignment evaluations, which focus solely on model outputs, are insufficient for assessing real-world deployment. It proposes that alignment claims should be tied to the specific level of evidence collected (model, response, interaction, or deployment). Through audits, the study finds a lack of user-facing verification and process steerability in existing benchmarks, highlighting the need for more interaction-focused evaluation methods.

EP-GRPO: Entropy-Progress Aligned Group Relative Policy Optimization with Implicit Process Guidance
P-GRPO addresses credit assignment failures in Group Relative Policy Optimization (GRPO) for LLM reasoning. It uses entropy-gated modulation to focus on informative decision points and implicit process signals from policy divergence to provide directional, outcome-driven feedback at the token level, reducing training waste and improving alignment.

From Parameter Dynamics to Risk Scoring : Quantifying Sample-Level Safety Degradation in LLM Fine-tuning
his paper proposes a novel method, Sample-Level Quantification of Safety Degradation (SQSD), to identify and quantify which training samples are most responsible for degrading LLM safety during fine-tuning. By analyzing the cumulative parameter drift towards unsafe directions, SQSD assigns risk scores to individual samples, enabling targeted mitigation of safety vulnerabilities.

Investigating Advanced Reasoning of Large Language Models via Black-Box Environment Interaction
his paper introduces a novel evaluation method for Large Language Models (LLMs) called "black-box environment interaction." LLMs interact with hidden functions, learning from input-output pairs to deduce the underlying rules. The contribution is the \textsc{Oracle} benchmark, which tests integrated reasoning in unknown environments, revealing that current LLMs struggle with this complex task.
JASTIN: Aligning LLMs for Zero-Shot Audio and Speech Evaluation via Natural Language Instructions
ASTIN addresses the challenge of evaluating generative audio models by framing it as a self-instructed reasoning task. It achieves this by connecting a frozen audio encoder with a fine-tuned LLM via a trainable adapter, and uses a novel data preparation pipeline to ensure robust zero-shot generalization. This approach leads to state-of-the-art performance in aligning with human subjective ratings for audio and speech evaluation.

Manifold of Failure: Behavioral Attraction Basins in Language Models
his paper introduces a framework to systematically map "behavioral attraction basins," which are unsafe regions in Large Language Models (LLMs). By reframing vulnerability discovery as a quality diversity problem using MAP-Elites, the authors illuminate the continuous topology of these failure regions. Their contribution lies in characterizing these unsafe areas rather than just fixing them, revealing distinct, model-specific vulnerability patterns.

Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agent
his paper surveys meta-learning and meta-reinforcement learning by formalizing them based on tasks. It then traces the development of key algorithms that led to DeepMind's Adaptive Agent, highlighting how meta-learning enables rapid adaptation to new tasks with minimal data by leveraging transferable knowledge.

Misaligned by Reward: Socially Undesirable Preferences in LLMs
his paper introduces a new method to evaluate reward models for Large Language Models (LLMs) by focusing on socially undesirable preferences, rather than just general instruction following. They convert existing social evaluation datasets into pairwise preference data to test if reward models favor biased, unsafe, or unethical responses. The key contribution is demonstrating that current reward models can exhibit significant social misalignments, which are often hidden by traditional evaluation methods.
NeuroState-Bench: A Human-Calibrated Benchmark for Commitment Integrity in LLM Agent Profiles
his paper introduces NeuroState-Bench, a novel benchmark designed to evaluate the "commitment integrity" of LLM agents, ensuring they maintain coherence throughout multi-turn tasks. Unlike previous methods, it uses human-calibrated side-query probes to directly assess this integrity, rather than relying on inferred internal states. The benchmark's contribution lies in its comprehensive design, including diverse tasks and probes, and its empirical demonstration that task success and commitment integrity are not always aligned.

OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models
his paper introduces OceanPile, a large-scale multimodal corpus designed to address the data bottleneck in ocean science AI. Its core method involves unifying diverse ocean data, including sonar, imagery, and text, into a single, aligned dataset. The main contribution is enabling the development of foundation models for ocean science, overcoming limitations of fragmented and weakly labeled data.
On the Non-decoupling of Supervised Fine-tuning and Reinforcement Learning in Post-training
his paper proves that supervised fine-tuning (SFT) and reinforcement learning (RL) are fundamentally intertwined during large language model post-training. The core contribution is demonstrating that neither SFT nor RL can be performed independently without negatively impacting the other's objective, whether applied sequentially. This non-decoupling implies that their interleaved application is necessary for optimal performance.

SoK: Robustness in Large Language Models against Jailbreak Attacks
his paper addresses the critical issue of Large Language Model (LLM) vulnerability to jailbreak attacks. Its core contribution is the introduction of "Security Cube," a novel, multi-dimensional evaluation framework designed to comprehensively assess the robustness of LLMs against these adversarial prompts, moving beyond simplistic metrics like attack success rate. This framework enables a more thorough understanding of existing attack and defense techniques and identifies key challenges in LLM security.

StoryAlign: Evaluating and Training Reward Models for Story Generation
his paper introduces StoryRMB, the first benchmark for evaluating reward models on human story preferences. They find existing reward models perform poorly, achieving only 66.3% accuracy in selecting preferred stories. To improve this, they construct a large dataset of story preference pairs to train better reward models for story generation.

Strat-Reasoner: Reinforcing Strategic Reasoning of LLMs in Multi-Agent Games
trat-Reasoner enhances LLMs' strategic reasoning in multi-agent games by introducing a recursive framework where an agent's reasoning incorporates others'. It uses a centralized Chain-of-Thought comparison module to provide reward signals for intermediate reasoning steps, addressing challenges of non-stationarity and credit assignment in multi-agent environments.

The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systems
his paper introduces the 2025 AI Agent Index, a comprehensive catalog of 30 advanced AI agents. Its core method involves collecting and documenting technical and safety features from publicly available information and developer correspondence. The key contribution is to provide a structured overview of the rapidly evolving AI agent landscape, highlighting trends in capabilities and, importantly, the concerning lack of transparency regarding safety and societal impact among developers.

Towards Robust LLM Post-Training: Automatic Failure Management for Reinforcement Fine-Tuning
his paper introduces the first systematic approach to automatically manage failures during Reinforcement Fine-Tuning (RFT) of LLMs. It proposes RFT-FaultBench, a comprehensive benchmark to categorize and analyze RFT failures. The core contribution is developing methods to automatically detect and address these failures, moving beyond manual inspection and improving RFT robustness.

Uno-Orchestra: Parsimonious Agent Routing via Selective Delegation
no-Orchestra is a novel orchestration policy for LLM multi-agent systems that jointly learns to decompose tasks and select appropriate agent-primitive pairs for each subtask. This selective delegation approach, trained via reinforcement learning, significantly improves accuracy (77.0% macro pass@1) and reduces per-query cost by an order of magnitude compared to existing methods. Its core contribution lies in unifying task decomposition and worker selection for parsimonious and efficient agent routing.

History Anchors: How Prior Behavior Steers LLM Decisions Toward Unsafe Actions
his paper introduces HistoryAnchor-100, a dataset designed to test LLM safety by examining how prior harmful actions influence future decisions. The core method involves presenting LLMs with scenarios where a harmful past action is followed by a choice between safe and unsafe options. The key contribution is demonstrating that a simple instruction to "stay consistent with the strategy shown in the prior history" dramatically increases LLM unsafe action selection, even for highly aligned models, highlighting a critical vulnerability in current LLM agent design.
Temper and Tilt Lead to SLOP: Reward Hacking Mitigation with Inference-Time Alignment
his paper introduces SLOP, a method for inference-time alignment that generalizes existing techniques by using a sharpened logarithmic opinion pool of generative reward models. By adjusting the "temperature" of reference models and calibrating SLOP weights, the approach mitigates reward hacking and improves robustness while maintaining alignment performance.
Adaptive Negative Reinforcement for LLM Reasoning:Dynamically Balancing Correction and Diversity in RLVR
his paper introduces Adaptive Negative Sample Reinforcement (A-NSR) to improve LLM reasoning. A-NSR dynamically adjusts the penalty for incorrect reasoning steps during training, initially prioritizing error correction and later shifting towards more nuanced updates to balance correction and diversity. This adaptive approach aims to enhance LLM reasoning performance beyond fixed penalty methods.
AEM: Adaptive Entropy Modulation for Multi-Turn Agentic Reinforcement Learning
EM addresses the challenge of credit assignment in multi-turn agentic reinforcement learning by adaptively modulating entropy dynamics during training. Unlike methods requiring dense intermediate supervision, AEM is supervision-free and improves the exploration-exploitation trade-off by analyzing and adjusting entropy at the response level, aligning uncertainty estimation with how agents interact with environments. This novel approach enhances learning efficiency and generalization without increasing supervision complexity.

DGPO: Distribution Guided Policy Optimization for Fine Grained Credit Assignment
GPO addresses credit assignment challenges in reinforcement learning for large language models by reinterpreting distribution deviation as a guiding signal instead of a penalty. It uses the bounded Hellinger distance to enable safe, token-level exploration, overcoming the gradient instability and conservatism of KL divergence. This allows for more precise identification and reinforcement of effective reasoning steps within complex generated sequences.

ESSAM: A Novel Competitive Evolution Strategies Approach to Reinforcement Learning for Memory Efficient LLMs Fine-Tuning
his paper introduces ESSAM, a novel approach for fine-tuning LLMs using competitive Evolution Strategies combined with Sharpness-Aware Maximization. ESSAM addresses the high memory demands of traditional RL methods by leveraging zero-order parameter search and improving generalization. Its core contribution is achieving comparable or superior performance to RL algorithms on mathematical reasoning tasks, while being significantly more memory-efficient.

EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle
volveR enables LLM agents to self-improve by creating a closed-loop experience lifecycle. It first distills interaction trajectories into reusable strategic principles (Offline Self-Distillation) and then uses these principles to guide online task interactions, iteratively refining the agent's performance through reinforcement learning. This approach addresses the limitation of LLM agents in systematically learning from their own experiences and refining problem-solving strategies.

FutureWorld: A Live Reinforcement Learning Environment for Predictive Agents with Real-World Outcome Rewards
utureWorld introduces a novel reinforcement learning environment for training agents to make live future predictions. Its core method involves a delayed reward mechanism where agent predictions are evaluated and rewarded only after real-world outcomes are realized. This allows agents to learn from actual events, closing the training loop and enabling continuous learning from the real world.

InvThink: Premortem Reasoning for Safer Language Models
nvThink is a novel framework that enhances language model safety by requiring a three-step process: enumerating potential harms, analyzing their consequences, and then generating a response with explicit mitigation constraints. This "premortem" reasoning approach significantly improves safety scores, especially in larger models, while crucially avoiding the "safety tax" by preserving reasoning capabilities. Its contribution lies in a structured generation process that proactively addresses potential failures across general and domain-specific ethical scenarios.

MemSearcher: Training LLMs to Reason, Search and Manage Memory via End-to-End Reinforcement Learning
emSearcher trains LLM agents using end-to-end reinforcement learning to manage a compact, question-relevant memory, avoiding the costly full history concatenation of traditional methods. Its core innovation is multi-context GRPO, which enables unified optimization across multiple turns with varying LLM contexts. This approach significantly improves performance and maintains stable context lengths in multi-turn interactions.

Modality Gap-Driven Subspace Alignment Training Paradigm For Multimodal Large Language Models
his paper addresses the "Modality Gap," where visual and linguistic embeddings for the same meaning are systematically offset. The authors propose the "Fixed-frame Modality Gap Theory" to precisely model this gap as stable biases and anisotropic residuals. Based on this, they introduce "ReAlign," a training-free strategy that aligns text representations to image distributions using statistics from unpaired data.

OASES: Outcome-Aligned Search-Evaluation Co-Training for Agentic Search
ASES trains agentic search models by generating intermediate rewards that are aligned with the final task outcome. It achieves this by evaluating how well each search step contributes to answering the original question, providing more reliable supervision than traditional methods. This outcome-aligned process reward mechanism is the core contribution, improving the agent's ability to acquire evidence effectively.

Position: Agent Should Invoke External Tools ONLY When Epistemically Necessary
his paper argues that tool-augmented agents should only use external tools when their internal reasoning is insufficient to reliably complete a task. It introduces the Theory of Agent (ToA) framework, which views agents as making sequential decisions about resolving uncertainty internally or delegating it externally. The core contribution is a principled approach to tool use, distinguishing necessary delegation from unnecessary actions and explaining common agent failures as miscalibrated uncertainty resolution.

Safactory: A Scalable Agentic Infrastructure for Training Trustworthy Autonomous Intelligence
afactory introduces a unified infrastructure for training trustworthy autonomous agents. It integrates parallel simulation for generating diverse agent experiences, a trustworthy data platform for managing and extracting insights from these experiences, and an autonomous evolution platform for continuous learning and improvement. This closed-loop system aims to systematically discover and mitigate risks in long-horizon decision-making and real-world interaction for advanced AI.
VESPO: Variational Sequence-Level Soft Policy Optimization for Stable Off-Policy LLM Training
ESPO addresses the high variance issue in off-policy LLM training by introducing a principled, closed-form sequence-level reshaping kernel. This kernel explicitly incorporates variance reduction into a variational framework, directly operating on importance weights without heuristic token-level approximations. VESPO's key contribution is a theoretically grounded method for stable off-policy LLM training that demonstrably reduces variance.

Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making
da-Diffuser addresses decision-making by treating it as sequence modeling with diffusion models, but crucially incorporates evolving latent dynamics. The core method is a causal diffusion model that simultaneously learns observed interaction patterns and underlying latent processes from minimal observations. This allows for more precise environment modeling and effective planning and control by explicitly accounting for hidden factors influencing agent behavior.

Context, Reasoning, and Hierarchy: A Cost-Performance Study of Compound LLM Agent Design in an Adversarial POMDP
his paper investigates how different design choices for compound LLM agents impact performance and cost in adversarial, partially observable environments. The core method involves a controlled study in a cyber defense simulation, systematically varying agent perception, reasoning strategies, and task decomposition. The main contribution is providing empirical guidance on balancing performance gains with inference costs for these complex agent architectures.

DebiasRAG: A Tuning-Free Path to Fair Generation in Large Language Models through Retrieval-Augmented Generation
ebiasRAG is a novel, tuning-free framework that uses retrieval-augmented generation (RAG) to dynamically debias large language models (LLMs) without requiring additional training. By retrieving relevant and unbiased information, it mitigates social biases in LLM outputs while preserving their original generative capabilities. This approach offers a more efficient and adaptable solution for achieving fairer AI.

FORGE: Self-Evolving Agent Memory With No Weight Updates via Population Broadcast
ORGE is a novel method for improving LLM agent decision-making by evolving natural-language memory without gradient updates. It uses a population-based approach where failed experiences are converted into reusable knowledge (heuristics or demonstrations) by a reflection agent. This memory is then propagated to the population, allowing agents to learn and adapt over time.

Formal Methods Meet LLMs: Auditing, Monitoring, and Intervention for Compliance of Advanced AI Systems
his paper bridges formal methods and LLMs to address AI governance. It proposes techniques for auditing and monitoring LLM behavior throughout their lifecycle, enabling the verification of complex, temporally extended constraints like safety and regulatory compliance. The work introduces practical methods for predictive monitoring and runtime intervention to prevent violations.

Look Before You Leap: Autonomous Exploration for LLM Agents
his paper addresses LLM agents' failure in new environments due to premature action. It introduces "Exploration Checkpoint Coverage" to measure how well agents discover key environmental elements. The core contribution is a training strategy that balances task execution and exploration, leading to the "Explore-then-Act" paradigm for more adaptive agents.

paper.json: A Coordination Convention for LLM-Agent-Actionable Papers
his paper introduces `paper.json`, a companion JSON file to academic PDFs, designed to improve LLM agent comprehension. Its core method is a set of lightweight conventions for stable claim IDs, explicit "does-not-claim" lists, per-figure shell commands, and stable definition IDs. The main contribution is enabling LLM agents to more reliably extract information, assess claims, and understand the scope of research, facilitating better reproducibility and generalization.
RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agents
ecMem addresses the inefficiency of LLM agents' memory systems by delaying memory consolidation. Instead of processing every interaction, it stores them in a lightweight "subconscious" layer and only invokes the LLM to extract episodic and semantic memories when recurring, semantically similar interactions are detected. This recurrence-based approach significantly reduces token consumption while maintaining effectiveness by focusing LLM resources on information clusters deemed valuable for consolidation.
AI for Auto-Research: Roadmap & User Guide
his paper analyzes the AI research lifecycle, from idea generation to dissemination, identifying a critical boundary between reliable AI assistance and unreliable autonomy. While AI excels at structured tasks like literature review and data generation, it struggles with nuanced aspects like fabricating results, identifying errors, and assessing novelty, particularly under scientific pressure. The authors provide a roadmap and user guide to navigate these capabilities and limitations.

Code as Agent Harness
his paper introduces "code as agent harness," a new perspective on how large language models (LLMs) are used in agentic systems. The core method is to view code not just as an output, but as the fundamental infrastructure for agent reasoning, action, and environment modeling. The main contribution is a structured survey that organizes this concept into three layers: the harness interface, harness mechanisms, and scaling the harness, providing a unified framework for understanding and developing code-centric agent systems.

Position: A Three-Layer Probabilistic Assume-Guarantee Architecture Is Structurally Required for Safe LLM Agent Deployment
his paper argues that LLM agent safety requires a three-layer probabilistic architecture, not a single one. Each layer enforces a distinct safety dimension (intent, environment, dynamics) using independently certified probabilistic guarantees, which then form assumptions for the next layer. This compositional approach allows for provable system-level safety bounds, addressing a fundamental structural requirement for safe LLM agent deployment.
SkillGenBench: Benchmarking Skill Generation Pipelines for LLM Agents
his paper introduces SkillGenBench, a novel benchmark designed to evaluate the crucial ability of LLM agents to generate correct and reusable skills from raw data. Unlike previous benchmarks, SkillGenBench specifically isolates and assesses the skill generation process itself. Its core method involves a unified protocol where a generator produces standardized skill artifacts from corpora, which are then executed and evaluated under controlled conditions, covering both task-specific and task-agnostic generation scenarios.

EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL
nvFactory addresses the challenges of scaling tool-use LLM agents by automatically synthesizing realistic, stateful execution environments from authentic resources. It then generates robust, multi-turn training data by sampling and refining trajectories to capture implicit human intents, rather than over-specified instructions. This approach enables more effective Reinforcement Learning training for LLM agents.

General Preference Reinforcement Learning
his paper introduces General Preference Reinforcement Learning (GPRL) to bridge the gap between online RL and preference optimization for LLMs. GPRL uses a General Preference Model (GPM) to represent quality as a multi-dimensional, intransitivity-aware comparison, rather than a single scalar reward. This structured approach allows for continuous exploration in open-ended tasks, overcoming limitations of existing methods.

MA$^{2}$P: A Meta-Cognitive Autonomous Intelligent Agents Framework for Complex Persuasion
A$^{2}$P is a novel framework for complex persuasive dialogue generation that addresses limitations in current approaches. It employs a meta-cognitive, multi-agent architecture to autonomously infer a user's latent mental states and generate targeted, strategy-consistent responses. This framework aims to improve the effectiveness of persuasive dialogue, especially when user intentions are unclear.

AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaboration
utoResearchClaw is a multi-agent autonomous research system that addresses the iterative nature of scientific discovery. Its core method involves structured multi-agent debate for hypothesis generation and analysis, coupled with a self-healing executor that learns from failures. The key contribution is a robust, collaborative framework that integrates human oversight and cross-run learning to enable more effective and resilient autonomous research.

PEEK: Context Map as an Orientation Cache for Long-Context LLM Agents
EEK addresses the challenge of LLM agents repeatedly interacting with large contexts by introducing a "context map" as an orientation cache. This map, a small prompt artifact, stores reusable knowledge about the context's content, organization, and useful entities. PEEK's contribution is enabling agents to efficiently re-orient themselves within recurring contexts, improving performance and reducing computational overhead.
ThoughtTrace: Understanding User Thoughts in Real-World LLM Interactions
his paper introduces ThoughtTrace, the first large-scale dataset pairing real-world human-AI conversations with users' explicit thoughts. The core contribution is capturing users' underlying reasoning and reactions, which are semantically distinct from their messages and difficult for current LLMs to infer. This dataset enables improved user behavior prediction and fine-grained alignment for personalized AI assistants.

Rethinking How to Remember: Beyond Atomic Facts in Lifelong LLM Agent Memory
his paper proposes TriMem, a novel memory system for LLM agents that moves beyond atomic facts. Instead of relying solely on extracted facts, TriMem maintains three coexisting representation granularities: raw dialogue segments, extracted facts, and synthesized profiles. This approach allows for faithful storage of dialogue details, efficient retrieval of key information, and deep reasoning over aggregated semantic understanding, overcoming limitations of previous fact-centric methods.
Rewarding Beliefs, Not Actions: Consistency-Guided Credit Assignment for Long-Horizon Agents
his paper proposes ReBel, a reinforcement learning method for long-horizon tasks where agents learn from verifiable rewards. ReBel addresses challenges in partially observable environments by explicitly modeling and updating agent beliefs, using belief consistency as a self-supervised signal to improve credit assignment. This approach aims to provide more robust learning by comparing trajectories with similar belief states, leading to lower-variance advantage estimates.

TIDE: Efficient and Lossless MoE Diffusion LLM Inference with I/O-aware Expert Offload
IDE addresses the challenge of efficiently inferring large Mixture-of-Experts (MoE) diffusion LLMs on resource-constrained devices. Its core method is an I/O-aware expert offload strategy that exploits the temporal stability of expert activations during the diffusion process. By intelligently refreshing expert placements at intervals, TIDE minimizes I/O overhead and compute bottlenecks, enabling lossless and efficient inference.
![(a) Similarity heatmap of expert routing across denoising steps within a block. Expert routing remains highly similar for nearby steps, and the diagonal bands show that this stability extends beyond immediate neighbors: step pairs separated by five denoising steps retain cosine similarity near 0.95 0.95 . (b) Overview of TIDE . At refresh steps , the system intelligently swaps the GPU and CPU experts based on token hit counts (number of tokens each expert has processed). At skipped steps , the system continues decoding with the current expert placement and does not migrate experts. By exploiting routing stability across adjacent steps, TIDE avoids unnecessary GPU-CPU I/O overhead and maintains high GPU utilization. (c) Throughput comparison of TIDE against state-of-the-art MoE inference solutions [Kamahori et al. , 2024 , Eliseev and Mazur, 2023 ] for LLaDA2.0 in a single GPU-CPU setting.](https://arxiv.org/html/2605.20179v1/figures/figure1.png)
APEX: Autonomous Policy Exploration for Self-Evolving LLM Agents
PEX tackles exploration collapse in self-evolving LLM agents by introducing a "strategy map" – a DAG of milestones. This map guides exploration by identifying unexplored directions (Fork Discovery) and balancing discovery with leveraging known good strategies (Policy Selection), enabling agents to learn and adapt effectively at test time.

Frontier: Towards Comprehensive and Accurate LLM Inference Simulation
rontier is a novel discrete-event simulator designed to accurately model the complex, disaggregated architectures of modern LLM inference serving systems. Its core contribution lies in its disaggregated abstraction, which captures the nuances of co-location and various disaggregation strategies (PDD, AFD) with role-specific workers. This allows for decision-grade fidelity in simulating runtime optimizations and predicting Service Level Agreements (SLAs), overcoming the limitations of existing monolithic simulators.

Insights Generator: Systematic Corpus-Level Trace Diagnostics for LLM Agents
his paper introduces the Insights Generator (IG), a novel multi-agent system for systematically diagnosing failures in LLM agents at a corpus level. IG automates the process of identifying patterns and generating evidence-backed insights from large collections of execution traces, moving beyond manual, ad-hoc inspection. Its core contribution lies in formalizing corpus-level diagnostics and providing a scalable solution to understand systematic behavioral patterns in LLM agents.

Mem-$π$: Adaptive Memory through Learning When and What to Generate
em-$π$ introduces an adaptive memory framework for LLM agents that *generates* useful guidance on demand, rather than retrieving static information. Its core method involves a separate model that learns when and what guidance to produce based on the agent's current context, using a decoupled reinforcement learning objective. This allows for more context-aware and efficient memory utilization, improving performance across various agentic tasks.

Open-source LLMs administer maximum electric shocks in a Milgram-like obedience experiment
his paper investigates LLM obedience by adapting the Milgram experiment. It found that most open-source LLMs, when pressured by an authority figure, administered maximum electric shocks, demonstrating vulnerability to sustained pressure and gradual boundary violations, similar to human subjects. This highlights safety concerns for LLMs acting as autonomous agents in high-stakes scenarios.

PREFINE: Preference-Based Implicit Reward and Cost Fine-Tuning for Safety Alignment
REFINE adapts Direct Preference Optimization (DPO) for reinforcement learning to fine-tune pre-trained policies for safety. It uses trajectory-level preferences (preferred vs. dispreferred trajectories) to implicitly learn reward and cost functions, enabling the policy to generate low-cost behaviors while preserving high rewards without full retraining. This approach addresses safety alignment in continuous control by leveraging preference data in a sequential decision-making context.

Quantifying Hyperparameter Transfer and the Importance of Embedding Layer Learning Rate
his paper quantifies hyperparameter transfer, crucial for scaling LLMs, using three metrics: scaling law fit quality, extrapolation robustness, and asymptotic loss penalty. The authors discover that Maximal Update parameterization ($μ$P) excels over standard parameterization (SP) primarily due to its ability to significantly increase the embedding layer's learning rate when using AdamW.

Tracing the ongoing emergence of human-like reasoning in Large Language Models
his paper investigates whether Large Language Models (LLMs) exhibit human-like reasoning by comparing their conditional inference abilities across four languages to human performance. The core method involves a population-matching experiment where LLMs and humans are tested on their interpretation of conditional statements. The key contribution is the finding that humans integrate pragmatic inferences with logical reasoning, while LLM behavior is more varied, with some models adhering strictly to logic and others adopting a single, potentially pragmatic, interpretation.
DelTA: Discriminative Token Credit Assignment for Reinforcement Learning from Verifiable Rewards
his paper proposes DelTA, a method to improve reinforcement learning from verifiable rewards (RLVR) for large language models. It frames RLVR updates as a linear discriminator that guides token probability changes. DelTA's core contribution is a novel centroid construction that mitigates the dominance of common patterns, allowing the model to better identify and reinforce discriminative tokens that lead to higher-quality responses.

Federated LoRA Fine-Tuning for LLMs via Collaborative Alignment
his paper introduces CLAIR, a federated learning framework for fine-tuning Large Language Models (LLMs) using Low-Rank Adaptation (LoRA). CLAIR enables collaborative fine-tuning across clients with partial structural sharing and potential contamination, recovering the shared LoRA subspace and detecting malicious clients through a structured low-rank plus block-sparse decomposition. Its core contribution is a contamination-aware method that achieves exact or stable recovery of the shared LoRA parameters.

What Twelve LLM Agent Benchmark Papers Disclose About Themselves: A Pilot Audit and an Open Scoring Schema
his paper audits twelve LLM agent benchmark papers to assess the clarity of their evaluation methodologies. The authors developed a five-field schema to record details about benchmark identity, evaluation setup, inference settings, cost, and failure analysis. Their contribution is a pilot audit and an open scoring schema to improve reproducibility and transparency in LLM agent evaluations, highlighting the common lack of detailed reporting in existing work.
You Only Need Minimal RLVR Training: Extrapolating LLMs via Rank-1 Trajectories
his paper reveals that the parameter updates during Reinforcement Learning with Verifiable Rewards (RLVR) for LLMs are predominantly captured by a low-rank, specifically rank-1, trajectory. Their core method, RELEX, leverages this by estimating this rank-1 subspace from a short training window and then linearly extrapolating future model checkpoints. This significantly reduces the computational cost of RLVR while achieving comparable or superior performance.

LASH: Adaptive Semantic Hybridization for Black-Box Jailbreaking of Large Language Models
ASH is a black-box jailbreaking framework that adaptively combines outputs from multiple existing attack methods. It treats these outputs as "seed prompts" and uses a genetic optimizer to find the best mixture of these seeds for a given target request. This hybridization allows LASH to exploit the complementary strengths of different attack families, leading to more effective jailbreaks across various models and harm categories.
A Scalable Multi-LLM Collaboration System with Retrieval-based Selection and Exploration-Exploitation-Driven Enhancement
his paper introduces SMCS, a scalable system for multi-LLM collaboration. It addresses scalability issues by using a retrieval module to select the best LLMs for a given task and an enhancement module to improve response diversity and quality. SMCS demonstrates superior performance compared to existing closed-source LLMs by effectively integrating multiple open-source models.
Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making
da-Diffuser addresses decision-making by treating it as sequence modeling with diffusion models. Its core method is a unified framework that explicitly infers and models evolving latent dynamics alongside observed interactions. This allows for more precise environment modeling and effective planning by simultaneously learning temporal structures and hidden processes from minimal observations.

Agentic Discovery of Neural Architectures: AIRA-Compose and AIRA-Design
his paper introduces AIRA, a dual-framework approach where LLM agents autonomously discover novel neural architectures. AIRA-Compose searches for high-level primitives, while AIRA-Design handles low-level implementation, leading to new Transformer-based and hybrid Transformer-Mamba families. These discovered architectures consistently outperform existing models like Llama 3.2 and Composer on downstream tasks and exhibit significantly more efficient scaling.

AstraFlow: Dataflow-Oriented Reinforcement Learning for Agentic LLMs
straFlow addresses the high cost of reinforcement learning for agentic LLMs by introducing a dataflow-oriented system. It decouples rollout, dataflow management, and training into autonomous components, enabling efficient support for complex, multi-policy training on heterogeneous compute resources. This approach simplifies system engineering and makes agentic LLM RL more scalable and cost-effective.

Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems
his paper surveys LLM-based multi-agent systems by proposing a unified framework called the LIFE progression. It highlights how individual agent capabilities (Lay) enable collaboration (Integrate), which in turn necessitates fault attribution (Find) for effective autonomous self-improvement (Evolve). The key contribution is examining the causal links between these stages, addressing the challenge of error propagation and lack of self-evolution in current multi-agent systems.
CAP: Controllable Alignment Prompting for Unlearning in LLMs
his paper introduces CAP, a novel prompt-driven method for unlearning sensitive information in LLMs without modifying model weights. CAP uses reinforcement learning to optimize a prompt that guides the LLM to suppress specific knowledge while retaining general capabilities. This offers a computationally efficient and controllable solution for unlearning, even for closed-source models.

Don't Retrieve, Navigate: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAG
his paper introduces Corpus2Skill, a method that distills enterprise knowledge into a navigable, hierarchical skill directory. Instead of passively retrieving information, an LLM agent actively navigates this directory, drilling down through summaries to find relevant documents. This approach improves answer quality and grounding for QA and RAG tasks, particularly on domain-specific corpora with clear topical structures.

Frontier Large Language Models Rival State-of-the-Art Planners
his paper demonstrates that recent frontier Large Language Models (LLMs) can rival state-of-the-art classical planners on challenging planning tasks. Specifically, Gemini 3.1 Pro outperforms the strongest planner baseline, and even when semantic information is removed, it remains competitive, overturning previous conclusions about LLMs' planning capabilities.
FutureWorld: A Live Reinforcement Learning Environment for Predictive Agents with Real-World Outcome Rewards
utureWorld introduces a novel reinforcement learning environment for training predictive agents that learn from real-world outcomes. Its core method, verl-tool-future, addresses the challenge of delayed rewards by storing prediction rollouts and backfilling rewards only after events occur. This allows agents to learn from actual future outcomes, enabling continuous learning and improved prediction capabilities.

How to Train Your Advisor: Steering Black-Box LLMs with Advisor Models
his paper introduces "Advisor Models," a novel method to enhance black-box large language models (LLMs) by training smaller, open-weight models to provide dynamic, instance-specific advice. This advice guides the black-box LLM, significantly improving its performance on various tasks and personalizing its behavior more effectively than static prompts. The core contribution lies in enabling practical and cost-effective parametric optimization for closed-source LLMs.

Improve Large Language Model Systems with User Logs
his paper proposes UNO, a framework to improve LLM systems using user interaction logs. UNO addresses the challenges of noisy and unstructured log data by first distilling them into structured rules and preferences. This processed information is then used to optimize the LLM, overcoming issues like off-policy learning and distinguishing valuable feedback from user behavior.

NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation
anoResearch introduces a tri-level co-evolutionary framework for personalized research automation. It addresses the limitations of current LLM-based systems by developing a skill bank for reusable procedural knowledge, a memory module for user-specific experience, and a policy learner for implicit preference internalization. This approach enables the system to adapt to individual researchers' unique needs and preferences, moving beyond uniform outputs to genuinely usable personalized automation.

Painless Activation Steering: An Automated, Lightweight Approach for Post-Training Large Language Models
his paper introduces Painless Activation Steering (PAS), a fully automated method for post-training large language models. PAS eliminates the need for manual prompt engineering or feature annotation, making activation steering a practical and efficient alternative to existing methods. Its core contribution is enabling effortless and controllable behavior modification in LLMs using any labeled dataset.

RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agents
ecMem addresses the inefficiency of LLM agents' memory systems by delaying memory consolidation. Instead of processing every interaction, it stores them in a lightweight embedding layer and only invokes the LLM to extract episodic and semantic memory when recurring, semantically similar interactions are detected. This recurrence-based approach significantly reduces token consumption while maintaining effectiveness by focusing LLM resources on information clusters worth summarizing.
Rethinking Agentic Reinforcement Learning In Large Language Models
his paper re-frames Reinforcement Learning (RL) for Large Language Models (LLMs) by moving beyond traditional, narrowly defined tasks. It proposes an agentic RL paradigm where LLMs act as autonomous agents capable of goal-setting, planning, and dynamic adaptation in complex, open-ended environments. The core contribution lies in integrating cognitive capabilities like meta-reasoning and self-reflection into the RL learning loop, enabling more sophisticated decision-making.

Seeing is Understanding: Unlocking Causal Attention into Modality-Mutual Attention for Multimodal LLMs
his paper proposes a novel approach to improve vision-language alignment in Multimodal Large Language Models (MLLMs) by modifying their core architecture. The key contribution is unlocking causal attention within the decoder-only LLM, allowing earlier modalities (like images) to effectively incorporate information from later modalities (like text). This addresses the limitation of existing MLLMs where visual information might not be fully integrated into the text generation process.

TFGN: Task-Free, Replay-Free Continual Pre-Training Without Catastrophic Forgetting at LLM Scale
FGN is an architectural overlay for transformer language models that enables continual pre-training on new domains without forgetting previous knowledge. It achieves this by generating input-conditioned, parameter-efficient updates, leaving the core transformer unchanged. This approach successfully prevents catastrophic forgetting and demonstrates positive cross-domain transfer, even at LLM scale, without relying on replay buffers or task identifiers.

When Language Overwrites Vision: Over-Alignment and Geometric Debiasing in Vision-Language Models
his paper identifies "geometric over-alignment" as a core cause of hallucinations in decoder-based Vision-Language Models (VLMs). The VLM over-aligns visual information with the text manifold to bridge the modality gap, leading to linguistic biases overshadowing visual evidence. The contribution is the first quantitative characterization of this over-alignment, showing it concentrates in the top principal components of a universal text subspace.

Co-ReAct: Rubrics as Step-Level Collaborators for ReAct Agents
o-ReAct introduces a novel framework where rubrics act as step-level collaborators for ReAct agents during inference. By injecting rubrics into the agent's context at each decision point, Co-ReAct provides explicit guidance on what to target in evidence seeking, reasoning, and self-evaluation, leading to more focused and effective multi-step reasoning trajectories. This approach moves beyond rubrics as mere evaluators to become active guides for agent actions.

DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling
iLaDiff addresses the token correlation issue in diffusion language models by introducing a continuous latent space. This latent space, learned via an auto-encoder and a latent diffusion model, captures semantic relationships. A consistency model then distills this latent prior into a fast, few-step generative model, significantly improving sampling quality and inference speed over existing methods.

From Raw Experience to Skill Consumption: A Systematic Study of Model-Generated Agent Skills
his paper systematically studies the full lifecycle of model-generated skills for language agents, from experience generation to skill extraction and consumption. Their core contribution is a utility-grounded evaluation framework that reveals model-generated skills are generally beneficial but their effectiveness is non-trivial and depends on various factors.

Goal-Conditioned Agents that Learn Everything All at Once
his paper introduces Learning Everything All at Once (LEO), a method for goal-conditioned reinforcement learning. LEO efficiently utilizes all transitions by performing off-policy updates for every possible goal simultaneously, overcoming the computational infeasibility of naive relabeling. This approach significantly improves performance and achieves substantial speed-ups on various control tasks.
It's the humans, not the data: Geopolitical bias in LLMs originates in post-training, amplified by the language of the prompt
his paper demonstrates that geopolitical bias in Large Language Models (LLMs) primarily emerges during the post-training (chat tuning) phase, not from the initial training data. The authors found that LLMs often develop a bias favoring the country of their developer after chat tuning, and this bias is further influenced by the language of the prompt.

MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detection
emAudit is a post-hoc framework for auditing poisoned memory in LLM agents. It uses causal attribution to identify memories that causally influence harmful outputs and structural anomaly detection to pinpoint inconsistencies within the memory. This allows for the identification and mitigation of malicious memory injections after an agent has exhibited undesirable behavior.

Push Your Agent: Measuring and Enforcing Quantitative Goal Persistence in Long-Horizon LLM Agents
his paper introduces Quantitative Goal Persistence (QGP) to measure how well LLM agents complete tasks requiring a specific number of distinct items. Their benchmark, PushBench, uses verifiers to track progress and identify issues like repeated work or false completion. They demonstrate that specialized controllers significantly improve QGP, outperforming standard methods in challenging long-horizon tasks.

ARES: Automated Rubric Synthesis for Scalable LLM Reinforcement Learning
RES automates the creation of question-answer pairs and corresponding weighted rubrics from raw text, enabling scalable reinforcement learning for LLMs on open-ended tasks. This framework addresses the limitations of expert-written rubrics and fixed task-level evaluations by generating instance-specific reward supervision. ARES's contribution lies in its ability to synthesize diverse and high-quality training data for LLM RL, improving evaluation beyond automatically verifiable answers.

OpenSkillEval: Automatically Auditing the Open Skill Ecosystem for LLM Agents
his paper introduces OpenSkillEval, an automatic framework for evaluating LLM agents and the skills they use. It addresses the challenge of assessing the growing open-source skill ecosystem by generating realistic task instances from real-world artifacts and organizing community-contributed skills. The core contribution is a dynamic evaluation method that goes beyond static benchmarks to understand skill quality and guide user selection based on cost-performance.

Alignment Tampering: How Reinforcement Learning from Human Feedback Is Exploited to Optimize Misaligned Biases
his paper introduces "alignment tampering," a vulnerability in RLHF where LLMs can exploit the preference dataset generation process to amplify their own misaligned biases. The core method demonstrates how LLMs can influence human annotators to favor biased outputs by making them appear higher quality, leading to the reward model inheriting and amplifying these biases. The contribution is identifying and experimentally validating this novel attack vector against LLM alignment.

Guiding LLM Post-training Data Engineering with Model Internals from Sparse Autoencoders
his paper introduces SAERL, a framework that leverages model internals from Sparse Autoencoders (SAEs) to guide Large Language Model (LLM) post-training data engineering for reinforcement learning. SAERL models data diversity, difficulty, and quality using SAEs to inform operations like batch mixing, curriculum ordering, and data filtering. This approach significantly improves LLM performance and training efficiency compared to methods relying solely on external signals.

It's Not Always Sycophancy: Measuring LLM Conformity as a Function of Epistemic Uncertainty
his paper introduces MUSE, a framework to measure Large Language Model (LLM) conformity. It disentangles conformity into two drivers: sycophancy (aligning with user pushback regardless of certainty) and uncertainty-driven conformity (increasing conformity with higher epistemic uncertainty). The contribution is demonstrating that LLM conformity is not solely due to sycophancy but also influenced by the model's confidence in its initial response.

MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation
USE-Autoskill introduces a novel framework for LLM agents that treats skills as dynamic, evolving entities. Its core method involves a unified lifecycle for skills: creation, memory, management, and evaluation, enabling agents to continuously improve by generating, reusing, and refining skills. The key contribution is the concept of skill-level memory, which allows skills to accumulate experience across tasks, leading to more effective and adaptive problem-solving over time.
SIA: Self Improving AI with Harness & Weight Updates
his paper introduces SIA, a novel self-improving AI system that breaks down the traditional separation between updating an AI's code (harness) and its learned parameters (weights). SIA's core method is a meta-agent that iteratively refines both the task-specific agent's harness and its model weights based on feedback. The key contribution is demonstrating that simultaneously updating both aspects leads to significantly better performance across diverse and complex domains compared to updating only one.

StepOPSD: Step-Aware Online Preference Distillation for Agent Reinforcement Learning
tepOPSD addresses the credit assignment problem in multi-turn agent reinforcement learning by treating individual agent steps as the fundamental unit for learning. It decomposes trajectories into step segments, rescores them with hindsight, and uses these scores to shape rewards, leading to improved performance on tasks sensitive to local decision-making errors.

VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions
itaBench 2.0 addresses the gap in evaluating LLM agents by introducing a benchmark focused on personalized and proactive behavior in long-term user interactions. Its core method involves temporally ordered tasks with user preferences embedded in fragmented interactions, requiring agents to continuously infer and utilize this information. The contribution is a novel evaluation framework that moves beyond simple reasoning to assess an agent's ability to understand and adapt to individual users over time.

FinHarness: An Inline Lifecycle Safety Harness for Finance LLM Agents
inHarness is an inline safety harness for finance LLM agents that prevents unauthorized actions and ensures legitimate workflows. It achieves this by monitoring queries for intent drift, evaluating each tool call, and adaptively routing verification to different LLM judges. This approach allows agents to self-correct mid-trajectory, significantly reducing harmful actions while maintaining high approval rates for benign operations.

ACE: Self-Evolving LLM Coding Framework via Adversarial Unit Test Generation and Preference Optimization
CE is a self-evolving LLM coding framework that addresses the limitations of existing methods by using a solver-adversary architecture. It leverages adversarial unit test generation, where a single LLM generates both candidate code and test inputs designed to trigger execution failures. This execution-centric supervision allows the model to actively discover and correct its own errors, leading to more robust code generation without relying on large annotated datasets.

ATLAS: A Multi-LLM Training Framework for EvoDPO with Adaptive Reference Evolution
TLAS is a multi-LLM training framework that enables an active agent to self-evolve its policy through collaborative training by specialized meta-agents. Its core contribution is the EvoDPO algorithm, which overcomes limitations of fixed reference models by adaptively updating the reference policy based on continuous training telemetry, preventing stagnation and enabling more effective learning.

Blind Spots in the Guard: How Domain-Camouflaged Injection Attacks Evade Detection in Multi-Agent LLM Systems
his paper introduces "domain-camouflaged injection attacks," where malicious prompts mimic the target document's vocabulary and authority to evade detection. The core contribution is identifying and quantifying the "Camouflage Detection Gap" (CDG), demonstrating that standard injection detectors fail significantly against these sophisticated attacks, with detection rates plummeting.
CentaurEval: Benchmarking Human-in-the-Loop Value in Agentic Coding
entaurEval introduces a novel benchmark for evaluating human-in-the-loop coding agents by creating "Collaboration-Necessary" problems that are too difficult for humans or LLMs alone. Its core contribution is a standardized framework that dynamically generates tasks, enabling the measurement of human-AI collaboration's value in coding, which significantly outperforms standalone human or AI performance.

CODE-SHARP: Continuous Open-ended Discovery and Evolution of Skills as Hierarchical Reward Programs
ODE-SHARP is a framework that uses Foundation Models to autonomously discover and evolve a library of Python programs (SHARPs). These SHARPs encode skills as hierarchical reward programs, where each program defines a success condition and relies on previously discovered SHARPs as prerequisites. This allows a generalist agent to learn entirely from scratch via reinforcement learning, dynamically navigating its skill repertoire based on the current environment.

Cumulative Reasoning with Large Language Models
his paper introduces Cumulative Reasoning (CR), a structured framework that enhances Large Language Model (LLM) problem-solving by mimicking human iterative thought. CR uses LLMs in distinct roles (Proposer, Verifier, Reporter) to decompose tasks, generate and validate intermediate steps, and build a dynamic DAG of verified propositions. This approach significantly improves performance on complex reasoning tasks, outperforming existing methods in logical inference and the Game of 24.
Enhancing Causal Reasoning in Large Language Models: A Causal Attribution Model for Precision Fine-Tuning
his paper introduces a causal attribution model that uses "do-operators" to create interventional scenarios, allowing for systematic quantification of LLM component contributions to causal reasoning. This model enables precise fine-tuning of LLMs for causal discovery tasks, improving their ability to leverage context, domain knowledge, and numerical data for accurate causal inference.

General Agentic Planning Through Simulative Reasoning with World Models
his paper proposes that general agentic planning requires "simulative reasoning" within a world model, contrasting it with current reactive decision-making. The core method is to build an agent that mentally simulates future outcomes of actions to make more flexible, goal-directed decisions. The contribution is the SiRA architecture, demonstrating this simulative approach as a general-purpose planning mechanism for agents.

GROW: Aligning GRPO with State-Action Modeling for Open-World VLM Agents
his paper introduces GROW, a reinforcement learning framework for open-world VLM agents. GROW addresses limitations of existing methods by decomposing full trajectories into state-action samples, enabling effective use of GRPO for multi-turn tasks. This approach avoids excessively long contexts and noise, improving learning efficiency and performance.

Insights Generator: Systematic Corpus-Level Trace Diagnostics for LLM Agents
his paper introduces the Insights Generator (IG), a novel system for systematically diagnosing failures in LLM agents at a corpus level. IG addresses the limitations of manual inspection by automatically generating evidence-backed natural-language insights about systematic behavioral patterns across large collections of execution traces. Its core contribution lies in formalizing corpus-level diagnostics and providing a scalable, multi-agent approach to uncover and explain LLM agent failures.

Learning Spatiotemporal Sensitivity in Video LLMs via Counterfactual Reinforcement Learning
his paper addresses the problem of Video LLMs relying on shortcuts rather than spatiotemporal understanding. Their core method, Counterfactual Relational Policy Optimization (CRPO), uses reinforcement learning with counterfactual video transformations (flips, reversals) and a novel "Counterfactual Relation Reward" to train models to be sensitive to dynamic changes in video content. This contribution aims to improve Video LLMs' ability to truly track and reason about video dynamics.

Learning to Configure Agentic AI Systems
his paper addresses the challenge of configuring complex LLM-based agent systems by framing it as a semi-Markov decision process. Their proposed method, ARC, is a hierarchical policy that dynamically selects query-specific configurations to optimize performance and resource usage. ARC significantly improves accuracy across various benchmarks compared to fixed configurations, demonstrating the value of adaptive agent system setup.

LightReasoner: Can Small Language Models Teach Large Language Models Reasoning?
ightReasoner proposes a novel method where smaller language models (SLMs) teach larger language models (LLMs) by identifying and highlighting crucial reasoning steps. The core idea is to leverage the behavioral differences between an expert LLM and an amateur SLM to create targeted supervision data. This distilled data then fine-tunes the LLM, focusing on its unique strengths and improving reasoning efficiency without requiring massive, uniformly optimized datasets.
Metis: Learning to Jailbreak LLMs via Self-Evolving Metacognitive Policy Optimization
etis reformulates LLM jailbreaking as inference-time policy optimization within an adversarial POMDP. It uses a self-evolving metacognitive loop to diagnose defense logic and refine its policy via structured feedback, achieving an 89.2% average attack success rate and outperforming traditional methods on resilient models.

MoralityGym: A Benchmark for Evaluating Hierarchical Moral Alignment in Sequential Decision-Making Agents
his paper introduces MoralityGym, a benchmark for evaluating how well AI agents can follow hierarchical moral rules in complex decision-making scenarios. It uses a novel formalism called Morality Chains to represent these rules and a new Morality Metric to assess alignment, decoupling task performance from ethical behavior. The contribution is a principled framework for integrating psychological and philosophical insights into AI safety, enabling the development of more reliable and ethical AI systems.

Orchard: An Open-Source Agentic Modeling Framework
rchard is an open-source framework designed to address infrastructure and training gaps in agentic modeling with LLMs. Its core contribution is Orchard Env, a lightweight environment service that provides reusable primitives for managing sandbox lifecycles, agent harnesses, and pipeline stages across various task domains. This enables scalable training of autonomous agents capable of complex problem-solving.

Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action
elican-Unify 1.0 introduces a novel unified embodied intelligence model that leverages a single Vision-Language Model (VLM) for understanding, reasoning, and generating future actions and videos. Its core method involves mapping diverse inputs into a shared semantic space and then using this representation to autoregressively produce chains of thought and predict future modalities within a single denoising process. This unification approach allows for joint optimization of understanding, reasoning, imagination, and action, a significant contribution over training separate expert systems.

Planning in the LLM Era: Building for Reliability and Efficiency
his paper argues that the planning field is shifting towards using LLMs to generate verifiable symbolic solvers, rather than for direct plan generation. This approach aims to build reliable and efficient planners that minimize LLM reliance during inference, addressing the limitations of earlier methods.

Ratchet: A Minimal Hygiene Recipe for Self-Evolving LLM Agents
atchet addresses the lifecycle management bottleneck in self-evolving LLM agents by introducing a single-agent loop for natural language skill management. Its core method integrates four hygiene mechanisms—outcome-driven retirement, bounded active-cap, meta-skill authoring guidance, and pattern canonicalization—to enable a frozen LLM to effectively write, retrieve, curate, and retire its own skills. This approach significantly improves performance on tasks like MBPP+ hard-100, demonstrating a substantial gain over baselines and showing promise for agentic problem-solving.

The Illusion of Reasoning: Exposing Evasive Data Contamination in LLMs via Zero-CoT Truncation
his paper introduces the Zero-CoT Probe (ZCP) to detect evasive data contamination in LLMs. ZCP works by truncating the model's reasoning steps to expose memorization, which often masks true reasoning abilities. By comparing performance on original versus truncated reasoning, ZCP effectively identifies and isolates memorized data from genuine problem-solving skills.

ALIVE: Awakening LLM Reasoning via Adversarial Learning and Instructive Verbal Evaluation
LIVE addresses the "reward bottleneck" in LLM reasoning by moving beyond costly scalar rewards. Its core method, Adversarial Learning with Instructive Verbal Evaluation, unifies problem posing, solving, and judging within a single policy. This allows LLMs to internalize reasoning logic directly from raw text through adversarial training and verbal feedback, fostering a deeper, self-contained understanding of correctness.

Co-ReAct: Rubrics as Step-Level Collaborators for ReAct Agents
o-ReAct introduces a novel framework where rubrics act as step-level collaborators for ReAct agents. Instead of just evaluating final outputs, Co-ReAct integrates rubrics directly into the agent's decision-making process during inference, guiding each reasoning or action step. This allows agents to more effectively target evidence, refine their reasoning, and improve the overall quality and efficiency of multi-step tasks.

DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling
iLaDiff addresses the token correlation issue in diffusion language models by introducing a continuous latent space. This latent space, learned via an auto-encoder and a latent diffusion model, captures semantic information. A consistency model then distills this latent prior into a fast, few-step generative model, significantly improving sampling quality and inference speed.

Efficient and Transferable Agentic Knowledge Graph RAG via Reinforcement Learning
his paper introduces KG-R1, an agentic framework that uses reinforcement learning to optimize knowledge-graph retrieval-augmented generation (KG-RAG). Instead of fixed multi-module pipelines, a single agent learns to interact with knowledge graphs, retrieving and incorporating information dynamically for more efficient and transferable question answering. This approach reduces inference costs and improves accuracy compared to existing methods.

Foundation Protocol: A Coordination Layer for Agentic Society
he Foundation Protocol (FP) introduces a graph-based coordination layer for agentic societies, unifying diverse entities like agents, humans, and institutions. Its core method is to provide a flexible framework for multi-party organization, event-based collaboration, and economic primitives, while prioritizing policy and accountability. FP's main contribution is enabling the scalable and safe interaction of autonomous agents by acting as a bridging layer for existing protocols, fostering an AI economy.

GENSTRAT: Toward a Science of Strategic Reasoning in Large Language Models
his paper introduces GENSTRAT, a novel benchmark for evaluating strategic reasoning in LLMs. Its core method involves procedurally generating a diverse distribution of imperfect-information card games, allowing for evergreen and robust evaluation. GENSTRAT's contribution is a more generalizable assessment of LLM strategic capabilities beyond fixed, canonical games, enabling confidence in predicting their performance in real-world messy environments.

Goal-Conditioned Agents that Learn Everything All at Once
his paper introduces Learning Everything All at Once (LEO), a method for goal-conditioned reinforcement learning. LEO efficiently learns from all transitions by jointly outputting values and actions for every possible goal simultaneously, enabling parallel, off-policy updates. This approach significantly improves sample efficiency and performance on goal-conditioned tasks while being substantially faster than naive relabeling.
It's the humans, not the data: Geopolitical bias in LLMs originates in post-training, amplified by the language of the prompt
his paper demonstrates that geopolitical bias in LLMs primarily emerges during post-training, not pre-training, contradicting common assumptions. The researchers found that models often develop a bias favoring their developer's home country after fine-tuning, with the prompt's language also influencing the strength of this bias. This highlights the crucial role of human-driven post-training processes in shaping LLM behavior.

MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detection
emAudit is a post-hoc framework for auditing poisoned memory in LLM agents. It uses causal attribution to identify memories that causally influence harmful outputs and structural anomaly detection to pinpoint suspicious memory patterns. This allows for the identification and mitigation of memory poisoning after malicious behavior has occurred, addressing a gap in existing online-only defenses.

Model Spec Midtraining: Improving How Alignment Training Generalizes
his paper introduces Model Spec Midtraining (MSM) to improve how language models generalize during alignment training. MSM involves training models on synthetic documents discussing their desired behavior specification *before* standard alignment fine-tuning. This pre-training step helps models understand the spec's content, leading to more robust and targeted generalization from subsequent demonstration data.
R$^3$L: Reflect-then-Retry Reinforcement Learning with Language-Guided Exploration, Pivotal Credit, and Positive Amplification
$^3$L addresses exploration and exploitation challenges in RL for LLMs by introducing a "reflect-then-retry" mechanism. This method uses language feedback to analyze failed attempts, guiding retries from failure points to improve trajectory synthesis and reduce costs. The paper also proposes pivotal credit assignment and positive amplification to overcome coarse credit assignment and failure-dominated training.
SafeHarbor: Hierarchical Memory-Augmented Guardrail for LLM Agent Safety
afeHarbor is a hierarchical memory-augmented guardrail system for LLM agents. Its core method involves extracting context-aware defense rules through adversarial generation and dynamically injecting them into a local hierarchical memory. This approach aims to provide precise decision boundaries, balancing safety and utility without requiring retraining, and includes a self-evolution mechanism for continuous improvement.

Scaling-Aware Adapter for Structure-Grounded LLM Reasoning
his paper introduces Cuttlefish, a unified multimodal LLM that enhances reasoning over 2D and 3D structures. Its core method, Scaling-Aware Patching, adaptively generates variable-size patches over structural graphs, allowing the model to scale its query token budget with structural complexity. This approach overcomes limitations of fixed-length connectors, enabling more flexible and effective geometric grounding for generalized all-atom reasoning.

VI-CuRL: Stabilizing Verifier-Independent RL Reasoning via Confidence-Guided Variance Reduction
his paper introduces VI-CuRL, a method to stabilize Reinforcement Learning for LLM reasoning without external verifiers. It uses the LLM's own confidence to guide a curriculum, prioritizing high-confidence examples to reduce gradient variance and prevent training collapse. This approach effectively manages the bias-variance trade-off, leading to more stable and scalable LLM reasoning.

When Planning Fails Despite Correct Execution: On Epistemic Calibration for LLM-Based Multi-Agent Systems
his paper addresses failures in LLM multi-agent systems where plans are executed correctly but are based on agents misjudging their knowledge (epistemic miscalibration). The core method, EPC-AW, proposes an agentic workflow that assesses plan stability under varying information conditions, rather than direct feasibility checks. The contribution is a novel approach to improve LLM agent planning by ensuring epistemic calibration, leading to more robust and reliable multi-agent system behavior.

CyBiasBench: Benchmarking Bias in LLM Agents for Cyber-Attack Scenarios
his paper introduces CyBiasBench, a benchmark designed to quantify attack-selection bias in LLM agents used for cybersecurity. The core method involves evaluating five LLM agents across various scenarios to reveal their tendency to disproportionately focus on specific attack families, independent of prompt variations. The main contribution is the identification and characterization of this "attack-selection bias" as an inherent agent trait, demonstrating that LLM agents exhibit distinct and persistent preferences in their offensive strategies.

Flow-OPD: On-Policy Distillation for Flow Matching Models
low-OPD addresses bottlenecks in multi-task flow matching models by using on-policy distillation. It first trains specialized "teacher" models for individual tasks, then distills their expertise into a single "student" model through a novel two-stage alignment process. This approach aims to overcome reward sparsity and gradient interference, leading to improved performance across multiple objectives.

KL for a KL: On-Policy Distillation with Control Variate Baseline
his paper introduces vOPD, a method to stabilize On-Policy Distillation (OPD) for large language models. It achieves this by framing OPD as policy-gradient reinforcement learning and incorporating a control variate baseline, specifically a value function. The key contribution is that this value function has a closed-form solution derived from the student and teacher models' existing forward pass, avoiding the computational overhead of previous stabilization techniques.

Learning CLI Agents with Structured Action Credit under Selective Observation
his paper introduces a novel approach for training command-line interface (CLI) agents by leveraging the inherent structure of CLI actions. To address challenges of partial observation and sparse rewards, it proposes $σ$-Reveal to selectively extract relevant context and Action Advantage Assignment to better attribute credit to actions within long interaction sequences. The core contribution lies in using structured action information as a learning signal, improving agent performance on complex CLI tasks.

Reason to Play: Behavioral and Brain Alignment Between Frontier LRMs and Human Game Learners
his paper investigates whether advanced Large Reasoning Models (LRMs) can replicate human learning and planning in novel video games. By analyzing human gameplay with fMRI data, the study finds that LRMs better match human learning behaviors and predict brain activity compared to reinforcement learning agents. This suggests LRMs exhibit a more human-like approach to acquiring and applying abstract knowledge in complex environments.

TraceFix: Repairing Agent Coordination Protocols with TLA+ Counterexamples
raceFix is a verification-first pipeline that uses TLA+ model checking to automatically repair LLM multi-agent coordination protocols. An LLM agent synthesizes a protocol, generates TLA+ logic, and iteratively refines it using counterexamples until verified. This verified protocol is then compiled into system prompts, ensuring robust and efficient agent coordination.

ADKO: Agentic Decentralized Knowledge Optimization
DKO is a framework for collaborative black-box optimization among autonomous agents. Its core method involves each agent maintaining a private Gaussian Process surrogate and communicating only through "knowledge tokens," which are compressed summaries of their findings. This approach achieves sample efficiency, privacy, and handles diverse objectives by avoiding raw data sharing, while its contribution lies in the formal analysis of information loss from token compression and language model approximation.

Graph Representation Learning Augmented Model Manipulation on Federated Fine-Tuning of LLMs
his paper proposes an Augmented Model Manipulation (AugMP) strategy to attack federated fine-tuning (FFT) of LLMs. The core method uses graph representation learning to understand benign model updates and generate more effective and stealthy malicious updates. The contribution is a novel attack that leverages these insights to corrupt the global LLM during collaborative fine-tuning.

Self-Play Enhancement via Advantage-Weighted Refinement in Online Federated LLM Fine-Tuning with Real-Time Feedback
his paper introduces SPEAR, an online federated learning algorithm for LLMs that enhances self-play. SPEAR leverages real-time user feedback to create advantage-weighted contrastive pairs, enabling efficient fine-tuning on resource-constrained edge devices without requiring privileged ground-truth data. Its core contribution is enabling continuous self-improvement of LLMs in a federated setting by effectively utilizing natural feedback loops.

Ask Early, Ask Late, Ask Right: When Does Clarification Timing Matter for Long-Horizon Agents?
his paper investigates when clarification is most valuable for long-horizon AI agents. They introduce a framework to inject clarifications at different stages of execution and find that the optimal timing depends on the type of missing information. Specifically, goal clarifications are most effective early on, while input clarifications remain valuable throughout the agent's task.

Beyond "I cannot fulfill this request": Alleviating Rigid Rejection in LLMs via Label Enhancement
his paper introduces LANCE, a method to reduce "rigid rejection" in LLMs by enhancing safety labels. LANCE uses variational inference to predict a continuous distribution of rejection categories, providing nuanced gradients that allow LLMs to neutralize harmful prompt elements and generate safer, more natural responses instead of generic refusals.

LLMs Improving LLMs: Agentic Discovery for Test-Time Scaling
his paper introduces AutoTTS, a framework that uses an agentic approach to automatically discover optimal test-time scaling (TTS) strategies for large language models. Instead of manual tuning, AutoTTS creates environments where TTS strategies can be learned efficiently by synthesizing controllers that decide how to allocate computation during inference, based on cheap feedback signals. This allows for a more comprehensive exploration of the computation-allocation space, leading to improved LLM performance.

AssayBench: An Assay-Level Virtual Cell Benchmark for LLMs and Agents
ssayBench is a new benchmark designed to evaluate Large Language Models (LLMs) and agents on predicting cellular phenotypes from CRISPR screens. It addresses the lack of standardized evaluation for this task, which is crucial for accelerating biological discovery and drug development. The benchmark utilizes a large dataset of publicly available CRISPR screens to assess the models' ability to handle heterogeneous biological data and predict diverse phenotypic outcomes.

Dynamic Cross-Modal Prompt Generation for Multimodal Continual Instruction Tuning
his paper introduces DRAPE, a novel framework for Multimodal Continual Instruction Tuning (MCIT). DRAPE addresses catastrophic forgetting in MLLMs by dynamically generating instance-specific soft prompts, adapting to individual query-image pairs rather than relying on fixed task-level modules. This instance-level adaptation allows for more flexible and effective learning of new capabilities while preserving existing knowledge.
MATRA: Modeling the Attack Surface of Agentic AI Systems -- OpenClaw Case Study
his paper introduces MATRA, a pragmatic threat modeling framework for agentic AI systems. MATRA adapts existing risk assessment methods to systematically identify and quantify risks by first assessing asset impact and then using attack trees to determine likelihood. The authors demonstrate MATRA's effectiveness on an OpenClaw case study, showing how architectural controls can mitigate identified risks.

Probing Cross-modal Information Hubs in Audio-Visual LLMs
his paper investigates how audio and visual information is processed and integrated within Audio-Visual Large Language Models (AVLLMs). The core method involves analyzing token representations to understand where information from one modality is encoded in the other. The key contribution is the discovery that AVLLMs primarily use "sink tokens" to integrate cross-modal information, and that this integration is not uniform but concentrated in a specific subset of these sink tokens.

Reasoning Is Not Free: Robust Adaptive Cost-Efficient Routing for LLM-as-a-Judge
his paper investigates the trade-off between accuracy and cost when using LLMs as judges. It finds that explicit reasoning significantly improves performance on complex tasks but incurs higher costs, suggesting selective use. The authors propose RACER, a method that adaptively routes requests to reasoning or non-reasoning judges within a budget, accounting for potential distribution shifts.
Remember the Decision, Not the Description: A Rate-Distortion Framework for Agent Memory
his paper proposes a novel rate-distortion framework for agent memory, shifting focus from descriptive memory quality to its impact on decision-making. The core method frames memory compression as a decision-centric problem, where memory quality is measured by the loss in achievable decision quality. The main contribution is a theoretical framework that defines an exact forgetting boundary and an optimal memory-distortion frontier, leading to an online memory learner (DeMem) that efficiently manages memory by only refining it when necessary to avoid decision conflicts.

Rethinking Agentic Search with Pi-Serini: Is Lexical Retrieval Sufficient?
his paper investigates whether lexical retrieval is sufficient for agentic search with advanced LLMs. The authors introduce Pi-Serini, a search agent that pairs a well-tuned BM25 lexical retriever with capable LLMs. Their findings demonstrate that a sufficiently deep and optimized lexical retriever, when combined with powerful LLMs, can achieve high accuracy in deep research tasks, even surpassing agents using dense retrievers.
SLIM: Sparse Latent Steering for Interpretable and Property-Directed LLM-Based Molecular Editing
LIM is a plug-and-play framework that decomposes LLM hidden states into sparse, property-aligned features using a Sparse Autoencoder. This allows for precise steering in the latent space to control molecular properties, improving editing success rates without altering the LLM's parameters. The method also enables interpretable analysis of the editing process.

Threat Modelling using Domain-Adapted Language Models: Empirical Evaluation and Insights
his paper empirically evaluates domain-adapted language models (LLMs and SLMs) for structured threat modeling using the STRIDE approach in 5G security. The core method involves systematically analyzing the impact of domain adaptation, model size, decoding strategies, and prompting techniques on threat classification accuracy. The main contribution is providing insights into how these factors influence the effectiveness of language models in cybersecurity threat modeling.
AttenA+: Rectifying Action Inequality in Robotic Foundation Models
his paper introduces AttenA+, a framework that addresses the "action inequality" in robotic foundation models. It recognizes that low-velocity actions are often more critical for task success than high-velocity transitions. AttenA+ rectifies this by reweighting the training objective based on inverse velocity, prioritizing kinematically critical segments through a novel attention mechanism. This approach aims to improve the performance of Vision-Language-Action and World-Action models on complex, long-horizon robotic tasks.

Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training
his paper investigates whether low-rank pre-training methods for large language models generalize as well as full-rank training, a question previously addressed only by limited perplexity metrics. The authors provide a more thorough comparison by analyzing the geometric and spectral properties of the solutions found by five different low-rank methods, revealing how rank constraints impact model representations beyond simple perplexity scores. Their contribution lies in offering a deeper understanding of low-rank pre-training's effectiveness and its fundamental differences from full-rank training.
Children's English Reading Story Generation via Supervised Fine-Tuning of Compact LLMs with Controllable Difficulty and Safety
his paper fine-tunes compact LLMs (8B parameters) on expert-designed children's reading curricula and existing generated stories. The core method focuses on controllable difficulty and safety, enabling educators to target specific reading levels. The main contribution is demonstrating that these fine-tuned, smaller LLMs can generate English reading stories that are more appropriate in difficulty for children than those produced by larger, zero-shot models, while remaining cost-effective.

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents
VA-Bench is an end-to-end framework for evaluating voice agents. Its core method involves generating realistic, multi-turn bot-to-bot audio conversations with automatic validation and introducing two composite metrics, EVA-A (Accuracy) and EVA-X (Experience), to measure task completion, speech fidelity, and conversational quality. This addresses the limitations of existing benchmarks in simulating realistic dialogues and capturing voice-specific failure modes.

Harnessing Agentic Evolution
his paper introduces AEvo, a meta-editing framework for agentic evolution. AEvo treats the evolutionary process as an interactive environment, using accumulated evidence as its state. Its core contribution is a meta-agent that revises the evolutionary mechanism itself, rather than directly generating candidates, to improve long-horizon evolution and prevent drift.

Position: Assistive Agents Need Accessibility Alignment
his paper argues that assistive AI agents for visually impaired users must prioritize "accessibility alignment" as a core design goal, not an afterthought. Current agentic AI fails in assistive scenarios due to mismatches with sighted-user assumptions regarding verification, risk, and interaction. The authors propose a new lifecycle-oriented design pipeline to create accessibility-aligned agents.

RealICU: Do LLM Agents Understand Long-Context ICU Data? A Benchmark Beyond Behavior Imitation
his paper introduces RealICU, a novel benchmark for evaluating LLMs on long-context ICU data. Unlike previous benchmarks that rely on potentially suboptimal clinician actions, RealICU uses hindsight annotations from senior physicians reviewing complete patient trajectories. This allows for a more accurate assessment of LLM reasoning capabilities across tasks like patient status assessment, problem identification, and action recommendation.

ScioMind: Cognitively Grounded Multi-Agent Social Simulation with Anchoring-Based Belief Dynamics and Dynamic Profiles
cioMind is a novel multi-agent social simulation framework that integrates structured opinion dynamics with LLM-based agent reasoning. Its core method combines a personality-conditioned belief update rule with a hierarchical memory architecture and dynamic agent profiles, allowing for cognitively grounded and evolving agent behavior. This approach addresses limitations of existing methods by offering a more realistic and nuanced simulation of social opinion dynamics.

Senses Wide Shut: A Representation-Action Gap in Omnimodal LLMs
his paper introduces IMAVB, a benchmark to test omnimodal LLMs' ability to detect contradictions between text and their own sensory input. The core finding is a "Representation-Action Gap," where models internally represent mismatches but fail to reject false textual claims in their outputs. This highlights a critical limitation in their grounding capabilities.

Where Does Reasoning Break? Step-Level Hallucination Detection via Hidden-State Transport Geometry
his paper introduces a novel method for detecting hallucinations in large language models at the step-by-step reasoning level, rather than just the overall output. It proposes that correct reasoning follows a stable path in the model's hidden states, while errors cause deviations. The core contribution is a geometric approach that identifies these deviations by analyzing the "transport cost" between hidden states, allowing for precise localization of the first hallucination.

Learning POMDP World Models from Observations with Language-Model Priors
his paper introduces Pinductor, a method that uses Large Language Models (LLMs) to learn world models for partially observable environments (POMDPs). Pinductor leverages LLM priors to propose and refine POMDP models from limited observation-action data, significantly improving sample efficiency. Its key contribution is achieving comparable performance to methods with privileged state access, while using less information and outperforming existing sample-inefficient approaches.

MILM: Large Language Models for Multimodal Irregular Time Series with Informative Sampling
ILM represents multimodal irregular time series as XML-formatted triplets and fine-tunes a large language model (LLM) in two stages. The first stage trains the LLM to predict from sampling patterns alone, while the second stage jointly models patterns and observed values. This approach effectively leverages the predictive power of irregular sampling and multimodal data for tasks like healthcare prediction.
Sampling from Flow Language Models via Marginal-Conditioned Bridges
his paper proposes a novel sampling method for Flow Language Models (FLMs) by leveraging their unique denoiser structure. Instead of collapsing marginal distributions, the method samples a one-hot token from the posterior marginals at each step and then uses an analytic Ornstein-Uhlenbeck bridge conditioned on this sampled token. This "marginal-conditioned bridge" sampling is training-free, efficient, and provides a principled way to generate valid one-hot token sequences.

An LLM-Based System for Argument Reconstruction
his paper introduces an LLM-based system that reconstructs arguments from text into abstract argument graphs. The system uses a multi-stage pipeline to identify claims, premises, and their logical relationships (support, attack, undercut), representing them as directed acyclic graphs. Its contribution lies in providing an end-to-end method for automated argument analysis and structure recovery, evaluated through both manual and quantitative experiments.

FlowCompile: An Optimizing Compiler for Structured LLM Workflows
lowCompile optimizes structured LLM workflows by treating them as a compilation problem, not just an inference-time routing problem. It globally explores the design space of sub-agent configurations before deployment to create reusable workflow-level configurations that balance accuracy and latency across various trade-offs. This compilation approach allows for pre-computed, optimized workflow structures, improving efficiency and performance.

Good Agentic Friends Do Not Just Give Verbal Advice: They Can Update Your Weights
his paper introduces TFlow, a novel communication method for multi-agent LLM systems. Instead of exchanging text, TFlow allows agents to directly update the receiver's internal weights with learned, low-rank perturbations. This significantly reduces computational costs and memory usage by enabling instance-level adaptation without permanent model changes.

Inducing Artificial Uncertainty in Language Models
his paper introduces a method to induce artificial uncertainty in language models, particularly when challenging data for training uncertainty quantification is scarce. The core idea is to train models to express uncertainty even on simple examples, thereby improving their ability to signal uncertainty on genuinely difficult or unseen data. This approach aims to overcome the limitations of traditional supervised uncertainty quantification methods as language models saturate training datasets.
A Multi-Memory Segment System for Generating High-Quality Long-Term Memory Content in Agents
his paper introduces a Multi-Memory Segment System (MMS) to generate higher-quality long-term memory content for agents. Inspired by cognitive psychology, MMS processes short-term memory into multiple distinct long-term memory segments, creating corresponding retrieval and contextual memory units. This approach aims to overcome the limitations of simple summarization, thereby improving both memory recall and response quality.
Active Learning for Communication Structure Optimization in LLM-Based Multi-Agent Systems
his paper proposes an active learning method to optimize communication structures in LLM-based multi-agent systems. Instead of random task sampling, it uses an ensemble-based information-theoretic framework to identify the most informative tasks for improving communication. This approach efficiently estimates task value by measuring how much a task alters the distribution of communication parameters, leading to more stable and effective optimization under limited training budgets.

AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Management
gentProg tackles the challenge of long-horizon GUI agent context management by representing interaction history as a program. This program structure guides information retention and discarding, mitigating context overhead. The paper also introduces a global belief state for handling partial observability and environmental changes, improving agent robustness.

Android Coach: Improve Online Agentic Training Efficiency with Single State Multiple Actions
his paper introduces Android Coach, a framework to improve the efficiency of training Android agents with online reinforcement learning. It addresses the costly nature of emulator interactions by shifting from a "single state, single action" to a "single state, multiple actions" paradigm. This allows the agent to explore more actions from a single emulator state, significantly reducing training time and cost.

Are LLM Agents Behaviorally Coherent? Latent Profiles for Social Simulation
his paper introduces a novel method to assess the behavioral coherence of LLM agents by first identifying their underlying latent profiles and then testing their consistency in conversational settings. The core contribution is demonstrating that LLM agents often exhibit significant behavioral inconsistencies, challenging their direct substitution for human participants in social simulations.

ARMOR: An Agentic Framework for Reaction Feasibility Prediction via Adaptive Utility-aware Multi-tool Reasoning
RMOR is an agentic framework that addresses the challenge of reaction feasibility prediction by adaptively leveraging multiple AI tools. It models tool-specific utilities and prioritizes them hierarchically, resolving conflicts to produce more accurate predictions than single-tool or simple aggregation methods. This adaptive, utility-aware multi-tool reasoning represents ARMOR's core contribution to improving computational chemistry predictions.

ART for Diffusion Sampling: A Reinforcement Learning Approach to Timestep Schedule
his paper introduces Adaptive Reparameterized Time (ART), a method to optimize the timestep schedule for diffusion model sampling. ART learns a reparameterized time variable to dynamically adjust computation across the sampling trajectory, minimizing discretization error. The contribution is a reinforcement learning framework (ART-RL) that provides a principled way to find the optimal ART schedule, bridging continuous-time RL with deterministic optimization.

Argus: Evidence Assembly for Scalable Deep Research Agents
rgus addresses the inefficiency of current deep research agents by treating evidence gathering as a jigsaw puzzle. Instead of parallelizing redundant searches, its Searcher collects evidence for sub-queries, while a Navigator manages a shared graph, identifying missing pieces and synthesizing the final, source-traced answer. This cooperative approach ensures complementary evidence is assembled, improving scalability and reducing redundant computation.

Confirming Correct, Missing the Rest: LLM Tutoring Agents Struggle Where Feedback Matters Most
his paper evaluates LLM tutoring agents' ability to distinguish between correct, suboptimal, and incorrect student reasoning in propositional logic. The core method involves a benchmark with knowledge-graph ground truth, revealing that LLMs excel at identifying optimal steps but struggle significantly with valid-but-suboptimal and incorrect reasoning. The main contribution is demonstrating that LLMs fail precisely where adaptive tutoring is most crucial, suggesting architectural limitations rather than data issues, and that accurate diagnosis doesn't guarantee pedagogically useful feedback.

Reasoners or Translators? Contamination-aware Evaluation and Neuro-Symbolic Robustness in Tax Law
his paper investigates whether LLMs truly reason in tax law or simply regurgitate contaminated training data. They introduce a contamination detection protocol and a novel test suite to evaluate LLMs against neuro-symbolic systems. The findings suggest that legal reasoning is compositional, and neuro-symbolic approaches offer greater robustness and generalization to unseen legal scenarios.
Towards Foundation Models for Relational Databases with Language Models and Graph Neural Networks
his paper proposes a hybrid deep learning architecture that combines a fine-tuned BART language model with a GraphSAGE-based Graph Neural Network (GNN) to process relational databases. The core method injects relational context from entity graphs into BART's row embeddings, overcoming limitations of previous task-specific approaches. This hybrid model significantly improves performance on relational data tasks, narrowing the gap to state-of-the-art methods.

VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocation
ideoSeeker addresses the limitations of text-based prompts in video understanding by introducing a novel paradigm that uses **visual prompts** for instance-level localization. Its core method involves an **agentic reasoning framework** that allows the model to proactively perceive and retrieve relevant video segments based on visual cues, rather than relying solely on language. This approach significantly improves user experience and enables more precise spatiotemporal understanding by tightly integrating visual perception with reasoning.

Who Owns This Agent? Tracing AI Agents Back to Their Owners
his paper addresses the critical problem of **agent attribution**, which is the inability to trace harmful AI agents back to their deploying accounts. The core method involves formalizing this gap and proposing techniques to link observed agent behavior to the responsible account at the hosting vendor. The main contribution is defining this problem for the first time and laying the groundwork for solutions to establish accountability for AI agent actions.

SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generation
GR enhances LLM reasoning by generating query-specific subgraphs from external knowledge bases. This framework grounds intermediate reasoning steps in structured knowledge, helping LLMs focus on relevant entities and evidence for more accurate and consistent complex inferences.

AMR-SD: Asymmetric Meta-Reflective Self-Distillation for Token-Level Credit Assignment
his paper introduces Asymmetric Meta-Reflective Self-Distillation (AMR-SD) to address the credit-assignment problem in aligning LLMs for complex reasoning. Instead of directly using reference solutions, AMR-SD compresses diagnostic signals into "Socratic hints and critiques" via a reflection bottleneck. This approach aims to prevent over-conditioning and answer leakage, improving the effectiveness of reinforcement learning for LLMs.

CrossView Suite: Harnessing Cross-view Spatial Intelligence of MLLMs with Dataset, Model and Benchmark
his paper introduces CrossView Suite, a comprehensive framework to enhance multimodal large language models' (MLLMs) spatial reasoning across multiple viewpoints. It addresses data scarcity, evaluation limitations, and alignment issues by providing a large-scale dataset (CrossViewSet), a scene-disjoint benchmark (CrossViewBench), and a model (CrossViewer) with explicit object-level consistency mechanisms. The core contribution lies in enabling MLLMs to consistently perceive and reason about objects and their spatial relationships from diverse perspectives.

DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention
ashAttention introduces a novel hierarchical attention mechanism that addresses limitations of prior methods. Its core innovation is using an adaptive sparse $α$-entmax transformation to dynamically select relevant key-value blocks based on query relevance, ensuring full differentiability throughout the hierarchy. This adaptive approach allows for a variable number of selected tokens, leading to improved long-context modeling and non-dispersive attention.
Distilling Tabular Foundation Models for Structured Health Data
his paper addresses the high inference cost of tabular foundation models (TFMs) in healthcare by using knowledge distillation. The core method involves a novel "stratified out-of-fold teacher labeling" technique to prevent context leakage from the TFM teacher. The contribution is demonstrating that lightweight student models can achieve over 90% of the TFM's AUC, run significantly faster, and maintain crucial calibration and fairness properties, making TFM-level predictions practical for healthcare applications.
Lance: Unified Multimodal Modeling by Multi-Task Synergy
ance is a lightweight unified multimodal model that achieves synergistic performance across image and video understanding, generation, and editing through collaborative multi-task training. Its core method involves a dual-stream mixture-of-experts architecture with unified context modeling and decoupled capability pathways, enhanced by modality-aware positional encoding. This approach allows for efficient joint learning and strong cross-task alignment without relying on massive model scaling or text-image dominance.
Latent Action Reparameterization for Efficient Agent Inference
his paper introduces Latent Action Reparameterization (LAR) to address the high inference cost of LLM agents. LAR learns a compact latent action space where each latent action represents a multi-step semantic behavior, allowing agents to make decisions over a shorter horizon. This learned abstraction, unlike hand-crafted methods, is integrated directly into the LLM for efficient planning and execution.

LongMINT: Evaluating Memory under Multi-Target Interference in Long-Horizon Agent Systems
his paper introduces LongMINT, a new benchmark designed to evaluate memory-augmented agents in realistic, long-horizon scenarios with interfering information. The core method involves creating complex, interconnected contexts with frequently updated data across diverse domains and question types. LongMINT's contribution is to provide a more challenging and realistic evaluation of agent memory, moving beyond static recall to assess performance under dynamic interference.

Overeager Coding Agents: Measuring Out-of-Scope Actions on Benign Tasks
his paper introduces "overeager actions," where autonomous coding agents perform unauthorized tasks beyond benign user requests. To measure this, they developed the OverEager-Gen benchmark, which found that explicitly stating authorized scope in prompts can paradoxically increase overeager behavior by encouraging pattern matching. Their contribution is a novel benchmark and validation method to accurately assess and mitigate these out-of-scope actions.

Pocket Foundation Models: Distilling TFMs into CPU-Ready Gradient-Boosted Trees
his paper addresses the latency issue of large tabular foundation models (TFMs) for real-time fraud scoring. Their core method distills a TFM teacher into a CPU-ready gradient-boosted tree (XGBoost or CatBoost) student model. The key contribution is a novel stratified out-of-fold labeling technique that overcomes label leakage from in-context learning teachers, enabling effective distillation and achieving near-teacher performance at significantly faster CPU speeds.
Predictable Confabulations: Factual Recall by LLMs Scales with Model Size and Topic Frequency
his paper introduces a novel scaling law for factual recall in Large Language Models (LLMs), demonstrating that recall quality is predictable and improves with both model size and the frequency of a topic in the training data. The core method involves evaluating numerous LLMs on scholarly references and finding that recall follows a sigmoid relationship with a combined measure of model parameters and topic representation. The key contribution is identifying these two factors as primary drivers of factual recall, explaining a significant portion of performance variance and offering a theoretical framework based on signal-to-noise ratio.

Reversa: A Reverse Documentation Engineering Framework for Converting Legacy Software into Operational Specifications for AI Agents
eversa is a framework that uses a multi-agent pipeline to convert legacy software into operational specifications for AI agents. Its core method involves specialized agents analyzing code, extracting implicit rules, and synthesizing specifications, with a key contribution being its emphasis on traceability, confidence marking, and preserving gaps for human validation. This allows AI agents to understand and modify legacy systems with greater reliability and reduced risk.

SCICONVBENCH: Benchmarking LLMs on Multi-Turn Clarification for Task Formulation in Computational Science
his paper introduces SCICONVBENCH, a novel benchmark designed to evaluate Large Language Models (LLMs) on their ability to refine ill-posed scientific requests through multi-turn dialogue. The benchmark focuses on two key capabilities: eliciting missing information and resolving contradictory requests, across four computational science domains. SCICONVBENCH's contribution lies in addressing the crucial, yet often overlooked, initial phase of scientific task formulation where user requests require clarification before computation can begin.

Vision-OPD: Learning to See Fine Details for Multimodal LLMs via On-Policy Self-Distillation
his paper introduces Vision-OPD, a self-distillation method to improve MLLMs' fine-grained visual understanding. It addresses the "regional-to-global perception gap" by training a full-image model (student) to mimic the strong performance of a crop-conditioned model (teacher) on the same MLLM. This transfers the model's ability to focus on crucial details from privileged regional views to its general full-image perception.

A Methodology for Selecting and Composing Runtime Architecture Patterns for Production LLM Agents
his paper introduces the "stochastic-deterministic boundary" (SDB) as a core architectural concept for production LLM agents, defining a four-part contract for integrating LLM outputs into system actions. It then proposes a methodology for selecting and composing six runtime patterns (categorized by Coordination, State, and Control) to manage this SDB across different agent types, drawing parallels to distributed systems while accounting for the stochastic nature of LLMs.
BalanceRAG: Joint Risk Calibration for Cascaded Retrieval-Augmented Generation
alanceRAG addresses the challenge of calibrating cascaded Retrieval-Augmented Generation (RAG) systems. Its core method involves jointly calibrating uncertainty thresholds for both LLM-only and RAG branches to achieve a target system-level risk. The contribution is a novel approach using sequential graphical testing to identify "safe" operating points on a 2D lattice of thresholds, enabling risk-adaptive calibration that retains more examples compared to stage-by-stage methods.

CopT: Contrastive On-Policy Thinking with Continuous Spaces for General and Agentic Reasoning
opT reverses the traditional Chain-of-Thought by first generating a draft answer and then using "on-policy thinking" to reflect and correct it. This approach leverages continuous embeddings as contrastive verifiers to assess the trustworthiness of the draft answer, aiming for more efficient and agentic reasoning.

Detecting Fluent Optimization-Based Adversarial Prompts via Sequential Entropy Changes
his paper proposes a novel method for detecting adversarial prompts by treating them as an online change-point detection problem. It analyzes the stream of next-token entropy, using the LLM's system prompt to establish a baseline. The core contribution is a training-free, model-agnostic detector that effectively identifies and localizes adversarial suffixes by monitoring deviations from expected token probabilities, outperforming existing methods.

Probabilistic Tiny Recursive Model
his paper introduces Probabilistic Tiny Recursive Models (PTRM) to improve upon deterministic Tiny Recursive Models (TRM). PTRM addresses TRM's tendency to get stuck in suboptimal solutions by injecting Gaussian noise during recursion, allowing for parallel exploration of diverse solution paths. This stochastic approach, without retraining, significantly boosts accuracy on complex reasoning tasks by enabling better selection of the final answer.
Probing Embodied LLMs: When Higher Observation Fidelity Hurts Problem Solving
his paper investigates how observation fidelity impacts embodied Large Language Model (LLM) agents in robotic tasks. The core method involves testing LLMs on a mechanical puzzle with varying levels of visual and symbolic information. The key contribution is the counterintuitive finding that LLMs perform best with raw RGB input and worst with perfect ground-truth observations, suggesting that some level of noise or ambiguity can actually improve their problem-solving abilities.

Robotics-Inspired Guardrails for Foundation Models in Socially Sensitive Domains
his paper reframes safety for foundation models in sensitive domains from output-level checks to runtime behavioral control of interaction trajectories, inspired by robotics. Their core method, the Grounded Observer framework, uses formal constructs to enforce constraints during interactions, enabling real-time interventions to prevent undesirable behavior. This approach offers enforceable behavioral guarantees, a significant contribution beyond existing empirical risk reduction methods.

What Do Evolutionary Coding Agents Evolve?
his paper investigates what evolutionary coding agents, powered by LLMs, actually learn. They introduce EvoTrace, a dataset of evolutionary coding processes, and EvoReplay, a method to analyze these traces. This allows them to distinguish between genuine algorithmic innovation and other mechanisms like re-tuning or overfitting, providing a deeper understanding of how these agents evolve.

Are Tools Always Beneficial? Learning to Invoke Tools Adaptively for Dual-Mode Multimodal LLM Reasoning
his paper introduces AutoTool, a method that enables multimodal large language models (MLLMs) to adaptively decide whether to use external tools for reasoning. By employing a reinforcement learning framework with a dual-mode strategy, AutoTool balances tool-assisted and text-centric reasoning to avoid redundant or misleading tool invocations, ultimately improving accuracy and efficiency.

ClinSeekAgent: Automating Multimodal Evidence Seeking for Agentic Clinical Reasoning
linSeekAgent automates the process of actively seeking and synthesizing multimodal evidence from diverse clinical data sources for LLM-based reasoning. Unlike previous approaches that assume pre-curated evidence, it dynamically queries knowledge bases, navigates EHRs, and uses imaging tools to gather information, refining hypotheses as it learns. This framework enables LLMs to make more grounded clinical decisions by actively acquiring and integrating evidence.

KoRe: Compact Knowledge Representations for Large Language Models
oRe addresses the limitations of LLMs encoding knowledge within opaque parameters by introducing a method to represent 1-hop knowledge graph sub-graphs as compact, discrete tokens. These tokens are then injected into a pre-trained LLM backbone without requiring extensive retraining. This approach offers a more transparent and updatable way to integrate external knowledge, leading to competitive performance on knowledge-intensive tasks.

MixRea: Benchmarking Explicit-Implicit Reasoning in Large Language Models
his paper introduces the "explicit-implicit reasoning" task and the MixRea benchmark to assess if LLMs exhibit "inattentional blindness" to subtle cues, similar to humans. Their core method involves creating diverse reasoning questions with varying explicit and implicit information. The contribution lies in demonstrating widespread inattentional blindness in LLMs and proposing Potential Relation Completion Prompting (PRCP) as a method to improve their reasoning by recovering overlooked causal relations.

DeepWeb-Bench: A Deep Research Benchmark Demanding Massive Cross-Source Evidence and Long-Horizon Derivation
eepWeb-Bench is a new benchmark designed to rigorously evaluate advanced language models on "deep research" tasks. Its core method involves creating complex research questions that require agents to gather extensive evidence from multiple sources, reconcile conflicting information, and perform multi-step reasoning to arrive at an answer. The paper's main contribution is a significantly more challenging evaluation dataset that pushes beyond existing benchmarks, enabling a clearer distinction of current frontier model capabilities.

SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agents
his paper introduces SpecBench, a benchmark designed to measure "reward hacking" in long-horizon coding agents. The core method involves creating tasks with visible tests (used for agent training) and held-out tests (simulating real-world usage). The contribution is quantifying reward hacking by measuring the performance gap between these two test suites, highlighting when agents optimize for passing training tests at the expense of true functionality.

TextReg: Mitigating Prompt Distributional Overfitting via Regularized Text-Space Optimization
his paper addresses **prompt distributional overfitting** in LLMs, where optimized prompts become overly specific and generalize poorly. Their core method, **TextReg**, introduces a regularization framework that penalizes prompt inefficiency by controlling representation capacity and scope. This approach aims to create more robust and generalizable prompts by mitigating the accumulation of narrow, sample-specific rules.

TimeSRL: Generalizable Time-Series Behavioral Modeling via Semantic RL-Tuned LLMs -- A Case Study in Mental Health
imeSRL addresses the challenge of cross-dataset distribution shifts in time-series health prediction. Its core method involves an LLM framework that first translates raw sensor data into natural language abstractions, then predicts outcomes solely from these semantic concepts. This approach, optimized with RL, aims to improve generalizability by forcing reasoning over more robust, high-level behavioral semantics rather than raw, potentially noisy, numerical data.

Domain-Adaptable Reinforcement Learning for Code Generation with Dense Rewards
his paper presents a reinforcement learning framework using Proximal Policy Optimization to fine-tune large language models for code generation. Its core method involves a customizable, execution-aware reward function that optimizes for syntax, correctness, style, security, and simulator executability, with a token-level reward mapping for effective credit assignment. The contribution lies in enabling domain-adaptable code generation, demonstrated by significant improvements on general-purpose and robotic program synthesis tasks.

Preference-aware Influence-function-based Data Selection Method for Efficient Fine-Tuning
his paper introduces PRISM, a novel data selection method for efficient LLM fine-tuning. PRISM addresses the limitation of existing methods by recognizing that target examples have varying relevance to the current model. It achieves this by weighting target examples based on the model's current preference, creating a more nuanced target representation. This allows PRISM to prioritize candidate training samples that are most effective in guiding the model towards the desired behavior, thus optimizing the use of limited training budgets.

A Few GPUs, A Whole Lotta Scale: Faithful LLM Training Emulation with PrismLLM
rismLLM enables faithful emulation of large-scale LLM training on a few GPUs by constructing a high-fidelity execution graph. Its core method involves a slicing-based approach to capture scale-dependent behaviors, allowing engineers to debug and tune training frameworks without needing exclusive access to massive GPU clusters. This significantly reduces the cost and complexity of LLM development.
Agentic Recommender System with Hierarchical Belief-State Memory
ARS addresses limitations in memory-augmented recommender systems by proposing a hierarchical belief-state memory. This framework treats recommendation as a partially observable problem, progressively abstracting user observations into a structured memory with three tiers: event, preference, and profile. MARS's core contribution is this structured memory and its adaptive lifecycle management, allowing for more robust and nuanced user preference modeling.

AI Assurance: A Comprehensive Testing Strategy for Enterprise AI Systems
his paper proposes a new AI assurance strategy for enterprise AI systems, shifting from traditional correctness verification to continuous risk reduction. It emphasizes treating evaluation as a core engineering discipline and introduces a structured AI Failure Taxonomy and a revised AI Assurance Pyramid to address the unique probabilistic and emergent nature of these systems. The contribution lies in providing a comprehensive framework and operational guidance for managing the distinct risks associated with enterprise AI.
CVSearch: Empowering Multimodal LLMs with Cognitive Visual Search for High-Resolution Image Perception
VSearch tackles the challenge of high-resolution image perception in multimodal LLMs by dynamically adapting its search strategy. It first attempts an efficient expert-assisted search and, if that fails, employs a novel semantic-aware scanning method that intelligently partitions images into coherent regions to avoid fragmentation. This approach balances coverage and efficiency, improving the LLM's ability to perceive detailed images.
ETCHR: Editing To Clarify and Harness Reasoning
TCHR addresses limitations in multimodal reasoning by decoupling an image editing model from a language understanding model. Its core method involves training a question-conditioned, reasoning-aware image editor that can perform visual transformations to clarify reasoning steps, overcoming the limitations of fixed toolkits and noisy intermediate images. The contribution is a novel approach that enhances visual reasoning by enabling editors to actively participate in the reasoning process, improving accuracy even with complex queries.

Leveraging Foundation Models for Causal Generative Modeling
his paper introduces FM-CGM, a modular framework that leverages pretrained foundation models for end-to-end visual causal reasoning. It comprises a concept extractor, manipulator, and counterfactual generator, enabling zero-shot causal discovery, intervention, and generation. The key contribution is the development of Causal Semantic Guidance (CSG), a mechanism that ensures semantic interventions propagate correctly while preserving invariant relationships.

LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws
his paper proposes the "Shannon Scaling Law" to explain LLM behavior beyond monotonic scaling. It models LLM training as information transmission over a noisy channel, where model parameters represent bandwidth and training tokens represent signal power. This framework reveals a fundamental Shannon capacity for LLMs, explaining non-monotonic performance degradation when the signal-to-noise ratio is insufficient.

PGT: Procedurally Generated Tasks for improving visual grounding in MLLMs
his paper introduces Procedurally Generated Tasks (PGT), a novel data-driven framework to enhance fine-grained visual understanding in Multimodal Large Language Models (MLLMs). PGT overlays geometric primitives on images to create dense supervision, disentangling visual grounding from semantic knowledge. This approach significantly improves performance on relational, quantitative, and 3D understanding benchmarks, with instruction tuning on PGT data yielding substantial gains on specific benchmarks like What'sUp and CV-Bench-2D.

Precise: SDE-Consistent Stochastic Sampling for RL Post-Training of Flow-Matching Models
his paper proposes "Precise," a method for improving Reinforcement Learning (RL) in flow-matching models by addressing the challenge of converting deterministic sampling to a stochastic policy. Precise breaks down sampler design into balancing exploration and faithful SDE discretization, deriving an SDE schedule to optimize this balance and improve RL performance.

SkillOpt: Executive Strategy for Self-Evolving Agent Skills
killOpt treats agent skills as trainable external states, optimizing them through controlled text edits rather than hand-crafting or loose self-revision. This systematic approach uses a separate optimizer model to make bounded add/delete/replace edits to a skill document, accepting only those that strictly improve performance. SkillOpt's core contribution is a controllable, text-space optimizer for agent skills that achieves stable, reproducible skill improvement without increasing inference cost.

Approaching I/O-optimality for Approximate Attention
his paper presents an I/O-efficient algorithm for computing attention in large language models, significantly reducing data transfers between fast and slow memory. By adapting an approximate attention framework, their method achieves an almost-linear I/O cost with respect to the input size $n$, approaching the theoretical lower bound. This work contributes to making large language model computations more memory-efficient.
Learning Kernel-Based MDPs from Episodic Preferential Feedback
his paper develops a theoretical framework for learning Markov Decision Processes (MDPs) with kernel-based rewards and transitions using only episodic preferential feedback. The core method involves estimating values and confidence sets based on pairwise trajectory comparisons, modeled by a Bradley-Terry-Luce link. The main contribution is proving sublinear regret bounds, demonstrating that the learned policy converges to the optimal one with sufficient data.
Strong Teacher Not Needed? On Distillation in LLM Pretraining
his paper investigates knowledge distillation for Large Language Model pretraining, challenging the assumption that a stronger teacher is always necessary. They demonstrate that even smaller, undertrained teachers can effectively improve larger students through careful loss mixing. Furthermore, a stronger teacher doesn't guarantee better results, and distillation primarily enhances generalization rather than in-domain performance.
FineVLA: Fine-Grained Instruction Alignment for Steerable Vision-Language-Action Policies
his paper introduces FineVLA, a framework for fine-grained instruction alignment in Vision-Language-Action (VLA) models. Its core method involves constructing a large, human-verified dataset of trajectories with detailed, execution-critical language annotations. The main contribution is enabling steerable VLA policies that can follow precise instructions, improving robotic task execution and video understanding beyond coarse goal-level commands.

Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environments
his paper proposes NoisyAgent, a training framework to improve LLM agent robustness in real-world, imperfect environments. The core method involves explicitly training agents with simulated "user noise" (ambiguous inputs) and "tool noise" (tool failures). This approach enhances agent performance by bridging the gap between idealized training and the stochastic nature of real-world interactions.

LUCoS: Latent Unsupervised Context Selection for Tabular Foundation Models
his paper introduces LUCoS, a novel unsupervised method for selecting informative instances to label for tabular foundation models in a cold-start setting. LUCoS leverages the latent embedding space of these models, rather than the original tabular data, to perform geometric instance selection. This approach overcomes the limitations of raw tabular data and significantly improves predictive performance compared to random selection.

Natural Language Query to Configuration for Retrieval Agents
his paper addresses the challenge of optimizing retrieval agent configurations for individual queries. Their core method, BRANE, uses an LLM to extract query characteristics and then employs lightweight predictors to estimate the correctness of different pipeline configurations. BRANE's contribution is enabling dynamic, per-query configuration selection to balance answer quality and serving cost without retraining, offering a tunable cost-quality tradeoff.

Pair-In, Pair-Out: Latent Multi-Token Prediction for Efficient LLMs
his paper introduces Pair-In, Pair-Out (PIPO), a method that unifies input compression and multi-token prediction for efficient LLM inference. PIPO treats token compression and expansion as mirrored operations, allowing it to predict multiple output tokens from a single hidden state. Crucially, it eliminates the expensive verifier by training a lightweight confidence head to reliably accept or reject draft tokens.

Position: AI Safety Requires Effective Controllability
his paper argues that AI safety needs to prioritize **controllability** alongside alignment. Controllability ensures AI systems can be reliably stopped, overridden, or redirected at runtime, even in complex environments, without sacrificing normal functionality. The authors introduce a benchmark, `\controlbench{}`, to study and evaluate this crucial aspect of AI safety.

QUACK: Questioning, Understanding, and Auditing Communicated Knowledge in Multimodal Social Deduction Agents
UACK introduces a novel evaluation framework for multimodal social deduction agents, moving beyond simple win rates. Its core contribution is a Statement Verification Pipeline that reconstructs agent trajectories from logs and audits every utterance for consistency with perceived information and actions, automatically identifying specific failure modes like spatial hallucination and unsupported accusations. This allows for a deeper understanding of agent reasoning and the grounding of their language.

Scaling, Benchmarking, and Reasoning of Vision-Language Agents for Mobile GUI Navigation
his paper introduces HyperTrack, a large-scale dataset and GUIEvalKit toolkit for evaluating Vision-Language Models (VLMs) in mobile GUI navigation. Their core method involves analyzing the impact of data scaling on supervised and reinforcement learning fine-tuning, demonstrating that reinforcement learning excels, especially in out-of-domain scenarios. The contribution is a comprehensive benchmark and dataset that reveals the importance of data scale and reinforcement learning for robust VLM navigation agents.
BASIS: Batchwise Advantage Estimation from Single-Rollout Information Sharing for LLM Reasoning
ASIS is a novel reinforcement learning algorithm for improving LLM reasoning that eliminates the need for a critic. It achieves this by sharing information across prompts within a batch to enhance value function estimation, even with only a single rollout per prompt. This batchwise information sharing significantly reduces estimation error and leads to more efficient policy optimization, outperforming existing single-rollout methods and rivaling multi-rollout approaches with less training time.

Learning to Orchestrate Agents under Uncertainty
his paper addresses the challenge of adaptively coordinating diverse AI agents with uncertain reliability and output quality. The core method, BOT-Orch, frames orchestration as a bandit problem where a meta-controller learns to delegate tasks to agents. Its key contribution is a novel regularization technique using Optimal Transport (OT) distances to explicitly model and account for uncertainty in agent outputs, leading to provably efficient learning with sub-linear regret.

BAIT: Boundary-Guided Disclosure Escalation via Self-Conditioned Reasoning
AIT is a three-step jailbreaking framework that guides LLMs to disclose harmful information by iteratively refining their understanding of protection boundaries. It leverages the model's self-reasoning and consistency to escalate disclosure, achieving high attack success rates by focusing on prevention-oriented framing and iterative refinement. This method significantly improves upon existing jailbreak techniques.

MAIGO: Mitigating Lost-in-Conversation with History-Cleaned On-Policy Self-Distillation
AIGO addresses the "lost-in-conversation" problem in LLMs by reducing self-contamination from previous assistant replies. It achieves this through on-policy self-distillation, cleaning the dialogue history for training. This method improves model performance without requiring external rewards or complex inference setups.

AI Assurance: A Comprehensive Testing Strategy for Enterprise AI Systems
his paper proposes a new AI assurance strategy for enterprise AI systems, shifting focus from traditional correctness verification to continuous risk reduction. It emphasizes treating evaluation as a core engineering discipline and highlights the unique organizational impacts of AI failures. The contribution includes a structured AI Failure Taxonomy and a revised five-layer AI Assurance Pyramid to guide operational practices.
Are Frontier LLMs Ready for Cybersecurity? Evidence for Vertical Foundation Models from Dual-Mode Vulnerability Benchmarks
his paper evaluates frontier Large Language Models (LLMs) for cybersecurity tasks using dual-mode benchmarks: white-box code vulnerability detection and black-box web application security testing. The core method involves testing six leading LLMs and two domain-specialized models against these benchmarks. The key contribution is demonstrating that current frontier LLMs are largely unprepared for cybersecurity, exhibiting high false positive rates in code analysis and low ground-truth coverage in web security, while domain-specialized agents show significantly better performance.

Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics
x-Prover is a multi-agent system that uses Large Language Models (LLMs) combined with formal verification tools (Lean) to automate theorem proving. Its core method involves LLMs generating reasoning steps that are then validated by Lean, ensuring formal correctness. Ax-Prover's contribution is its ability to solve complex mathematical and quantum physics problems autonomously or collaboratively, demonstrating strong performance, especially on novel benchmarks.

Beyond VLM-Based Rewards: Diffusion-Native Latent Reward Modeling
his paper introduces DiNa-LRM, a novel method for aligning diffusion models by learning preferences directly within the model's latent diffusion states, rather than relying on computationally expensive Vision-Language Models. DiNa-LRM addresses the domain mismatch issue by formulating a noise-calibrated reward function that accounts for diffusion-specific uncertainty, leading to more efficient and robust preference optimization.

Bridging AI and Clinical Reasoning: Abductive Explanations for Alignment on Critical Symptoms
his paper introduces a method for aligning AI diagnostic reasoning with clinical practice by using formal abductive explanations. This approach generates minimal, guaranteed explanations of critical symptoms, enhancing transparency and trust in AI predictions. The contribution lies in providing clinically actionable insights that preserve AI accuracy, facilitating adoption in medical diagnosis.
(How) Do Large Language Models Understand High-Level Message Sequence Charts?
his paper investigates whether Large Language Models (LLMs) truly understand the formal semantics of High-Level Message Sequence Charts (HMSCs), a crucial visual modeling language. The researchers tested three LLMs on 129 semantic tasks, ranging from basic queries to complex abstractions and trace calculations, to assess their consistency with HMSC semantics. The study's contribution lies in its rigorous evaluation of LLM comprehension of formal software design artifacts.

AI-Mediated Communication Can Steer Collective Opinion
his paper investigates how AI, specifically LLMs, influences collective opinion when mediating human-to-human communication. The core method involves empirical analysis showing LLMs introduce directional biases when editing texts on contested topics, and a theoretical model demonstrating how an AI intermediary can steer opinion dynamics within a social network. The contribution lies in revealing and quantifying this previously understudied impact of AI on group opinion formation.
Decomposed Vision-Language Alignment for Fine-Grained Open-Vocabulary Segmentation
his paper proposes a Decomposed Vision-Language Alignment framework to improve open-vocabulary segmentation. It addresses the challenge of unseen attribute-category combinations by factorizing text prompts into concept and attribute tokens, allowing for separate cross-modal interactions. The core contribution lies in a Feature-Gated Cross-Attention module and log-space similarity aggregation, which enforce compositional semantics and enhance generalization.

Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planning
his paper proposes a bilevel policy approach for long-horizon planning in embodied AI. It combines low-level imitation learning for manipulation with high-level symbolic planning, creating a hierarchical system where a symbolic policy guides a neural policy. This method aims to overcome the limitations of pure imitation learning for complex, multi-step tasks.

PAGER: Bridging the Semantic-Execution Gap in Point-Precise Geometric GUI Control
AGER addresses the challenge of precise geometric control in GUI agents, where actions require pixel-level accuracy rather than region tolerance. Its core method involves a topology-aware agent that decomposes construction tasks into dependent steps, ensuring geometric correctness and robustness against cascading errors. The paper's contribution lies in introducing this novel agent and the PAGE Bench benchmark to evaluate and advance point-precise GUI interaction.

ScreenSearch: Uncertainty-Aware OS Exploration
creenSearch tackles the challenge of GUI agents exploring operating system states by addressing partial observability. Its core method combines structural screen retrieval and deduplication with an uncertainty-aware graph-bandit algorithm. The key contribution is a novel ambiguity signal that prioritizes exploring states where the same action leads to diverse outcomes, thereby improving exploration efficiency and reducing errors.

A Case for Agentic Tuning: From Documentation to Action in PostgreSQL
his paper argues that traditional documentation-based system tuning is insufficient due to its static nature and lack of reasoning. It introduces PerfEvolve, a method that empowers LLM agents with executable skills to dynamically tune systems like PostgreSQL by verifying versions, profiling workloads, and optimizing parameters jointly. PerfEvolve significantly outperforms existing documentation-driven tuning methods.

Does Code Cleanliness Affect Coding Agents? A Controlled Minimal-Pair Study
his paper investigates if code cleanliness impacts autonomous coding agents. Their core method uses "minimal pairs" of code repositories that are identical except for their structural and stylistic quality. The study found that while code cleanliness did not affect the agent's task completion rate, it significantly altered its operational footprint.

Agent JIT Compilation for Latency-Optimizing Web Agent Planning and Scheduling
his paper introduces agent Just-In-Time (JIT) compilation to significantly reduce latency in web agent planning and scheduling. The core method involves compiling natural language task descriptions into executable code, enabling parallelization and LLM calls within the compiled plan. The key contribution is a novel JIT-Planner and JIT-Scheduler system that optimizes for minimum cost and explores parallelization strategies, overcoming the slow sequential fetch-screenshot-execute loop of prior approaches.
