From the arXiv
Friday, 2 October 2026 · 20 papers
Agentick: A Unified Benchmark for General Sequential Decision-Making Agents
Agentick is a unified benchmark designed to fairly evaluate diverse sequential decision-making agents, including RL, LLM, and hybrid approaches. It offers 37 procedurally generated tasks across various capabilities, difficulties, and modalities through a single interface. Agentick's contribution lies in enabling direct…
Calibrated Enough to Know, Not Calibrated to Act: Fabricated Evidence Makes LLM Agents Commit to the Unknowable
This paper demonstrates that Large Language Model (LLM) agents are highly susceptible to fabricated evidence, committing to actions on unknowable questions when presented with professional-looking data. The core method involves comparing LLM agent responses to provably unpredictable questions with and without fabricate…
CODESKILL: Learning Self-Evolving Skills for Coding Agents
CODESKILL is a novel LLM-based framework that learns to manage a bank of reusable coding skills. It extracts, evolves, and maintains these skills from agent trajectories using a learned policy, addressing limitations of fixed prompts and heuristic updates. This self-evolving skill bank allows coding agents to more effe…
Combee: Scaling Prompt Learning for Self-Improving Language Model Agents
Combee is a novel framework designed to scale prompt learning for self-improving language model agents. Its core method addresses the limitations of existing approaches by enabling efficient and high-quality parallel prompt learning, allowing agents to learn from a large number of traces without performance degradation…
DIAL: Position-Debiased LLM Judges with Adaptive Human Preference Calibration
DIAL is a framework that uses both abundant LLM comparisons and limited human feedback to improve LLM-based evaluations. It debiases LLM judgments by accounting for response order and then calibrates these debiased LLM preferences to better align with actual human preferences. This approach allows for more scalable and…
Estimating and Orthogonalizing Unknown Pre-training Gradients for Continual Fine-tuning of Large Language Models
This paper proposes EoupCT, a novel framework to address catastrophic forgetting in continual LLM fine-tuning. EoupCT estimates unknown pre-training gradients by generating pseudo-data via a learnable soft prompt, allowing for orthogonalization and preservation of general-purpose knowledge lost during fine-tuning. This…
FTB Graph: Determining and Validating First-token Broadcasters and Language-Identity Head Circuits in Multilingual Language Models
This paper introduces FTB Graph, a method using Edge Attribution Patching and activation patching to map the causal circuits responsible for determining the target language of multilingual language models. The core contribution is the discovery of "broadcasting hubs" in deep or mid-to-deep layers that dictate first-tok…
G$^2$PTQ: Improving LLM Post-Training Quantization with Generalized Gradient Compensation
G$^2$PTQ improves LLM post-training quantization by unifying first- and second-order gradient information within a globally supervised, block-wise optimization. It addresses limitations of prior methods by dynamically refreshing gradient and Hessian estimates for each Transformer block and stabilizing updates with a tr…
HasMem: Hard-Origin Adaptively Softened Memory for Long-Term LLM Agents
HasMem introduces a novel memory system for long-term LLM agents that combines a fixed, verifiable "hard-origin" prompt with an adaptively softened memory. This approach allows for flexible memory resizing and re-encoding without altering the frozen LLM, significantly improving long-term context retention and question …
MoMHa: Multi-Objective Optimization of LLM Harnesses over Accuracy, Safety, and Tokens
This paper introduces MoMHa, a novel method for optimizing the Python code (harness) that surrounds Large Language Models. MoMHa treats harness design as a multi-objective search problem, balancing accuracy, safety, and token cost. Its core contribution is demonstrating that a single-phase joint-reward approach for thi…
PUBG Ally: A Conversational Embodied Agent as an AI Teammate
PUBG Ally is a conversational embodied agent designed to act as an AI teammate in the game PUBG: BATTLEGROUNDS. Its core method combines a language model for reasoning and communication with a fast control layer for real-time game actions, enabling it to perceive the game, interact naturally with players, and make stra…
Rufus-Air: An Open LLM Post-Training Recipe
Rufus-Air presents an open, eight-stage post-training recipe for LLMs, building capabilities sequentially from supervised fine-tuning to advanced agentic reasoning. Its core contribution is a reproducible methodology using open-source components and public data, emphasizing reward reliability and difficulty filtering f…
Stepwise Intrinsic Rewards for Reasoning in Large Language Models
This paper introduces Stepwise Marginal Information Gain (MIG), an intrinsic reward signal for training LLMs in reinforcement learning. MIG measures how each reasoning step improves the likelihood of the correct answer, rewarding progress without requiring external annotations or complex search. This allows for more gr…
StraTA: Incentivizing Agentic Reinforcement Learning with Strategic Trajectory Abstraction
This paper introduces StraTA, a framework that enhances agentic reinforcement learning for long-horizon tasks by incorporating an explicit, sampled trajectory-level strategy. This strategy guides the agent's actions, improving exploration and credit assignment. StraTA's core contribution is this strategic abstraction, …
The Geometry of Refusal: Why Post-Hoc Safety Is Fragile and Pretraining-Time Safety Persists
This paper argues that post-hoc safety training methods like RLHF are fragile because they create a "refusal gate" that masks, rather than erases, undesirable behaviors. Geometrically, these safety updates are orthogonal to the model's core capabilities, meaning they only suppress them slightly on sharp curvature direc…
Think Short, Defer Smart, Act, and Repeat: Calibrated Reasoning and Uncertainty-Aware Deferral for Edge LLM Agents
This paper introduces Think Short, Defer Smart (TSDS), a framework for edge LLM agents. TSDS efficiently manages on-device reasoning by stopping early when an action is stable and intelligently defers uncertain actions to a cloud model using perplexity. Its core contribution is a jointly calibrated approach that optimi…
VLANeXt Family: A Systematic Study of VLA Models from Core Recipes to Emerging Paradigms
This paper systematically studies Vision-Language-Action (VLA) models by dissecting design choices across foundational components, perception, and action modeling. Their core method involves a unified framework and evaluation setup, starting from a baseline similar to RT-2. The key contribution is distilling 12 finding…
Why Jailbreaks Succeed in Diffusion Language Models: An Energy Landscape Analysis
This paper explains jailbreaks in diffusion language models by viewing safety alignment as an energy landscape. Jailbreaks succeed by either hiding the harmful intent initially or forcing the generation process over an "energy barrier" towards unsafe outputs. The authors propose three training-free detection methods ba…
Admission Without Answers: Label-Free Certification and Experience Learning for LLM-Based Optimization Modeling
This paper introduces ADMITOR, a novel label-free method for admitting reliable optimization models generated by LLMs. ADMITOR achieves this by generating multiple models, testing them on resampled problem instances, and admitting those with consistent optimal values across different model families. Its key contributio…
Affective Flow Language Model for Emotional Support Conversation
This paper introduces the Affective Flow Language Model (AFlow) to improve emotional support conversations. AFlow models the dialogue as an "affective utility flow," allowing it to estimate the value of intermediate conversation states and potential strategies. Its contribution lies in the Affective Flow Preference Opt…