From the arXiv
Thursday, 27 August 2026 · 20 papers
$R^3$: Training Robots to Reason in Natural Language via Reinforcement Learning
This paper introduces $R^3$, a method to train Vision-Language Models (VLMs) to reason in natural language for robotic manipulation. $R^3$ first fine-tunes a VLM on expert reasoning traces and then uses reinforcement learning with offline action data to improve its reasoning capabilities for guiding low-level robotic p…
AsymSpec: Context-Asymmetric Speculative Decoding for Agentic LLMs
AsymSpec addresses the inference cost of agentic LLMs by breaking the symmetry in speculative decoding. It uses a lightweight drafter with full context to guide a larger verifier operating on compressed context, mitigating accuracy loss from compression. This asymmetric approach achieves significant speedups while reta…
ProgRouter: Online Progress-Guided Orchestration for Multi-Agent LLM Workflows under Quality-Cost Tradeoffs
ProgRouter addresses the high cost of multi-agent LLM workflows by introducing an online, progress-guided orchestration method. It adaptively selects LLM agents at each step based on a multi-view progress scorer that considers task completion, trends, and state quality. This allows for dynamic routing to maintain task …
Repair or Resample? Rethinking Failure Debugging in LLM Multi-Agent Systems
This paper addresses the reliability bottleneck in LLM-based multi-agent systems (MASs) for complex tasks. It introduces SymTrace, a framework that enables controlled evaluation of repair methods by allowing selective regeneration of MAS execution trajectories after a failure point. This allows researchers to distingui…
SciMIF: Understanding Multimodal Instruction Following in Scientific Domains
This paper introduces SciMIF, a benchmark for evaluating multimodal instruction following in scientific domains. It proposes a taxonomy of 10 constraint groups derived from analyzing 22 tasks across 5 disciplines, and uses this to systematically augment scientific datasets. The benchmark reveals significant performance…
SwarmWorld: Stigmergic technological evolution in societies of language-model agents
This paper introduces SwarmWorld, a novel framework where language-model agents collectively evolve technologies through indirect environmental interaction (stigmergy). The core method involves homogeneous agents exploring, resource processing, and constructing artifacts whose functionality is then tested in a determin…
ToST: A Tree-of-Thought Socratic Teaching Framework for Multi-Path Guidance and Parallel Thinking
This paper introduces ToST, a novel framework for Socratic teaching using LLMs. ToST moves beyond single-solution guidance by employing "Parallel Sowing" to encourage students to explore multiple valid approaches to a problem. Its "Multi-Path Adaptive Guidance" then provides flexible, non-linear support across these di…
A Self-Evolving Multi-Agent Framework Defense against LLM Jailbreak Attacks
This paper introduces a novel, self-evolving defense framework for LLMs against jailbreak attacks. Its core method involves a persistent rule memory that learns from successful attacks by abstracting their structural wrappers into generalizable rules. This allows the defense to adapt and defend against new, unseen atta…
VISA: Agentic Self-Evolving Data Synthesis for Multimodal Instruction Following
VISA is an agentic framework that synthesizes multimodal instruction-following data through a self-evolving loop. It iteratively generates, verifies, and refines instructions by analyzing images, sampling from memory, and using tools and LLM judges. This approach addresses limitations of one-pass synthesis by incorpora…
Candidate supply and answer selection shape the value of LLM judging in multi-agent systems
This paper investigates how LLM judges can improve multi-agent system (MAS) performance by providing selection pressure on candidate answers. The core method involves conceptualizing MAS reasoning as an evolutionary pipeline and analyzing how LLM judges influence candidate generation and selection across various questi…
Code World Model: Coding Agent as World Brain
This paper introduces the Code World Model, which uses a language model as a "world brain" to generate executable code that simulates environment evolution. This approach separates the underlying rules and state from visual realization, enabling persistent consequences and coherent, rule-consistent development. The gen…
EVOMAL: Self-Poisoning in Self-Evolving Coding Agents
This paper introduces "self-poisoning" in self-evolving coding agents, where agents can inadvertently create and execute malicious code by imitating compromised skills from a shared library. The EvoMal attack exploits this by embedding payloads within benign-looking structures, causing agents to replicate and propagate…
Multi-Granularity Context-Enhanced RAG over Multimodal Knowledge Graphs
This paper introduces a novel framework for multimodal retrieval-augmented generation (RAG) that addresses the semantic gap in existing methods. Its core method enhances RAG by integrating textual context throughout the processing of visual information and multimodal knowledge fusion, rather than treating modalities in…
Skill Issue: Are Skills Language-Invariant in LLMs?
This paper investigates whether language affects the performance of large language models (LLMs) on specific tasks, independent of their general knowledge. The core method is multilingual self-play, where two instances of the same LLM compete in a text-based game, each using a different language. The contribution is de…
TailSFT: Filtered Fine-Tuning Improves Post-Training Performance
This paper introduces TailSFT, a supervised fine-tuning method that improves post-reinforcement learning performance by filtering out already well-modeled data sequences. By focusing training on the "tail" of the data distribution, TailSFT helps models learn under-represented areas. This approach leads to significant i…
Trace Integrity for LLM Data Agents: A Vision for Auditable Structured Reasoning in Real-World Systems
This paper introduces "Trace Integrity" as a crucial reliability criterion for LLM data agents, moving beyond simple answer accuracy. It proposes that the *process* behind an answer must be explicit, executable, and auditable, not just the final output. The core contribution is operationalizing this with "execution con…
EXAONE Tabular 1.0 : Technical Report
EXAONE Tabular 1.0's core method is an architecture redesign for tabular in-context learning, interleaving feature and item attention within each Transformer layer. This approach, trained on synthetic data, allows it to make predictions without dataset-specific fine-tuning. Its main contribution is achieving state-of-t…
Large Language Model Few-Shot Prompting with Dilemma Training Outperforms Human Surrogates in Predicting Patient Preferences
This paper introduces P4-DT, a large language model trained to predict patient preferences in serious illness. Unlike previous methods, P4-DT uses "dilemma training" to build a dynamic decision policy by engaging users with varied medical scenarios. This approach significantly improves prediction accuracy compared to h…
Anchoring Bias in LLM-as-a-Judge Systems: Prior Scores Compromise Evaluation Independence
This paper investigates the "anchoring bias" in LLM-as-a-Judge systems, demonstrating that prior scores, even when presented as mere metadata, significantly influence subsequent evaluations. The core method involves comparing LLM judgments under different prompt conditions, revealing that including prior scores systema…
From Passive Response to Proactive Correction: Enhancing LLM Robustness Against Input Fact Perturbations
This paper introduces DEDUCE, a three-stage framework that enhances LLM robustness against factually incorrect user inputs. DEDUCE proactively detects, deliberates on, and corrects factual errors in the input before generating a response. Its core contribution is transforming LLMs from passive responders to active erro…