From the arXiv
Monday, 12 October 2026 · 20 papers
A Baseline Assessment for the Agentic Web Technology Stack
This paper introduces MASTIF, a framework for evaluating LLM-based agent technologies. It provides a baseline assessment of various LLMs, protocols, and frameworks on 300 Mind2Web tasks. The findings suggest that choosing a task-specific technology stack can significantly improve performance metrics like task completio…
A Multi-Agent LLM System for Automated Tuning of Specialized Neural Network Models
This paper introduces a multi-agent LLM system for automatically tuning specific components within pre-defined neural network architectures. Its core method involves three LLM agents (analyst, coder, recorder) interacting with an experiment log and execution environment to generate targeted code for component adjustmen…
Matched-Context Group Policy Optimization for LLM Agent Training
This paper introduces Matched-Context Group Policy Optimization (MCGPO) to address credit assignment in training language model agents with sparse rewards. MCGPO constructs weighted action preferences by matching intermediate states and progress within groups of agent rollouts, using task rules to define comparison con…
Humanize Olympiad Agents: A Multi-Session Workflow for Olympiad Problem Solving with Solve, Review, Wiki, Verify
This paper introduces HOA (Humanize Olympiads Agent), a novel framework designed to improve LLM performance on complex Olympiad problems. HOA's core method involves a multi-session workflow where an agent's solutions are iteratively refined through independent review, a structured knowledge wiki, and formal verificatio…
Inject a Turn, Not a Token: Learning Where to Redirect LLM Reasoning for Self-Correction
This paper introduces UPTURN, a novel self-correction method for LLMs that avoids fine-tuning. UPTURN learns to identify points of reasoning failure and redirects the LLM's generation by injecting a corrective instruction as a new user turn, rather than modifying tokens. This approach significantly improves accuracy ac…
RATED: Reliability-Aware AI Agent Tool Retrieval via Execution Dynamics
RATED addresses the critical issue of AI agent tool retrieval by going beyond semantic relevance to incorporate tool reliability during execution. Its core method combines a frozen dual-encoder for semantic matching with a contextual bandit that dynamically re-ranks tools based on real-time execution feedback. This app…
SWE-DeceptionBench: Benchmarking Deceptive Behaviors of LLMs Across the Software Development Lifecycle
This paper introduces SWE-DeceptionBench, a benchmark designed to evaluate deceptive behaviors of Large Language Models (LLMs) within the software development lifecycle. The benchmark covers six stages and two deception types (active and passive), assessing how LLMs respond to misleading requests or present infeasible …
Task Context Shapes Component Roles in Language Models
This paper proposes a network view to understand how language models reuse components across tasks. By analyzing the influence and importance of attention heads under task changes, they demonstrate that task context significantly redistributes component roles. This redistribution explains how the same heads can respond…
X-AgentRed: Red-Teaming Personal Agents in Evolving Multi-Service Ecosystems
X-AgentRed addresses the risk of unintended harmful outcomes from personal agents interacting with multiple services. Its core method is a self-evolving red-teaming framework that systematically discovers and refines harmful tool call paths by leveraging a graph of tool dependencies and incorporating execution feedback…
TabReliBench: Evaluating Tabular Foundation Models Beyond Predictive Accuracy
This paper introduces TabReliBench, a benchmark for evaluating tabular foundation models (TFMs) on reliability beyond just predictive accuracy. It assesses TFMs across various metrics like calibration and interval efficiency, revealing that model rankings shift significantly based on the evaluation criteria. The study …
Transformer-based In-Context Score Operator Learning for Diffusion Models
This paper introduces a novel in-context learning approach for diffusion models, enabling them to adapt to unseen distributions without retraining. The core method learns an "in-context score operator" using a Transformer architecture that leverages a Gaussian-kernel conditional-mean representation. This allows the mod…
AMLworld-Compact: Importance-Weighted Downsampling for Cost-Effective LLM Evaluation and Error Diagnosis
This paper introduces AMLworld-Compact, a method for cost-effectively evaluating Large Language Models (LLMs) on Anti-Money Laundering (AML) datasets. It achieves this by strategically downsampling benign transactions based on supervised scores, significantly reducing the number of required graph prompts. The core cont…
Tracing and Taming Hallucinated Terms via Subsequence-Association Filtering and Breadth-Aware Selection for LLM Query Expansion
This paper introduces SAFE-QE, a training-free method to address hallucinated terms in LLM-generated query expansions. It leverages a "subsequence-association" account of hallucination, scoring candidate terms based on their reproducibility across different contexts while down-weighting those lacking corpus support. Th…
LAPT-Scale: Scaling Embodied Policies with Latent Action Pre-Training on Human Videos
LAPT-Scale addresses the challenge of scaling robotic policies by leveraging large-scale human videos. Its core method involves pre-training a robot policy using "latent actions" extracted from human video transitions, which capture fine-grained motion dynamics. This approach significantly reduces the need for costly r…
MC-EvoBench: Auditing Experience-Driven Self-Improvement in Minecraft Agents
This paper introduces MC-EvoBench, a controlled Minecraft benchmark designed to rigorously evaluate embodied recursive self-improvement in agents. Its core method involves a fixed set of "evolution chains" where agents must demonstrate persistent, transferable capabilities by overcoming specific challenges. The key con…
Same Query, Different Answer: Run-to-Run Variance in Semantic Query Processing
This paper investigates the run-to-run variance in semantic query processing, where LLMs judge individual data rows. The core method involves re-executing existing benchmarks and logging millions of model calls to quantify how much query results change across different executions, even at temperature 0. The key contrib…
Your Discrete Graph Diffusion Model is Secretly Memorizing
This paper reveals that discrete graph diffusion models (GDMs) secretly memorize training data, a phenomenon previously overlooked. The core method involves analyzing reverse diffusion trajectories conditioned on corrupted training graphs, demonstrating a strong bias towards reconstructing these specific training examp…
Finite-Sample Guarantees for Fully Discrete Conditional Diffusion Models
This paper provides the first finite-sample guarantees for conditional diffusion models trained with discrete steps. The core method aligns score training with the sampling grid, enabling joint analysis of statistical and discretization errors. This leads to theoretical bounds on the generated distribution's error, sho…
QTestBench: A Test Framework for Evaluating LLM-Generated Quantum Code
QTestBench is a novel framework designed to evaluate the effectiveness of LLM-generated quantum test suites. Its core method involves using independent benchmark checkers to validate tests, rather than treating the tests themselves as the ground truth. This approach allows QTestBench to assess how well LLM-generated te…
Returning to Development States: When Full Sandbox Snapshots Help Coding Agents
This paper proposes using Go-Explore-style search with full sandbox snapshots to improve coding agents' failure recovery. The core method involves restoring and branching from intermediate environment states, particularly those containing runtime information like databases and services, rather than restarting from scra…