From the arXiv
Wednesday, 29 July 2026 · 20 papers
CHARM: A Multimodal Graph Foundation Model with Hierarchical Context Modeling for Zero-Shot Transfer
CHARM is a multimodal graph foundation model that addresses zero-shot transfer by modeling hierarchical context across different modalities. Its core method involves learning transferable cross-modal relations and disentangling domain-specific information from generalizable node representations. This allows CHARM to ge…
HiSkill: Empowering LLM Agents with Hierarchical Skill Graphs
HiSkill addresses the limitations of flat skill representations in LLM agents by introducing a hierarchical skill graph. This framework organizes skills and actions into a directed graph, capturing complex relationships like decomposition and temporal transitions. HiSkill's contribution lies in enabling more efficient …
MemLens: A Value-Aware Memory Management System with Interactive Analytics for LLM-based Agents
MemLens introduces a value-aware memory management system for LLM agents, treating memory records as first-class objects. Its core method involves Shapley-style evaluation to identify and prioritize valuable memory content, enabling efficient storage and retrieval. The system's contribution lies in providing interactiv…
Speculate While You Reason: Teaching Agents to Predict Their Next Tool Call via Joint Agent-Speculator RL
This paper introduces a "self-speculating agent" that unifies task execution and next tool call prediction within a single model. By training this agent using a joint reinforcement learning method, it learns to predict its future tool calls by leveraging its own partial reasoning process. This approach aims to reduce l…
Tools Are Not Islands: Set-Level Tool Retrieval for LLM Agents via Query-Conditioned Hyperedge Prediction
This paper introduces HYSET, a novel method for LLM agents to retrieve tool sets. Instead of evaluating tools individually or sequentially, HYSET treats the entire tool set as a unit, predicting hyperedges on a tool co-invocation graph to capture joint utility and compatibility. This set-level approach aims to improve …
RSIBench-Data: Benchmarking Data-Centric Research for Recursive Self-Improvement
This paper introduces RSIBench-Data, a benchmark designed to isolate and evaluate the data-centric research capabilities of LLM agents for recursive self-improvement. The core method involves a controlled environment where agents iteratively refine training data strategies for a fixed target model, with all other aspec…
DecoEvo: Score-Decoupled Co-Evolution of Solver and Rubric-Generator Skills in Text Space
DecoEvo addresses the limitations of fixed evaluation in text-space LLM optimization by introducing a decoupled co-evolutionary approach. It simultaneously trains a solver to improve its performance and a rubric generator to create more comprehensive evaluation criteria. This method allows for more robust optimization …
How Do LLMs Read Bug Reports? An Empirical Study of Attention in LLMs for Automated Program Repair
This paper empirically studies how Large Language Models (LLMs) attend to information within bug reports when performing automated program repair. By analyzing attention patterns on real-world bugs, it reveals how LLMs prioritize different sections and how these patterns differ between successful and unsuccessful repai…
Messier: A High-Resolution Corpus for Cross-Benchmark Agent Evaluation
Messier is a large, standardized corpus of 957,253 records from 30 benchmarks and 714 agents, designed to unify and enable cross-benchmark evaluation of AI agents. Its core contribution is providing a comprehensive, comparable dataset that reveals uneven progress across different agent capabilities, highlighting areas …
Minimizing Targeted Activations: Input-Only Suppression of Evaluation-Awareness Latents in Large Language Models
This paper introduces an "input-only" method to suppress specific internal activations in Large Language Models without modifying the model itself. By optimizing prompts, they aim to drive an "evaluation-awareness" latent towards zero, preventing models from altering their behavior when they detect being tested. Their …
Runtime Uncertainty Monitoring for LLM-Based Multi-Agent Systems Using Bayesian Networks
This paper proposes a novel method for monitoring runtime uncertainty in LLM-based multi-agent systems for actuarial risk modeling. It utilizes Bayesian Networks to propagate uncertainty derived from token-level log-probabilities, transformed into calibrated task-level confidence estimates. This approach aims to provid…
SAM3D-Guided Object-Centric Representation Alignment for Vision-Language-Action Models
This paper proposes a method to improve Vision-Language-Action (VLA) models by incorporating fine-grained 3D object understanding. It uses SAM3D as a frozen teacher to extract 3D object representations during training, aligning them with the VLA model's intermediate features. This allows the VLA model to learn 3D objec…
AngelSpec: Towards Real-World High Performance Inference with Speculative Decoding
AngelSpec introduces a unified training framework for speculative decoding, addressing the challenge that no single drafting mechanism is optimal for all real-world language model inference tasks. It achieves this by co-specializing different drafting structures (autoregressive multi-token prediction and block-parallel…
Instruction-Tuned Models Locally Reuse Human Syntax More Than Humans Do
This paper investigates whether instruction-tuned language models exhibit syntactic convergence, mirroring human dialogue patterns. The core method involves measuring the reuse of context-free grammar rules in model-generated text compared to human-generated text. The key contribution is demonstrating that instruction-…
A Cost-Effective Multimodal LLM Reasoning Framework for Question Answering over Irregular Clinical Time Series
This paper introduces ClinPRISM, a cost-effective framework for question answering over irregular clinical time series. It addresses the challenges of sparsity and irregular sampling by using an irregularity-aware encoder and a temporal evidence distiller to create LLM-compatible representations. The framework's key co…
Cognivia: A Cognitive Behavioral Therapy Copilot for Evidence-Based Mental Healthcare
Cognivia is an AI therapist designed to address the shortage of human therapists by providing evidence-based Cognitive Behavioral Therapy (CBT). Its core method involves automatically identifying cognitive distortions and generating rational responses, drawing from authoritative CBT texts and augmented with mental heal…
Desktop-Delta Bench: Do Computer-Use Models Understand Desktop GUI Transitions?
This paper introduces Desktop-Delta Bench (DDB), a new benchmark for evaluating computer-use agents (CUAs). DDB focuses on assessing an agent's ability to understand GUI transitions and causal relationships between actions and their effects, addressing limitations of existing benchmarks that only measure end-task succe…
Does Runtime Topology Context Improve LLM-Generated Kubernetes Security Patches?
This paper investigates whether providing LLMs with runtime Kubernetes topology context improves the correctness of automatically generated security patches. The authors introduce KuTIE, a system that leverages Istio call graph data to inform LLMs, aiming to prevent functional regressions caused by patches that overloo…
Empirical Evaluation of Out-Of-Distribution Performance of Tabular Foundation Models
This paper empirically evaluates the out-of-distribution (OOD) performance of nine tabular foundation models (TFMs) across three real-world datasets exhibiting different types of distribution shifts. The core contribution is demonstrating that all tested TFMs systematically degrade in performance under distribution shi…
Evaluating Multi-Turn Multimodal Diagnostic Reasoning on Challenging Real-World Clinical Cases
This paper introduces ClinMM-Bench, a novel benchmark designed to evaluate multi-turn multimodal diagnostic reasoning in clinical settings. It addresses the limitations of existing single-turn evaluations by simulating the progressive disclosure of information and dynamic hypothesis updating seen in real-world medical …