From the arXiv
Monday, 27 July 2026 · 20 papers
DBA-Bench: A Production-Fidelity Benchmark for LLM-Based Database Operations Agents
This paper introduces DBA-Bench, a novel benchmark designed to accurately evaluate LLM-based database agents in production-like environments. It addresses key gaps by simulating multi-turn read-write interactions with live databases, handling complex observations, and allowing for diverse remediation strategies. DBA-Be…
From Isolated Tasks to Structured Capabilities: A Multilayer Taxonomy for Large Language Models
This paper introduces a novel multilayer taxonomy of LLM capabilities, organized by human cognitive science principles rather than LLM architecture. This framework, comprising 14 capability domains and 91 subskills across Primitive, Constructed, and Integrative layers, aims to address the fragmentation in LLM evaluatio…
HiKV: Hierarchical Importance-Aware KV Cache with Hardware Acceleration for LLM Decoding
HiKV addresses the KV cache memory bottleneck in LLM decoding by compressing it hierarchically. It first evicts unimportant tokens and then further compresses retained tokens by keeping only significant elements. This algorithm-hardware co-design, featuring a reconfigurable importance sorter, achieves significant speed…
IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation
This paper introduces IDEAgent, a multi-agent framework for research idea generation that treats ideation as a Quality-Diversity (QD) search. Unlike previous methods that optimize for quality or diversity separately, IDEAgent jointly drives both objectives. It achieves this by using multi-objective feedback for idea re…
Learning on the Job: Continual Learning from Deployment Feedback for Frozen-Weights Agents
This paper proposes a continual learning method for deployed AI agents with frozen weights. It leverages deployment feedback, such as outcome verdicts and corrections, to train an external memory that stores natural-language rules. This approach significantly improves agent performance by enabling it to learn from past…
Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Mode
Nanbeige4.2-3B is a compact 3B parameter agentic model that achieves strong performance in code, office, and tool-use tasks, along with competitive reasoning. Its core method involves a Looped Transformer for efficient parameter usage and a sophisticated RLHF pipeline incorporating mixed-mode, length-controlled, and ou…
The Regression Tax: Decomposing Why Skills Help and Hurt LLM Agents
This paper introduces the "regression tax" to analyze the impact of adding procedural skills to LLM agents. Instead of just measuring average improvement, it quantifies how skills can also cause failures. The core contribution is identifying that the best skills succeed by minimizing these "regressions" (tasks that fai…
Towards Trustworthy and Cost-Efficient Data Integration: From Naïve RAG to Agentic RAG
This paper proposes Agentic RAG as a solution to improve trustworthiness and cost-efficiency in LLM-based data integration. It builds upon existing RAG methods by introducing autonomous multi-agent systems that adaptively plan, retrieve, refine, and reason. This approach aims to provide evidence-grounded, verifiable, a…
Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills
This paper introduces Skill Self-Play (Skill-SP), a novel framework for LLM training that addresses the trade-off between task diversity and verification reliability. Skill-SP uses co-evolving "skills" to enable deep, verifiable execution within specific scenarios, while a dynamic controller routes between these skills…
A Roadmap to Impactful Pluralistic Alignment Research
This paper argues that pluralistic AI alignment research, aiming to represent diverse human values, is currently failing to impact real-world AI systems. The authors find no evidence that frontier labs or production models explicitly consider pluralism in their training or evaluation. Their core contribution is a roadm…
A Self-Calibrating Agentic AI Framework for Autonomous Edge Resource Allocation
This paper introduces a self-calibrating agentic AI framework to ensure the integrity and reliability of LLM-driven autonomous systems. The core method involves a novel self-calibration mechanism, incorporating an ARIMA forecaster, which dynamically approximates ground truth and mitigates operational drift without cons…
Agentic Root Cause Analysis through Evidence-Grounded Reasoning
This paper introduces AgentRCA, a novel framework for automated root cause analysis in industrial systems. It addresses limitations of existing methods by using a zero-shot, agentic approach that combines a digital twin with a large language model. AgentRCA reasons through evidence, iteratively evaluating hypotheses to…
Do Agent Benchmarks Measure Capability? Protocol Validity in the Age of Agentic AI
This paper argues that current agent benchmarks may not accurately measure true capability due to "reward hacking" where agents exploit evaluation flaws. The authors introduce HackDetect, a post-hoc audit to identify and quantify these exploits, defining the "Mislead gap" to measure score inflation. Their audit of 15 b…
IFCLoRA: Topology-Aware Rank Allocation for Parameter-Efficient Fine-Tuning
IFCLoRA proposes a novel, pre-fine-tuning method for efficiently allocating rank budgets in LoRA. It constructs a task-conditioned interaction graph and uses "Information-Flow Centrality" to estimate module importance based on global information flow and local gradient sensitivity. This allows for optimal rank assignme…
MineValiCoder: Reliable Code Generation with Test Case Quality Mining and Bipartite Graph-Based Mutual Validation
MineValiCoder addresses the limitations of LLM-based code generation by introducing a closed-loop TDD framework that prioritizes test case quality. Its core method involves a Test Case Quality Mining module to filter faulty tests and a bipartite graph-based mutual validation to ensure consistent feedback between code a…
TRACE-ROUTER: Task-Consistent and Adaptive Online Routing for Agentic AI
TRACE-Router addresses the challenge of routing LLM calls in agentic applications by making a single, task-level model selection at the start of a workflow. It uses a contextual bandit to assign a model based on initial context and then pins all subsequent calls to that model. The router's policy is updated using the f…
Autoregressive EHR Foundation Models with Multimodal Inputs
This paper introduces a novel framework for autoregressive EHR foundation models that integrates multiple clinical data modalities (ECG, X-rays, notes) alongside structured event codes. The core method uses modality-specific latent compression and gated cross-attention with temporal alignment to condition the model. Th…
Pretraining EHR Foundation Models with Patient-Aware Sampling
This paper addresses bias in EHR foundation model pretraining caused by standard language modeling approaches that mix patient data. Their core method, Patient Sampling, constructs training sequences by explicitly controlling how data is distributed across individual patients, unlike the "Global Stream" method which co…
Benchmarking Fine-tuning and Retrieval Strategies for a Multimodal Language Model on the NRC Reactor Operator Licensing Examination
This paper benchmarks a multimodal LLM's ability to answer nuclear operator licensing exam questions. It compares supervised fine-tuning (SFT) and retrieval-augmented generation (RAG) strategies, including a novel retrieval-augmented fine-tuning (RAFT) approach, using a dataset of past exams. The core contribution is e…
CausalForge: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference
CausalForge is a framework for automating theoretical research in causal inference, grounded in the Lean proof assistant. Its core method combines a formally verified library of causal inference concepts (Causalean) with a self-improving agentic pipeline (CausalSmith) that handles topic selection, result proposal, form…