From the arXiv
Tuesday, 8 September 2026 · 20 papers
A Verifier-Guided Explainable Reasoning Framework with Gold-Anchored QLoRA, Task-Aware Mixture-of-Experts, and Group-Relative RLVR
This paper introduces a framework to improve the explainability and verifiability of LLM reasoning in educational question answering. It achieves this by using a gold-anchored QLoRA for model adaptation, a task-aware router to direct problems to specialized symbolic solvers (like Z3), and a reinforcement learning appro…
ACE: Adaptive Calibration-Free Expert Skipping for MoE-based LLMs
ACE introduces a training-free method to reduce redundant computation in MoE LLMs by adaptively skipping experts for each token. Its core contribution lies in the Global Spectral Proxy and Router-Conditioned Refinement components, which estimate expert contribution and relevance without requiring calibration or additio…
RISE: Recursive Improvement via Self-Extrapolating Policy Distillation
RISE addresses limitations in language model post-training by creating a synthetic teacher from the model's own training trajectory, avoiding external models or privileged conditioning. It achieves this by extrapolating parameter or logit changes to generate dense, token-level supervision. This method recursively impro…
Trace2Tower: Transition-Aware EigenTrace Induction of Multi-Level Skills for LLM Agents
Trace2Tower addresses limitations in LLM agent skill learning by introducing a transition-aware framework that distills raw execution traces into a hierarchical skill structure. It achieves this by abstracting interactions into events, constructing a graph based on semantic and temporal relationships, and using spectra…
Unifying ICL, SFT, KL-Regularized RL Through a Bayesian Lens
This paper unifies diverse LLM training and inference methods like ICL, SFT, and RL under a single Bayesian framework. The core method involves constructing a generalized Bayes posterior over outputs using a prior model and a utility signal, then approximating this posterior via KL projection. This Bayesian lens explai…
A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Support
This paper introduces Debate-Mixture-of-Agents (DMoA), a novel multi-agent framework designed to mimic the iterative, role-based reasoning of clinical diagnosis, unlike single-turn LLMs. DMoA significantly improves diagnostic accuracy and safety by structuring interactions between specialized agents. Its core contribut…
Does Your Agent's Memory Survive a Model Upgrade? A Controlled Study of Memory Portability
This paper investigates how well an agent's memory survives model upgrades by comparing four memory storage methods: raw history (LC-RAW), retrieved chunks (RAG), natural language notes (NOTES), and fixed-schema knowledge graphs (KG-fixed). The core contribution is demonstrating that fixed-schema structures like knowle…
GUT: Quantifying and Optimizing the Reasoning Uncertainty of LLMs via Graph Complexity
This paper introduces GUT, a method to quantify and reduce Large Language Model (LLM) reasoning uncertainty. GUT models LLM reasoning as a directed acyclic graph, where graph complexity serves as a measure of uncertainty. The proposed GUT-Q module quantifies this uncertainty, while GUT-O aims to optimize LLM reasoning …
Measuring AI Accountability Through Argumentation Analysis: Can Model Reasoning Withstand Scrutiny?
This paper proposes a novel method for measuring AI accountability by analyzing the structural quality of a model's defense for its verdicts, rather than relying on ground truth. Their contribution is a four-phase dialectical protocol, grounded in argumentation theory, that assesses how well AI models can withstand scr…
PRICE: A Systematic Study of LLM Adaptation Choices for Bitcoin Price Forecasting
This paper introduces PRICE, a systematic method for adapting LLMs to Bitcoin price forecasting. PRICE combines efficient fine-tuning (LoRA), recursive inference, integer numerical representation, and specific prompting/decoding strategies to improve accuracy. Its core contribution is demonstrating that each of these a…
Substrate-Aware AI Agents: Execution Context as a First-Class Input
This paper introduces "substrate-aware" AI agents that consider execution constraints like memory and time during planning. By providing these operational details as input, the agents generate more efficient code, significantly reducing memory usage and execution time, as demonstrated in numerical code generation tasks…
Testing Interchangeability in LLM Agent Teams
This paper tests the assumption of agent interchangeability in multi-agent LLM systems. It finds that while swapping agents has a small impact on task performance, it significantly increases communication overhead and can even lead to performance degradation, suggesting that agents develop task-specific conventions tha…
The Mirror Agent Model: a Bayesian Architecture for Interpretable Agent Behavior
The Mirror Agent Model proposes a Bayesian architecture where an agent's internal model of an observer is a direct reflection of its own. This design facilitates interpretable behavior and explanations by explicitly modeling the observer's perspective. The paper's contribution lies in this novel architecture and its ex…
TruthInsightBench: An Evidence-Grounded Benchmark for Automated Evaluation of Open-Ended Scientific Discovery Agents
This paper introduces TruthInsightBench, a novel benchmark designed to evaluate the scientific discovery capabilities of AI agents, rather than just their ability to reproduce existing results. It achieves this by presenting agents with blind scientific objectives and frozen data, requiring them to independently derive…
How to Speculate about Uncertainty in Agentic Coding? A Draft-Model Gate Method
This paper introduces Speculative Uncertainty (SU), a method to detect potential failures in LLM agents without internal access. SU uses a small draft model to score the agent's output tokens, identifying uncertainty by analyzing reasoning and action spans. This provides an actionable failure likelihood score that can …
A Human-in-the-Loop Framework for AI-Assisted Scoring in Large-Scale Writing Assessment
This paper introduces a human-in-the-loop framework for AI-assisted scoring of short written responses in large-scale assessments. The core method combines AI scoring with human review to maintain assessment quality while improving efficiency. Its contribution lies in demonstrating the feasibility and effectiveness of …
A Schema Bounded Language Model for Refining Robot Policies Without Destabilizing Local Learning
This paper proposes a decentralized robot navigation system where each robot uses a local Large Language Model (LLM) for policy generation and refinement, avoiding destabilizing local learning. The core method involves a schema-bounded LLM that communicates policy summaries with other robots, allowing for collaborative…
Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive Optimization
This paper introduces OR-Clarify, a benchmark for evaluating how well Large Language Models (LLMs) can identify missing information before formulating optimization problems. The core method involves presenting LLMs with incomplete problem descriptions and assessing their ability to ask clarifying questions to a simulat…
Constructing and Evaluating Clinical Reasoning Trajectories for Medical Agent
This paper introduces MedTraj, a framework for evaluating medical AI agents beyond just the final answer. It constructs and scores multi-step reasoning trajectories based on clinical data, assessing qualities like coherence and evidence support. This approach allows for a more robust evaluation of AI's clinical reasoni…
CONTINUITY: Security-Context Contracts for Composable LLM Agent Controls
This paper addresses the challenge of ensuring end-to-end security in composable LLM agent systems, where individual security mechanisms can fail when combined. The core method, CONTINUITY, uses assume-guarantee contracts and signed security context transfers (like root grants and role-bound receipts) to maintain verif…