From the arXiv
Monday, 7 September 2026 · 20 papers
A Verifier-Guided Explainable Reasoning Framework with Gold-Anchored QLoRA, Task-Aware Mixture-of-Experts, and Group-Relative RLVR
This paper introduces a framework to improve the explainability and verifiability of LLM reasoning in educational question answering. It achieves this by using a gold-anchored QLoRA for initial model adaptation, a task-aware router to direct problems to specialized symbolic solvers (like Z3), and a reinforcement learni…
ACE: Adaptive Calibration-Free Expert Skipping for MoE-based LLMs
ACE addresses redundant computation in MoE LLMs by adaptively skipping experts for each token without requiring extra training or calibration. It uses a Global Spectral Proxy to estimate expert capacity and Router-Conditioned Refinement to evaluate expert responses based on routing preferences, leading to more efficien…
RISE: Recursive Improvement via Self-Extrapolating Policy Distillation
RISE improves language model training by creating a synthetic teacher from the model's own experience, bypassing the limitations of external teachers or in-context learning. It extrapolates parameter or logit changes from the model's training trajectory to generate dense, token-level supervision. This method combines r…
Trace2Tower: Transition-Aware EigenTrace Induction of Multi-Level Skills for LLM Agents
Trace2Tower addresses limitations in LLM agent skill learning by introducing a transition-aware framework that distills raw execution traces into a hierarchical skill structure. It achieves this by abstracting interactions into canonical events, building a graph based on semantic and temporal relationships, and using s…
Unifying ICL, SFT, KL-Regularized RL Through a Bayesian Lens
This paper unifies diverse LLM training and evaluation methods like ICL, SFT, and RL under a Bayesian framework. The core method involves constructing a generalized Bayesian posterior over outputs using a prior model and a utility signal, then approximating this posterior via KL projection. This approach explains seemi…
A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Support
This paper introduces Debate-Mixture-of-Agents (DMoA), a novel multi-agent framework that mimics structured clinical diagnostic reasoning through role-based interactions. DMoA significantly improves diagnostic accuracy and safety compared to single-turn LLMs by enabling iterative reasoning. Its core contribution lies i…
Does Your Agent's Memory Survive a Model Upgrade? A Controlled Study of Memory Portability
This paper investigates how well an agent's memory survives model upgrades by comparing four memory storage methods: raw history, RAG chunks, natural language notes, and a fixed-schema knowledge graph. The core contribution is demonstrating that fixed-schema knowledge graphs offer the most robust memory portability, wi…
GUT: Quantifying and Optimizing the Reasoning Uncertainty of LLMs via Graph Complexity
This paper introduces GUT, a method to quantify and reduce reasoning uncertainty in LLMs. GUT models LLM reasoning as a directed acyclic graph, capturing all possible branches. It then uses this graph to measure uncertainty (GUT-Q) and optimize prompts to reduce it (GUT-O).
Measuring AI Accountability Through Argumentation Analysis: Can Model Reasoning Withstand Scrutiny?
This paper proposes a novel method for measuring AI accountability by analyzing the structural quality of a model's defense for its verdicts, rather than relying on ground truth. Using a dialectical protocol based on argumentation theory, the research assesses how well AI models can withstand scrutiny and justify their…
PRICE: A Systematic Study of LLM Adaptation Choices for Bitcoin Price Forecasting
This paper introduces PRICE, a systematic framework for adapting Large Language Models (LLMs) for Bitcoin price forecasting. It combines efficient fine-tuning (LoRA), recursive inference, integer numerical representation, and specific prompting/decoding strategies to improve accuracy and reliability. The core contribut…
Substrate-Aware AI Agents: Execution Context as a First-Class Input
This paper introduces "substrate-aware" AI agents that consider execution constraints like memory and time during planning. By providing these constraints as input, agents can generate more efficient code, as demonstrated by reduced memory usage and faster execution times in their experiments with frontier models. The …
Testing Interchangeability in LLM Agent Teams
This paper tests the assumption that agents in multi-agent LLM systems are interchangeable. By swapping role-matched agents between independently formed teams and observing performance on new tasks, they found that while task scores change little, communication costs significantly increase. This suggests that agents de…
The Mirror Agent Model: a Bayesian Architecture for Interpretable Agent Behavior
The Mirror Agent Model proposes a Bayesian architecture where an agent's internal model of an observer is a direct reflection of its own state. This design enables the generation of interpretable agent behavior and explicit explanations for its actions, achieved by leveraging saliency methods to highlight relevant inte…
TruthInsightBench: An Evidence-Grounded Benchmark for Automated Evaluation of Open-Ended Scientific Discovery Agents
This paper introduces TruthInsightBench, a novel benchmark designed to evaluate the scientific discovery capabilities of AI agents, rather than just their ability to reproduce existing results. It presents agents with blind scientific objectives and frozen data, requiring them to independently formulate and support cla…
How to Speculate about Uncertainty in Agentic Coding? A Draft-Model Gate Method
This paper introduces Speculative Uncertainty (SU), a method to detect potential failures in LLM agents without internal access. SU uses a small draft model to score the agent's generated output, identifying uncertainty by analyzing the likelihood of its tokens. This provides a failure signal that can trigger intervent…
A Human-in-the-Loop Framework for AI-Assisted Scoring in Large-Scale Writing Assessment
This paper introduces a human-in-the-loop framework for AI-assisted scoring of short written responses in large-scale assessments. The core method involves using LLMs to generate scores, with human raters reviewing and correcting them to maintain quality while reducing manual workload. The contribution lies in demonstr…
A Schema Bounded Language Model for Refining Robot Policies Without Destabilizing Local Learning
This paper proposes a decentralized robot navigation system where individual robots use a schema-bounded Large Language Model (LLM) for policy generation and refinement. The core method involves each robot independently combining an LLM with bandit and deep reinforcement learning controllers, communicating policy summa…
Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive Optimization
This paper introduces **OR-Clarify**, a benchmark for evaluating how well Large Language Models (LLMs) can identify and resolve missing information before formulating optimization problems. The core method involves presenting LLMs with incomplete problem descriptions and assessing their ability to ask clarifying questi…
Constructing and Evaluating Clinical Reasoning Trajectories for Medical Agent
This paper introduces MedTraj, a framework for evaluating medical AI agents beyond just the final answer. It constructs and scores multi-step reasoning trajectories based on clinical data, assessing qualities like coherence and evidence support. This approach allows for a more robust evaluation by understanding *how* a…
CONTINUITY: Security-Context Contracts for Composable LLM Agent Controls
This paper addresses the problem of security-context discontinuity in composable LLM agent systems, where security information can be lost or corrupted across component boundaries. Their framework, CONTINUITY, uses assume-guarantee contracts and signed security context mechanisms to ensure verifiable composition. The c…