From the arXiv
Tuesday, 28 July 2026 · 20 papers
Gubernaut: A Deterministic Homeostatic Controller for Affect-Regulated LLM Agents, Validated Across Independent Model Families
This paper introduces Gubernaut, a deterministic runtime controller for LLM agents designed to prevent reactive failures like escalation or sycophancy. It operates as a model-agnostic layer that monitors numerical telemetry (intensity, valence, repetition) and adjusts the LLM's behavior without processing text, thus cr…
The Physics of Multi-Turn Long-Horizon Planning: From Pre-training to Post-training via Single- and Multi-Teacher On-Policy Agentic Distillation
This paper introduces a controlled environment to systematically study multi-turn long-horizon planning in foundation model agents. The core method involves analyzing planning ability acquisition during pre-training by manipulating data formats and introducing world models, and then shaping it through post-training tec…
UNIFUSION: Adapting Autoregressive Language Models into Discrete Diffusion under a Unified Reverse-Rate Objective
This paper proposes UNIFUSION, a method to adapt autoregressive language models for discrete diffusion. It unifies existing diffusion objectives under a single generalized KL objective, allowing seamless switching between different corruption kernels like masking and uniform noise. UNIFUSION then uses a simple continua…
Kimi K3: Open Frontier Intelligence
Kimi K3 is a 2.8T parameter Mixture-of-Experts model that achieves significant scaling efficiency improvements through novel attention mechanisms (Kimi Delta Attention) and expert routing (Stable LatentMoE). Its core contribution lies in its massive scale, native vision capabilities, and an unprecedented 1-million-toke…
When LLM Defenses Backfire: Characterizing Safety, Performance, and Cost Trade-offs
This paper systematically analyzes the trade-offs of LLM jailbreak defenses across safety, performance, and cost. It categorizes defenses by operational strategy and finds that they rarely improve downstream capabilities, instead varying in how they impact usability and efficiency. Rule-based defenses best maintain per…
Agentic Permissions Policy Algebra for Taint Confinement in LLM Agents
This paper introduces APPA, a novel Information Flow Control framework for LLM agents. APPA addresses the usability bottleneck of traditional taint tracking by enabling engine-managed context branching and prospective acquisition enforcement, allowing agents to safely process mixed-confidentiality data without permanen…
Beyond Aggregate Risk: Role-Stratified Conformal Risk Control for LLM Tool Calls
This paper introduces **role-stratified conformal risk control** for LLM tool calls, a method that addresses the limitations of aggregate risk control by setting separate risk budgets for different argument roles within a tool call. This allows for more precise risk management, preventing high-risk fields from being ma…
ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical Understanding
ClinFusion is a vision-centric multimodal LLM system designed for holistic medical understanding. Its core method involves a compositional and cascaded vision encoder that unifies diverse 2D and 3D medical image understanding. The paper's contribution lies in this novel encoder architecture and a vision-grounded evalua…
D-Score: A Spectral Hidden-State Signal for Hallucination Detection in Large Language Models
This paper introduces the D-Score, a novel method for detecting hallucinations in Large Language Models. The D-Score is a spectral statistic derived from the geometry of hidden activations during a single forward pass. It quantifies how many singular directions in the activation matrix have singular values close to the…
DataOrchestra: Learning to Orchestrate Per-Example Curation of Pretraining Data
DataOrchestra learns to create personalized data processing pipelines for each pretraining example. It intelligently decides whether to drop, keep, or clean data, and for cleaning, it selects and instructs specific LLM-based rewriting tools. This approach achieves stable performance gains across multiple benchmarks by …
Hierarchical Group-Conditional Conformal Risk Control for Selective Prediction in Language Models
This paper addresses the limitation of standard conformal risk control (CRC) in language models, which provides population-level risk guarantees but can fail for specific subgroups. They propose Hierarchical Group-Conditional CRC (HG-CRC), a post-hoc method that enforces simultaneous risk guarantees across a user-defin…
LOCKS: Page-Local Compact Key Summaries for Efficient Long-Context Decoding
LOCKS proposes a novel method for efficient long-context decoding in large language models by creating compact, page-local spectral summaries of the KV cache. These summaries allow the model to quickly estimate attention mass and selectively attend to only the most relevant pages, significantly reducing computation. Th…
Reason-Mediated Behavioral Models for Auditing LLM Social Simulators
This paper introduces a method to audit Large Language Model (LLM) social simulators by analyzing the underlying reasoning process, not just the final outcome. It proposes mapping open-ended rationales into "signed reason states" to assess if LLMs can replicate human reasoning patterns. The contribution is demonstratin…
Context Is King: How In-Context Specification Shapes the Geometry of Concepts
This paper demonstrates that the geometric structure of concepts within large language models is not fixed but dynamically shaped by in-context specifications. The model can arrange tokens into different topological structures, like cycles or trees, based on provided rules, even overriding strong pre-trained knowledge.…
MMOE: Modernizing Diffusion Transformers with Efficient Expert Design
This paper introduces ModernMOE (MMOE), a method to improve the efficiency and quality of diffusion transformers for generative AI. MMOE adapts successful LLM scaling principles, like sparse experts and efficient routing, to diffusion models. Its core contribution is a systematic integration of these modern expert desi…
Retrieval-Augmented Large Language Models as Components of Cognitive Computing architecture for Regulatory Knowledge Management
This paper proposes a cognitive computing architecture for regulatory knowledge management by integrating locally deployed Large Language Models (LLMs) with Retrieval-Augmented Generation (RAG). The core method involves using RAG to enhance LLMs with controlled knowledge retrieval and traceability, transforming them fr…
A corrective agentic hybrid RAG and an operations-grounded evaluation for a scientific facility
This paper introduces APS-RAG, a platform
Closed-Loop Validation-Repair for Healthcare Interoperability: A Multi-Model Study of Schema Compliance in Clinical LLMs
This paper introduces a closed-loop validation-repair method to address schema noncompliance in clinical LLMs. By evaluating three models across 320 scenarios, they found consistent compliance issues, suggesting common training data gaps. Their method effectively identifies and can potentially fix these errors, crucial…
DeepFaith: Evidence-Grounded LLMs for Faithful Incident Reporting in Multi-Stage APT Defense
DeepFaith addresses the challenge of generating interpretable incident reports from complex APT defenses. Its core method involves transforming structured defense outputs into natural-language reports that are explicitly grounded in system evidence, ensuring factual accuracy. The contribution is a framework that uses e…
From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesis
This paper addresses the challenge of making large language models retain and reuse scientific computing knowledge. Their core method, SciConsolidate, synthesizes transferable procedural knowledge from successful and failed execution experiences. This approach aims to bridge the "abstraction-execution gap" by generatin…