From the arXiv
Thursday, 10 September 2026 · 20 papers
Belief-State Engine: Augmenting LLMs for Principled Planning Under Partial Observability
This paper addresses the failure of LLM agents in partially observable environments by introducing the Belief-State Engine (BSE). The BSE is an external module that maintains a Bayesian posterior over the environment's hidden states, feeding only this belief to the LLM. This architectural change allows LLMs to perform …
DiSCo: A Distribution-First Steering and Cultural Prior Evaluation Framework for Measuring Cultural Preference Bias in LLMs
DiSCo is a novel framework for evaluating LLMs' cultural bias by focusing on their default preferences rather than single correct answers. It uses a forced-choice, distribution-first approach with a context gradient to isolate and measure inherent cultural leanings and steerability across multiple cultures. The paper's…
Show-Harness: Just a VLM Agent Can Play Robots
Show-Harness provides a semantic interface that allows Vision-Language Models (VLMs) to control robots by translating high-level intents into discrete actions. This method enables zero-shot control of powerful VLMs and efficient adaptation of smaller models, democratizing robot control.
Active Adaptation, Not Static Defense: Temporal Dynamics of Preventative Steering in Adversarial Fine-Tuning
This paper investigates the temporal dynamics of Preventative Steering, a defense against adversarial fine-tuning in LLMs. It reveals that the defense relies on an **active adaptation process** during training, rather than a static injection of corrective signals. The core contribution is demonstrating that the protect…
Beyond One-Size-Fits-All: Sample-Adaptive Strategy Routing for Vision Token Pruning in MLLMs
This paper addresses the inefficiency of processing numerous visual tokens in Multimodal Large Language Models (MLLMs) by proposing VIP-Router. Instead of a single fixed pruning strategy, VIP-Router adaptively selects the best pruning method for each input based on its visual and textual features. This sample-adaptive …
Beyond Surface Imitation: Contrastive Modeling for Reasoning Path Alignment in Multimodal In-Context Learning
This paper proposes a novel multimodal in-context learning (ICL) framework that moves beyond superficial imitation. It introduces contrastive demonstration modeling, where demonstrations explicitly highlight the difference between suboptimal and optimal responses along with the reasoning path for refinement. This appro…
Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization
This paper investigates whether foundation models can effectively moderate online content by comparing instruction-driven and example-driven policy operationalization. Using the new ModerationBench benchmark, they demonstrate that foundation models significantly outperform existing systems, achieving comparable effecti…
ConvMem: Convolutional Memory for Long-Context Reasoning
ConvMem addresses LLM limitations with long contexts by reformulating reasoning as a hierarchical convolution, treating the LLM as a kernel. This training-free, parallelizable method summarizes text segments in a logarithmic tree structure, significantly reducing latency compared to sequential approaches. Its key contr…
Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training
This paper addresses the challenge of training LLM agents to discover multiple successful strategies from a single decision point. Their proposed method, Direct Diversity Optimization (DDO), combines a novel tree-based collection of diverse trajectories with a reference-relative objective. DDO effectively improves both…
Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs
This paper proposes FOM-UL, a layer-selective unlearning method for LLMs. It identifies and updates only the most influential transformer layers for forgetting specific data, minimizing impact on the rest of the model. This targeted approach improves the balance between forgetting unwanted information and maintaining m…
From Symbolic Perception to Logical Deduction: A Framework for Guiding Language Models in Geometric Reasoning
This paper proposes a framework for geometric reasoning using a Large Language Model (LLM) by integrating a Geometric Vision Parser and a Symbolic Solver. The parser translates geometric diagrams into symbolic representations, which the solver then uses for logical deduction. This approach achieves performance comparab…
RAP: Research Attention Prediction Reveals Target-Conditioned Evidence Acquisition Biases
This paper introduces Research Attention Prediction (RAP), a novel benchmark for evaluating LLMs as research agents by predicting future paper shares across AI/ML fields. The core contribution is identifying that LLMs struggle to accurately predict research trends, often underperforming a simple moving average baseline…
TRACE: Training Reasoning Agents for Causal Exploration with Synthesized Rewards
This paper introduces TRACE, a method for training reasoning agents in complex diagnostic tasks where ground truth is hard to obtain. TRACE synthesizes verifiable rewards by simulating interventions in a controlled environment, allowing agents to learn causal reasoning from noisy, real-world-like data. The core contrib…
What Should an Agent Forget? Separating What Is Stored from What Is Used
This paper introduces RD-Forget, a training-free framework that separates an agent's stored experience from its active memory. It achieves this by maintaining a source archive and a query-conditioned memory view, allowing superseded facts to be retained for historical context while suppressing them for current queries.…
A Later Test Set Is Not a New Domain: Pretraining Familiarity Survives a Contamination-Free Hold-Out
This paper introduces a novel evaluation protocol for time-series foundation models by creating a test set of data published *after* model training. The core contribution is demonstrating that pretrained models still outperform others on this "later" test set, suggesting their familiarity with the training data, not ju…
Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation
Maverick enables private and verifiable LLM inference by delegating the computationally intensive matrix-vector multiplication operation. Its core contribution is an information-theoretically sound verification protocol for this delegation, offering transparent preprocessing, efficient verification, and minimal server …
$Φ$-Bench: Can Large Language Models Engineer the Infrastructure That Powers Them?
This paper introduces $Φ$-Bench, a novel benchmark designed to evaluate Large Language Models' (LLMs) ability to engineer the infrastructure that supports them. Unlike previous benchmarks, $Φ$-Bench covers the entire LLM infrastructure stack with tasks ranging from kernel optimization to system-level improvements, addr…
ProbPlug: A Plugin Uncertainty Network for Reliable Confidence in LLM Binary Classification
ProbPlug is a lightweight framework that estimates the confidence of LLM binary classification predictions by analyzing internal token features from a frozen LLM. It uses a self-attention module to aggregate these features, providing reliable confidence estimates without altering the base model. This approach improves …
The Answer Path and the Grounding Instruction in LLM Question Answering over Knowledge Graphs
This paper investigates how to best present knowledge graph triples to Large Language Models for question answering. The core method involves systematically varying four aspects of the prompt: the triples included (specifically, the "answer path"), their syntax, their order, and a grounding instruction. The key contrib…
Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs
This paper surveys inference-efficiency mechanisms for VideoLLMs, which are expensive due to their computational demands. The core contribution is a structured analysis of techniques that reduce parameter count, FLOPs, latency, and memory usage across different stages of the VideoLLM pipeline, from frame sampling to LL…