From the arXiv
Friday, 10 July 2026 · 20 papers
Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing
This paper introduces a Cognitive-structured Multimodal Agent that addresses limitations in current unified multimodal models by externalizing visual information into an Episodic Visual Memory. This allows for selective retrieval of relevant visual context during reasoning, overcoming issues with long-horizon dialogues…
Game Theory Driven Multi-Agent Framework Mitigates Language Model Hallucination
This paper introduces G-Frame, a multi-agent framework that uses game theory to train language models for scientific domains. By integrating Bayesian and team game principles, G-Frame forces models to internalize domain constraints, significantly reducing hallucinations. This approach leads to specialized models like O…
Towards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model Finetuning
This paper addresses the "Knowing-Using Gap" in LLM fine-tuning, where models memorize new facts but fail to apply them in reasoning. Using a novel "self-patching" technique, they identify that memorized knowledge is internally present but not correctly routed to computation-effective layers. This "knowledge-circuit mi…
UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing
UltraX addresses the diminishing returns of scaling LLMs by focusing on data quality. Its core method is an adaptive programmatic editing framework that refines pre-training data at scale by enabling fine-grained insertion, deletion, and modification. This approach improves data quality efficiently and reliably, overco…
WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Search
WebSwarm addresses the limitations of single LLM agents in deep and wide web searches by introducing a recursive delegation framework. Its core method involves dynamically creating agentic search nodes that jointly decompose tasks, recursively expand search, and adaptively collaborate. This allows for more effective ha…
Multi-Modal, Multi-Environment Machine Teaching for Robust Reward Learning
This paper proposes a novel machine teaching method for robust reward learning in Inverse Reinforcement Learning (IRL). It addresses the challenge of learning reward functions that generalize across multiple environments by leveraging heterogeneous feedback modalities. The core contribution is demonstrating how differe…
Remember When It Matters: Proactive Memory Agent for Long-Horizon Agents
This paper introduces a proactive memory agent that actively intervenes by injecting relevant memories into an action agent's decision-making process. This combats "behavioral state decay" in long-horizon tasks where crucial information is lost. The plug-and-play memory agent significantly improves task success rates b…
SMetric: Rethink LLM Scheduling for Serving Agents with Balanced Session-centric Scheduling
This paper introduces SMetric, a novel LLM scheduling method for serving AI agents. It addresses the unique demands of agentic workloads, where complete responses are prioritized over per-token latency, and KV cache reuse is significantly higher. SMetric proposes a balanced session-centric approach that leverages globa…
TRACE: A Two-Channel Robust Attribution Watermark via Complementary Embeddings for LLM-Agent Trajectories
TRACE embeds a robust watermark into LLM agent trajectories by using two complementary channels. One channel is content-based for deletion resilience, and the other is position-based for rewrite resilience. This dual approach allows for distortion-free action choices and self-synchronization, ensuring attribution even …
WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Driving
WCog-VLA addresses the limitations of reactive autonomous driving by introducing a dual-level framework for proactive driving. It achieves this by unifying world cognition and reasoning at a semantic level, incorporating 3D perception and agent tokens for dynamic understanding and Game-theoretic Chain-of-Thought reason…
Workflow as Knowledge: Semantic Persistence for LLM-Mediated Workflows
This paper proposes a conceptual model for LLM-mediated workflows, representing workflow definitions, instances, and execution details as persistent knowledge objects. The core method uses Lisp-inspired concepts like symbolic forms and live-image thinking to distinguish between deterministic "derive" operations and LLM…
Eigenvalue Calibration for Semantic Embeddings of Large Language Models
This paper introduces a novel framework for calibrating the eigenvalues of semantic embeddings from LLMs, treating them as density matrix predictors. By applying temperature scaling to these eigenvalues, the authors demonstrate improved uncertainty quantification. Their work establishes theoretical links between entrop…
Prompt Compression via Activation Aggregation
This paper proposes "Prompt Compression via Activation Aggregation," a method to compress instruction prompts into a single activation vector. This compressed vector, a learned weighted sum of intermediate layer activations, can then be injected into an early layer of the LLM, replacing the original token sequence. The…
Token-Flow Firewall: Semantic Runtime Auditing for Persistent AI Agents
This paper introduces TokenWall, a runtime defense framework for persistent AI agents. Its core method is to treat natural-language token flows (like memory updates or tool arguments) as the primary attack surface. TokenWall acts as a semantic firewall, auditing these flows to intercept unsafe behavior before it reache…
UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Tasks
UniClawBench introduces a capability-driven benchmark for evaluating proactive AI agents in real-world scenarios. It addresses limitations of existing benchmarks by focusing on five core agent capabilities and offering 400 bilingual tasks designed for dynamic, multi-turn interactions. This approach allows for a more gr…
AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understanding
This paper introduces AUTOPILOT-VQA, a new benchmark designed to evaluate vision-language models' ability to understand safety-critical incidents in dashcam videos. The core method involves a dataset of structured questions about real-world driving events, covering various factors like weather, traffic, and accident de…
DocMaster: A Hierarchical Structure-Aware System for Document Analysis
DocMaster addresses the challenge of analyzing complex documents by preserving their hierarchical structure, unlike existing systems that flatten them. Its core method involves parsing documents into hierarchical trees and building a structure-aware semantic index. This enables more accurate document filtering and in-d…
OmniFood-Bench: Evaluating VLMs for Nutrient Reasoning and Personalized Health Advice
OmniFood-Bench is a new benchmark designed to evaluate Vision-Language Models (VLMs) on their ability to perform complex food-related reasoning. It moves beyond simple classification to assess how well VLMs can identify ingredients, estimate quantities, and ultimately provide personalized health advice, addressing the …
The complexities of patient-centred conversational artificial intelligence
This paper highlights the limitations of current health chatbot evaluations, which often use idealized patient simulations. The authors developed a novel patient simulator that models diverse communication styles and emotional states, achieving near-human realism in Turing-style tests. Their work demonstrates that acco…
The Context Access Divide: Interaction-Level Architecture as a Complementary Dimension of Agentic Inequality
This paper introduces the "Context Access Divide" (CAD) as a new dimension of AI inequality, distinct from existing measures of availability, quality, and quantity. The CAD highlights how the ability of an AI to dynamically retrieve relevant context from a user's knowledge corpus, versus requiring manual document attac…