From the arXiv
Tuesday, 14 July 2026 · 20 papers
Extending LLM Context via Associative Recurrent Memory
This paper introduces the Associative Recurrent Memory Transformer (ARMT) to overcome the context length limitations of standard transformers. ARMT achieves constant memory scaling and improved efficiency by incorporating an associative recurrent memory mechanism. The authors also contribute domain-specific long-contex…
Proxy Exploration and Reusable Guidance: A Modular LLM Post-Training Paradigm via Proxy-Guided Update Signals
This paper introduces Proxy-guided Update Signal Transfer (PUST), a modular post-training framework for LLMs. PUST decouples exploration from alignment by using a lightweight proxy model to efficiently discover high-reward behaviors. The relative improvement signal from the proxy is then transferred to guide the primar…
Xiaomi-Robotics-U0: Unified Embodied Synthesis with World Foundation Model
This paper introduces Xiaomi-Robotics-U0, a unified 38-billion-parameter model for embodied AI. Its core method is to treat embodied generation as an extension of existing foundation image/video models, jointly optimizing various tasks like scene and video generation. The key contribution is a framework that preserves …
HyperSafe: Inference-Time Safety Recovery for Fine-Tuned Language Models
HyperSafe addresses the fragility of safety in fine-tuned language models by proposing a post-hoc, model-specific approach. It generates a "Safe Side Network" (SSN) for each fine-tuned model by learning a mapping from layer-wise activation fingerprints to SSN parameters. This allows for non-invasive safety restoration …
GEIS: A Generation-Evaluation-Improvement Loop of Agent Skills for Long-Form Article Generation
GEIS introduces a novel Generation-Evaluation-Improvement loop for long-form article generation. Its core method involves a structured cycle of agent skills, including planning, drafting, and evaluation, to address challenges like long context and complex instructions. The key contribution is a declarative and inspecta…
Agent Hacks Agent: Autoresearch for Production-Agent Red-Teaming
This paper introduces AHA, an automated red-teaming method for LLM agents. AHA uses one agent to discover vulnerabilities in another by forming and testing hypotheses about unsafe behavior. Its core contribution is a falsifiable discovery loop that generates reusable vulnerability knowledge, represented in a Vulnerabil…
From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
This paper proposes a roadmap for developing physical intelligence by addressing fragmentation in current research. It identifies key gaps in model representation, standardization, and system composition, and introduces the concept of an "embodied brain" as a unified target. This embodied brain would integrate multimod…
MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents
MM-ToolSandBox is a unified framework and benchmark designed to evaluate visual tool-calling agents. It offers a stateful execution environment with over 500 tools across diverse domains, supporting complex multi-turn, multi-image tasks. The framework's contribution lies in its realistic simulation of conversational ph…
RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM
RAGU is a modular GraphRAG engine that improves knowledge graph construction by separating extraction from consolidation, using a two-stage process with deduplication and summarization. Its core contribution is a compact, domain-adapted LLM (Meno-Lite-0.1) trained for language skills, which outperforms larger models in…
When Local Monitors Miss Compositional Harm: Diagnosing Distributed Backdoors in Multi-Agent Systems
This paper introduces the concept of "distributed backdoors" in multi-agent LLM systems, where a harmful payload is split across agents such that individual local checks pass. The core contribution is demonstrating that traditional local monitors are insufficient to detect these attacks because the fragments appear ben…
How Temperature Shapes Ideological Discourse in Retrieval-Augmented Generation?
This paper investigates how ideological biases in retrieved information affect LLM outputs within Retrieval-Augmented Generation (RAG). Using Lexical Multidimensional Analysis on COVID-19 treatment articles, they identified three ideological discourses. By varying sampling temperatures, the study demonstrates that RAG …
PaperRouter-Agent: A Content-Grounded LLM Agent for Personalized Hierarchical Paper Routing
This paper introduces PaperRouter-Agent, a novel LLM agent designed for personalized hierarchical paper routing. Its core method involves grounding routing decisions in the content of existing papers within user-defined folders, rather than relying solely on folder names. The agent's contribution is a training-free app…
UMoE:Unlocking Every Expert in Domain-Specific Training
This paper introduces UMoE, a method to optimize Mixture-of-Experts (MoE) models for domain-specific tasks. UMoE realigns the expert pool by pruning underperforming experts and regrowing new ones, preserving original model size and inference cost. This approach significantly improves domain-specific performance over st…
A Multimodal Dataset for Large Language Model Applications in the Energy Domain
This paper introduces mAIEnergy, a novel multimodal dataset designed to advance Large Language Model applications in the energy sector. It comprises diverse data types, including text, images, time series, and geospatial information, all harmonized and structured for immediate use. The dataset's core contribution is pr…
Agentic Skill Optimization over Lie Algebroids
This paper introduces LASKO, a framework for optimizing agent skills by modeling them as structured artifacts. LASKO treats skill edits as operations within a controlled Lie algebroid, allowing for a more nuanced understanding of how changes affect system behavior beyond simple vector space manipulations. Its core cont…
An Explainable Agentic System for Detection of Conversational Scams with Summary-Based Memory
This paper introduces an explainable agentic system to detect sophisticated, long-term conversational scams, which current message-level detectors miss. Its core method utilizes a summary-based memory to track scam progression. The key contribution is a novel benchmark, ConScamBench-278, for evaluating such systems and…
CDFM: Towards a General-Purpose Causal Discovery Foundation Model
This paper introduces the Causal Discovery Foundation Model (CDFM), a unified framework for general-purpose causal discovery. CDFM aims to overcome the limitations of dataset-specific algorithms by enabling zero-shot structural inference across diverse domains. Its core contribution lies in leveraging theoretical insig…
DiffEEG: A Self-Supervised Denoising Diffusion Model for Learning EEG Generic Representations
DiffEEG is a self-supervised denoising diffusion model that learns generic EEG representations from unlabeled data. It addresses annotation scarcity and class imbalance in seizure detection by pre-training a 1D U-Net with self-attention and then fine-tuning with reinforcement learning to directly optimize for seizure d…
Evidence-Backed Video Question Answering
This paper introduces E-VQA, a new task that requires Video LLMs to provide not just answers but also precise spatio-temporal evidence (temporal segments and object masks) to support their responses. The core contribution is the creation of the ST-Evidence benchmark and a large-scale instruction dataset to train models…
HCRMap: Pressure-Aware Hot-Expert Residency Mapping for 3.5D MoE Chiplet Inference
HCRMap addresses the challenge of imbalanced expert usage in Mixture-of-Experts (MoE) models on 3.5D chiplet systems. Its core method dynamically manages expert replicas by considering expert hotness, costs, and resource pressure to decide which experts to promote, retain, demote, or evict. The contribution is a pressu…