From the arXiv
Monday, 13 July 2026 · 20 papers
A Sovereign, Open-Source Foundation Model for German and English
This paper introduces Soofi S 30B-A3B, a novel open-source Mixture-of-Experts foundation model for German and English. Its hybrid Mamba-Transformer architecture efficiently activates only 3B parameters per token, offering significant throughput advantages for long contexts and high concurrency. Soofi S achieves competi…
Communication-Efficient Digital-Twin Coordination for Heterogeneous LLM Embodied Agents over Computing Power Networks
This paper proposes LDT-Coord, a novel framework for coordinating heterogeneous LLM-powered embodied agents. It utilizes lightweight digital twins to enable communication-efficient coordination by having agents independently select actions and report them, overcoming challenges of high communication overhead, LLM capab…
Fictional Worldbuilding: Multi-Agent LLM Collaboration with Hierarchical Context Compression and Iterative Review
This paper introduces AutoWorldBuilder, a multi-agent LLM system for fictional worldbuilding. Its core method involves a hierarchical context compression technique to manage information growth and an iterative review process with specialized agents to ensure content quality and consistency. The main contribution is a r…
LongMedBench: Benchmarking Medical Agents for Long-Horizon Clinical Decision-Making
This paper introduces LongMedBench, a benchmark designed to evaluate medical AI agents on long-horizon clinical decision-making using real-world electronic health records. Unlike previous benchmarks focusing on short-term tasks, LongMedBench simulates longitudinal patient care, requiring agents to integrate information…
Multimodal Reward Hacking in Reinforcement Learning
This paper investigates "reward hacking" in reinforcement learning for multimodal large language models (MLLMs), where models achieve higher rewards without actually improving task performance. The core method involves introducing the "Newly Rewarded Failure Rate" (NRFR) to quantify failures introduced by RL. The key c…
ProofCouncil: An LLM Agent for Solving Open Mathematical Problems
ProofCouncil is an LLM agent designed to solve open mathematical problems by mimicking real-world mathematical practice through an author-critic architecture. Its core method involves an iterative process where an "author" generates potential solutions and a "critic" evaluates them, leading to improved problem-solving.…
Shared Selective Persistent Memory for Agentic LLM Systems
This paper addresses the context problem in agentic LLM systems by introducing **shared selective persistent memory**. This architecture intelligently identifies and retains reusable context like task specifications and tool configurations, discarding irrelevant session details. The key contribution is enabling collabo…
Mach-Mind-4-Flash Technical Report
Mach-Mind-4-Flash is a 35B-parameter MoE model that achieves competitive performance with larger models through post-training optimization and scalable agentic reinforcement learning. Its core contribution lies in a novel training pipeline that includes an efficient RL/OPD infrastructure, parallel domain-specific exper…
Agora: Enhancing LLM Agent Reasoning Via Auction-Based Task Allocation
Agora enhances LLM agent reasoning by using an auction mechanism to dynamically allocate tasks to expert models and tools. This approach allows agents to bid based on their actual capabilities, ensuring tasks go to the most competent solver and improving cost-efficiency. The paper's contribution lies in this novel ince…
Failure as a Process: An Anatomy of CLI Coding Agent Trajectories
This paper treats LLM coding agent failures not as a single event, but as a dynamic process. Its core method involves analyzing the step-by-step evolution of failures across thousands of execution trajectories. The main contribution is a new framework for understanding how failures emerge, worsen, and become unrecovera…
Geopolitical alignment: Endorsement effects in large language models
This paper investigates whether Large Language Models (LLMs) exhibit geopolitical bias when evaluating policies. The core method involves an endorsement experiment where LLMs rate identical policies described as supported by different geopolitical actors (US, EU, China, Russia). The key contribution is the finding that…
Self-Guided Test-Time Training for Long-Context LLMs
This paper proposes a "Self-Guided Test-Time Training" (SG-TTT) method to improve how Large Language Models (LLMs) utilize long contexts. Instead of expensive full-context adaptation or noisy random sampling, SG-TTT intelligently selects relevant spans within the long input for instance-specific parameter tuning. This …
STEEL: Sparsity-Aware Fused Attention for Energy-Efficient Long-Sequence Inference on AMD's XDNA NPU
This paper introduces STEEL, an open-source implementation of FlashAttention optimized for energy-efficient long-sequence inference on AMD's XDNA NPUs. Its core method is a dataflow formulation of prefill attention that exploits spatial parallelism and on-chip memory, coupled with a sparsity-aware pipeline placement to…
Task-Specific Multimodal Question Answering Agents via Confidence Calibration and Incremental Reasoning for QANTA 2026
This paper introduces a two-agent system for multimodal question answering, tailored for the QANTA 2026 challenge. The "Tossup" agent uses a smaller GPT model with confidence calibration and numeric reasoning to decide when to answer under uncertainty. The "Bonus" agent employs a larger GPT model with lead-in awareness…
TrustX Agent Risk Classification Framework (ARC): Risk-Tiering Internally Created Agentic AI Systems
The TrustX Agent Risk Classification Framework (ARC) addresses the challenge of governing increasingly complex agentic AI systems. Its core method involves a twelve-dimension scoring rubric, combined with classification models and an autonomy framework, to quantify risk. ARC's contribution is a structured, repeatable i…
Super-Tuning: From Activation-Aware Pruning to Sparse Fine-Tuning
This paper introduces Super-Tuning, a novel sparse parameter-efficient fine-tuning (PEFT) method. It leverages activation-weighted magnitude scores from a calibration pass to identify crucial parameters for adaptation, reducing memory and compute costs. The method also proposes Supra, a hybrid adapter combining sparse …
ALICE: Learning a General-Purpose Pathology Foundation Model from Vision, Vision-Language, and Slide-Level Experts
ALICE is a novel foundation model for computational pathology that consolidates expertise from multiple specialized models (vision, vision-language, and slide-level) into a single backbone. It achieves this through a multi-stage agglomerative distillation process, trained on a massive dataset of pathology images. ALICE…
All Explanations are Wrong, But Many Are Useful: Exploring the Rashomon Explanation Set with Large Language Models
This paper challenges the accuracy-explainability trade-off in AI by proposing the "Rashomon Explanation" paradigm. Instead of a single explanation, it generates a set of faithful, prediction-guiding explanations. The proposed RashomonLLM workflow uses Large Language Models to iteratively align explanations with predic…
Evolution of Accuracy and Visual-Cognitive Errors in a Decade of Vision-Language AI Models
This paper introduces the Complex Social Behavior (CSB) dataset to evaluate vision-language models (VLMs) on complex human interactions, moving beyond simpler benchmarks. By analyzing VLMs from 2017-2025 on CSB and MS-COCO, the study tracks accuracy improvements and categorizes visual-cognitive errors, revealing that C…
Practical Source Code Recovery from Binary Functions Using Anchor-Based Retrieval and LLM Reasoning
This paper proposes a practical method for recovering source code from stripped binary functions. It combines reverse engineering with anchor-based retrieval from a source code database, followed by LLM reasoning to re-rank candidate source code snippets. The core contribution is a binary-to-source matching approach th…