From the arXiv
Thursday, 23 July 2026 · 20 papers
PoTRE: Test-Time Reasoning inspired by Cognitive Heterogeneity
PoTRE is a novel framework that enhances LLM reasoning by employing a heterogeneous ensemble of four specialized agents: adversarial refinement, hierarchical planning, spectrum search, and direct chaining. These agents' diverse perspectives are dynamically integrated by a task-adaptive aggregation layer to produce robu…
PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning
PRO-LONG introduces a programmatic memory framework for LLM agents to tackle long-horizon reasoning tasks. It addresses the challenge of context management by maintaining a complete, structured interaction log and leveraging recent advancements to efficiently retrieve relevant information, overcoming the trade-off betw…
Reinforcement Learning for Large Language Model Selective Evidence Adoption from Contaminated Retrieval Results
This paper addresses the challenge of Large Language Models (LLMs) selectively adopting evidence from potentially contaminated retrieval results. Their core method involves post-training LLMs using Reinforcement Learning with Direct Preference Optimization (DAPO) and novel reward signals (rule-based or semantic judge) …
Sound Probabilistic Safety Bounds for Large Language Models
This paper introduces a framework for calculating rigorous probabilistic safety bounds for Large Language Models (LLMs), ensuring they don't generate harmful content. Their core method applies Clopper-Pearson confidence intervals and a novel algorithm that uses latent space features to efficiently explore generation pa…
LKValues: Aligning Large Language Models with Sri Lankan Societal Values
This paper introduces LKValues, a novel resource suite to address the Western bias in Large Language Model (LLM) value alignment. It contributes a survey-grounded set of 40 Sri Lankan societal values, an instruction corpus (LKvaluesIT) in Sinhala and English, and an evaluation benchmark (LKvaluesBench) to enable cultur…
Notes to Self: Can LLMs Benefit from Experiential Abstractions?
This paper investigates if Large Language Models (LLMs) can improve their problem-solving abilities by learning from their own past experiences, similar to how humans create reusable strategies. The core method involves extracting natural-language "experiential abstractions" from LLM solution traces and then using thes…
Solar Open 2 Technical Report
Solar Open 2 is a 250B-parameter Mixture-of-Experts model designed for long-horizon agentic tasks. Its core innovation is a novel 1M-token attention mechanism that interleaves softmax and linear attention layers without positional encoding, enabling it to process entire agent trajectories. The paper also details effici…
Co-Evolving LLM Evaluators and Policies via DynamicRubric
This paper addresses the challenge of improving large language models (LLMs) when evaluator feedback on similar quality responses becomes less informative. The core method, DynamicRubric, proposes a novel co-evolutionary framework where evaluators and policies improve together. It generates dynamic, weighted rubric ite…
Statistical Inference for Rank Allocation in Low-Rank Adaptation
This paper introduces StatLoRA, a novel method for allocating rank in Low-Rank Adaptation (LoRA) for large language models. Instead of relying on heuristic importance scores, StatLoRA frames rank allocation as a statistical hypothesis testing problem. It uses estimated p-values derived from a central limit theory to st…
Gotta Catch them all: the modes of Sycophancy
This paper challenges the view of sycophancy in LLMs as a single behavior. It identifies three distinct modes of sycophancy that, while producing similar outputs, have separable internal representations and emerge at different processing stages. This work contributes by demonstrating that sycophancy is a structured phe…
OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skills
This paper introduces OpenSkillRisk, a benchmark designed to evaluate the safety of LLM agents when using third-party skills. The core method involves systematically testing agents against 263 risky skills, categorized by threat type, within a controlled sandbox environment. The main contribution is a comprehensive and…
PyroDash: Cost-Efficient Token-Level Small-Large Language Model Collaborative Inference
PyroDash enables cost-efficient inference by having a small language model (SLM) decide when to request help from a larger language model (LLM) for specific tokens. This collaborative approach, managed by a "Collaborate Engine," allows the SLM to handle simpler tasks and offload complex ones to the LLM with a single ha…
Understanding the Impact of Linguistic Realization Choices on LLM Stance with Causal Tracing
This paper investigates how different linguistic constructions, beyond just word choice, influence Large Language Model (LLM) political stance judgments. Using activation patching, it causally traces these shifts within the model, demonstrating that even meaning-preserving rewrites can alter LLM decisions and identifyi…
Which Values Do LLMs Confuse? A Schwartz-Based Recognition Study
This paper investigates whether Large Language Models (LLMs) can accurately identify specific values in given situations, using Schwartz's ten basic values as a framework. The core method involves a controlled top-1 recognition task on Russian situational texts, evaluating 21 LLM runs. The key contribution is the findi…
Closing the Lab-to-Store Gap: A Data-Efficient Post-Training and Experience-Driven Learning VLA Framework for Retail Humanoids
This paper introduces DEED, a framework to improve the real-world performance of humanoid robots in tasks like restocking shelves. DEED achieves this through efficient post-training techniques and experience-driven learning, addressing challenges like errors and environmental changes. Its core contribution lies in a sy…
EvoDRC: A Self-Evolving Agentic Framework for Automated DRC Violation Repair
EvoDRC is a novel framework that automates the repair of design rule violations (DRVs) in advanced chip layouts. It achieves this by employing a self-evolving agentic system where Large Language Model (LLM) agents learn and refine repair "skills" based on past repair experiences. This approach significantly reduces the…
Reading and Steering Representations of Materials-Science Mechanisms in an Open-Weight Language Model
This paper develops methods to understand how a large language model represents materials science knowledge. They demonstrate that concepts are readable in individual hidden states, relationships between concepts are encoded in transformations between states, and these internal representations can causally influence th…
Self-supervision drives representational convergence in medical foundation models more than clinical supervision
This paper investigates how medical foundation models develop shared representations. It finds that **self-supervised learning, not clinical supervision, is the primary driver of representational convergence** in medical image encoders. This convergence, while modest, suggests that self-supervision is more effective at…
Small, Free, and Effective: Orchestrating Open-Weight Small Language Models to Outperform Single LLM for Malware Analysis
This paper proposes orchestrating multiple small, open-weight language models (SLMs) to achieve superior performance in malware analysis compared to single large language models (LLMs). The core method involves designing and evaluating different multi-agent architectures to effectively combine the capabilities of these…
The Ethics of Autonomous AI Agents for Offensive Security
This paper argues that LLM-driven autonomous AI agents for offensive security introduce three key ethical challenges: **indeterminacy in actions, impact, and user population.** This indeterminacy, stemming from non-deterministic policies and opaque LLM supply chains, makes attribution difficult and lowers the skill bar…