From the arXiv
Tuesday, 1 September 2026 · 20 papers
Reconciling Process Supervision with Outcome-Based Credit in Agentic Policy Optimization
This paper introduces TASPO, a method to bridge the gap between outcome-based credit and process supervision in reinforcement learning for language agents. TASPO converts privileged training information into actionable credit for individual decisions, ensuring that each action is appropriately rewarded based on its con…
Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence
This paper proposes a method for scaling large reasoning models (LRMs) beyond human supervision by gradually reducing reliance on direct human feedback. The core idea is to transition from human judgments to automated verifiers and self-generated learning curricula, enabling LRMs to improve autonomously in complex, ope…
Stick to What You Know: A Study of Knowledge-Aligned Supervised Fine-Tuning
This paper proposes "knowledge-aligned SFT" to reduce hallucinations in language models by ensuring fine-tuning targets are consistent with the model's existing knowledge. The authors introduce new methods like "Recall Rewrite" which only keeps claims the model can reliably recall, demonstrating significant improvement…
A Model with No Head and Many Thoughts
This paper introduces Soft Latent Thinking, a method that replaces the computationally expensive LM head during reasoning with a lightweight projector. This allows reasoning to occur in continuous embedding space, avoiding discrete tokenization at each step. The contribution is improved reasoning performance (higher pa…
Low-Resource Preference Adaptation of LLMs via Activation-Based Label Propagation
This paper proposes a method to adapt Large Language Models (LLMs) to user preferences with minimal labeled data. It leverages the observation that LLM activations for preferred and rejected responses form distinct clusters, even in pre-trained models. By training a lightweight probe on a small set of labeled preferenc…
S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement?
This paper introduces S3Gym, a benchmark designed to evaluate if Large Language Models (LLMs) can improve themselves. S3Gym tests LLMs' abilities in self-testing, self-judging, and self-improvement through interactive text-based games. The research demonstrates that self-improvement is not an inherent capability and de…
A Universal Context-Reuse Layer for Cross-Model KV Sharing
This paper introduces a "Universal Context-Reuse Layer" that enables KV-cache sharing between different Large Language Models (LLMs), even those with varying architectures or tokenizers. The core method involves translating KV states from a source model to be consumable by a target model, significantly reducing redunda…
HSRM: Hidden-State Reward Models for Test-Time Verification
This paper introduces HSRM, a method for verifying mathematical reasoning generated by large language models. Instead of re-processing the text of candidate solutions, HSRM directly analyzes the internal hidden states of the generator model at each reasoning step. This lightweight approach allows for efficient verifica…
Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agents
This paper introduces AutoSciRub, a novel framework for autonomous research agents. AutoSciRub's core method is to first automatically generate an executable rubric that defines specific, actionable, and verifiable criteria for a given research task. This rubric is then used to guide the agent's research execution, ver…
LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation
This paper introduces LightNav-0, a generalist embodied navigation model that directly leverages the spatial reasoning capabilities of pre-trained Vision-Language Models (VLMs). Its core method involves a unified token interface to represent navigation goals and actions, bypassing task-specific components. The main con…
LOCI: A Locator-Critic with Refinement Loop
LOCI addresses Vision-Language Model (VLM) limitations in complex visual understanding by decoupling visual search from evidence verification. It uses a Locator agent to find relevant image details and a Critic agent to assess their sufficiency, iteratively refining the evidence through a self-correcting loop. This app…
Measure Before You Manage: Evaluating Agent Working Memory in Coding Agents
This paper proposes a method to evaluate agent working memory by considering the semantic differences between memory objects like instructions and tool outputs. The core contribution is demonstrating that these semantic differences lead to distinct retention and compression behaviors, which should inform memory managem…
Token-Efficient Data Reasoning Agents via Adaptive Structuring of Unstructured Data
This paper introduces "agentic data cracking," a method to make LLM agents more cost-efficient for reasoning over unstructured data. Instead of processing entire documents for each query, the agent adaptively structures relevant data on demand, significantly reducing token consumption and computational cost. This appro…
When Does Bigger Help? A Controlled Study of LLM Scale for Ontology Learning
This paper investigates how Large Language Model (LLM) scale impacts ontology learning. Through a controlled study of various Qwen and GPT models, they found that increasing model size, particularly between 9B and 27B parameters, primarily boosts precision in term typing. However, the benefits of scale are not uniform …
Wrong Prediction, Right Answer: Recovering Evidence from Collapsed LLM Sequence Scores
This paper reveals that Large Language Models (LLMs) often fail reasoning tasks not due to a lack of underlying logic, but due to output generation issues. They demonstrate that correct reasoning can be recovered from collapsed sequence scores by using a simple additive correction method, significantly improving accura…
Sycophantic Agreement Transfers with Neutral Data via Contrastive Preference Optimization
This paper reveals that sycophantic agreement, where language models excessively agree with users, can unintentionally emerge from contrastive preference optimization training. The core method involves analyzing how sycophancy transfers from teacher models to student models, demonstrating a strong correlation between t…
Aspire: Can Models Self-Evolve from Vague Goals?
This paper introduces ASPIRE, a benchmark that enables LLMs to self-evolve from vague, natural-language goals rather than predefined tasks. The core method involves an agent that must interpret the goal, identify learning needs, select data and update methods, and create its own evaluation signals. ASPIRE's contributio…
DIASENTINEL: An Auditable Multi-Agent System for Guideline-Grounded Diabetes Risk Screening
DIASENTINEL is a multi-agent system that uses LLMs for diabetes risk screening from EHRs while ensuring reliability and auditability. Its core method involves integrating risk prediction, signal extraction, guideline grounding via Reciprocal Rank Fusion, and a hybrid verification layer. The system's contribution is a p…
Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment
This paper proposes a framework for reproducible ML evaluation that explicitly accounts for human disagreement. Its core method is to move beyond simple consensus aggregation and instead capture diverse human perspectives. The main contribution is a more robust and human-centered approach to AI evaluation and alignment…
You Shouldn't Have Asked: A Pragmatics-Inspired Taxonomy for Evaluating LLM Refusals
This paper introduces a novel taxonomy for evaluating LLM refusals, grounded in pragmatic theory, to assess how well models handle the social cost of saying "no." By analyzing 16 LLMs across 14 harm categories, the study finds that while models' refusals are explicit and morally charged, they primarily use offering alt…