From the arXiv
Thursday, 3 September 2026 · 20 papers
Bilevel Coordinated Reflection: A Game-Theoretic Approach to Multi-Agent LLM Systems
This paper models multi-agent LLM systems as a bilevel coordination game, where the orchestrator and workers engage in strategic interaction. The core contribution is a game-theoretic framework that unifies coordination, memory improvement via reflection, and the necessity of external verification. It analyzes reflecti…
Competitive Market Behavior of LLMs
This paper investigates if Large Language Models (LLMs) can effectively participate in human-designed market mechanisms. By replicating economic experiments with LLM agents in a double auction, the study finds that LLM-populated markets converge slower or not at all to equilibrium compared to human markets, leading to …
Diagnosing with Insights: Structured Analysis of Agent Failures via Behavioral Abstractions
This paper introduces AGENTSCOPE, a neuro-symbolic method for diagnosing LLM agent failures. It addresses the complexity of agent trajectories by abstracting behavior into structured representations and using "neural invariants" to define expected properties. AGENTSCOPE then employs LLM-guided reasoning on these struct…
SafeEvolve: Harness-Policy Co-Evolution from Agent Experience for Safety Alignment
SafeEvolve proposes a novel framework for LLM agent safety by co-evolving the agent's harness and policy based on its experience. It uses trajectory-level safety evidence to iteratively update the harness (safety prompts and skills) and fine-tune the agent's policy, creating a self-improving system that bridges runtime…
Cliff: Learning Process Rewards from the First Mistake
Cliff proposes a reward shaping strategy for Reinforcement Learning from Verifiable Rewards (RLVR) that addresses the limited guidance of coarse outcome rewards. It leverages an off-the-shelf LLM to identify the *first mistake* in a reasoning process. This mistake effectively splits the rollout into a correct prefix an…
When Decodability Is Not Enough: Logical Validity Representations, Behavioral Dissociation, and Causal Tests in Language Models
This paper investigates whether language models truly understand logical validity, not just by their answers, but by examining their internal representations. The core method involves creating matched pairs of logically valid and invalid statements and testing if this validity can be decoded from the model's hidden sta…
When Persona Attributes Improve Population Alignment in Large Language Models
This paper investigates how to effectively use "persona prompting" to make Large Language Models (LLMs) better predict human survey responses. The core method involves using textual descriptions of individuals (personas) with various attributes to guide LLMs. The main contribution is to explore how different ways of se…
CivBench: A Long-Horizon Benchmark for Tool-Mediated Agents in Civilization VI
CivBench is a new benchmark designed to evaluate language model agents in complex, long-horizon tasks like the game Civilization VI. It uses a novel "Model Context Protocol" to expose a vast action space and over 300 turns, requiring agents to perform sustained planning and state monitoring. The paper introduces two ke…
Discriminative World Models for Web Agents
This paper introduces a new training objective called "predicted-state matching" for web agents. Instead of simply predicting the next web state, the model is trained to generate representations that can effectively distinguish the true resulting state from those produced by alternative actions. This discriminative cap…
Door-in-the-Face Requests and Refusal Behaviour in Large Language Models
This paper investigates whether the "door-in-the-face" persuasion technique, where a large refused request increases compliance with a smaller one, applies to Large Language Models (LLMs). The core method involves presenting LLMs with a large request, then a smaller, related version, and comparing compliance rates to a…
Learn from Whoever Is Right: Answer-Verified Multi-Teacher Distillation for Multi-Domain LLMs
This paper introduces MT-SDPO, a novel distillation method for unifying LLM capabilities across multiple domains. Instead of relying on domain labels, MT-SDPO dynamically identifies the most suitable "teacher" model for each individual sample, allowing for more accurate and flexible knowledge transfer. This approach im…
Loom: Weaving Diagnostic Strands into Free-Text Consensus via Embedding-Space Reweighting
Loom addresses the challenge of aggregating conflicting free-text diagnostic hypotheses from multiple sources. Its core method projects these hypotheses into an embedding space and uses an iterative reweighting algorithm to find a consensus. This approach allows for a more robust and reliable aggregation than tradition…
Post-Training Language Models for Gold-Medal Performance in Coding Competitions
This paper introduces a specialization pipeline for large language models to excel in competitive programming. Their method combines curated problems, synthetic reasoning, supervised fine-tuning, and reinforcement learning. A key contribution is GenCorrect, a test-time strategy that iteratively generates and refines so…
Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skills
This paper introduces DisCo, an AI agent that distills operational knowledge from GitHub repositories into reusable "skills." The core method involves two distillation approaches: task-agnostic to capture general ML know-how and task-oriented to generate specific skills for a given research problem. DisCo's contributio…
CodePoisonRAG: Knowledge Poisoning Attacks on Retrieval-Augmented Code Generation
CodePoisonRAG is a novel framework for knowledge poisoning attacks against Retrieval-Augmented Code Generation (RACG). It demonstrates that an attacker can transform benign code into a poisoned artifact that injects a specific vulnerability into generated code, even with only black-box access to the RACG system. This w…
Do Tabular Foundation Models Know Physics? Contamination, Units, and the Deterministic Limit
This paper investigates whether tabular foundation models (TFMs) learn physics from data. The core method involves evaluating four TFMs and six baselines on datasets derived from physical equations. The key contribution is demonstrating that while TFMs excel at interpolating physics, their inherent Bayesian structure p…
Debias-SparseGPT: Bias-Aware Pruning for Large Language Models
Debias-SparseGPT is a post-training pruning method that addresses bias amplification in LLMs caused by sparsity. It incorporates representational debiasing by using a second-order term on demographically contrasting inputs. This approach effectively reduces pruning-induced bias while maintaining model performance acros…
EarlyEval: Cheaper Agent Evaluation via Early Outcome Prediction
This paper introduces EarlyEval, a method to significantly reduce the cost of evaluating LLM agents. Instead of running agents to completion, EarlyEval uses lightweight classifiers trained on intermediate agent behavior to predict the final outcome early. This allows evaluation to be halted prematurely when the outcome…
PragAlign: Feedback-Guided Pragmatic Alignment for Controlled Synthetic Dialogue Generation
PragAlign is a feedback-guided framework for generating synthetic dialogues that align with specific communicative intents, emotions, and service contexts. It employs a generate-evaluate-revise loop where an LLM evaluator assesses dialogue quality and provides targeted feedback for refinement. This approach significant…
User Feedback Provides a Unique Signal that LLMs Can not Detect
This paper argues that user feedback is a valuable, yet underutilized, signal for improving LLMs. The core method involves comparing model revisions made with and without feedback on both synthetic and naturalistic data. The key contribution is demonstrating that feedback-informed revisions significantly outperform bas…