← Back to Model Beat
4Hardware·Jun 12

When Does Delegation Beat Majority? A Delegation-Based Aggregator for Multi-Sample LLM Inference

arXiv:2606.08098v2 Announce Type: replace Abstract: Majority voting over sampled answers is the dominant unsupervised aggregator for multi-sample LLM inference. In this paper, we show a delegation-based aggregator (Propagational Proxy Voting, PPV; Sakai et al., 2025) yields an unsupervised consensus rule that beats majority on MMLU-Pro by +1.5 pp overall and +2.24 pp on the non-trivial subset (paired McNemar p ~ 1.0e-14, n = 8,099). Majority discards two signals that every sample carries: within-group letter entropy and between-group reasoning geometry. PPV exposes per-voter levers that consume exactly these two signals: When (how much weight a voter keeps on its own pick) and Whom (how it splits the remainder across peers). We drive When with letter entropy and Whom with per-question-centered embedding cosine. Our method needs no gold labels and no auxiliary training: per-question, we partition 128 sampled generations into 16 groups, compute each group's letter-level semantic entropy and reasoning embedding centroid,…

Covered by 1 source

Related stories

HardwareOpenAI Probed by Coalition of State Attorneys GeneralJun 13 · 4 sourcesHardwareAmazon’s data centers used 2.5 billion gallons of water last yearJun 11 · 2 sourcesHardwareThe Next US-China AI Battle Is Over Compute — and China Is Spending BigJun 12HardwareInteraction-Centered Intelligence: Toward an Interaction-Based Theory of Human-AI Co-CreationJun 12