DraftExpert: Expansion-Aware Self-Speculative Decoding for End-Device MoE Inference

Researchers have introduced AngelSpec, a framework designed to improve speculative decoding efficiency for large language models. The method dynamically adapts drafting structures to different real-world workloads, addressing the inconsistency in performance often found when using standard autoregressive multi-token prediction.