← Back to Model Beat
Models·3d ago·all news from October 15, 2026

llama.cpp v0.7.0

## Overview llama.cpp v0.7.0 adds the LiliCorr speculative decoding technique and MTP for GLM5-Next, a new GPU cache for MoE experts kept in host memory (, up to ~2.2x decode speedup when experts are offloaded), and a large batch of new models: K2 Horizon (dense and MoVA), Prism Bonsai 2 27B, EmbeddingGemma-2 (text+vision+audio), the LiquidAI d1/d1-omni and vLLM decision 2/d3 decision models, pplx-decider, MiniCPM-V 4.7, Nemotron Super 3.5 VL / Nemotron Bolt and maion-coder. The server gets a refactored chat session API (, part-based formatted output), much better slot and prompt-cache restore behavior, decision-model support for the new architectures and a new default port (9931), the web UI gains a full models manager, and ggml is updated to v0.27.0. ### Highlights - New GPU cache for host-memory MoE experts (): experts run on the GPU from an LRU cache, up to 2.2x faster decode [#29887](https://github.com/ggml-org/llama.cpp/pull/29887) - The expert cache is…

Covered by 1 source

Related stories

ModelsGemini 4 Argon: Built to solve your hardest problemsOct 13 · 11 sourcesModelsDeepseek V4.1 Flash 1017 beats larger rivals in agentic tasks while once again massively cutting per-task costsOct 16 · 14 sourcesModelsMeta Releases Open AI Model While Keeping Its Best Tech ClosedOct 15 · 9 sourcesModelsAlibaba Unveils $450 AI Glasses in Expanding Push Into GadgetsOct 13 · 21 sources