Cursor Open-Sources Mixture-of-Kittens (MoK): A Deterministic MoE Training Megakernel for GB300 NVL72 Racks
Cursor Research has released the source code for Mixture-of-Kittens (MoK), a training kernel designed for mixture-of-experts models. By consolidating communication and computation into a single deterministic process, this tool improves performance by up to 2.37 times over existing public benchmarks when used on GB300 NVL72 hardware.
Covered by 1 source
- MMarkTechPost↗Asif RazzaqAug 4