Scaling Properties of Continuous Diffusion Spoken Language Models

Apple researchers are investigating continuous diffusion models as an alternative to discrete autoregressive approaches for spoken language modeling. By bypassing the need to convert audio into discrete tokens, this method aims to reduce the computational bottlenecks and data requirements currently hindering the performance of speech-only models.