Hot French startup ZML releases free product to speed inference across lots of AI chips

French startup ZML has released an open-source software tool called ZML/LLMD designed to accelerate AI model inference across a variety of hardware architectures. By optimizing how models run on diverse chips, the software aims to lower the computational costs associated with deploying large language models.