OpenAI and Broadcom announce chip designed for LLM inference at scale
OpenAI has partnered with Broadcom to develop a custom chip specifically optimized for running large language models. This move aims to reduce the company's reliance on external hardware providers and improve the efficiency of high-scale inference tasks.
Covered by 1 source
- AArs Technica↗Samuel AxonJun 24