Google Open-Sources TPU Sync for KV Cache and Weight Transfer on TPUs

Google has released the source code for TPU Sync, a C++ library designed to manage the movement of model weights and KV cache blocks across hardware components. By facilitating data transfers between TPU high-bandwidth memory, host memory, and network storage, the tool aims to streamline memory management for large-scale machine learning workloads on Google infrastructure.