Better prompt caching for GPT-6
OpenAI has introduced new prompt caching features for GPT-6, including explicit breakpoints, enhanced diagnostics, and improved hit rates. These updates are designed to lower latency and operational costs for developers by allowing the model to more efficiently reuse previously processed input data.
Covered by 1 source
- OOpenAI Blog↗1d ago