Together AI Releases Together Compiler: Agents Make Inference Up to 2.6x Faster

Together AI has released Together Compiler, a tool that uses automated agents to continuously re-optimize model inference based on changing traffic patterns. By dynamically adjusting the inference forward pass, the system has demonstrated performance gains of up to 2.6 times the throughput of previous InferenceX configurations.