← Back to Model Beat
Hardware·6h ago·all news from November 22, 2026

AWS Lambda Now Runs GPU Inference with 48 Concurrent Invocations Sharing One Model per GPU

AWS Lambda now supports GPU-accelerated inference by allowing up to 48 concurrent function invocations to share a single model on an EC2 G-series instance. This update utilizes vLLM and SGLang base images, enabling developers to deploy machine learning models without writing custom handler code. By allowing asynchronous timeouts of up to 90 minutes, this change simplifies the deployment of resource-intensive AI workloads within the serverless environment.

Covered by 1 source

Related stories

HardwareRemember the frontier AI pause? Chip companies don’t eitherNov 18HardwareEven His Own Officials Don’t Think Trump’s China Trip Will Lead to Progress on AINov 18 · 3 sourcesHardwareMore than half the electricity feeding America's largest data centers comes from gas and coalNov 18HardwareTencent’s Sales Miss Estimates in Setback for Founder’s AI PushNov 18 · 3 sources