Tired of ads? Enjoy an ad-free experience by signing up.
👩‍🍳 How we use AI at Tech in Asia, thoughtfully and responsibly.
🧔‍♂️ A friendly human may check it before it goes live. More news here

AWS Lambda adds GPU support for serverless inference

Amazon Web Services (AWS), the cloud computing arm of Amazon, said AWS Lambda now supports GPU-backed functions on Amazon Elastic Compute Cloud (EC2) G-series instances through Lambda Managed Instances.

The update lets developers run inference, media processing, rendering, and scientific computing workloads in container images without managing servers.

AWS said the feature targets workloads that need GPU acceleration but are often built on self-managed infrastructure.

The company added that it is optimized for inference rather than model training, and remains compatible with existing Lambda event sources and orchestration tools.

The feature is generally available. Pricing combines the underlying EC2 instance cost, a 9.75% management fee for GPU instances, and Lambda’s standard request charge.

The launch comes as cloud providers expand serverless GPU options.

Google Cloud said its Cloud Run GPU offering is generally available, and its documentation shows managed container services can use GPUs.

🔗 Source: AWS Blog

Recent Amazon Web Services developments

Stay ahead in Asia’s tech landscape

You've reached your 2 free content limit for the month. Sign up for free to read the full story.

🏄 For casual readers / 👶 Free

Basic

US$0

Free forever

Get instant access to this article and more every month

0 premium content

Unlimited news briefs

5

5 articles

Ad-free reading experience

Just US$0 per day

⌛Sign up in 20s. No payment details needed.

📖 For learners / 👍 Starter

Lite

US$4.92/month

Billed annually at US$59/year

Get instant access to this article and more every month

4

4 premium content

Unlimited news briefs & articles

Ad-free reading experience

Just US$0.17 per day

Cancel anytime

Our subscriber community includes professionals from these companies: