Tired of ads? Enjoy an ad-free experience by signing up.
👩‍🍳 How we use AI at Tech in Asia, thoughtfully and responsibly.
🧔‍♂️ A friendly human may check it before it goes live. More news here

Akamai adds thousands of Nvidia GPUs for AI inference platform

Akamai announced it has acquired thousands of Nvidia Blackwell GPUs to deploy across its global edge network for a distributed AI inference platform aimed at lowering latency and data egress.

The deployment pairs Nvidia RTX PRO 6000 Blackwell Server Edition GPUs and Nvidia BlueField-3 DPUs with Akamai’s network of more than 4,400 locations to route inference workloads locally, Akamai said.

Akamai said the platform will support AI R&D, localized fine-tuning of large language models, and post-training optimization near end users.

Akamai said this GPU rollout expands its inference and generalized compute capacity.

Akamai also said the setup can reduce latency by up to 2.5x and lower AI inference costs by as much as 86% compared with traditional hyperscaler infrastructure.

🔗 Source: Akamai

🧠 Food for thought

Implications, context, and why it matters.

Strong early demand and live media use cases support Akamai’s edge inference push

  • The large GPU acquisition follows a surge in demand for Akamai Inference Cloud about a week after its official debut on stage at NVIDIA GTC in Washington, DC in late October 2025, signaling early interest in its edge-based approach 1.
  • Organizations across industries are running production tests, including latency-sensitive workloads 1.
  • Media company Monks said Akamai Inference Cloud lets it transcode 8K multi-camera feeds, handle virtual reality content, and create AI-powered play summaries in real time at the edge 1.
  • Video technology firm Harmonic said Akamai’s infrastructure could run NVIDIA Blackwell cards at the edge, which would let it run AI models locally for live-stream personalization and other features with faster response times 1.

A new front opens in the cloud wars, centered on the edge

  • Akamai’s move takes on the centralized “AI factory” model of hyperscalers (the biggest cloud providers) with what it calls a “decentralized nervous system” for inference-era workloads 2.
  • Akamai says the industry has hit a tipping point, with AI inference now matching AI training in importance 2.
  • Akamai plans to spread inference-optimized compute across its global network of more than 4,400 locations, shifting competition toward latency and geography alongside processing power 2.
  • Akamai says the architecture targets “physical” and “agentic” AI use cases, including smart grids and surgical robotics, where decisions need real-time execution and centralized data centers can add latency plus data-egress constraints 2.

Stay ahead in Asia’s tech landscape

You've reached your 2 free content limit for the month. Sign up for free to read the full story.

🏄 For casual readers / 👶 Free

Basic

US$0

Free forever

Get instant access to this article and more every month

0 premium content

Unlimited news briefs

5

5 articles

Ad-free reading experience

Just US$0 per day

⌛Sign up in 20s. No payment details needed.

📖 For learners / 👍 Starter

Lite

US$4.92/month

Billed annually at US$59/year

Get instant access to this article and more every month

4

4 premium content

Unlimited news briefs & articles

Ad-free reading experience

Just US$0.17 per day

Cancel anytime

Our subscriber community includes professionals from these companies:

Stay updated on the go with our mobile app.

Get latest insights with smoother, more personalized experience through TIA mobile app.