Tired of ads? Enjoy an ad-free experience by signing up.
👩‍🍳 How we use AI at Tech in Asia, thoughtfully and responsibly.
🧔‍♂️ A friendly human may check it before it goes live. More news here

Nvidia helps develop DeepSeek model: US lawmaker

US lawmaker claims Nvidia provided technical support to Chinese AI startup DeepSeek, despite export controls.

Representative John Moolenaar said Nvidia helped DeepSeek optimize its R1 AI model using H800 processors through joint algorithm, framework, and hardware development.

He argued this support allowed DeepSeek to achieve advanced performance, undermining US export restrictions on high-end chips.

Nvidia reportedly facilitated DeepSeek’s model training with minimal GPU hours, despite the chips being classified as restricted.

Moolenaar called for stricter enforcement of export conditions for Nvidia’s H200 chips, citing concerns over DeepSeek’s alleged connections to China’s military and the Chinese Communist Party.

Nvidia rejected the accusations, saying China has sufficient domestic chips for military use and that US technology is not relied on by Chinese military sectors.

🔗 Source: Bloomberg

🧠 Food for thought

Implications, context, and why it matters.

The line between routine customer support and prohibited export-control circumvention remains unclear

  • An allegation was made by Representative John Moolenaar that technical support was provided by Nvidia, including an “optimized co-design of algorithms, frameworks and hardware” for running H800 processors with DeepSeek’s R1 model.
  • The exact wording of US export rules that separate allowed technical assistance from prohibited export-control circumvention would be required to judge that claim.
  • H800 processors were permitted for sale to Chinese customers until October 2023, while specific license terms and end-use restrictions for exporting H800 chips were not specified.
  • Without those rules and license details, it cannot be determined from these facts alone whether the reported work conflicted with US policy or fit within support for legally obtained H800 hardware.

Software optimization can improve AI model inference efficiency

  • DeepSeek’s reported “near-frontier performance” from “deprecated” H800 chips suggests that software and system tuning can raise hardware utilization.
  • Teams running existing GPU fleets can cut inference spend using serving methods like continuous (in-flight) batching to keep GPUs busy 1.
  • Quantization can shrink memory use and may improve throughput, depending on the workload and the hardware 1.
  • This leaves room for vendors to turn new research into products, including sparse-attention approaches for long-context serving 2 plus scheduling and routing techniques at the system level 1.

Recent Nvidia developments

Stay ahead in Asia’s tech landscape

You've reached your 2 free content limit for the month. Sign up for free to read the full story.

🏄 For casual readers / 👶 Free

Basic

US$0

Free forever

Get instant access to this article and more every month

0 premium content

Unlimited news briefs

5

5 articles

Ad-free reading experience

Just US$0 per day

⌛Sign up in 20s. No payment details needed.

📖 For learners / 👍 Starter

Lite

US$4.92/month

Billed annually at US$59/year

Get instant access to this article and more every month

4

4 premium content

Unlimited news briefs & articles

Ad-free reading experience

Just US$0.17 per day

Cancel anytime

Our subscriber community includes professionals from these companies:

Stay updated on the go with our mobile app.

Get latest insights with smoother, more personalized experience through TIA mobile app.