Tired of ads? Enjoy an ad-free experience by signing up.
👩‍🍳 How we use AI at Tech in Asia, thoughtfully and responsibly.
🧔‍♂️ A friendly human may check it before it goes live. More news here

DeepSeek’s new AI model gets mixed benchmark results

Chinese AI startup DeepSeek released DeepSeek-V4-Pro-0813 on August 12.

A brief note on its website said the model offered “significantly enhanced agent capabilities,” but that statement had been removed by August 13 afternoon as early developer feedback appeared mixed.

Independent benchmarks also produced mixed results.

On the Artificial Analysis Intelligence Index, the model scored 53, matching GLM-5.2 from Beijing-based AI company Zhipu AI, while trailing the Terra model in OpenAI’s latest GPT-5.6 series by four points and Moonshot AI’s Kimi K3 by seven.
San Francisco-based Vals AI ranked the model 12th on its index.

The company said DeepSeek-V4-Pro-0813 struggled with sandboxed terminal tasks and generating complex financial models in Microsoft Excel, although some researchers said it performed well in cybersecurity tests.

🔗 Source: South China Morning Post

Recent DeepSeek developments

Stay ahead in Asia’s tech landscape

You've reached your 2 free content limit for the month. Sign up for free to read the full story.

🏄 For casual readers / 👶 Free

Basic

US$0

Free forever

Get instant access to this article and more every month

0 premium content

Unlimited news briefs

5

5 articles

Ad-free reading experience

Just US$0 per day

⌛Sign up in 20s. No payment details needed.

📖 For learners / 👍 Starter

Lite

US$4.92/month

Billed annually at US$59/year

Get instant access to this article and more every month

4

4 premium content

Unlimited news briefs & articles

Ad-free reading experience

Just US$0.17 per day

Cancel anytime

Our subscriber community includes professionals from these companies:

Stay updated on the go with our mobile app.

Get latest insights with smoother, more personalized experience through TIA mobile app.