Tired of ads? Enjoy an ad-free experience by signing up.
👩‍🍳 How we use AI at Tech in Asia, thoughtfully and responsibly.
🧔‍♂️ A friendly human may check it before it goes live. More news here

Singapore pushes new global AI testing standard

Singapore’s Infocomm Media Development Authority and Enterprise Singapore have proposed a new international standard for testing generative AI systems.

The proposal will be discussed at the an ISO meeting in Singapore, the first time held in ASEAN, bringing more than 35 national bodies and 250 AI experts.

The draft builds on Singapore’s earlier AI testing efforts including AI Verify and a starter kit for large language model applications.

The government is also hosting workshops on AI standards and policy alongside the meeting.

🔗 Source: Enterprise Singapore

🧠 Food for thought

Implications, context, and why it matters.

Singapore’s AI standards plan builds on years of joint work

  • Singapore’s proposal builds on years of public work with global tech companies 1.
  • The AI Verify Foundation, a Singapore-backed group, supported that effort. It builds open-source tools for AI testing and governance. Premier members include IMDA, Google, Microsoft, and IBM 2.
  • Its tools include the AI Verify toolkit for AI governance testing, plus Project Moonshot. Project Moonshot mixes benchmarking with red teaming, which sit at the center of the proposed standard 2.
  • The foundation and IMDA ran a Global AI Assurance Pilot with more than 30 organizations. They also launched the Global AI Assurance Sandbox, which links companies using generative AI applications with specialist testers. Both efforts are meant to inform future standards for technical testing of generative AI applications 3, 4.

The standard could influence AI rules and grow assurance services

  • The proposed standard is meant to sit alongside ISO/IEC 42001, the international standard for AI management systems 5.
  • Standards like this may help define the state of the art for meeting rules such as the European Union’s AI Act and California’s SB-53, a proposed state bill on AI safety and oversight 6.
  • It offers a qualitative framework with clear objectives for reviewing prompt-based text-to-text systems that use generative AI. It also covers quality traits such as safety, with methods such as red teaming 7.
  • This could help grow a market for AI assurance services, where specialist firms may help companies apply and check themselves against new global benchmarks 3.

Stay ahead in Asia’s tech landscape

You've reached your 2 free content limit for the month. Sign up for free to read the full story.

🏄 For casual readers / 👶 Free

Basic

US$0

Free forever

Get instant access to this article and more every month

0 premium content

Unlimited news briefs

5

5 articles

Ad-free reading experience

Just US$0 per day

⌛Sign up in 20s. No payment details needed.

📖 For learners / 👍 Starter

Lite

US$4.92/month

Billed annually at US$59/year

Get instant access to this article and more every month

4

4 premium content

Unlimited news briefs & articles

Ad-free reading experience

Just US$0.17 per day

Cancel anytime

Our subscriber community includes professionals from these companies:

Stay updated on the go with our mobile app.

Get latest insights with smoother, more personalized experience through TIA mobile app.