Tired of ads? Enjoy an ad-free experience by signing up.
👩‍🍳 How we use AI at Tech in Asia, thoughtfully and responsibly.
🧔‍♂️ A friendly human may check it before it goes live. More news here

Apple co-founder joins 850 people urging AI superintelligence pause

Over 850 people, including Apple co-founder Steve Wozniak and Virgin Group founder Richard Branson, have signed a statement urging a halt to the development of superintelligence, AI that could surpass human intelligence, until there is strong public support and a scientific consensus that it can be built and controlled safely.

The statement, published on October 22, also includes prominent AI researchers such as Yoshua Bengio, Geoff Hinton, and Stuart Russell.

Signatories warn that unchecked superintelligence could bring economic obsolescence, disempowerment, losses of freedom, dignity, and control, national security risks, and even possible human extinction.

They call for a ban on superintelligence projects until there is strong public support for the technology and a scientific consensus that it can be built and controlled safely.

Supporters include tech leaders, academics, religious figures, media personalities, and former US politicians and officials like Susan Rice and Mike Mullen.

A recent survey cited by the statement found only 5% of US adults support fast, unregulated superintelligence development, while most want robust regulation and believe superhuman AI should not be created until proven safe or controllable.

🔗 Source: CNBC

🧠 Food for thought

Implications, context, and why it matters.

Frontier AI regulation is moving from theory to practice, with California’s SB 53 setting compliance baselines that may become federal standards

  • SB 53, effective January 2026, is the first U.S. state rule for “frontier AI models” (the most advanced systems trained with exceptionally large computational budgets) defined by a compute threshold above 10^26 floating point operations (FLOPs). As of 2025, analysts see only a few models at this level, and one forecast expects around 10 by 2026. It requires transparency reports, safety frameworks, and incident reporting within 15 days 1.
  • Regulators may accept forthcoming federal laws, regulations, or guidance as meeting state rules even without formal preemption. That creates a form of “cooperative AI federalism” (state alignment with federal policy to reduce compliance fragmentation) which could let SB 53 shape national practice 2.
  • OpenAI, Meta, and Google opposed the bill over innovation concerns. The scope targets large developers with revenues over 500 million, and it leaves out kill-switch mandates (forced shutdown mechanisms) or third-party audits, which sets a middle path between accelerationists and safetyists 2.

The superintelligence safety debate creates market opportunities for third-party AI assurance and compliance service providers

  • SB 53 directs large frontier developers to publish a frontier AI framework with mitigation and testing methods, including third-party evaluations by independent assessors. At deployment they must publish transparency reports that describe risk assessments and the role of any third-party evaluators, which creates demand for independent evaluators 1.
  • The Future of Life Institute (a nonprofit focused on risks from advanced technologies) 2025 AI Safety Index found that only three of seven leading AI companies ran meaningful tests for dangerous capabilities, with gaps in existential safety planning and external validation. That opens room for specialized safety assessment firms 3.
  • Mindgard, a cybersecurity startup focused on AI assurance, sells autonomous red teaming (adversarial testing) platforms that catch AI-specific threats including prompt injections (malicious inputs that manipulate model behavior) and model inversion (extracting sensitive training data from a model) 4.

Stay ahead in Asia’s tech landscape

You've reached your 2 free content limit for the month. Sign up for free to read the full story.

🏄 For casual readers / 👶 Free

Basic

US$0

Free forever

Get instant access to this article and more every month

0 premium content

Unlimited news briefs

5

5 articles

Ad-free reading experience

Just US$0 per day

⌛Sign up in 20s. No payment details needed.

📖 For learners / 👍 Starter

Lite

US$4.92/month

Billed annually at US$59/year

Get instant access to this article and more every month

4

4 premium content

Unlimited news briefs & articles

Ad-free reading experience

Just US$0.17 per day

Cancel anytime

Our subscriber community includes professionals from these companies:

Stay updated on the go with our mobile app.

Get latest insights with smoother, more personalized experience through TIA mobile app.