New Alibaba method cuts AI search training costs by 88%

Alibaba Group has introduced a new method for training AI models for search, which it claims could reduce costs by nearly 90%.

The technique, named ZeroSearch, was outlined in a research paper published last week.

ZeroSearch enables AI models to replicate search capabilities without relying on external search engines.

Instead, pre-trained models utilize large knowledge bases to train other AI models, minimizing the need for costly commercial search infrastructures.

Alibaba claims it can cut training costs from US$586.70 to just US$70.80.

This approach could help smaller teams train AI more affordably.

🔗 Source: South China Morning Post

🧠 Food for thought

1️⃣ Cost optimization emerges as the new battleground in AI development

Alibaba’s ZeroSearch breakthrough comes at a time when AI training costs are reaching unsustainable levels for many organizations and developers.

Training cutting-edge AI models requires enormous resources, with Google’s Gemini Ultra costing approximately $191 million and OpenAI’s GPT-4 costing $78 million to train 1.

This cost barrier has spurred a broader industry shift toward finding efficiencies, with Alibaba’s 88% cost reduction representing one of the most significant breakthroughs in this area.

The environmental impact of AI training also drives this push for efficiency, as traditional training methods for large models can emit over 626,000 pounds of CO2 equivalent, nearly five times the lifetime emissions of an average American car 2.

Beyond cost savings, these efficiency innovations are critical for expanding AI accessibility, as the industry increasingly recognizes that prohibitive development expenses limit innovation and market growth.

2️⃣ Alibaba strengthens its competitive position in the global AI cloud services market

ZeroSearch represents a strategic move by Alibaba in the highly competitive cloud AI services market, where AWS currently leads with 31% market share, followed by Microsoft Azure (20%), while Google Cloud and Alibaba Cloud each hold approximately 6% 3.