Zoho, an Indian SaaS company, has announced the development of large language models (LLMs) focused on Indian languages. The company is working with IITs, AI4Bharat, and data collection firms like Karya to create high-quality datasets.

Challenges include mixed-language data and different tokenization needs.

AI4Bharat has curated datasets, and Zoho is training its models using these along with its own data collection efforts.

A general LLM with 7 billion and 13 billion parameters will be released this year, while the Indic language model has no specified timeline.

Zoho is also leveraging generative AI for specialized IT applications, including anomaly detection and security algorithms. The company has implemented over 80 AI algorithms and handles over 5 billion API calls monthly through ManageEngine.

Zoho aims to optimize models for accuracy and responsiveness, especially for consumer-facing applications, while staying agile in the evolving AI landscape.

Recent Zoho developments