OpenAI said to develop AI tool for music from text, audio

OpenAI is developing a generative music tool that can create music from text and audio prompts.

The tool could be used for tasks like adding music to videos or guitar tracks to vocals.

It’s unclear when OpenAI plans to release it, or if it will be a standalone product or integrated into existing apps such as ChatGPT or Sora.

A source said OpenAI is working with Juilliard School students to annotate music scores for training data.

The company previously launched generative music models before ChatGPT, but its recent audio efforts have focused on text-to-speech and speech-to-text.

Other tech firms, including Google and Suno, are also developing generative music tools.

🔗 Source: TechCrunch

🧠 Food for thought

Implications, context, and why it matters.

Legal clarity will decide whether OpenAI’s generative music tool works for enterprises

OpenAI has not confirmed licenses with major labels and publishers. Spotify works with Sony Music, Universal Music Group, and Warner Music Group, with plans to license their catalogs 1.
Without licenses, enterprises that use AI music face legal risk. GEMA, Germany’s performance rights organization, is suing OpenAI in Munich Regional Court for unlicensed use of song lyrics in ChatGPT training 2.
The Recording Industry Association of America sued Suno and Udio, targeting unauthorized training data use 3.
If OpenAI repeats Sora’s opt-out training approach, it invites the backlash that later forced a policy reversal 4.

Build copyright compliance for faster adoption of generative music

AI model developers and music-creation platforms should build neural fingerprinting tools like SoundPatrol 4. The software uses machine learning to find similarities in melody and harmony. It also checks rhythm and structure to flag derivative works.
Music-distribution platforms and audio tooling providers can provide watermarking that embeds inaudible metadata 5. It supports authorship checks and royalty tracking. Digimarc says it scales 5.
Commercial insurers need to create indemnity products for enterprises that use AI music. Policies need to cover copyright claims that hit platforms like Deezer, which gets about 20,000 AI track uploads each day, with roughly 70% of streams of that AI music linked to fraudulent activity 6.