DeepMind and YouTube have unveiled Lyria, an AI-powered music generation model, and Dream Track, a revolutionary toolset designed to create AI-generated music for YouTube Shorts.

Lyria, the brainchild of DeepMind's artificial intelligence research, is an AI model capable of generating melodies, rhythms, and harmonies that rival those created by human composers. Leveraging a massive dataset of music recordings, Lyria is able to comprehend the intricacies of music theory and composition, crafting compositions that are not only technically proficient but also emotionally evocative. The new model will power experimental creativity tools coming to the platform, including:

Dream Track – A voice cloning tool for YouTube shorts. Users provide text inputs of music they want to make with artists and the tool will generate 30-second snippets featuring cloned voices of artists including T-Pain and Charlie Puth.

‍

Music AI tools – A set of tools designed to help artists and producers bolster their creative processes. Users can create new music or instrumental sections from scratch or reimagine existing tracks.

‍

Alongside the launch of Lyria, the Google DeepMind team announced it expanded its AI detection tool SynthID to now cover AI-generated audio, with music generated by Lyria having a watermark embedded directly into the output’s audio waveform. The watermark is designed to be robust and can withstand edits including noise additions, MP3 compression or the track being sped up or slowed down.

‍

The possibilities with these new tools are endless. Creators can  effortlessly craft original backing tracks for their Shorts videos and experiment with innovative musical styles.