Meta Releases Open-Source AI Tool AudioCraft to Create Music and Audio

Share

Meta Platforms on Wednesday introduced its open-source AI tool called AudioCraft that will help users to create music and audio based on text prompts.

The AI tool is bundled with three models, AudioGen, EnCodec and MusicGen, and works for music, sound, compression and generation, Meta said

MusicGen is trained using company-owned and specifically licensed music, it added.

Artists and industry experts have raised concerns over copyright violations, as machine learning software work by recognizing and replicating patterns from data scraped from the web.

According to the company’s blog post, MusicGen generates music from text prompts, while AudioGen generates audio from text prompts. Meta has also released an improved version of our EnCodec decoder. It helps in generating higher quality music with fewer artifacts. The pre-trained AudioGen models, announced by the company, lets users generate environmental sounds and sound effects.It helps in generating sounds like a dog bark, or sirens from vehicles.

The models will be available for access to researchers and practitioners to train their models with their own datasets. These models are capable of producing high-quality audio with long-term consistency, claims the company. They have been internally developed at Meta over the past years. 

AudioCraft models will act as tools for musicians and sound designers in the future, the company said. The company is also working towards improving the current models and add improvisations based on the users’ feedback.

Earlier this year, Alphabet introduced its own experimental audio generating AI tool called MusicLM.


Samsung launched the Galaxy Z Fold 5 and Galaxy Z Flip 5 alongside the Galaxy Tab S9 series and Galaxy Watch 6 series at its first Galaxy Unpacked event in South Korea. We discuss the company’s new devices and more on the latest episode of Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.
Affiliate links may be automatically generated – see our ethics statement for details.