Adobe has unveiled Project Music GenAI Control, an innovative AI tool poised to transform music creation and editing. Presented at the Hot Pod Summit in Brooklyn, this groundbreaking prototype allows users to generate music from text descriptions or reference melodies and offers extensive editing capabilities within the same workflow. Users can input text prompts describing desired music styles, such as ‘happy dance’ or ‘sad jazz,’ and the tool generates music accordingly. Furthermore, it facilitates customization of the generated music, including adjustments to tempo, intensity, repeating patterns, and structure. Users can remix sections of music or create repeating loops, catering to various content creation needs like backing tracks or background music for podcasts and animations.
Developed in collaboration with researchers from the University of California and Carnegie Mellon University, Project Music GenAI Control stands out from existing generative music tools by providing a more integrated and user-friendly editing experience. Unlike other tools that necessitate repetitive audio generation or separate audio editing software for modifications, Adobe’s tool enables “pixel-level control” for music, allowing for direct and detailed adjustments to the generated audio.
Adobe underscores its commitment to ethical and legal considerations by training its generative AI tools on licensed or public domain data to sidestep potential intellectual property issues. The company also explores watermarking technology to identify audio produced by Project Music GenAI Control, although implementation and effectiveness details are pending.
While the tool is in the research stage and lacks a user interface, Adobe’s initiative marks a significant stride in AI-powered music creation and editing. It unlocks possibilities for individuals lacking professional audio experience to bring their musical ideas to life and contributes to ongoing discussions about the ethical and legal implications of AI-generated content.
Project Music GenAI Control forms part of Adobe’s broader endeavors to leverage AI in enhancing audio and video creation tools. Other projects like Project Sound Lift illustrate Adobe’s dedication to using AI to address common audio challenges, such as speech separation from background noise and voice recording enhancement. These developments underscore Adobe’s role in advancing AI technology in creative industries, offering tools that streamline and enhance the creative process for professionals and hobbyists alike.
Read more – Microsoft and Mistral AI partnership