Futureverse, an AI and metaverse technology company with one of the largest digital collecting communities in the space, published its first research paper introducing a new infrastructure model to democratize high-end music quality by combining musical composition with artificial intelligence (AI).
The research paper, JEN 1: TEXT-GUIDED UNIVERSAL MUSIC GENERATION WITH OMNIDIRECTIONAL DIFFUSION MODELS,” was written by members of the Futureverse Altered State Machine innovation team and delves into the intricacies of today’s audio generation.
JEN 1, according to the press release now being shared with nft, is a “high fidelity” sound synthesis model for “text-to-music generation” – combining musical compositions and free text prompts to produce higher quality sound output.
The advancement of AI, as we have experienced it so far in 2023, has already made significant progress with image and text. However, when it comes to producing authentic and realistic music — that’s not stealing the image and likeness of an artist’s voice, lyrics, or melodies — there are still several challenges, which Futureverse’s research paper at the come in order.
The research underlines the complexity of sound generation within musical compositions. Unlike speech, music requires higher sampling rates to capture the nuances, requiring a more sophisticated training process. With AI, improved data processing during training requires high-quality audio that also takes into account the interplay of multiple instruments and intricate melodic structures.
Meet JEN 1
Jen is spelled JEN because she was designed to be your girlfriend who goes into the studio with you. She’s a tool,” said Futureverse co-founder Shara Senderoff in an exclusive interview and first look with Billboard.
JEN 1 is expected to be released in early 2024 and can create songs up to three minutes long and help producers with half-written songs by offering continuation and in-painting. It can generate text-driven music, paint in music, and progress, while generating high-fidelity 48kHz stereo sound – and maintaining computational efficiency.
During the initial testing phases, JEN 1 underwent rigorous evaluation against state-of-the-art models, with both computational statistics and human assessments conducted by an esteemed advisory board of music industry experts, according to the company.
The results?
JEN 1 is superior in producing higher quality music with an average score of 85.7/100 compared to current industry methods of 83.8/100. The company has also released early audio demos that demonstrate JEN 1’s capabilities.
“Human sensitivity to musical dissonance requires high precision in music generation,” said Senderoff and co-founder Aaron McDonald, who have been working in deep space for the past two years.
Before launching Futureverse, Senderoff co-founded the music tech venture fund, Raised In Space, with music industry titan Scooter Braun, which helped drive innovation in music copyrights, royalties and revenue streams by leveraging blockchain technology and Web3.
McDonald, who spent 20 years in technology as an engineer, product developer and investor with portfolios in excess of $1 billion, focuses on enabling developers and users to create and consume interoperable content built specifically within metaverse applications.
This research paper appears to be the first step in tastefully applying AI to an industry-wide barrier.
Launch of Born Ready, a $50 million investment fund and studio
Last week, Futureverse announced its new $50 million venture capital fund and studio, Born ready, following the recently announced $54 million Series A funding round led by 10T Holdings, which included contributions from Ripple Labs. It has already integrated 11 metaverse infrastructure and content companies into one collaborative ecosystem, delivering the essential components needed to build a metaverse application.
Over the past year, the company has formed strategic global partnerships with Wimbledon, FIFA, Authentic Brands Group (ABG), Mastercard, Death Row Records, Snoop Dogg, Keanu Reeves, Timbaland and more. The most recent collaboration with the Cool Cats NFT Collection combines the brand’s IP with Futureverse’s advanced technology, as both Senderoff and McDonald join the Cool Cats board of directors.