12 ms·
DeepMind releases Lyria 2 music generation model
- mvkel 1y ago"Releases" is a strong word, as in typical google fashion, the actual thing that was released was a waitlist form.
- ifuknowuknow 1y ago[flagged]
- htrp 1y agoOnly available in the US "Country of residence (this current phase of the experiment is only available to users based in the U.S. for now, but feel free to submit interest and stay tuned for updates): "
- modeless 1y agoMusic models are not interesting to me unless I can use them to edit and remix existing music. Of course none of them let you do that to avoid being sued by the labels.
- ipnon 1y agoYes, why are deep learning models so effective relatively at writing code? It's because programmers have been making their work copyleft for decades, and continue to do so.
- whywhywhywhy 1y agoMusics only lagging because of the legal threat of labels, at some point in the near future music models will have their SDXL moment and from then on you'll be able to do all things like style transfer or make something very similar to this but different. Suno and similar are purposefully limiting their models on the public side.
- CamperBob2 1y agoAgreed to some extent, but I don't think you'll have too long to wait before that comes to pass. It can't possibly be that hard to build a model that will disassemble a given song into its original tracks, like a Fourier transform that yields drums, strings, keyboards, and vocals rather than sines and cosines. Equally unlikely that such a model will be too large to run locally. We will get some very cool tools -- and some very cool remixes - when that happens.
- justlikereddit 1y agoThis is called "stem separation" It was added to FL studio in 2023 and I don't think they were the first to do it.
- vhcr 1y agohttps://github.com/deezer/spleeter https://github.com/deezer/spleeter https://github.com/facebookresearch/demucs https://github.com/facebookresearch/demucs
- ipnon 1y agoIt seems to struggle to create music with a strong identity. It is great if you want to make a poor imitation of top 40 hits. But the thing about top 40 type music is that the best music is already in the Top 40. It remains to be seen if there is as strong a demand for a music chart filled with slop as there is demand for a music chart filled with pop tunes by celebrities. I don't think audio files are the right output for deep learning music models. It'd be more useful to pro musicians to describe some parameters for synths, or describe a MIDI baseline, or describe tunings for a plugin and then have the model generate these, which can then be tweaked similar to how we now code with LLMs. But generating muddy, poorly mixed WAVs with purple prose lyrics is only an interesting deep learning demo at this point, not an advancement in music itself.
- krige 1y ago> It is great if you want to make a poor imitation of top 40 hits. generation models in a nutshell
- 999900000999 1y agoI actually built a very crude python app that could generate basic melodies with MIDI. It can serve as a fun starting point if you want to remix common songs. But it wasn't a very fun project to set up. It's like this technology is out there but nobody really wants to develop it. If I had to guess there are already a handful of fake record labels generating at tons of AI slop to just post on Spotify. Even if each song only gets something like two or three views over time they can still generate a modest amount of revenue. Oh wait Spotify has been caught doing that themselves
- navigate8310 1y agoSome of the artists of the top 40 use some form of auto-tune to generate pleasing music. Can that be considered a slop-y?
- CaptainFever 1y agoWell, auto-tune used to be (or still is) considered quite controversial.
- eucryphia 1y agoYou know what the biggest problem with pushing all-things-Al is? Wrong direction. I want Al to do my laundry and dishes so that I can do art and writing, not for Al to do my art and writing so that I can do my laundry and dishes. - Joanna Maciejewska You could add music
- chii 1y agoNothing stops you from doing art and writing, just like nothing is stopping someone today from riding a horse, running a marathon or rowing a boat.
- wavemode 1y agoPresumably, the idea is that AI drives down the cost (and thus, value / career prospects) of art and writing.
- my_username_is_ 1y agoI'm gonna be honest... Very few people are artists for the pay
- thrdbndndn 1y agoI'm not sure how this contradicts what they said. AI would likely lower the number of paid opportunities. Additionally, art requires practice. Sure, some "lower-tier" artists may produce work that AI could replace without anyone noticing. But by removing that step, we risk having fewer truly great artists emerging.
- dist-epoch 1y agoI will also be honest, if you expect to live off your art, you are doing it wrong.
- vkou 1y ago
- moralestapia 1y ago>Waitlist They still haven't learned, wow. Someone in there really wants to drive Google to the ground.
- hiddencost 1y agoLeadership wrote the requirement "launch by X date if you want to get promoted". Rank and file said "absurd". Middle management figured out a way to claim success to leadership while keeping rank and file from quitting.
- ipaddr 1y agoUsually that's the Iceland rollout.
- fallinditch 1y agoI am interested in using AI-driven music composition tools in new ways, and Lyra 2 sounds impressive, but a) so far, using these tools leaves me feeling a little meh, and b) we are in between the before and after times right now, witnessing the transition to the world of AI content and we're definitely losing something. Prompt: Hazy, fractured UK Garage, Bedroom Recording, Distorted and melancholic. Instrumental. A blend of fractured drum patterns, vocal samples that have been manipulated and haunting ambient textures, featuring heavy sub-bass, distorted synths, sparse melodic fragments. https://www.youtube.com/watch?v=cNog4qB-mHQ&t=5s&pp=2AEFkAIB https://www.youtube.com/watch?v=cNog4qB-mHQ&t=5s&pp=2AEFkAIB
- ipaddr 1y agoThe interest in ai music generation is lower than I initially thought. I jumped in but felt the exercise lacked the joy of making music physically or with software like pro tools. With pro tools you control the thousands of knobs which gives you more control. These AI models take away that connection. You can play around with different words to get different results but it's like painting with a shotgun. No one wants to hear other people's ai songs because they lack meaning and novelty. AI image and short video generation can create novelty and interest. But when the medium require more from the person like reading a book or watching a movie the level of AI acceptance goes down. We'll accept an AI generated email or ad copy but not an ai generated playlist and certainly not a deepfake of someone from reality. That's what people want from AI, a blending of real life into a fantasy generator but no one is offering that yet.
- redox99 1y agoAlso image generation, particularly with latest GPT, can be finetuned a lot more than music generation which is nowadays limited to "here's something with those lyrics and genre".
- mindwok 1y agoThe impact of AI on creative fields will be pretty nuanced I feel. I don't think we will end up in a world where everyone is just AI generating the media they want. In some cases we will, for example stuff like lo-fi beats on YouTube are already started to be bulk made by AI because really it's just fancy white noise for people to use to work. Actual music (like what you find on Spotify) I think won't be impacted very much. People strongly identify with the art they consume, and that identity comes from the people who make the art. Those folks might be using AI under the covers for elements of their creative work, but ultimately what people care about is the humanity behind the art. It's the same with film, and traditional art people hang on their walls. We like the actors, the director, the artist, their taste, and who they are. It's why we have celebrities, because we get invested in the people behind the art. Video games I think will be interesting... I feel they will be more susceptible to being accepted as AI generated. I don't think people identify with them as strongly.
- TheAceOfHearts 1y agoI've made a few tracks using Suno to scratch my own itch / desire for music that covers certain themes. The best use of Suno for has been the ease with which you can generate diss tracks: I ask Gemini to make a diss track lyrics related to specific topics, and then I have Suno generate the actual track. It's very cathartic when you're sitting at home in the dark because the power company continues to fail. Anyway, I hope I can get access, I think it would be fun to vibe some new music. Although this UI looks severely limited in what capabilities it provides. Why aren't the people who build these tools innovating more? It would be cool if you could generate a song and then have it split into multiple tracks that you can remix and tweak independently. Maybe a section of track is pretty good but you want to switch out a specific instrument. Maybe describe what kind of beats you want to the tool and have it generate multiple potential interpretations, which you can start to combine and build up into a proper track. I think ideally I'd be able to describe what kind of mood or vibe I'm going for, without having to worry about any of the musical theory behind it, and the tool should generate what I want.
- deleted 1y ago[deleted]
- rTX5CMRXIfFG 1y ago> Why aren't the people who build these tools innovating more? We’re getting access to generative AI tech and people are looking for innovation in the UI? I mean I get the need for UX but it’s probably coming man, what with MVPs and all
- TheAceOfHearts 1y agoI think producing new and interesting music with AI tools will require models that allow for far more granularity, tweaking multiple tracks / layers, and this has to be exposed through a more professional and capable UI. It has to go hand-in-hand if it's going to be treated as anything other than a novelty or a toy. Vibe coding has improved significantly in tandem with UI innovations that provide a more intuitive interface to the workflow. Although in the vibe coding space there's still a lot of room for innovation and exploration, especially when doing detailed task development.
- canogat 1y ago[dead]
- dumpsterdiver 1y agoWell they’re not. And a lot of real artists are happily replacing portions of their own work using them.
- dlivingston 1y agoNobody is out seeking to destroy the lives of artists. Companies and people are just pushing the frontier of AI anyway they can, and it just turns out that images and audio are two directions the frontier can be expanded.
- iamsaitam 1y agoConsciouslly or unconsciouslly is the subject's problem not ours. It doesn't change the nature of the consequence of their actions.
- tgv 1y ago> Companies and people are just pushing the frontier of AI ... in the way that seems most profitable to them. They may not be 'seeking to destroy the lives of artists', but that's a false dichotomy. The outcome may very well be that they will. They know, and they don't care.
- echelon 1y agoLots of people want to express themselves. They're wholly under-served in this world. There's no reason someone who didn't pay the opportunity cost to learn to draw or to learn to play guitar shouldn't be able to make art and express themselves.
- adefa 1y agoIf you missed it, check out this MusicFX DJ: https://labs.google/fx/tools/music-fx-dj https://labs.google/fx/tools/music-fx-dj It's pretty fun :) https://imgur.com/a/ohTZXZ0 https://imgur.com/a/ohTZXZ0
- achow 1y agohttps://deepmind.google/technologies/lyria/ https://deepmind.google/technologies/lyria/ Lyria 2 is currently available to a limited number of trusted testers
- broof 1y agoAi music has been awesome for me, not because the music is that good, but because it gives me the ability to do something that I couldn’t have done myself. I use it all the time for my DnD group, songs about characters, funny moments, backstories, it’s a great tool that our players have found to increase engagement with the game
- jiehong 1y agoSounds like a new genre: live music generated on the fly depending on each user’s context. Just a new possibility!
- raincole 1y ago"Twitch plays (generates) music" goes brrr.
- Keyframe 1y agoiMUSE on steroids. It will come for sure.
- subscribed 1y agoJust imagine private model (own, little spech-to-text model) listening to the people playing DnD feeding to the bigger brother that in turn controls the music generation and feeds it back to the speakers as the story progresses. :)
- aitchnyu 1y agoMy theoretical perfect wireless headphone will detect interruptions and play a lofi instrumental version at low volume without skipping a beat and ramp up to original. Bonus points if it can detect my brain straining as an interruption.
- Tepix 1y agoInstead of making music together with human musicians, you're now doing this process with a machine. Yay!
- deleted 1y ago[deleted]
- rkagerer 1y agoAre there any particularly good samples anyone can point out? The 2-3 clips I listened to in the article sounded awful (my own subjective opinion).
- justlikereddit 1y agoClassic google approach to AI. "We made something really fancy" "Oh you wanted to try it out for yourself instead of just reading our self-congratulatory tech demos article? How about fuck you!" Yeah fuck you too Google, this is why your AI competitors are eating you alive, and good riddance
- ein0p 1y agoIt's kinda like Suno, except Suno sounds pretty good sometimes. Even so, I played with Suno for a few days and lost interest. There are some amazing examples on Suno, though: https://suno.com/song/9a7fd58e-132c-4ac5-9a25-f40d7f6f8c9f https://suno.com/song/9a7fd58e-132c-4ac5-9a25-f40d7f6f8c9f. This is one of the early tunes, it probably can do better now.
- n_kr 1y agoIs there a model which can generate vocals for an existing song given lyrics and some direction? I can't sing my way out of a paper bag, but I can make everything else for a song, so it would be a good way to try a bunch of ideas and then involve an actual singer for any promising ideas.
- xyproto 1y agoUS only.
- collias 1y agoI find this to be profoundly depressing. I've just recently re-discovered the joy of writing my own songs, and playing them with (actual) instruments. It's something I get immense pleasure from, and for once, I'm actually getting some earned traction. In another life, I may have been a musician, and it's something I fantasize about regularly. With all these AI-generated music tools, the world is about to be flooded with a ton of low-effort, low-quality music. It's going to to absolutely drown out anyone trying to make music honestly, and kill budding musicians in their crib. I suppose this is the same existential crisis that other professions/skills are also going through now. The feeling of a loss of purpose, or a loss of a fantasy in learning a new skill and switching careers, is pretty devastating.
- berkut 1y agoPeople also said similar things in the past (I'm a musician as well: guitar, piano and bass) about Synths and Drum machines (and things like GarageBand which can do backing drums and even basslines semi-automatically now). Some of those things enabled others to create new types of music or express themselves in different ways.
- tgv 1y agoPeople have said that about robots and computers in the workplace, and indeed, since the 60s, more and more jobs have been automated. And there are less musicians now. Film scores and albums are produced with samples instead of bands or orchestras, reducing demand for session players, leading to less income for musicians, leading to less musicians. And while automating dangerous jobs is a good thing, generating AI music isn't. It's not as unethical as generating deepfakes, but it's useless, and bad for society.
- XenophileJKO 1y agoI mean you say that.. but the counter point.. is maybe I don't like your lyrics and I want to make my own.
- 1y ago
- antononcube 1y agoThe creation of music by AI brings to mind a quote from David Bowie: “Music itself is going to become like running water or electricity. So take advantage of these last few years, because this will never happen again. Get ready for a lot of touring, because that's the only unique experience left.” While Bowie had different reasoning for making that statement, it's interesting to think that with AI-generated music, his idea of "music like water or electricity" might finally come true.
- pipes 1y agoI think the same is happening with video games. Especially with Xbox game pass or whatever it's called. I've done it to myself with roms. Everything available so none of it valuable to me.
- rafaelmn 1y agoThat sounds like a comment about streaming and artists getting basically nothing from it ? I think music AI in live music would actually be interesting - theoretically it can react to crowds better than any human could. A group music editing session with the AI weaving it to music - sounds like a fun art project.
- closewith 1y agoIt foresaw streaming, but it was a direct response to Napster and file sharing.
- widdershins 1y ago> theoretically it can react to crowds better than any human could That's one area I'd expect AI to do poorly. Performance is a two-way dialog between performers and the crowd, with facial expressions and body movements from both the stage and the audience in communication. I'd expect any AI that's not attached to a humanoid robot to be less exciting to a crowd. However, I am very excited about AI in some of the other contexts you mentioned, like as a music-writing or editing partner.
- 1y ago
- deleted 1y ago[deleted]
- hollowturtle 1y agoStrong opinion ahead: the very moment people will finally realize that music is in the microscopic nuances of the human touch, breath and taste(literally for every instrument), hopefully we will get disinvested in this useless technology. Yes, I am aware of software like pro tools, but that can ba used well for touch up all tue nueances
- DuckOnFire 1y ago[flagged]
- chaosprint 1y agoIt seems inevitable now. I used to think AI music would always sound compromised in term of audio quality, but the tech seems to have crossed a threshold, kind of like Retina displays did for screens. Soon, hiring people for commercial background music might be rare. Think AI for jingles, voiceovers, maybe even the models and visuals. Cafes can use AI-generated music too – in a way, the owner curates or "creates" it based on their taste. But there are still interesting parts to human music making: the unpredictability and social side of live shows, for example. Maybe future music releases could even be interactive, letting listeners easily tweak tracks? Like this demo: https://glicol.org/demo#ontherun https://glicol.org/demo#ontherun
- otabdeveloper4 1y agoAI slop is cringe. You don't want that kind of optics when marketing your product or company. No, it won't "get better". AI slop is slop not because of technical limitations.
- dragandj 1y agoCafes CAN use AI generated music, but WHY would they use it? Last time I checked there's millions of hours of human-produced music. The only reason might be the price, but AFAIK cafes have to pay a flat price to national music associations regardless of the actual music that they play. The downside is that AI-generated music might be cringe and chase away the customers. At best, cafes have no upside and no downside. At worst, they close the doors.
- qnleigh 1y agoI'm very happy to see that they're prioritizing making tools for musicians, rather than making AI music generators to replace musicians. Everything else I've come across so far was trying to do the latter.
- lifeinthevoid 1y agoMaybe they're playing the long game and using this to train on musician's input to prepare for the final blow.
- macleginn 1y agoThe end effect will be the same, I'm afraid: one "AI composer" in a TV studio or a marketing shop will be able to create most of the needed music on demand, removing the need to record and mix new tracks and putting a lot of musicians out of business.
- staticelf 1y agoFigure out an AI to do my dishes, laundry and clean my home. Not the fun parts of life please. Everyone wants the futuristic star trek future but we all forget that there is only one Captain Kirk and his small crew. Most of us will be sitting around at home doing laundry and cleaning the workplaces of the robots that is owned by large corporations.
- anentropic 1y agoThis is not actually music. Music is a cultural practice, this is just organised sound. Maybe one day AIs will be able to participate in cultural practices like humans do, as sentient beings, but current generative AI models do not.
- aniviacat 1y ago> That is not a water bottle, it's a domesticated puddle. Many (most?) people don't care about the artists behind songs (even less so about their culture). They care about the "organised sound" being enjoyable to hear. And to them, AI music is just as valuable as manual music. Gangam style didn't become popular because people cared about PSY. It didn't become popular because of its thoughtful lyrics and insightful message. It became popular because it sounds good.
- squigz 1y ago> Many (most?) people don't care about the artists behind songs This seems an absurd take to me when you consider the popularity of, say, Taylor Swift, or various rappers.
- aniviacat 1y agoIf 60% of people don't care about the artist's image/culture/story, and 40% do, then 100% of artists are gonna try to make their image/culture/story look good. Hence, I don't consider the popularity of such artists to be a counter-argument to my statement. However, my statement is based solely on anecdotal evidence, so I won't claim to have solid pro-arguments either; hence why I put a question mark after the "most".
- otabdeveloper4 1y ago> They care about the "organised sound" being enjoyable to hear. "Enjoyable to hear" is a problem that has been solved since the paleolithic. Musical scales and modes have always been a thing, making sounds that are nice and harmonic is a straightforward mathematical problem.
- 1y ago
- concats 1y agoTrying to look at the bigger picture for a moment. A lot of the philosophical debate about art I see here, and elsewhere on social media, is often very shallow and can be reduced to: Does one believe that the value of the art-piece (be is music, paintings, film, or whatever) is created in the mind of the artist, or is it created in the mind of the consumer? If you believe only in the former, AI art is an oxymoron and pointless. If you believe only the later, you're likely to rejoice at all the explosion of new content and culture we can expect in the coming years. As far as I can tell though, most regular people think that the truth is somewhere in between these two extremes, where both both the creator and the consumer's thoughts are important in unison. That culture is about where the two meet each other, and help each other grow. But most of the arguments I've seen online seem to ignore or miss this dichotomy of views entirely, which unfortunately reduces the quality of the debate considerably.
- XenophileJKO 1y agoYou are on to the key insight here.. what is emerging is the creative consumer. I.e. I know what I want when I hear it. Or I know what I want when I see it. This means you can hear something and say.. you know this is nice, but I would like it more if it were different in this way. With generative tools you can do that. Personally I really like to listen to music, but I generally dislike the lyrics. I want uplifting songs, maybe about what I am doing right now to motivate me. Well with something like Suno.com.. I can just make one. Or I can work with claude or chatgpt to quickly iterate on some lyrics and edit them to create an even higher fidelity song. The key here is that I can give a rat's ass if anyone in the world likes or cares about my song.. but I can listen to it while I work. It is exactly what I wanted to listen to or close enough.
- concats 1y agoMy theory is that as the quality of these generative tools increase, we'll see the public opinion of them slowly shift. Regardless of philosophy (although discussing it is always fun), it just seems inevitable since there are so many more consumers than producers. And as you say, consumers are the ones that will primarily benefit from this new technology. As a consumer we care primarily (some could argue solely) about our own emotional reaction to the music —or more generally put, art-piece. In practical terms I also believe that this will give rise to a lot of new consumer behavior, and, as you so aptly puts it "creative consumers" will become normal. The ability to on-demand create more content to fill out some very narrow niche is a great example ("Today I want 24 hours of non stop Mongolian throat singing neo-industrial Christmas music"). Or maybe to create covers of songs in the voices of your favorite long dead artist. Anything from minor tweak of existing works ("I wish this love song was dedicated specifically to ME", to completely new works (Just look at how much the parody-music genre has grown since Suno and the like first appeared). The possibilities are near endless.
- noisy_boy 1y agoI thought AI is supposed to free up my time by taking my job so I can unleash my musical creativity on an empty stomach? It is going to make music too?
- qwertox 1y ago"Democratization of ___" (fill in with your favorite word). This is what it also does look like. I'm not saying that this is anything good or bad, but when I usually hear that sentence, it's associated with something positive, empowering.
- thomastraum 1y agothe biggest thread to music is the audience. a machine doing any of this would be not causing a meltdown by musicians in the 80s. A punk rock band would not feel threatened by this neither would be Prince. the sad truth is human output is so averaged out now, that most of it will be replaced.
- TaupeRanger 1y agoAnother breathless press release with no demo. Typical DeepMind. Nothing to see here.
- bustling-noose 1y agoMusic on iPod or a Walkman or a radio is great. But have you ever attended live music shows ? Have you ever ‘felt’ the music ? Even someone at a local bar singing feels and hits different. AI can never bring feelings. That will never change. Even science fiction agrees with that. So bring all the AI you want everywhere, some things are irreplaceable by electronic world.
- VladVladikoff 1y agoI expect this type of stuff to be used for elevator and telephone hold music. Or even perhaps indie video games where they don’t have a budget for music.
- waltercool 1y ago[dead]
- mentalgear 1y agoDisappointed, until now DeepMind seemed like genuinely being a company working on important, AGI-directed models. Not the latest money-grabbing automation. Might be Google's influence. Most probably.
- eth0up 1y agoAs a musician with infirmities and other hindrances, I have dreamed of this for many years. Consider the DJ, particularly the variety that remixes music. While a skill in itself to manage the h/s/ware, such an artist is largely exhibiting their taste in music, excerpting, rearranging and altering existing music to accomplish a sound otherwise missing. I've found many such remixed versions vastly superior to the originals. Now imagine, without mastering a specific instrument or skill, you can now create the music in/of your own mindspace, which for me is rarely the music I hear, and often a deviation of what I do hear. I'm sure this isn't quite what's being offered yet, but every time I grasp my instruments with my trademark touch of inevitable futility, I hope I make it to a time when I can produce what my lack of virtues presently prohibits. It's not the physical acrobatics or mathematical showcasing of great music that I want - it's the end result of the music itself.
- asah 1y agois there a way for AI music to become an "instrument" the way synths and drug machines became in the 70s/80s...
- iamleppert 1y agoThe problem with all these AI companies and products is that they all over-value the content itself. The content is not the thing that is valuable, its the person who creates it and the community and culture that forms around it. These are things that require people, a lot of time, luck, and can never be automated. You see this all the time with people who spend huge amounts of money and effort making things that may even be great and high quality but never gain any real value. Companies do it all the time too. It's very hard to predict what will become valuable, and what will not. Just because AI will let you create more of something, or do it faster or cheaper -- it doesn't matter as long as you are missing some external factor that makes something high quality popular or valuable. And yes, there is always an external factor at work, a lot of times many factors. This is further evidenced by the fact that quality itself of something valuable sometimes doesn't need to be there (although it is more likely to be there, than not). Just by magically dropping the content price or effort to $0, doesn't matter because the content itself has no or little to no intrinsic value. There isn't suddenly going to be an expanded market of people who will listen to your AI generated music or buy your AI-enabled product. If tomorrow, I could make a random kid on the street sing just as well as Taylor Swift, or even if an exact perfect copy of her emerged somewhere, it doesn't mean she has any relationship to the value of Taylor Swift.
- jaggs 1y agoThat's weird. I just learned about a new music generation model called Lyra today, based out of Luxembourg. What's the odds on a similar sounding name in the same field appearing in the same week? I've got to say I don't think I'd relish going up against Google in a brand fight though. https://blog.aiva.ai/ https://blog.aiva.ai/.
- qotgalaxy 1y ago[dead]