I asked AI to make a music video for Infected Mushroom

222,948
0
Published 2022-10-03
I used a variety of AI models to create a music video for the track Bliss on Mushrooms (feat. Miyavi), by Infected Mushroom & Bliss. The exciting part about working with AI models to produce visuals is that the technology is advancing at such a breakneck speed, new tools are coming out faster than I can keep up. This is the first time I've been able to use Dalle2 and Stable-Diffusion, and like many others in the AI art space, I've been OBSESSED. We are living in the future and it feels like magic that I'm just one person and I'm able to do this with the resources available. It isn't magic though, it's thanks to the amazing and selfless contributions of the open source community.

What parts are done by me vs the AI? Just like in my previous AI generated video using Disco Diffusion, I am manually keyframing many elements to sync up with the music. The camera motion, video inputs, cuts, noise and strength scheduling, etc, are all still controlled by me. We are still not at the point where I can input a song, press a button, and get a result like this... YET. It is only a matter of time until we get there in the future, and I have plans to further improve the scalability of this process. Eventually it will take 2 days for me to do this, rather than 2 months!

Are you interested in making your own AI music videos? I’ve created a free post on patreon documenting all the resources I used to make this video so you can try it yourself. Here is the link:
www.patreon.com/posts/72825385

Want to see the exact settings and prompts I used to create this video? I've posted all of them here: www.patreon.com/posts/72829815

This is the longest music video I've posted on this channel, and it took me over 2 months of work to finish! If you'd like to support me and get your name featured at the end of each video in a mini game, here is a link to my patreon: www.patreon.com/doodlechaos

My social media:
Twitter: twitter.com/doodlechaos
Discord: discord.com/invite/7FCrWAzDY7
Tiktok: www.tiktok.com/@doodlechaos
Instagram Shorts: www.instagram.com/doodlechaos_shorts/
Email: [email protected]

Music:
Infected Mushroom & Bliss - Bliss on Mushrooms (feat. Miyavi) [Monstercat Release] :    • Infected Mushroom & Bliss - Bliss on ...  

End Screen Music:
lofi geek - Monster:    • Monster (Lofi Halloween Music)  

Art Credits:
Abandoned Warehouse Model by Aurélien Martel - sketchfab.com/3d-models/abandoned-warehouse-interi…

Apple 2 Computer On Desk by Hank-Ball - www.cgtrader.com/free-3d-models/electronics/comput…

For a few frames in 6:10 - 6:16 I used Greg Rutkowski's name in the prompt for Dalle2. For Greg's style influencing this section, I wish to properly credit him for his amazing art. twitter.com/GrzegorzRutko14

Input Videos Credit:
Techno Viking Video -    • The original Technoviking video.  
Headbanger at Festival -    • BFG Division but its headbanging guy  

All Comments (21)
  • @TheAwes0meo
    I love the augmented reality part. It would be pretty terrifying to get trapped in a world that changes so quickly like that.
  • @colinfritz
    6:30 on is actually insane. My eyes were glued to the screen. Props doodle
  • @thedoczekpl
    Another great work by you! I'm overwhelmed by amount of variables that are here: moving camera, smooth changes between realistic 3D style and cartoon style, I loved that part where it was mixed with IRL video. Keep going!
  • @toainsully
    This should be the official music video for Infected Mushroom & Bliss
  • I have no words this is actually insane, the transitions, the visuals. OH MY GOD WHAT A TRIP!
  • Oh, man, I love Infected Mushroom, and so I was hyped when the music kicked in. Great video; lots of interesting concepts used in this. I'm certain they'd absolutely love this, considering all of their cover art has a weird/creepy/psychedelic/alien nature to them.
  • @GrouchyGander
    You know what's freaky? This is pretty much exactly what my dreams are like. Not even joking. The vague coherence; objects and scenery morphing into each other while still making near perfect sense and at some points feeling extremely real, to the point I'm sometimes more confused when waking up than being asleep. I mean yeah, just in general this video is freaky, but as someone with extremely vivid dreams, because the way some beings and creatures came into shape is so similar to how they appear in my dreams. I even keep a dream journal to document what happens and draw creatures and places I remember from them. The scene in the park was ESPECIALLY reminiscent of a dream I had. Not exactly what happened, but the portal arch and the visual texture was so close I broke out in a cold sweat. Freaky as hell, but I absolutely loved it.
  • I could tell this was Infected Mushroom. They have a VERY distinct sound! And what a perfect choice for such dreamy acidic videos!
  • @CullenCraft
    This was not a shortcut. This was genuine art.
  • Psychedelics are the reason why i didn’t take my life when i was at my end. I was stripped of my ego and saw the beauty of life and interconnectivity and even though i still battle anxiety and depression, I’m doing better everyday and will never think in such a self destructive way again.
  • This is so cool! And I love the music choice. I think you're ready to start VJing festivals
  • @AaronShenghao
    I love that in some of these pictures, the AI even tried to imitate the original artist's signature.
  • @UyeGaming
    Dude. I been following this type of AI work for a bit now, and when you mixed real life and AI generated version to the beat of the song, that had to be THE BEST USE OF IT I SEEN. That was amazing not only creative sense, but execution it as well. Also, I laughed at the Greg Rutkowski meme. You should connect with Corridor Digital!
  • @jayaybe1
    WOW! Amazing :face-red-heart-shape:. The thing I love most is when an object like the train or a doorway becomes different versions of itself and often then becomes something else entirely. These types of videos recreate the visual psychedelic experience better than anything I've ever seen. Bravo!
  • @alacer8878
    Oh my god the sequencec at 2:50 blew my mind. Makes me wanna try and recreate the effect for some kind of story video or something.
  • Infected Mushroom's music already feels like an acid trip, but adding these visuals amplifies that feeling by a factor 10 or maybe 10,000
  • @C.5.
    AI videos were already scary for how good they could be(last one as an example). This is weirdly good for that it feels like something you would expect in early 2000s with the effects but also has that Halloween electric music vibe. very very interesting
  • That was amazing! I love that the song is called, "Bliss on Mushrooms" too. This is honestly pretty close, (minus the rapid scene changes), to what it's like when you've had WAAAAAAY TOO MANY shrooms in one go and just have to hope for the best. Been there a few times myself listening to this exact type of PsyTrance. Always a good time 🤙