Black MIDI, but every note spawns a physics object... (4k, 60fps, ray traced)

2,748,724
0
Published 2021-07-07
I created a program in Unity that can read Black MIDI files and generate a Synthesia like visualization. However, each time a piano key is pressed, a corresponding tetromino physics object is spawned (since it plays the Tetris Theme A). The high note density areas created some interesting effects.

I had a simpler version of this almost done, but for some reason I always feel the need to do a bunch of extra modifications that people probably won't even notice (60fps + 4k, I still don't have a 4k monitor, so I don't even know what it truly looks like, lol). After figuring out how to use Unity's HDRP, I couldn't resist setting up path tracing. Unfortunately, the Unity Recorder package isn't capable of waiting for the ray tracing paths to converge before moving to the next frame yet. To circumvent this, my code paused the simulation for about 200 frames for path convergence stalling, took a 4k screenshot, then repeated the process for about 72 hours straight. I was very sad when a bug in my code glitched out the physics at the very end of the simulation. Surprisingly, after fixing it and skipping a bunch of frames to set up a pick up shot where it failed, the physics behaved deterministically so the transition was unnoticeable.

Massive thanks to Kanade Tachibana for allowing me to use this MIDI file!
Link to original video:    • Tetris Theme V4  
Link to Kanade Tachibana's channel:    / @kanadetachibanablackmidi  

Music: Tetris Theme A

Cash Register Sound Effect:
freesound.org/people/kiddpark/sounds/201159/

It was super fun making the patron thank you outro screen. The blocks are ordered and sized in terms of lifetime contribution, as well as color coded by tier. I'm not making any money off this video. If you would like to support me and appear on screen in the next patron shoutout, here is the link to my Patreon page: www.patreon.com/doodlechaos
www.twitch.tv/doodlechaos
twitter.com/doodlechaos
[email protected]

All Comments (21)
  • @5MadMovieMakers
    Mom says to clean up your 3.5 million blocks when you're done
  • @bghmusic
    Never have my eyes seen something more beautiful
  • Black Key: "Mom, I'm scared of those shadows" White Key: "The shadows can't hurt you." The shadows: 0:23
  • @KrazyKF
    "Oh hey, this isn't that bad so far." 0:24 The shadow.
  • @ChristopherMoom
    The real reason you never get to see the product of all the Tetrominoes is because DoodleChaos is insanely lucky and the Tetrominoes all happened to line up perfectly when they fell down off screen, causing them to disappear like in actual Tetris Jokes aside this is a really neat video, it's really satisfying whenever the song makes an explosion of Tetrominoes, great stuff
  • @RubyBlooming
    Shout outs to the one green block that gets on top of the piano at 1:15, they went where no block had gone before
  • @DoggoGod
    I love how you can see the shadows move and you have a couple seconds to prepare yourself
  • I love how the melody is still recognizable, even with all the runs and full-piano slams happening
  • @abstractn7819
    "Did you do it?" "Yes" "And how much RAM did it cost?" "...Everything"
  • @achoi2669
    "yeah im apart of percussion" "oh yeah? what instrument do you play?" "piano."
  • @znox_x6165
    The parts where the music sounds like it explodes is so satisfying lol
  • @evanz9752
    Every computers nightmares be like:
  • @Qoride
    1:12 props to that one green block that made it on top of the piano
  • @TT-gm5yv
    This is more like "PC spec show-off" but with a musical twist. I love it.
  • @meILM
    I want to see all the pieces at the bottom fit together perfectly
  • @qwertyb1883
    I can't imagine all the effort that went into this video, all the time it took ti write the midi, coding the 3d objects, render time, and especially all the thought and effort that went into the thumbnail. Good job, Doodle!
  • Ah, yes. Let's raytrace our Midis. We're finally reaching the graphics Toby reccomended for his own music