Training AI to Play Fortnite (Reinforcement Learning + Computer Vision)

Will Kwan
Will Kwan
2,741
3
Published 2024-07-15
Source code, pretrained model checkpoint, and documentation for the Fortnite reinforcement learning agent: github.com/wkwan/scrimbrain

I open-sourced ScrimBrain because reinforcement learning isn't practical enough yet to help the average game developer do automated playtesting, or to help esports pros practice. My business is making games and videos, not doing AI research (I don’t make any money doing that), but I think RL is the best approach for these use cases.

If you want to support the channel, play my games! CoachDody and I spent months making Steal My Wall!, a fun and intense competitive Fortnite map that helps you master fundamental boxfighting skills like stealing pieces, taking good peeks, and using exploits to get into your opponent’s box: www.fortnite.com/@coachdody/2191-1425-4724

In case you’re new to Fortnite, all maps are free (devs get payouts based on player metrics) so it doesn’t cost anything to queue into a game. Our map includes solo practice areas with tutorials to explain the skills that other combat maps assume you already have. I’m not a competitive Fortnite player and I’m also not 15, so we designed the solo practice for players like me who want to learn the basics efficiently.
All Comments (20)
  • @MakeDataUseful
    Thanks for sharing your learning Will, I'm looking forward to checking out the repo.
  • @AwareOCE
    As someone heavily interested in game based AI, this is fucking awesome! Cool as hell work, cant wait to see your future projects!
  • @ben_jamin01
    "no useful game ai tool developments in 4 years.. fine I'll do it myself..." Absolute player 🙏🙏
  • @BrandonCourt
    I feel like what we call "AI" in recent years is misleading and over hyped because it's too attached to an expectation of being close to achieving sentient AI and it easily SEEMS that way on surface. I think this technological breakthrough of LLM is inherently a dead end in terms of future progression when looking at it as 'method' of AI. It's more like Mimicked Intelligence. We should be calling it MI.
  • @FryingPan
    THIS IS THE GREATEST AI FORTNITE TRAINING OF ALL TIME!!
  • @DeathPixel
    Nice video. I looked a bit at your code, especially the step function of your custom env. I couldn't find any delay between when the agent performs an action and taking a screenshot for the next observation. So the only time that passes inbetween is the time it takes for the function to take a new screenshot (or your sampling rate is synced with the game at 60Hz?) Did you try maybe to reduce the sampling rate of the agent? Maybe that helps to reduce data over the time dimension and lead to faster learning?
  • @orionh5535
    Nice to see your still e-alive. Nice to see the thought process behind a persomal process. I feel like chat GPT killed alot pf research not related to having a chatbot as the final product behind AI research.
  • @SamiCSc
    The only notification I get from youtube is when you upload.
  • @Gazzar19
    Training in real time might take to long to get enough data
  • @SanoKei
    Very cool, but why didn't you use DrEureka?
  • @LupusMechanicus
    bro game sucks ass, the building is zoomer cancer. Pick a good game next time.