Training an unbeatable AI in Trackmania

Is there some way of ,,punnishing" the AI for hitting the wall?

You could program AI to use your path, which is recorded in slow motion, as a baseline to deviate from.

When the AI went full Dr. Strange

Incredibly interesting and good visualization. I'm looking forward to the next video

Amazing video Yosh. Just a beautiful example of how neural networks and reward work. Congrats

Hery bro, nice project truely. But hey, petitips ici : would, could etc... le L se prononce pas du tout, jamais :)

This is insane. I would love to see the possibilities you could achieve with AI in this game.

At 17 minutes you taught a bot how to drift. Then the drift reward was removed. And we further trained the bot.
Try to teach the bot with a teacher first, for example, so that it repeats after you. And then teach the bot with reinforcement.

I am confused, did you feed the net pixel data from the game? or would that be too computationally intensive? Thats amazing though.

The human mind took hundreds of thousands of years to evolve to what it is now, and you're giving the AI a few hours. Just think about that for a while.

You french

Playing against bots in the future of videogames will never be the same again. Terrifying, unbeatable and unhuman actions 😅

The next step is to test the AI on the Spaghetti map

Amazing editing. Love the visuals of the ai's all racing.

Simply brilliant video! So much though and effort goining in into what seems to be a totaly meaningless endeavor. However, I am sure that the experience and knowledge gained will prove to be invaluable! The journey definitely is the reward in this case!

Absolutely amazing story telling! I loved the use of color to easily demonstrate progression. One of my favorite aspects about this video is that you actually used your AI on multiple tracks and introduced generalization. I feel like too often people will train an AI to only be good at one specific task while ignoring other scenarios. This is one of the few videos in which you're actually training your AI and having it learn how to do something instead of just having it memorize one set of instructions. Memorizing ≠ Learning and you did an amazing job having your AI learn. Kudos!