OpenAI Five Defeats Amateur Human Teams at Dota 2

[Nick H. 8,940]

Quote

OpenAI Five Defeats Amateur (including a Semi-pro) Human Teams at Dota 2

Our team of five neural networks, OpenAI Five, has started to defeatamateur human teams at Dota 2. While today we play with restrictions, we aim to beat a team of top professionals at The International in August subject only to a limited set of heroes. We may not succeed: Dota 2 is one of the most popular and complex esports games in the world, with creative and motivated professionals who train year-round to earn part of Dota’s annual $40M prize pool (the largest of any esports game).

OpenAI Five plays 180 years worth of games against itself every day, learning via self-play. It trains using a scaled-up version of Proximal Policy Optimization running on 256 GPUs and 128,000 CPU cores — a larger-scale version of the system we built to play the much-simpler solo variant of the game last year. Using a separate LSTM for each hero and no human data, it learns recognizable strategies. This indicates that reinforcement learning can yield long-term planning with large but achievable scale — without fundamental advances, contrary to our own expectations upon starting the project.

Source and more

 

I found it a pretty interesting read, even if I didn't fully understand everything.

 

EDIT: The video as well: