Tweeted By @gdb
A good analysis of the embeddings we use in the OpenAI Five model: https://t.co/Dx9ZseZYhx. After analyzing the rest of the model, concludes: “All the strategy and tactics must lie in one place – 1024-unit LSTM.” Pretty remarkable what LSTMs (invented in 1997!) can do at scale.
— Greg Brockman (@gdb) September 11, 2018