Tweeted By @ericjang11
Gumbel-Softmax aka Concrete distribution maps gumbel noise + temperature scalar to a simplex. This neat paper on Invertible Gaussian Reparameterization shows that you can map other kinds of noise to the simplex and it empirically works well!
— Eric Jang 🇺🇸🇹🇼 (@ericjang11) February 16, 2021
https://t.co/SihvRnaQLg