Tweeted By @AlecRad
Those samples use a different technique than the ones shown in the blog. The samples you are looking at are temperature=1. We use top_k=40. Unconditional samples with that are here: https://t.co/OxQBnCc6mA
— Alec Radford (@AlecRad) February 19, 2019
It's also important to note that conditioning on "real" text helps too.