Tweeted By @srchvrs

They iteratively train several models. Largest is trained for 3.5 days on 2048-v3 TPU pod. It seems that one hour of this pod is ~$2.5K. Thus, we get an insane price tag ~$200K. The full experiment might cost you about half a MILLION USD if u want to reproduce it. https://t.co/wthQXaGe40

— Leonid Boytsov (@srchvrs) November 13, 2019