Tweeted By @GuggerSylvain
You can run BLOOM or OPT-176B in Transformers without a 🖥️supercomputer thanks to Accelerate, but how does it work exactly?
— Sylvain Gugger (@GuggerSylvain) September 27, 2022
New blog post that dives deep into the awesome PyTorch features we use for this (also see summary in thread🧵)https://t.co/6UyNJ5I7U9