Tweeted By @huggingface
Introducing PruneBERT, fine-*P*runing BERT's encoder to the size of a high-resolution picture (11MB) while keeping 95% of its original perf!
— Hugging Face (@huggingface) June 1, 2020
Based on our latest work on movement pruning: https://t.co/jDLpUmEtcp
Code and weights: https://t.co/RnWf0rrRJBhttps://t.co/13gFApbOsE