Tweeted By @huggingface
Excited to welcome Longformer, the transformer for long-range document tasks, to transformers 🤗(thanks to @i_beltagy).
— Hugging Face (@huggingface) June 2, 2020
Try 1 of the 7 models from the model hub:https://t.co/vcTFStsLlX
or check out how to convert a pre-trained BERT to its "long" version:https://t.co/qYXdtMzPFX. pic.twitter.com/a3QqKIuzBf