Tweeted By @srush_nlp
Survey of "Seq. Knowledge Distillation" (https://t.co/fmL7XeMrCl) for #sustainlp
— Sasha Rush (@srush_nlp) November 19, 2020
Covers main technique, use in compression, extensions, and many of the wild unanticipated use-cases (adv. attacks, NAT, transfer)
Talk: https://t.co/fmL7XeMrCl pic.twitter.com/mf3fePAVJy