Homepage
Close
Menu

Site Navigation

  • Home
  • Archive(TODO)
    • By Day
    • By Month
  • About(TODO)
  • Stats
Close
by JulianSlzr on 2020-05-15 (UTC).

[1/4] “Masked Language Model Scoring” is in #acl2020nlp! Score sentences with any BERT variant via mask+predict (works w/ @huggingface). Improves ASR, NMT, acceptability.

Paper: https://t.co/j2iJlIJbVQ
Code: https://t.co/zVbCkAhi9P

(w/ @LiangDavis, @toannguyen177, Katrin K.) pic.twitter.com/LhLYdXC3FS

— Julian Salazar (@JulianSlzr) May 15, 2020
nlpresearchw_code
by JulianSlzr on 2020-05-15 (UTC).

[3/4] Unsupervised MLM scores from BERT narrow the human gap on the BLiMP minimal pairs set (@a_stadt, @sleepinyourhat), suggesting left-to-right bias in GPT-2 has an outsized effect.

(Yes, we ran these experiments when the dataset came out, 1 week before the ACL deadline 😌) pic.twitter.com/I5ng2NobSd

— Julian Salazar (@JulianSlzr) May 15, 2020
nlpresearch

Tags

learning tutorial misc nlp rstats gan ethics research dataviz survey python tool security kaggle video thought bayesian humour tensorflow w_code bias dataset pytorch cv tip application javascript forecast swift golang rl jax julia gnn causal surey diffusion
© Copyright Philosophy 2018 Site Template by Colorlib