Tweeted By @ak92501
Making Transformers Solve Compositional Tasks
— AK (@ak92501) August 11, 2021
paper: https://t.co/1qUhBPlTfa
explore the design space of Transformer models showing that the inductive biases given to the model by several design decisions significantly impact compositional generalization pic.twitter.com/WSMeRNl3SX