Tweeted By @glouppe

Who knew? Changing the reset gate in @kchonyc's GRU so that the gate can take values in ]0,2[ instead of ]0,1[ makes the cell bistable, hence enabling long-lasting memories! Very nice work by my colleagues @vecovennicolas, @DamienERNST1 and Guillaume Drion! https://t.co/u2h9obRx9t

— Gilles Louppe (@glouppe) June 11, 2020