Tweeted By @apaszke
No, it does matter. CNNs have ops so costly that the eager overhead on CPU is entirely hidden behind GPU execution, so you don’t pay anything for it. But eager never postpones running the kernels, so it will have lower latency than lazy (and it’s still somewhat cheaper).
— Adam Paszke (@apaszke) October 6, 2018