Tweeted By @hardmaru
Parameter Prediction for Unseen Deep Architectures
— hardmaru (@hardmaru) October 27, 2021
Their graph hypernetwork can predict all 24M parameters of a ResNet-50, achieving 60% CIFAR-10 accuracy, and 50% Top-5 accuracy on ImageNet. A forward pass takes only a fraction of a second, even on a CPU!https://t.co/qRJiDTVRoH