6 min read
VGG-19-BN spends 18.6% of its compute on channels that output zero
292 channels in torchvision's VGG-19-BN output exactly 0 on 10,000 test photos. Cutting them changed no answers and saved 18.6% of the operations.
Articles
Research notes by Rokib Al Dhin Raadh.