Model Compression

Awesome lists

• Awesome Knowledge Distillation
• Awesome model compression and acceleration
• CNN Compression Survey

Reading list

Compression

• Compressing Neural Networks using the Variational Information Bottleneck
• WEIGHTLESS: LOSSY WEIGHT ENCODING FOR DEEP NEURAL NETWORK COMPRESSION
• To prune, or not to prune: exploring the efficacy of pruning for model compression

Pruning

• Dynamic Filter Networks
• Dynamic Steerable Blocks in Deep Residual Networks

Knowledge Distillation

• Knowledge Distillation - Slides: Hinton
• Gift from Knowledge Distillation