What is Deep Learning ?
” Learning multiple levels of representation to help a learner accomplish a task of interest, with higher levels capturing more abstract concepts through a deeper composition of computations. “ - Yoshua Bengio
Subpages
- Best Practices
- AI Alignment
- Awesome Presentations
- Courses
- Dialogue
- Generative Networks
- Meta Learning
Articles
- A gentle introduction to auto-encoders
- Concise introduction (and some math) on Convolutional Neural Network
- Torch vs Theano
- Why Deep Learning works (renormalization theory)
- What information do CNN destroy as the input goes up the layers of the CNN?
- Image Captioning
- Deep Learning Hardware Guide
- Initiating and launching Theano in Amazon AWS, step by step guide
- Galaxy Zoo Kaggle competition winner’s description of his strategy and experience
- Single Artificial Neuron taught to recognize hundres of patterns
- Deep-learning algorithm predicts photos’ memorability at “near-human” levels
- A brief history of Neural Nets and Deep Learning, Part 1
- The Top A.I. Breakthroughs of 2015
- How convolutional neural networks see the world
- Exploring the world on-the-go using Google Cloud Vision and Twilio
- Attention and Memory in Deep Learning and NLP
- How to Code and Understand DeepMind’s Neural Stack Machine
- NIPS 2015 Deep Learning Symposium Part I
- NIPS 2015 Deep Learning Symposium Part II
- Must know tips/tricks for training DNN
- Should we be rethinking unsupervised learning
- 26 things I learned in the deep learning summer school
- Debugging Machine learning
- LSTM Networks for time series prediction
- How to implement YOLO object detector
Blog posts by deep learning competition winners
- NOAA Right Whale Recognition, Winner’s Interview: 2nd place, Felix Lau
- My solution for the Galaxy Zoo challenge
- Learning Deep Convolutional Neural Networks for Places2 Scene Recognition
Books
- Deep Learning by Yoshua Bengio et al, MIT Press. Free online version
- Neural Networks and Deep Learning by Michael Nielsen, Determination Press. Free online version
Tutorials
- Rolling in the deep learning (common man’s guide to Deep learning)
- Recurrent Neural Networks
- Hacker’s Guide to Neural Networks (Detailed tutorial on writing your own code for NN)
- [Crash course in learning theory](https://blogs.princeton.edu/imabandit/2015/10/13/crash-course-on-learning-theory-part-1/> (Also has part 2)
- Restricted Bolztman machines, very simplified
- General Bolztman machines, very simplified
- End to End tensorflow examples
- Neural Turning Machines in Lasagne
- Reasoning, Attention and Memory NIPS Workshop 2015,
- What is Variational Autoencoder
- Convolutional Neural Networks
- Introduction to Reinforcement Learning
Courses
- https://www.cs.ox.ac.uk/people/nando.defreitas/machinelearning/
- https://computing.ece.vt.edu/~f15ece6504/
- https://cs231n.github.io/
- http://videolectures.net/deeplearning2015_montreal/
- https://www.udacity.com/course/deep-learning--ud730
- https://developer.nvidia.com/deep-learning-courses
- List with links https://docs.google.com/spreadsheets/d/1NSbURoynPVnOvSCtmaIX6zV8wl6n3ybacnNGMyb-v-0/edit#gid=0
- Deep Learning, University of Montrea - Yoshua Bengio https://ift6266h16.wordpress.com/
Deep Learning frameworks
- Comparision of frameworks
- Benchmarking of Convnets
- Caffe (UC Berkeley)
- Theano (LISA Lab, Univ of Montreal)
- Tensorflow (Google)
- Torch (Facebook)
- Neon (Nervana)
- CNTK (Microsoft)
Datasets
Online Tools (Demos)
Challenges
Software Libraries
- A Theano framework for building and training neural networks
- Neural Network tools for Theano
- Theano-based Deep Learning library
- Fred’s Theano Workshop
- Theano-based implementation of Deep Q-learning
- Nano size Theano LSTM module
- A collection of tutorials on neural networks, using Theano
- Neural networks in Theano
- A Theano implementation of GP’s using automatic differentiation.
- IPAM Tutorials on Theano/Torch
- Theano-based Alexnet
- Recurrent Neural Network for modeling sequential data implemented using Python and Theano.
- A Theano framework for building and training neural networks
- Python implementation of the DeSTIN deep learning perception system using the Theano library
- theano patch
- Theano based deep ANN learning code
- Experiments comparing thee toolkits: April-ANN, Torch 7, Theano
- An implementation of Bayesian Personalised Ranking in Theano
- Recurrent neural networks with theano.
- Library for implementing RNNs with Theano
- An implementation of the Hessian-free optimization algorithm in Theano
- Demonstration of recurrent neural network implemented with Theano
- A Machine Learning library based on Theano
- General purpose Hessian-free optimization in Theano
- Modular Restricted Boltzmann Machine (RBM) implementation using Theano
- http://joschu.github.io/
Startups
- Nervana Systems
- Clarifai
- Ersatz Labs
- MetaMind
- Skymind
- HyperVerge
- Deepomatic
- Twenty Billion
- Bay Labs
- DeepVision.io
- Cerebras.net
- http://magizbox.com/index.php/deep-learning-company/