==== Deep Learning ==== === Articles === * A gentle introduction to auto-encoders http://nikhilbuduma.com/2015/03/10/the-curse-of-dimensionality * Concise introduction (and some math) on Convolutional Neural Network http://ufldl.stanford.edu/tutorial/supervised/ConvolutionalNeuralNetwork/ * Torch vs Theano http://fastml.com/torch-vs-theano/ * Why Deep Learning works (renormalization theory) https://charlesmartin14.wordpress.com/2015/04/01/why-deep-learning-works-ii-the-renormalization-group/ * What information do CNN destroy as the input goes up the layers of the CNN? http://qr.ae/7XFSmw * Image Captioning https://pdollar.wordpress.com/2015/01/21/image-captioning/ * Deep Learning Hardware Guide http://timdettmers.com/2015/03/09/deep-learning-hardware-guide/ * Initiating and launching Theano in Amazon AWS, step by step guide http://blog.eduardovalle.com/tag/lenet/ * Galaxy Zoo Kaggle competition winner's description of his strategy and experience http://benanne.github.io/2014/04/05/galaxy-zoo.html === Books === * Deep Learning by Yoshua Bengio et al, MIT Press. Free online version http://www.iro.umontreal.ca/~bengioy/dlbook/ * Neural Networks and Deep Learning by Michael Nielsen, Determination Press. Free online version http://neuralnetworksanddeeplearning.com/ === Tutorials === * Rolling in the deep learning (common man's guide to Deep learning) https://medium.com/the-programmable-chronicles/rolling-in-the-deep-learning-4302bd5c06da * Recurrent Neural Networks http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ * Crash course in learning theory https://blogs.princeton.edu/imabandit/2015/10/13/crash-course-on-learning-theory-part-1/ (Also has part 2) === Courses === * https://www.cs.ox.ac.uk/people/nando.defreitas/machinelearning/ * https://computing.ece.vt.edu/~f15ece6504/ * https://cs231n.github.io/ * http://videolectures.net/deeplearning2015_montreal/ === Datasets === * Large-scale CelebFaces Attributes (CelebA) Dataset http://mmlab.ie.cuhk.edu.hk/projects/CelebA.html * Video Description Dataset http://www.cs.utexas.edu/users/ml/clamp/videoDescription/ === Challenges === * THUMOS Challenge Action Recognition in Temporally Untrimmed Videos http://www.thumos.info/home.html === Software Libraries === * https://github.com/bartvm/blocks A Theano framework for building and training neural networks * https://github.com/benanne/Lasagne Neural Network tools for Theano Docs: http://lasagne.readthedocs.org/en/latest/ * https://github.com/fchollet/keras Theano-based Deep Learning library * https://github.com/StartupML/Bastien-Theano-Workshop Fred's Theano Workshop * https://github.com/spragunr/deep_q_rl Theano-based implementation of Deep Q-learning * https://github.com/JonathanRaiman/theano_lstm Nano size Theano LSTM module * https://github.com/craffel/theano-tutorial A collection of tutorials on neural networks, using Theano * https://github.com/kastnerkyle/net Neural networks in Theano * https://github.com/markvdw/theanogp A Theano implementation of GP's using automatic differentiation. * https://github.com/clementfarabet/ipam-tutorials IPAM Tutorials on Theano/Torch * https://github.com/uoguelph-mlrg/theano_alexnet Theano-based Alexnet * https://github.com/mohammadpz/Recurrent-Neural-Networks Recurrent Neural Network for modeling sequential data implemented using Python and Theano. * https://github.com/bartvm/blocks A Theano framework for building and training neural networks * https://github.com/opencog/python-destin Python implementation of the DeSTIN deep learning perception system using the Theano library * https://github.com/mzoehr/Theano theano patch * https://github.com/glorotxa/DeepANN Theano based deep ANN learning code * https://github.com/pakozm/ann-toolkits-comparison Experiments comparing thee toolkits: April-ANN, Torch 7, Theano * https://github.com/bbcrd/theano-bpr An implementation of Bayesian Personalised Ranking in Theano * https://github.com/bayerj/theano-rnn Recurrent neural networks with theano. * https://github.com/pascanur/GroundHog Library for implementing RNNs with Theano * https://github.com/doomie/HessianFree An implementation of the Hessian-free optimization algorithm in Theano * https://github.com/gwtaylor/theano-rnn Demonstration of recurrent neural network implemented with Theano * https://github.com/kastnerkyle/pylearn2 A Machine Learning library based on Theano * https://github.com/boulanni/theano-hf General purpose Hessian-free optimization in Theano * https://github.com/benanne/morb Modular Restricted Boltzmann Machine (RBM) implementation using Theano * http://joschu.github.io/ === Startups === * Nervana Systems * Clarifai * Ersatz Labs * MetaMind * Skymind * HyperVerge * Deepomatic * http://magizbox.com/index.php/deep-learning-company/