Gregoire Montavon & Klaus-Robert Muller 
Neural Networks: Tricks of the Trade [PDF ebook] 

The twenty last years have been marked by an increase in available data and computing power. In parallel to this trend, the focus of neural network research and the practice of training neural networks has undergone a number of important changes, for example, use of deep learning machines.The second edition of the book augments the first edition with more tricks, which have resulted from 14 years of theory and experimentation by some of the world’s most prominent neural network researchers. These tricks can make a substantial difference (in terms of speed, ease of implementation, and accuracy) when it comes to putting algorithms to work on real problems.