In Lecture 6 we discuss many practical issues for training modern neural networks. We discuss different activation functions, the importance of data preprocessing and weight initialization, and batch normalization; we also cover some strategies for monitoring the learning process and choosing hyperparameters. Keywords: Activation functions, data preprocessing, weight initialization, batch normalization, hyperparameter search Slides: http://cs231n.stanford.edu/slides/201...