Keywords: LeNet, Convolutional Neural Networks, Handwritten Digit Recognition All the figures in this post come from ‘Learning algorithms for classification-a comparison on handwritten digit recognition’1 Basic Works Convolutional network2 Inspiration Raw accuracy, training time, recognition time and memory requirements should be considered in classification. From experiments and comparison, the results can illuminate which one is... » read more
This paper was published in 1943 by Warren S. McCulloch and Walter Pitts.1 It has been considered as the origin of the neural network field. It contains the background knowledge of biological neural networks of that time. Basing on these biological neural network structure details, authors discarded some "unimportant" or "uncomputable" structures and simplified some complicated structures then get an abstracted model that may have a simple function and could be analyzed mathematically.