Abstract:Within the world of machine learning there exists a wide range of different methods with respective advantages and applications. This paper seeks to present and discuss one such method, namely Convolutional Neural Networks (CNNs). CNNs are deep neural networks that use a special linear operation called convolution. This operation represents a key and distinctive element of CNNs, and will therefore be the focus of this method paper. The discussion starts with the theoretical foundations that underlie convolutions and CNNs. Then, the discussion proceeds to discuss some improvements and augmentations that can be made to adapt the method to estimate a wider set of function classes. The paper mainly investigates two ways of improving the method: by using locally connected layers, which can make the network less invariant to translation, and tiled convolution, which allows for the learning of more complex invariances than standard convolution. Furthermore, the use of the Fast Fourier Transform can improve the computational efficiency of convolution. Subsequently, this paper discusses two applications of convolution that have proven to be very effective in practice. First, the YOLO architecture is a state of the art neural network for image object classification, which accurately predicts bounding boxes around objects in images. Second, tumor detection in mammography may be performed using CNNs, accomplishing 7.2% higher specificity than actual doctors with only .3% less sensitivity. Finally, the invention of technology that outperforms humans in different fields also raises certain ethical and regulatory questions that are briefly discussed.

Convolutional Neural Networks Demystified: A Matched Filtering Perspective Based Tutorial

Demystifying CNNs for Images by Matched Filters

Advances in Convolutional Neural Networks

CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualization

Understanding of a convolutional neural network

Deep Convolutional Neural Networks: A survey of the foundations, selected improvements, and some current applications

Theoretical Understanding of Convolutional Neural Network: Concepts, Architectures, Applications, Future Directions

Understanding Deep Convolutional Networks

Feed Forward and Backward Run in Deep Convolution Neural Network

Understanding of Convolutional Neural Network (CNN): A Review

A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends

Unsupervised Pre-Trained Filter Learning Approach for Efficient Convolution Neural Network.

Understanding Neural Networks Through Deep Visualization

On filter design in deep convolutional neural network

Convolutional Neural Networks Analyzed via Inverse Problem Theory and Sparse Representations

Deep Learning with CNNs: A Compact Holistic Tutorial with Focus on Supervised Regression (Preprint)

Convolutional Neural Networks Do Work with Pre-Defined Filters

Non-linear Convolution Filters for CNN-based Learning

A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects