Abstract:Within the world of machine learning there exists a wide range of different methods with respective advantages and applications. This paper seeks to present and discuss one such method, namely Convolutional Neural Networks (CNNs). CNNs are deep neural networks that use a special linear operation called convolution. This operation represents a key and distinctive element of CNNs, and will therefore be the focus of this method paper. The discussion starts with the theoretical foundations that underlie convolutions and CNNs. Then, the discussion proceeds to discuss some improvements and augmentations that can be made to adapt the method to estimate a wider set of function classes. The paper mainly investigates two ways of improving the method: by using locally connected layers, which can make the network less invariant to translation, and tiled convolution, which allows for the learning of more complex invariances than standard convolution. Furthermore, the use of the Fast Fourier Transform can improve the computational efficiency of convolution. Subsequently, this paper discusses two applications of convolution that have proven to be very effective in practice. First, the YOLO architecture is a state of the art neural network for image object classification, which accurately predicts bounding boxes around objects in images. Second, tumor detection in mammography may be performed using CNNs, accomplishing 7.2% higher specificity than actual doctors with only .3% less sensitivity. Finally, the invention of technology that outperforms humans in different fields also raises certain ethical and regulatory questions that are briefly discussed.

A Survey on Convolution Neural Networks

Advances in Convolutional Neural Networks

An Introduction to Convolutional Neural Networks

Convolutional Neural Network and its Applications in Artificial Intelligence

Major Convolutional Neural Networks in Image Classification: A Survey

A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends

A Non-Technical Survey on Deep Convolutional Neural Network Architectures

Convolutional Neural Network (CNN): A comprehensive overview

Recent Advances in Convolutional Neural Networks

Deep Convolutional Neural Networks: A survey of the foundations, selected improvements, and some current applications

A Survey: Image Classification Models Based on Convolutional Neural Networks

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

A Survey of Face Recognition based on Convolutional Neural Network

A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects

Convolutional neural network: a review of models, methodologies and applications to object detection

A Taxonomy of Deep Convolutional Neural Nets for Computer Vision

Research on the Application of Convolutional Neural Networks in the Image Recognition

Theoretical Understanding of Convolutional Neural Network: Concepts, Architectures, Applications, Future Directions

Understanding of Convolutional Neural Network (CNN): A Review