Abstract:Within the world of machine learning there exists a wide range of different methods with respective advantages and applications. This paper seeks to present and discuss one such method, namely Convolutional Neural Networks (CNNs). CNNs are deep neural networks that use a special linear operation called convolution. This operation represents a key and distinctive element of CNNs, and will therefore be the focus of this method paper. The discussion starts with the theoretical foundations that underlie convolutions and CNNs. Then, the discussion proceeds to discuss some improvements and augmentations that can be made to adapt the method to estimate a wider set of function classes. The paper mainly investigates two ways of improving the method: by using locally connected layers, which can make the network less invariant to translation, and tiled convolution, which allows for the learning of more complex invariances than standard convolution. Furthermore, the use of the Fast Fourier Transform can improve the computational efficiency of convolution. Subsequently, this paper discusses two applications of convolution that have proven to be very effective in practice. First, the YOLO architecture is a state of the art neural network for image object classification, which accurately predicts bounding boxes around objects in images. Second, tumor detection in mammography may be performed using CNNs, accomplishing 7.2% higher specificity than actual doctors with only .3% less sensitivity. Finally, the invention of technology that outperforms humans in different fields also raises certain ethical and regulatory questions that are briefly discussed.

Return of the Devil in the Details: Delving Deep into Convolutional Nets

Advances in Convolutional Neural Networks

Visualizing and Comparing Convolutional Neural Networks

Convolutional Neural Networks Exploiting Attributes of Biological Neurons

Deeper Interpretability of Deep Networks

Refining Architectures of Deep Convolutional Neural Networks

Towards Better Analysis of Deep Convolutional Neural Networks

Visualizing and Understanding Convolutional Networks

Rethinking the Inception Architecture for Computer Vision

Deep Convolutional Neural Networks: A survey of the foundations, selected improvements, and some current applications

Visualizing Deep Convolutional Neural Networks Using Natural Pre-images

Recent Advances in Convolutional Neural Networks

A Visual Cortex-Attentive Deep Convolutional Neural Network for Digital Image Design

Delving into Fully Convolutional Networks Activations for Visual Recognition.

CNN Features Off-the-Shelf: An Astounding Baseline for Recognition

Bag of Tricks for Image Classification with Convolutional Neural Networks

Very Deep Convolutional Networks for Large-Scale Image Recognition

Best Practices for Convolutional Neural Networks Applied to Object Recognition in Images

Convolutional neural network: a review of models, methodologies and applications to object detection

Visualizing and comparing AlexNet and VGG using deconvolutional layers