Think Again Networks and the Delta Loss

Alexandre Salle,Marcelo Prates

DOI: https://doi.org/10.48550/arXiv.1904.11816

2019-05-01

Abstract:This short paper introduces an abstraction called Think Again Networks (ThinkNet) which can be applied to any state-dependent function (such as a recurrent neural network).

Computation and Language,Machine Learning

What problem does this paper attempt to address?

Shallow-Deep Networks: Understanding and Mitigating Network Overthinking

Yigitcan Kaya,Sanghyun Hong,Tudor Dumitras

DOI: https://doi.org/10.48550/arXiv.1810.07052

2019-05-09

Abstract:We characterize a prevalent weakness of deep neural networks (DNNs)---overthinking---which occurs when a DNN can reach correct predictions before its final layer. Overthinking is computationally wasteful, and it can also be destructive when, by the final layer, a correct prediction changes into a misclassification. Understanding overthinking requires studying how each prediction evolves during a DNN's forward pass, which conventionally is opaque. For prediction transparency, we propose the Shallow-Deep Network (SDN), a generic modification to off-the-shelf DNNs that introduces internal classifiers. We apply SDN to four modern architectures, trained on three image classification tasks, to characterize the overthinking problem. We show that SDNs can mitigate the wasteful effect of overthinking with confidence-based early exits, which reduce the average inference cost by more than 50% and preserve the accuracy. We also find that the destructive effect occurs for 50% of misclassifications on natural inputs and that it can be induced, adversarially, with a recent backdooring attack. To mitigate this effect, we propose a new confusion metric to quantify the internal disagreements that will likely lead to misclassifications.

Machine Learning,Computer Vision and Pattern Recognition
Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

HJ Tang,KC Tan,EJ Teoh

DOI: https://doi.org/10.1109/tnn.2005.863457

2006-01-01

IEEE Transactions on Neural Networks

Abstract:The additive recurrent network structure of linear threshold neurons represents a class of biologically-motivated models, where nonsaturating transfer functions are necessary for representing neuronal activities, such as that of cortical neurons. This paper extends the existing results of dynamics analysis of such linear threshold networks by establishing new and milder conditions for boundedness and asymptotical stability, while allowing for multistability. As a condition for asymptotical stability, it is found that boundedness does not require a deterministic matrix to be symmetric or possess positive off-diagonal entries. The conditions put forward an explicit way to design and analyze such networks. Based on the established theory, an alternate approach to study such networks is through permitted and forbidden sets. An application of the linear threshold (LT) network is analog associative memory, for which a simple design method describing the associative memory is suggested in this paper. The proposed design method is similar to a generalized Hebbian approach, but with distinctions of additional network parameters for normalization, excitation and inhibition, both on a global and local scale. The computational abilities of the network are dependent on its nonlinear dynamics, which in turn is reliant upon the sparsity of the memory vectors.
Neural Nets via Forward State Transformation and Backward Loss Transformation

Bart Jacobs,David Sprunger

DOI: https://doi.org/10.48550/arXiv.1803.09356

2018-03-26

Abstract:This article studies (multilayer perceptron) neural networks with an emphasis on the transformations involved --- both forward and backward --- in order to develop a semantical/logical perspective that is in line with standard program semantics. The common two-pass neural network training algorithms make this viewpoint particularly fitting. In the forward direction, neural networks act as state transformers. In the reverse direction, however, neural networks change losses of outputs to losses of inputs, thereby acting like a (real-valued) predicate transformer. In this way, backpropagation is functorial by construction, as shown earlier in recent other work. We illustrate this perspective by training a simple instance of a neural network.

Neural and Evolutionary Computing,Machine Learning
Latent Assistance Networks: Rediscovering Hyperbolic Tangents in RL

Jacob E. Kooi,Mark Hoogendoorn,Vincent François-Lavet

2024-06-13

Abstract:Activation functions are one of the key components of a neural network. The most commonly used activation functions can be classed into the category of continuously differentiable (e.g. tanh) and linear-unit functions (e.g. ReLU), both having their own strengths and drawbacks with respect to downstream performance and representation capacity through learning (e.g. measured by the number of dead neurons and the effective rank). In reinforcement learning, the performance of continuously differentiable activations often falls short as compared to linear-unit functions. From the perspective of the activations in the last hidden layer, this paper provides insights regarding this sub-optimality and explores how activation functions influence the occurrence of dead neurons and the magnitude of the effective rank. Additionally, a novel neural architecture is proposed that leverages the product of independent activation values. In the Atari domain, we show faster learning, a reduction in dead neurons and increased effective rank.

Machine Learning
Catastrophic Importance of Catastrophic Forgetting

Albert Ierusalem

DOI: https://doi.org/10.48550/arXiv.1808.07049

2018-08-21

Abstract:This paper describes some of the possibilities of artificial neural networks that open up after solving the problem of catastrophic forgetting. A simple model and reinforcement learning applications of existing methods are also proposed.

Machine Learning,Artificial Intelligence
State-Reification Networks: Improving Generalization by Modeling the Distribution of Hidden Representations

Alex Lamb,Jonathan Binas,Anirudh Goyal,Sandeep Subramanian,Ioannis Mitliagkas,Denis Kazakov,Yoshua Bengio,Michael C. Mozer

DOI: https://doi.org/10.48550/arXiv.1905.11382

2019-05-26

Abstract:Machine learning promises methods that generalize well from finite labeled data. However, the brittleness of existing neural net approaches is revealed by notable failures, such as the existence of adversarial examples that are misclassified despite being nearly identical to a training example, or the inability of recurrent sequence-processing nets to stay on track without teacher forcing. We introduce a method, which we refer to as \emph{state reification}, that involves modeling the distribution of hidden states over the training data and then projecting hidden states observed during testing toward this distribution. Our intuition is that if the network can remain in a familiar manifold of hidden space, subsequent layers of the net should be well trained to respond appropriately. We show that this state-reification method helps neural nets to generalize better, especially when labeled data are sparse, and also helps overcome the challenge of achieving robust generalization with adversarial training.

Machine Learning,Artificial Intelligence
Imagine Networks

Seokjun Kim,Jaeeun Jang,Hyeoncheol Kim

DOI: https://doi.org/10.48550/arXiv.2111.03048

2021-12-30

Abstract:In this paper, we introduce an imagine network that can simulate itself through artificial association networks. Association, deduction, and memory networks are learned, and a network is created by combining the discriminator and reinforcement learning models. This model can learn various datasets or data samples generated in environments and generate new data samples.

Artificial Intelligence
Reversible Recurrent Neural Networks

Matthew MacKay,Paul Vicol,Jimmy Ba,Roger Grosse

DOI: https://doi.org/10.48550/arXiv.1810.10999

2018-10-26

Abstract:Recurrent neural networks (RNNs) provide state-of-the-art performance in processing sequential data but are memory intensive to train, limiting the flexibility of RNN models which can be trained. Reversible RNNs---RNNs for which the hidden-to-hidden transition can be reversed---offer a path to reduce the memory requirements of training, as hidden states need not be stored and instead can be recomputed during backpropagation. We first show that perfectly reversible RNNs, which require no storage of the hidden activations, are fundamentally limited because they cannot forget information from their hidden state. We then provide a scheme for storing a small number of bits in order to allow perfect reversal with forgetting. Our method achieves comparable performance to traditional models while reducing the activation memory cost by a factor of 10--15. We extend our technique to attention-based sequence-to-sequence models, where it maintains performance while reducing activation memory cost by a factor of 5--10 in the encoder, and a factor of 10--15 in the decoder.

Machine Learning
Forget but Recall: Incremental Latent Rectification in Continual Learning

Nghia D. Nguyen,Hieu Trung Nguyen,Ang Li,Hoang Pham,Viet Anh Nguyen,Khoa D. Doan

2024-06-25

Abstract:Intrinsic capability to continuously learn a changing data stream is a desideratum of deep neural networks (DNNs). However, current DNNs suffer from catastrophic forgetting, which hinders remembering past knowledge. To mitigate this issue, existing Continual Learning (CL) approaches either retain exemplars for replay, regularize learning, or allocate dedicated capacity for new tasks. This paper investigates an unexplored CL direction for incremental learning called Incremental Latent Rectification or ILR. In a nutshell, ILR learns to propagate with correction (or rectify) the representation from the current trained DNN backward to the representation space of the old task, where performing predictive decisions is easier. This rectification process only employs a chain of small representation mapping networks, called rectifier units. Empirical experiments on several continual learning benchmarks, including CIFAR10, CIFAR100, and Tiny ImageNet, demonstrate the effectiveness and potential of this novel CL direction compared to existing representative CL methods.

Machine Learning,Computer Vision and Pattern Recognition
Intriguing Properties of Randomly Weighted Networks: Generalizing While Learning Next to Nothing

Amir Rosenfeld,John K. Tsotsos

DOI: https://doi.org/10.1109/crv.2019.00010

2019-05-01

Abstract:Training deep neural networks results in strong learned representations that show good generalization capabilities. In most cases, training involves iterative modification of all weights in the network via back-propagation. In Extreme Learning Machines, it has been suggested to set the first layer of a network to fixed random values instead of learning it. In this paper, we propose to take this approach a step further and fix almost all layers of a deep convolutional neural network, allowing only a small portion of the weights to be learned. As our experiments show, fixing even the majority of the parameters of the network often results in performance which is on par with the performance of learning all of them. The implications of this intriguing property of deep neural networks are discussed and we suggest practical ways to harness it to create more robust and compact representations.
The Neural Race Reduction: Dynamics of Abstraction in Gated Networks

Andrew M. Saxe,Shagun Sodhani,Sam Lewallen

DOI: https://doi.org/10.48550/arXiv.2207.10430

2022-07-21

Abstract:Our theoretical understanding of deep learning has not kept pace with its empirical success. While network architecture is known to be critical, we do not yet understand its effect on learned representations and network behavior, or how this architecture should reflect task <a class="link-external link-http" href="http://structure.In" rel="external noopener nofollow">this http URL</a> this work, we begin to address this gap by introducing the Gated Deep Linear Network framework that schematizes how pathways of information flow impact learning dynamics within an architecture. Crucially, because of the gating, these networks can compute nonlinear functions of their input. We derive an exact reduction and, for certain cases, exact solutions to the dynamics of learning. Our analysis demonstrates that the learning dynamics in structured networks can be conceptualized as a neural race with an implicit bias towards shared representations, which then govern the model's ability to systematically generalize, multi-task, and transfer. We validate our key insights on naturalistic datasets and with relaxed assumptions. Taken together, our work gives rise to general hypotheses relating neural architecture to learning and provides a mathematical approach towards understanding the design of more complex architectures and the role of modularity and compositionality in solving real-world problems. The code and results are available at <a class="link-external link-https" href="https://www.saxelab.org/gated-dln" rel="external noopener nofollow">this https URL</a> .

Machine Learning,Artificial Intelligence
Neural Redshift: Random Networks are not Random Functions

Damien Teney,Armand Nicolicioiu,Valentin Hartmann,Ehsan Abbasnejad

2024-03-05

Abstract:Our understanding of the generalization capabilities of neural networks (NNs) is still incomplete. Prevailing explanations are based on implicit biases of gradient descent (GD) but they cannot account for the capabilities of models from gradient-free methods nor the simplicity bias recently observed in untrained networks. This paper seeks other sources of generalization in NNs.

Machine Learning,Artificial Intelligence,Computer Vision and Pattern Recognition
IF2Net: Innately Forgetting-Free Networks for Continual Learning

Depeng Li,Tianqi Wang,Bingrong Xu,Kenji Kawaguchi,Zhigang Zeng,Ponnuthurai Nagaratnam Suganthan

2023-06-18

Abstract:Continual learning can incrementally absorb new concepts without interfering with previously learned knowledge. Motivated by the characteristics of neural networks, in which information is stored in weights on connections, we investigated how to design an Innately Forgetting-Free Network (IF2Net) for continual learning context. This study proposed a straightforward yet effective learning paradigm by ingeniously keeping the weights relative to each seen task untouched before and after learning a new task. We first presented the novel representation-level learning on task sequences with random weights. This technique refers to tweaking the drifted representations caused by randomization back to their separate task-optimal working states, but the involved weights are frozen and reused (opposite to well-known layer-wise updates of weights). Then, sequential decision-making without forgetting can be achieved by projecting the output weight updates into the parsimonious orthogonal space, making the adaptations not disturb old knowledge while maintaining model plasticity. IF2Net allows a single network to inherently learn unlimited mapping rules without telling task identities at test time by integrating the respective strengths of randomization and orthogonalization. We validated the effectiveness of our approach in the extensive theoretical analysis and empirical study.

Machine Learning,Computer Vision and Pattern Recognition
Rethinking Arithmetic for Deep Neural Networks

George A. Constantinides

DOI: https://doi.org/10.1098/rsta.2019.0051

2019-09-17

Abstract:We consider efficiency in the implementation of deep neural networks. Hardware accelerators are gaining interest as machine learning becomes one of the drivers of high-performance computing. In these accelerators, the directed graph describing a neural network can be implemented as a directed graph describing a Boolean circuit. We make this observation precise, leading naturally to an understanding of practical neural networks as discrete functions, and show that so-called binarised neural networks are functionally complete. In general, our results suggest that it is valuable to consider Boolean circuits as neural networks, leading to the question of which circuit topologies are promising. We argue that continuity is central to generalisation in learning, explore the interaction between data coding, network topology, and node functionality for continuity, and pose some open questions for future research. As a first step to bridging the gap between continuous and Boolean views of neural network accelerators, we present some recent results from our work on LUTNet, a novel Field-Programmable Gate Array inference approach. Finally, we conclude with additional possible fruitful avenues for research bridging the continuous and discrete views of neural networks.

Machine Learning,Hardware Architecture,Neural and Evolutionary Computing
Rethinking the Relationship between Recurrent and Non-Recurrent Neural Networks: A Study in Sparsity

Quincy Hershey,Randy Paffenroth,Harsh Pathak,Simon Tavener

2024-04-01

Abstract:Neural networks (NN) can be divided into two broad categories, recurrent and non-recurrent. Both types of neural networks are popular and extensively studied, but they are often treated as distinct families of machine learning algorithms. In this position paper, we argue that there is a closer relationship between these two types of neural networks than is normally appreciated. We show that many common neural network models, such as Recurrent Neural Networks (RNN), Multi-Layer Perceptrons (MLP), and even deep multi-layer transformers, can all be represented as iterative maps.

Machine Learning
Learning to Forget using Hypernetworks

Jose Miguel Lara Rangel,Stefan Schoepf,Jack Foster,David Krueger,Usman Anwar

2024-12-01

Abstract:Machine unlearning is gaining increasing attention as a way to remove adversarial data poisoning attacks from already trained models and to comply with privacy and AI regulations. The objective is to unlearn the effect of undesired data from a trained model while maintaining performance on the remaining data. This paper introduces HyperForget, a novel machine unlearning framework that leverages hypernetworks - neural networks that generate parameters for other networks - to dynamically sample models that lack knowledge of targeted data while preserving essential capabilities. Leveraging diffusion models, we implement two Diffusion HyperForget Networks and used them to sample unlearned models in Proof-of-Concept experiments. The unlearned models obtained zero accuracy on the forget set, while preserving good accuracy on the retain sets, highlighting the potential of HyperForget for dynamic targeted data removal and a promising direction for developing adaptive machine unlearning algorithms.

Machine Learning,Artificial Intelligence,Cryptography and Security
Forgetting Outside the Box: Scrubbing Deep Networks of Information Accessible from Input-Output Observations

Aditya Golatkar,Alessandro Achille,Stefano Soatto

DOI: https://doi.org/10.48550/arXiv.2003.02960

IF: 5.414

2020-03-05

Machine Learning

Abstract:We describe a procedure for removing dependency on a cohort of training data from a trained deep network that improves upon and generalizes previous methods to different readout functions and can be extended to ensure forgetting in the activations of the network. We introduce a new bound on how much information can be extracted per query about the forgotten cohort from a black-box network for which only the input-output behavior is observed. The proposed forgetting procedure has a deterministic part derived from the differential equations of a linearized version of the model, and a stochastic part that ensures information destruction by adding noise tailored to the geometry of the loss landscape. We exploit the connections between the activation and weight dynamics of a DNN inspired by Neural Tangent Kernels to compute the information in the activations.
Elephant Neural Networks: Born to Be a Continual Learner

Qingfeng Lan,A. Rupam Mahmood

2023-10-03

Abstract:Catastrophic forgetting remains a significant challenge to continual learning for decades. While recent works have proposed effective methods to mitigate this problem, they mainly focus on the algorithmic side. Meanwhile, we do not fully understand what architectural properties of neural networks lead to catastrophic forgetting. This study aims to fill this gap by studying the role of activation functions in the training dynamics of neural networks and their impact on catastrophic forgetting. Our study reveals that, besides sparse representations, the gradient sparsity of activation functions also plays an important role in reducing forgetting. Based on this insight, we propose a new class of activation functions, elephant activation functions, that can generate both sparse representations and sparse gradients. We show that by simply replacing classical activation functions with elephant activation functions, we can significantly improve the resilience of neural networks to catastrophic forgetting. Our method has broad applicability and benefits for continual learning in regression, class incremental learning, and reinforcement learning tasks. Specifically, we achieves excellent performance on Split MNIST dataset in just one single pass, without using replay buffer, task boundary information, or pre-training.

Machine Learning,Artificial Intelligence
Syntactic vs Semantic Linear Abstraction and Refinement of Neural Networks

Calvin Chau,Jan Křetínský,Stefanie Mohr

2023-07-20

Abstract:Abstraction is a key verification technique to improve scalability. However, its use for neural networks is so far extremely limited. Previous approaches for abstracting classification networks replace several neurons with one of them that is similar enough. We can classify the similarity as defined either syntactically (using quantities on the connections between neurons) or semantically (on the activation values of neurons for various inputs). Unfortunately, the previous approaches only achieve moderate reductions, when implemented at all. In this work, we provide a more flexible framework where a neuron can be replaced with a linear combination of other neurons, improving the reduction. We apply this approach both on syntactic and semantic abstractions, and implement and evaluate them experimentally. Further, we introduce a refinement method for our abstractions, allowing for finding a better balance between reduction and precision.

Logic in Computer Science,Artificial Intelligence,Machine Learning

Think Again Networks and the Delta Loss

Shallow-Deep Networks: Understanding and Mitigating Network Overthinking

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

Neural Nets via Forward State Transformation and Backward Loss Transformation

Latent Assistance Networks: Rediscovering Hyperbolic Tangents in RL

Catastrophic Importance of Catastrophic Forgetting

State-Reification Networks: Improving Generalization by Modeling the Distribution of Hidden Representations

Imagine Networks

Reversible Recurrent Neural Networks

Forget but Recall: Incremental Latent Rectification in Continual Learning

Intriguing Properties of Randomly Weighted Networks: Generalizing While Learning Next to Nothing

The Neural Race Reduction: Dynamics of Abstraction in Gated Networks

Neural Redshift: Random Networks are not Random Functions

IF2Net: Innately Forgetting-Free Networks for Continual Learning

Rethinking Arithmetic for Deep Neural Networks

Rethinking the Relationship between Recurrent and Non-Recurrent Neural Networks: A Study in Sparsity

Learning to Forget using Hypernetworks

Forgetting Outside the Box: Scrubbing Deep Networks of Information Accessible from Input-Output Observations

Elephant Neural Networks: Born to Be a Continual Learner

Syntactic vs Semantic Linear Abstraction and Refinement of Neural Networks