Abstract:Developing strong AI signifies the arrival of technological singularity, contributing greatly to advancing human civilization and resolving social issues. Neural networks (NNs) and deep learning, which utilize NNs, are expected to lead to strong AI due to their biological neural system-mimicking structures. However, the statistical weight optimization techniques commonly used, such as error backpropagation and loss functions, may hinder the mimicry of neural systems. This study discusses the information propagation capabilities and potential practical applications of NNs as neural system mimicking structures by solving the handwritten character recognition problem in the Modified National Institute of Standards and Technology (MNIST) database without using statistical weight optimization techniques like error backpropagation. In this study, the NNs architecture comprises fully connected layers using step functions as activation functions, with 0-15 hidden layers, and no weight updates. The accuracy is calculated by comparing the average output vectors of the training data for each label with the output vectors of the test data, based on vector similarity. The results showed that the maximum accuracy achieved is around 80%. This indicates that NNs can propagate information correctly without using statistical weight optimization. Additionally, the accuracy decreased with an increasing number of hidden layers. This is attributed to the decrease in the variance of the output vectors as the number of hidden layers increases, suggesting that the output data becomes smooth. This study's NNs and accuracy calculation methods are simple and have room for various improvements. Moreover, creating a feedforward NNs that repeatedly cycles through 'input -> processing -> output -> environmental response -> input -> ...' could pave the way for practical software applications.

Rethinking Deep Learning: Non-backpropagation and Non-optimization Machine Learning Approach Using Hebbian Neural Networks

Rethinking Deep Learning: Propagating Information in Neural Networks without Backpropagation and Statistical Optimization

Hebbian Deep Learning Without Feedback

Neural Networks from Biological to Artificial and Vice Versa

Towards New Generation, Biologically Plausible Deep Neural Network Learning

Continual Learning with Deep Artificial Neurons

A Review of Neuroscience-Inspired Machine Learning

The Unreasonable Effectiveness of Deep Learning in Artificial Intelligence

Memory Networks: Towards Fully Biologically Plausible Learning

Dendritic Neuron Model with Effective Learning Algorithms for Classification, Approximation, and Prediction

Deep Learning: a new definition of artificial neuron with double weight

Kernelized information bottleneck leads to biologically plausible 3-factor Hebbian learning in deep networks

A single fast Hebbian-like process enabling one-shot class addition in deep neural networks without backbone modification

Deep Learning 2.0: Artificial Neurons That Matter -- Reject Correlation, Embrace Orthogonality

PC-SNN: Supervised Learning with Local Hebbian Synaptic Plasticity Based on Predictive Coding in Spiking Neural Networks

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

Deep learning incorporating biologically-inspired neural dynamics

Towards Self-Assembling Artificial Neural Networks through Neural Developmental Programs

Neuronal Auditory Machine Intelligence (NEURO-AMI) In Perspective

Correlative Information Maximization: A Biologically Plausible Approach to Supervised Deep Neural Networks without Weight Symmetry