Abstract:Pre-trained Artificial Neural Networks (ANNs) exhibit robust pattern recognition capabilities and share extensive similarities with the human brain, specifically Biological Neural Networks (BNNs). We are particularly intrigued by these models' ability to acquire new knowledge through fine-tuning. In this regard, Parameter-efficient Fine-tuning (PEFT) has gained widespread adoption as a substitute for full fine-tuning due to its cost reduction in training and mitigation of over-fitting risks by limiting the number of trainable parameters during adaptation. Since both ANNs and BNNs propagate information layer-by-layer, a common analogy can be drawn: weights in ANNs represent synapses in BNNs, while features (also known as latent variables or logits) in ANNs represent neurotransmitters released by neurons in BNNs. Mainstream PEFT methods aim to adjust feature or parameter values using only a limited number of trainable parameters (usually less than 1% of the total parameters), yet achieve surprisingly good results. Building upon this clue, we delve deeper into exploring the connections between feature adjustment and parameter adjustment, resulting in our proposed method Synapses & Neurons (SAN) that learns scaling matrices for features and propagates their effects towards posterior weight matrices. Our approach draws strong inspiration from well-known neuroscience phenomena - Long-term Potentiation (LTP) and Long-term Depression (LTD), which also reveal the relationship between synapse development and neurotransmitter release levels. We conducted extensive comparisons of PEFT on 26 datasets using attention-based networks as well as convolution-based networks, leading to significant improvements compared to other tuning methods (+8.5% over fully-finetune, +7% over Visual Prompt Tuning, and +3.2% over LoRA). The codes would be released.

Comparison Training for Computer Chinese Chess

Mastering Chinese Chess AI (Xiangqi) Without Search

Temporal difference learning in Chinese Chess

Design and improvement of the pruning algorithm of the Chinese chess in the computer games

Code Comparison Tuning for Code Large Language Models

A Comparative Study of Neural-Network Feature Weighting

Application of Q-Learning and RBF Network in Chinese Chess Game System

Checkmating One, by Using Many: Combining Mixture of Experts with MCTS to Improve in Chess

A Probabilistic Approach for Alignment with Human Comparisons

Beyond Monte Carlo Tree Search: Playing Go with Deep Alternative Neural Network and Long-Term Evaluation

Genetic Algorithms for Mentor-Assisted Evaluation Function Optimization

Design and Implementation of Chinese Chess Based on Manipulator

Discovering Long-Term Effects on Parameter Efficient Fine-tuning

Dual-Tuning: Joint Prototype Transfer and Structure Regularization for Compatible Feature Learning

Statistical Feature Combination for the Evaluation of Game Positions

The Improvement of Q-learning Applied to Imperfect Information Game

S4-Tuning: A Simple Cross-lingual Sub-network Tuning Method-Tuning: A Simple Cross-lingual Sub-network Tuning Method

Optimizing Non-Autoregressive Transformers with Contrastive Learning

Learning to Compare for Better Training and Evaluation of Open Domain Natural Language Generation Models

A Study on Training Fine-Tuning of Convolutional Neural Networks.

Improving Contrastive Learning by Visualizing Feature Transformation