New Exponential Bidirectional Associative Memory

Wang Baoyun,Zhang Qing,He Zhenya

DOI: https://doi.org/10.1007/bf02684715

1996-01-01

Journal of Electronics (China)

Abstract:A new exponential bidirectional associative memory model is introduced. It offers an even better recall performance than the modified exponential bidirectional associative memory (MEBAM). Only a little complexity of realization is spent for the improvement.

What problem does this paper attempt to address?

A New Bidirectional Associative Memory Model—homibam

Wang Baoyun,Yang Luxi,He Zhenya

DOI: https://doi.org/10.1007/bf02729273

1995-01-01

Journal of Electronics (China)

Abstract:A new bidirectional associative memory model named as HOMIBAM is introduced. The relationships of HOMIBAM with the models existed are pointed out. Both theoretical analysis and simulations show that the capacity and recall performance of HOMIBAM are superior to that of modified intraconnected BAM (MIBAM), higher-order BAM (HOBAM) greatly.
Optimal learning algorithm in bidirectional associative memories

Tao Wang,Zhuang, X.,Xiaoliang Xing,Lu, F.

DOI: https://doi.org/10.1109/IJCNN.1991.155332

1991-01-01

Abstract:The authors present an optimal learning algorithm in a discrete bidirectional associative memory (BAM). According to the cost function that measures the goodness of BAM, the authors transform the problem of specifying the connection matrix into a global optimization, solved by a gradient descent method. This learning algorithm guarantees to store all trained patterns whenever it is allowable. Experimental results are reported to demonstrate the power of the algorithm
Designing Bidirectional Associative Memories with Optimal Stability

T WANG,XH ZHUANG,XL XING

DOI: https://doi.org/10.1109/21.293491

1994-01-01

Abstract:In this paper, a learning algorithm for bidirectional associative memories (BAM's) with optimal stability is presented. According to an objective function that measures the stability and attraction of the BAM, the authors cast the learning procedure into a global minimization problem, solved by a gradient descent technique. This learning rule guarantees the storage of training patterns with basins of attraction as large as possible. The authors also investigate the storage capacity of the BAR/L, the convergence of the learning method, the asymptotic stability of each training pattern and its basin of attraction. To evaluate the performance of the authors' learning strategy, a large number of simulations have been carried out
A Bidirectional Associative Memory Based on Optimal Linear Associative Memory

ZO Wang

DOI: https://doi.org/10.1109/12.543710

IF: 3.183

1996-01-01

IEEE Transactions on Computers

Abstract:A bidirectional associative memory is presented. Unlike many existing BAM algorithms, the presented BAM uses an optimal associative memory matrix in place of the standard Hebbian or quasi correlation matrix. The optimal associative memory matrix is determined by using only simple correlation learning, requiring no pseudoinverse calculation. Guaranteed recall of all training pairs is ensured by the present BAM. The designs of a linear BAM (LBAM) and a nonlinear BAM (NBAM) are given, and the stability and other performances of the BAMs are analyzed. The introduction of a nonlinear characteristic enhances considerably the ability of the BAM to suppress the noises occurring in the output pattern, and reduces largely the spurious memories, and therefore improves greatly the recall performance of the BAM. Due to the nonsymmetry of the connection matrix of the network, the capacities of the present BAMs are far higher than that of the existing BAMs. Excellent performances of the present BAMs are shown by simulation results.
A New Higher Order Bidirectional Associative Memory Model and Its Performance Estimation

Chen Song

1998-01-01

Journal of Software

Abstract:In this paper, a new higher order bidirectional associative memory model is presented. It is an extension of Tai's HOBAM(higher order bidirectional associative memory) and Jeng's MIBAM(modified intraconnected BAM). The stability of the new model, in synchronous and asynchronous updating modes, is proven by defining an energy function such that it can ensure all the training pattern pairs to become its asymptotically stable points. Using statistical analysis principle, the storage capacity of the proposed model is estimated. The computer simulations show that this model has not only higher storage capacity but also better error correcting capability.
Asymmetric Bidirectional Associative Memories.

ZB XU,Y LEUNG,XW HE

DOI: https://doi.org/10.1109/21.310539

1994-01-01

IEEE Transactions on Systems Man and Cybernetics

Abstract:Bidirectional associative memory (BAM) is a potentially promising model for heteroassociative memories. However, its applications are severely restricted to networks with logical symmetry of interconnections and pattern orthogonality or small pattern size. Although the restrictions on pattern orthogonality and pattern size can be relaxed to a certain extent, all previous efforts are at the cost of increase in connection complexity. In this paper, a new modification of the BAM is made and a new model named asymmetric bidirectional associative memory (ABAM) is proposed. This model not only can cater for the logical asymmetry of interconnections but also is capable of accommodating a larger number of non-orthogonal patterns. Furthermore, all these properties of the ABAM are achieved without increasing the connection complexity of the network. Theoretical analysis and simulation results all demonstrate that the ABAM indeed outperforms the BAM and its existing variants in all aspects of storage capacity, error-correcting capability and convergence
Optimal Bidirectional Associative Memories.

GY Shi

DOI: https://doi.org/10.1080/00207720050030798

IF: 2.648

2000-01-01

International Journal of Systems Science

Abstract:This paper proposes a model for linear optimal bidirectional associative memories (BAMs), in which the design of the weight matrix is based on a least-squares cost functional. The minimization of the functional leads to a Lyapunov-type matrix equation. The mathematical properties of such an optimal bidirectional system are studied in detail. Simulations are conducted for the bidirectional association of pattern pairs with grey levels. It is shown that this optimal design of BAM is effective for memorizing patterns with grey levels.
Bidirectional Associative Memory Utilizing Maximum Likelihood

Xiaoliang WEI,Zuren FENG,Hong CHANG

DOI: https://doi.org/10.3321/j.issn:0253-987X.2008.08.008

2008-01-01

Abstract:A new learning rule and theoretical analysis of an extended bidirectional associative memory network (MLBAM) are presented by using the maximum likelihood criterion based on two well recognized and essential criteria, i.e., the convergence of the learning rule, and the noise tolerance of the network. Traditional methods fail to distinguish highly closing patterns. However, this disadvantage is improved by using the newly developed method, since the maximum likelihood method is used to seek the best possible closing mapping of two patterns. Experiments are made to verify the validity and efficiency of the proposed method. The method displays excellent anti-noise property and MLBAM network exhibits association at a 100% accuracy under one-bit inversion which implies that 100% of the one-bit errors is corrected.
Exponential Stability of Bidirectional Associative Memory Neural Networks with Variable Delays and Impulsive

Chaolong Zhang,Fang Yang,Dongqing Wu,Jun Yang

DOI: https://doi.org/10.1109/icca.2007.4376556

2007-01-01

Abstract:In this paper, a model of impulsive general BAMs neural networks is first formulated.We investigate impulsive effects on the stability of BAMs neural networks with variable delays and obtain some sufficient conditions ensuring exponential stability of the impulsive variable delays system.The results extend and improve some recent works for impulsive neural networks as well as non-impulsive neural networks.
Some statistical analysis of the recall probability of parallel intraconnected bidirectional associative memory

Wang Baoyun,Yang Luxi,Lu Hongtao,He Zhenya

DOI: https://doi.org/10.1007/BF02684710

1996-01-01

Journal of Electronics (China)

Abstract:This paper addressed a statistical analysis for the recall of parallel intraconnected bidirectional associative memory—Modified Intraconnected Bidirectional Associative Memory 0 (MIBAM) and proved the conclusions: two MIBAM with the equal total number of neurons have the equal recalling probability form pairs of stored pattern pairs ifm is not too large. So they have the same capacity and same error correcting ability, i. e., their performances are statistically equivalent. The results of simulation support the conclusions well.
An extended BAM neural network model

Miao Zhenjiang,Yuan Baozong

DOI: https://doi.org/10.1109/IJCNN.1993.714276

1993-01-01

Abstract:Proposes an extended bidirectional associative memory (BAM) neural network model which can do auto- and hetero-associative memory. The theoretical proof for this neural network model's stability is given. Experiments show that this neural network model is much more powerful than the M-P model, discrete Hopfield neural network, continuous Hopfield neural network, discrete bidirectional associative memory neural network, continuous and adaptive bidirectional associative memory neural network, backpropagation neural network and optimal designed nonlinear continuous neural network. Experimental results also show that, when it does auto-associative memory, the power of this model is the same as the loop neural network model which can only do auto-associative memory.
A reconfigurable bidirectional associative memory network with memristor bridge

Yingying Li,Junrui Li,Jie Li,Shukai Duan,Lidan Wang,Mingjian Guo

DOI: https://doi.org/10.1016/j.neucom.2021.04.077

IF: 6

2021-09-01

Neurocomputing

Abstract:<p>Bidirectional associative memories (BAMs) have been extensively applied in auto and heteroassociative learning. However, the research on the hardware implementation of BAM neural networks is relatively few. Memristor, a nanoscale synaptic-like element, provides a new perspective for the circuit implementation of neural networks. In this work, we improve a threshold memristor bridge circuit (T-MBC) and design a novel memristive bidirectional associative memory (MBAM) network circuit on this basis. T-MBC is capable to achieve positive, negative, and zero synaptic weights without any switches, inverters, transistors, and current–voltage conversion processes. The validity of T-MBC is illustrated by PSPICE. MBAM has a simpler structure and gains excellent effects in flexibility, and reconfigurability. Besides, it is shown that MBAM can be trained to recall both disturbed binary images and incomplete/noisy grey-scale images robustly. Meanwhile, a more complex application of emotion classification based on MBAM is also accomplished. Experimental results verify the effectiveness of the MBAM neural network and demonstrate that the MBAM neural network has high recognition accuracy and strong noise immunity.</p>

computer science, artificial intelligence
On the Capacity of Intraconnected Bidirectional Associative Memory

Baoyun Wang,Luxi Yang,Hongtao Lu,Zhenya He

DOI: https://doi.org/10.1109/ISCAS.1995.521541

1995-01-01

Abstract:In this paper, we addressed a theoretical analysis for the capacity of parallel intra-connected bidirectional associative memory (MIBAM) and proved the conclusions: two MIBAM with the equal total number of neurons have the equal recalling probability for m pairs of stored pattern pairs if m is not too large. The results of computer simulation support the conclusions well
Lmi-Based Exponential Stability Criterion for Bidirectional Associative Memory Neural Networks

Magdi S. Mahmoud,Yuanqing Xia

DOI: https://doi.org/10.1016/j.neucom.2010.03.006

IF: 6

2010-01-01

Neurocomputing

Abstract:In this paper, we investigate the problem of global exponential stability analysis for a class of bidirectional associative memory (BAM) neural networks with interval time-delays. Improved exponential stability condition is derived by employing new Lyapunov–Krasovskii functional and the integral inequality. Several special cases of interest are derived. The developed stability criteria are delay dependent and characterized by linear matrix inequalities (LMIs). The developed results are shown to be less conservative than previous published ones in the literature. Finally, simulations of two numerical examples are provided to demonstrate the efficacy of our approach.
Global Exponential Stability of Bidirectional Associative Memory Neural Networks with Distributed Delays

Qiankun Song,Jinde Cao

DOI: https://doi.org/10.1016/j.cam.2006.02.031

IF: 2.872

2007-01-01

Journal of Computational and Applied Mathematics

Abstract:A bidirectional associative memory neural network model with distributed delays is considered. By constructing a new Lyapunov functional, employing the homeomorphism theory, M-matrix theory and the inequality a∏k=1mbkqk⩽1r(∑k=1mqkbkr+ar) (a⩾0,bk⩾0,qk>0 with ∑k=1mqk=r-1, and r>1), a sufficient condition is obtained to ensure the existence, uniqueness and global exponential stability of the equilibrium point for the model. Moreover, the exponential converging velocity index is estimated, which depends on the delay kernel functions and the system parameters. The results generalize and improve the earlier publications, and remove the usual assumption that the activation functions are bounded . Two numerical examples are given to show the effectiveness of the obtained results.
Dual Memory Model for Experience-Once Task-Incremental Lifelong Learning.

Gehua Ma,Runhao Jiang,Lang Wang,Huajin Tang

DOI: https://doi.org/10.1016/j.neunet.2023.07.009

IF: 7.8

2023-01-01

Neural Networks

Abstract:Experience replay (ER) is a widely-adopted neuroscience-inspired method to perform lifelong learning. Nonetheless, existing ER-based approaches consider very coarse memory modules with simple memory and rehearsal mechanisms that cannot fully exploit the potential of memory replay. Evidence from neuroscience has provided fine-grained memory and rehearsal mechanisms, such as the dual-store memory system consisting of PFC-HC circuits. However, the computational abstraction of these processes is still very challenging. To address these problems, we introduce the Dual-Memory (Dual-MEM) model emulating the memorization, consolidation, and rehearsal process in the PFC-HC dual-store memory circuit. Dual-MEM maintains an incrementally updated short-term memory to benefit current-task learning. At the end of the current task, short-term memories will be consolidated into long-term ones for future rehearsal to alleviate forgetting. For the Dual-MEM optimization, we propose two learning policies that emulate different memory retrieval strategies: Direct Retrieval Learning and Mixup Retrieval Learning. Extensive evaluations on eight benchmarks demonstrate that Dual-MEM delivers compelling performance while maintaining high learning and memory utilization efficiencies under the challenging experience-once setting.
Genetic Approach to the Design of Bidirectional Associative Memory.

GY Shi

DOI: https://doi.org/10.1080/00207729708929371

IF: 2.648

1997-01-01

International Journal of Systems Science

Abstract:A genetic design approach to learning the weight matrix of a bidirectional associative memory (BAM) is proposed in this paper. This approach removes inadequacies in conventional iterative learning algorithms A restriction is made in the weight matrix representation in order to reduce the solution search. Design procedures are provided in detail. Simulations show that an approximate weight matrix can be effectively learnt by applying a genetic algorithm, which possesses extensive searching ability. By this approach, higher storage capacity and a satisfactory approximate recall can be realized despite the restriction imposed on the weight matrix. For the case that all training pattern pairs are storable, the genetic approach is capable of automatically making the attraction basin of each stored pattern pair as large as possible. This is realized by an appropriately defined discrete evaluation index. A larger attraction basin implies higher noise correction ability of the BAM. However, automatic adjustment of the attraction basin is difficult to realize by other methods.
An Efficient Learning Algorithm for Fuzzy Bi-directional Associative Memory

ZENG Shui-ling,YANG Jing-yu,XU Wei-hong

DOI: https://doi.org/10.3969/j.issn.1000-7180.2007.12.019

2007-01-01

Abstract:A new fuzzy bi-directional associative memory network model is proposed based on fuzzy composition of Max and Einstain’s s-Norm(Max-Ses FBAM).A simple efficient learning algorithm is proposed for the network.It is proved theoretically that,if there is a connected weight matrix which make arbitrary given pattern pairs set becoming stability state set of Max-Ses FBAM,then the proposed learning algorithm can find the maximum of all connected weight matrices.And the learning algorithm can ensure that,the Max-Ses FBAM with this maximal pair of connection weight matrices can be convergent to an equilibrium state in one iterative process for any input.
Optical Implementation of the Bipolar Bidirectional Associative Memory

Guoguang Mu

1993-01-01

Acta Optica Sinica

Abstract:A general approach to implement bipolar neural network in a single channel vector-matrix multiplier is proposed. Bipolar performances are achieved by using unipolar data and introducing an additional neuron into the network. Minor modifications of the optical system and the formation of the enlarged nonnegative memory matrix are presented. Results of computer simulation and optical demonstration in case of bipolar bidirectional associative memory are also provided.
Exponential Stability of Delayed Bidirectional Associative Memory Neural Networks with Reaction Diffusion Terms

Anping Chen,Lihong Huang,Jinde Cao

DOI: https://doi.org/10.1080/00207720701276531

IF: 2.648

2007-01-01

International Journal of Systems Science

Abstract:This article considers a class of delayed bi-directional associative memory (BAM) neural networks with reaction diffusion terms and delays. We obtain some simple criteria ensuring the existence and uniqueness of the equilibrium and its global exponential stability by applying homeomorphism mapping, constructing a new Lyapunov functional and inequality techniques. These criteria are independent of delays and posses infinitely adjustable real parameters, which improve and extend some recent results [ J. Cao and M. Dong, "Exponential stability of delayed bidirectional associative memory networks'', Appl. Math. Comput., 135, pp. 105 - 112, 2003; J. Cao and L. Wang, "Exponential stability and periodic oscillatory solution in BAM networks with delays'', IEEE Trans. Neural Networ., 13, pp. 457 - 463, 2002; Q. Song and J. Cao, "Global exponential stability and existence of periodic solutions in BAM networks with delays and reaction-diffusion terms'', Chaos Soliton. Fract., 23, pp. 421 - 430, 2005.] and have an important instructional significance in the designs and applications of bidirectional associative memory neural networks.

New Exponential Bidirectional Associative Memory

A New Bidirectional Associative Memory Model—homibam

Optimal learning algorithm in bidirectional associative memories

Designing Bidirectional Associative Memories with Optimal Stability

A Bidirectional Associative Memory Based on Optimal Linear Associative Memory

A New Higher Order Bidirectional Associative Memory Model and Its Performance Estimation

Asymmetric Bidirectional Associative Memories.

Optimal Bidirectional Associative Memories.

Bidirectional Associative Memory Utilizing Maximum Likelihood

Exponential Stability of Bidirectional Associative Memory Neural Networks with Variable Delays and Impulsive

Some statistical analysis of the recall probability of parallel intraconnected bidirectional associative memory

An extended BAM neural network model

A reconfigurable bidirectional associative memory network with memristor bridge

On the Capacity of Intraconnected Bidirectional Associative Memory

Lmi-Based Exponential Stability Criterion for Bidirectional Associative Memory Neural Networks

Global Exponential Stability of Bidirectional Associative Memory Neural Networks with Distributed Delays

Dual Memory Model for Experience-Once Task-Incremental Lifelong Learning.

Genetic Approach to the Design of Bidirectional Associative Memory.

An Efficient Learning Algorithm for Fuzzy Bi-directional Associative Memory

Optical Implementation of the Bipolar Bidirectional Associative Memory

Exponential Stability of Delayed Bidirectional Associative Memory Neural Networks with Reaction Diffusion Terms