Multistability of Switched Neural Networks With Gaussian Activation Functions Under State-Dependent Switching
Zhenyuan Guo,Shiqin Ou,Jun Wang
DOI: https://doi.org/10.1109/tnnls.2021.3082560
IF: 14.255
2021-01-01
IEEE Transactions on Neural Networks and Learning Systems
Abstract:This article presents theoretical results on the multistability of switched neural networks with Gaussian activation functions under state-dependent switching. It is shown herein that the number and location of the equilibrium points of the switched neural networks can be characterized by making use of the geometrical properties of Gaussian functions and local linearization based on the Brouwer fixed-point theorem. Four sets of sufficient conditions are derived to ascertain the existence of <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.16ex" height="2.343ex" style="vertical-align: -0.338ex;" viewBox="0 -863.1 3943.7 1008.6" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMAIN-37" x="0" y="0"></use><g transform="translate(500,403)"> <use transform="scale(0.707)" xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.574)" xlink:href="#MJMAIN-31" x="620" y="-291"></use></g><g transform="translate(1314,0)"> <use xlink:href="#MJMAIN-35" x="0" y="0"></use><g transform="translate(500,393)"> <use transform="scale(0.707)" xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.574)" xlink:href="#MJMAIN-32" x="620" y="-291"></use></g></g><g transform="translate(2629,0)"> <use xlink:href="#MJMAIN-33" x="0" y="0"></use><g transform="translate(500,392)"> <use transform="scale(0.707)" xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.574)" xlink:href="#MJMAIN-33" x="620" y="-291"></use></g></g></g></svg></span> equilibrium points, and <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.16ex" height="2.343ex" style="vertical-align: -0.338ex;" viewBox="0 -863.1 3943.7 1008.6" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMAIN-34" x="0" y="0"></use><g transform="translate(500,404)"> <use transform="scale(0.707)" xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.574)" xlink:href="#MJMAIN-31" x="620" y="-291"></use></g><g transform="translate(1314,0)"> <use xlink:href="#MJMAIN-33" x="0" y="0"></use><g transform="translate(500,392)"> <use transform="scale(0.707)" xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.574)" xlink:href="#MJMAIN-32" x="620" y="-291"></use></g></g><g transform="translate(2629,0)"> <use xlink:href="#MJMAIN-32" x="0" y="0"></use><g transform="translate(500,393)"> <use transform="scale(0.707)" xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.574)" xlink:href="#MJMAIN-33" x="620" y="-291"></use></g></g></g></svg></span> of them are locally stable, wherein <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.313ex" height="2.009ex" style="vertical-align: -0.671ex; margin-left: -0.089ex;" viewBox="-38.5 -576.1 995.9 865.1" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-31" x="712" y="-213"></use></g></svg></span> , <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.313ex" height="2.009ex" style="vertical-align: -0.671ex; margin-left: -0.089ex;" viewBox="-38.5 -576.1 995.9 865.1" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-32" x="712" y="-213"></use></g></svg></span> , and <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.313ex" height="2.009ex" style="vertical-align: -0.671ex; margin-left: -0.089ex;" viewBox="-38.5 -576.1 995.9 865.1" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-33" x="712" y="-213"></use></g></svg></span> are nonnegative integers satisfying <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="20.602ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 8870.1 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMAIN-30" x="0" y="0"></use> <use xlink:href="#MJMATHI-6C" x="500" y="0"></use> <use xlink:href="#MJMATHI-65" x="799" y="0"></use> <use xlink:href="#MJMATHI-71" x="1265" y="0"></use><g transform="translate(1726,0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-31" x="712" y="-213"></use></g> <use xlink:href="#MJMAIN-2B" x="2905" y="0"></use><g transform="translate(3906,0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-32" x="712" y="-213"></use></g> <use xlink:href="#MJMAIN-2B" x="5085" y="0"></use><g transform="translate(6086,0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-33" x="712" y="-213"></use></g> <use xlink:href="#MJMATHI-6C" x="7044" y="0"></use> <use xlink:href="#MJMATHI-65" x="7342" y="0"></use> <use xlink:href="#MJMATHI-71" x="7809" y="0"></use> <use xlink:href="#MJMATHI-6E" x="8269" y="0"></use></g></svg></span> and <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.395ex" height="1.676ex" style="vertical-align: -0.338ex;" viewBox="0 -576.1 600.5 721.6" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-6E" x="0" y="0"></use></g></svg></span> is the number of neurons. It implies that there exist up to <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.381ex" height="2.343ex" style="vertical-align: -0.338ex;" viewBox="0 -863.1 1025.1 1008.6" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMAIN-37" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMATHI-6E" x="707" y="571"></use></g></svg></span> equilibria, and up to <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.381ex" height="2.343ex" style="vertical-align: -0.338ex;" viewBox="0 -863.1 1025.1 1008.6" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMAIN-34" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMATHI-6E" x="707" y="572"></use></g></svg></span> of them are locally stable when <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="6.806ex" height="2.009ex" style="vertical-align: -0.671ex; margin-left: -0.089ex;" viewBox="-38.5 -576.1 2930.5 865.1" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-31" x="712" y="-213"></use> <use xlink:href="#MJMAIN-3D" x="1235" y="0"></use> <use xlink:href="#MJMATHI-6E" x="2291" y="0"></use></g></svg></span> . It also implies that properly selecting <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.313ex" height="2.009ex" style="vertical-align: -0.671ex; margin-left: -0.089ex;" viewBox="-38.5 -576.1 995.9 865.1" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-31" x="712" y="-213"></use></g></svg></span> , <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.313ex" height="2.009ex" style="vertical-align: -0.671ex; margin-left: -0.089ex;" viewBox="-38.5 -576.1 995.9 865.1" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-32" x="712" y="-213"></use></g></svg></span> , and <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.313ex" height="2.009ex" style="vertical-align: -0.671ex; margin-left: -0.089ex;" viewBox="-38.5 -576.1 995.9 865.1" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-33" x="712" y="-213"></use></g></svg></span> can engender a desirable number of stable equilibria. Two numerical examples are elaborated to substantiate the theor-tical results.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMAIN-37" d="M55 458Q56 460 72 567L88 674Q88 676 108 676H128V672Q128 662 143 655T195 646T364 644H485V605L417 512Q408 500 387 472T360 435T339 403T319 367T305 330T292 284T284 230T278 162T275 80Q275 66 275 52T274 28V19Q270 2 255 -10T221 -22Q210 -22 200 -19T179 0T168 40Q168 198 265 368Q285 400 349 489L395 552H302Q128 552 119 546Q113 543 108 522T98 479L95 458V455H55V458Z"></path><path stroke-width="1" id="MJMATHI-70" d="M23 287Q24 290 25 295T30 317T40 348T55 381T75 411T101 433T134 442Q209 442 230 378L240 387Q302 442 358 442Q423 442 460 395T497 281Q497 173 421 82T249 -10Q227 -10 210 -4Q199 1 187 11T168 28L161 36Q160 35 139 -51T118 -138Q118 -144 126 -145T163 -148H188Q194 -155 194 -157T191 -175Q188 -187 185 -190T172 -194Q170 -194 161 -194T127 -193T65 -192Q-5 -192 -24 -194H-32Q-39 -187 -39 -183Q-37 -156 -26 -148H-6Q28 -147 33 -136Q36 -130 94 103T155 350Q156 355 156 364Q156 405 131 405Q109 405 94 377T71 316T59 280Q57 278 43 278H29Q23 284 23 287ZM178 102Q200 26 252 26Q282 26 310 49T356 107Q374 141 392 215T411 325V331Q411 405 350 405Q339 405 328 402T306 393T286 380T269 365T254 350T243 336T235 326L232 322Q232 321 229 308T218 264T204 212Q178 106 178 102Z"></path><path stroke-width="1" id="MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path><path stroke-width="1" id="MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="MJMATHI-6C" d="M117 59Q117 26 142 26Q179 26 205 131Q211 151 215 152Q217 153 225 153H229Q238 153 241 153T246 151T248 144Q247 138 245 128T234 90T214 43T183 6T137 -11Q101 -11 70 11T38 85Q38 97 39 102L104 360Q167 615 167 623Q167 626 166 628T162 632T157 634T149 635T141 636T132 637T122 637Q112 637 109 637T101 638T95 641T94 647Q94 649 96 661Q101 680 107 682T179 688Q194 689 213 690T243 693T254 694Q266 694 266 686Q266 675 193 386T118 83Q118 81 118 75T117 65V59Z"></path><path stroke-width="1" id="MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="MJMATHI-71" d="M33 157Q33 258 109 349T280 441Q340 441 372 389Q373 390 377 395T388 406T404 418Q438 442 450 442Q454 442 457 439T460 434Q460 425 391 149Q320 -135 320 -139Q320 -147 365 -148H390Q396 -156 396 -157T393 -175Q389 -188 383 -194H370Q339 -192 262 -192Q234 -192 211 -192T174 -192T157 -193Q143 -193 143 -185Q143 -182 145 -170Q149 -154 152 -151T172 -148Q220 -148 230 -141Q238 -136 258 -53T279 32Q279 33 272 29Q224 -10 172 -10Q117 -10 75 30T33 157ZM352 326Q329 405 277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q233 26 290 98L298 109L352 326Z"></path><path stroke-width="1" id="MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path></defs></svg>
computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture