A New Fuzzy Spiking Neural Network Based on Neuronal Contribution Degree

Fang Liu,Jie Yang,Witold Pedrycz,Wei Wu
DOI: https://doi.org/10.1109/tfuzz.2021.3090912
IF: 12.253
2021-01-01
IEEE Transactions on Fuzzy Systems
Abstract:This article presents a novel network, contribution-degree-based spiking neural network (CDSNN), which combines ideas of spiking neural network (SNN) and fuzzy set theory. In this framework, two types of information, interval and instantaneous information conveyed by the membrane potential are described by two concepts such as area under membrane potential (AUM) and firing strength. Given that the neuron with large AUM or strong firing strength would enhance the frequency of action potentials of its postsynaptic neurons, the connection between the neuron and its postsynaptic neurons should be strengthened. Combined with an idea of membership function, three contribution degrees (<span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="15.997ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 6887.6 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-62" x="0" y="0"></use> <use xlink:href="#MJMATHI-6F" x="429" y="0"></use> <use xlink:href="#MJMATHI-6C" x="915" y="0"></use> <use xlink:href="#MJMATHI-64" x="1213" y="0"></use> <use xlink:href="#MJMATHI-73" x="1737" y="0"></use> <use xlink:href="#MJMATHI-79" x="2206" y="0"></use> <use xlink:href="#MJMATHI-6D" x="2704" y="0"></use> <use xlink:href="#MJMATHI-62" x="3582" y="0"></use> <use xlink:href="#MJMATHI-6F" x="4012" y="0"></use> <use xlink:href="#MJMATHI-6C" x="4497" y="0"></use><g transform="translate(4796,0)"> <use xlink:href="#MJMATHI-6D" x="0" y="0"></use> <use xlink:href="#MJMATHI-75" x="878" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMATHI-45" x="2052" y="-213"></use></g></g></svg></span>, <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="15.802ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 6803.4 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-62" x="0" y="0"></use> <use xlink:href="#MJMATHI-6F" x="429" y="0"></use> <use xlink:href="#MJMATHI-6C" x="915" y="0"></use> <use xlink:href="#MJMATHI-64" x="1213" y="0"></use> <use xlink:href="#MJMATHI-73" x="1737" y="0"></use> <use xlink:href="#MJMATHI-79" x="2206" y="0"></use> <use xlink:href="#MJMATHI-6D" x="2704" y="0"></use> <use xlink:href="#MJMATHI-62" x="3582" y="0"></use> <use xlink:href="#MJMATHI-6F" x="4012" y="0"></use> <use xlink:href="#MJMATHI-6C" x="4497" y="0"></use><g transform="translate(4796,0)"> <use xlink:href="#MJMATHI-6D" x="0" y="0"></use> <use xlink:href="#MJMATHI-75" x="878" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMATHI-53" x="2052" y="-219"></use></g></g></svg></span>, and <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="17.057ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 7344 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-62" x="0" y="0"></use> <use xlink:href="#MJMATHI-6F" x="429" y="0"></use> <use xlink:href="#MJMATHI-6C" x="915" y="0"></use> <use xlink:href="#MJMATHI-64" x="1213" y="0"></use> <use xlink:href="#MJMATHI-73" x="1737" y="0"></use> <use xlink:href="#MJMATHI-79" x="2206" y="0"></use> <use xlink:href="#MJMATHI-6D" x="2704" y="0"></use> <use xlink:href="#MJMATHI-62" x="3582" y="0"></use> <use xlink:href="#MJMATHI-6F" x="4012" y="0"></use> <use xlink:href="#MJMATHI-6C" x="4497" y="0"></use><g transform="translate(4796,0)"> <use xlink:href="#MJMATHI-6D" x="0" y="0"></use> <use xlink:href="#MJMATHI-75" x="878" y="0"></use><g transform="translate(1451,-155)"> <use transform="scale(0.707)" xlink:href="#MJMATHI-45" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMATHI-53" x="764" y="0"></use></g></g></g></svg></span>) are defined to quantify the ability of a neuron to provide information for postsynaptic neurons. According to these three degrees, the corresponding SpikeProp learning algorithms, referred to as SPE, SPS, and SPES, are developed. Experimental results obtained on ten benchmark datasets, one high-dimensional feature dataset, one big dataset, and one time series dataset with some commonly used algorithms, networks and CDSNN demonstrate that CDSNN can achieve improved performance in terms of accuracy, generalization, precision, recall and F-measure. The article demonstrates that the mechanism by which interval-instantaneous information is simultaneously learned in a SNN is feasible.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-62" d="M73 647Q73 657 77 670T89 683Q90 683 161 688T234 694Q246 694 246 685T212 542Q204 508 195 472T180 418L176 399Q176 396 182 402Q231 442 283 442Q345 442 383 396T422 280Q422 169 343 79T173 -11Q123 -11 82 27T40 150V159Q40 180 48 217T97 414Q147 611 147 623T109 637Q104 637 101 637H96Q86 637 83 637T76 640T73 647ZM336 325V331Q336 405 275 405Q258 405 240 397T207 376T181 352T163 330L157 322L136 236Q114 150 114 114Q114 66 138 42Q154 26 178 26Q211 26 245 58Q270 81 285 114T318 219Q336 291 336 325Z"></path><path stroke-width="1" id="MJMATHI-6F" d="M201 -11Q126 -11 80 38T34 156Q34 221 64 279T146 380Q222 441 301 441Q333 441 341 440Q354 437 367 433T402 417T438 387T464 338T476 268Q476 161 390 75T201 -11ZM121 120Q121 70 147 48T206 26Q250 26 289 58T351 142Q360 163 374 216T388 308Q388 352 370 375Q346 405 306 405Q243 405 195 347Q158 303 140 230T121 120Z"></path><path stroke-width="1" id="MJMATHI-6C" d="M117 59Q117 26 142 26Q179 26 205 131Q211 151 215 152Q217 153 225 153H229Q238 153 241 153T246 151T248 144Q247 138 245 128T234 90T214 43T183 6T137 -11Q101 -11 70 11T38 85Q38 97 39 102L104 360Q167 615 167 623Q167 626 166 628T162 632T157 634T149 635T141 636T132 637T122 637Q112 637 109 637T101 638T95 641T94 647Q94 649 96 661Q101 680 107 682T179 688Q194 689 213 690T243 693T254 694Q266 694 266 686Q266 675 193 386T118 83Q118 81 118 75T117 65V59Z"></path><path stroke-width="1" id="MJMATHI-64" d="M366 683Q367 683 438 688T511 694Q523 694 523 686Q523 679 450 384T375 83T374 68Q374 26 402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487H491Q506 153 506 145Q506 140 503 129Q490 79 473 48T445 8T417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157Q33 205 53 255T101 341Q148 398 195 420T280 442Q336 442 364 400Q369 394 369 396Q370 400 396 505T424 616Q424 629 417 632T378 637H357Q351 643 351 645T353 664Q358 683 366 683ZM352 326Q329 405 277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q233 26 290 98L298 109L352 326Z"></path><path stroke-width="1" id="MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="MJMATHI-75" d="M21 287Q21 295 30 318T55 370T99 420T158 442Q204 442 227 417T250 358Q250 340 216 246T182 105Q182 62 196 45T238 27T291 44T328 78L339 95Q341 99 377 247Q407 367 413 387T427 416Q444 431 463 431Q480 431 488 421T496 402L420 84Q419 79 419 68Q419 43 426 35T447 26Q469 29 482 57T512 145Q514 153 532 153Q551 153 551 144Q550 139 549 130T540 98T523 55T498 17T462 -8Q454 -10 438 -10Q372 -10 347 46Q345 45 336 36T318 21T296 6T267 -6T233 -11Q189 -11 155 7Q103 38 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="MJMATHI-45" d="M492 213Q472 213 472 226Q472 230 477 250T482 285Q482 316 461 323T364 330H312Q311 328 277 192T243 52Q243 48 254 48T334 46Q428 46 458 48T518 61Q567 77 599 117T670 248Q680 270 683 272Q690 274 698 274Q718 274 718 261Q613 7 608 2Q605 0 322 0H133Q31 0 31 11Q31 13 34 25Q38 41 42 43T65 46Q92 46 125 49Q139 52 144 61Q146 66 215 342T285 622Q285 629 281 629Q273 632 228 634H197Q191 640 191 642T193 659Q197 676 203 680H757Q764 676 764 669Q764 664 751 557T737 447Q735 440 717 440H705Q698 445 698 453L701 476Q704 500 704 528Q704 558 697 578T678 609T643 625T596 632T532 634H485Q397 633 392 631Q388 629 386 622Q385 619 355 499T324 377Q347 376 372 376H398Q464 376 489 391T534 472Q538 488 540 490T557 493Q562 493 565 493T570 492T572 491T574 487T577 483L544 351Q511 218 508 216Q505 213 492 213Z"></path><path stroke-width="1" id="MJMATHI-53" d="M308 24Q367 24 416 76T466 197Q466 260 414 284Q308 311 278 321T236 341Q176 383 176 462Q176 523 208 573T273 648Q302 673 343 688T407 704H418H425Q521 704 564 640Q565 640 577 653T603 682T623 704Q624 704 627 704T632 705Q645 705 645 698T617 577T585 459T569 456Q549 456 549 465Q549 471 550 475Q550 478 551 494T553 520Q553 554 544 579T526 616T501 641Q465 662 419 662Q362 662 313 616T263 510Q263 480 278 458T319 427Q323 425 389 408T456 390Q490 379 522 342T554 242Q554 216 546 186Q541 164 528 137T492 78T426 18T332 -20Q320 -22 298 -22Q199 -22 144 33L134 44L106 13Q83 -14 78 -18T65 -22Q52 -22 52 -14Q52 -11 110 221Q112 227 130 227H143Q149 221 149 216Q149 214 148 207T144 186T142 153Q144 114 160 87T203 47T255 29T308 24Z"></path></defs></svg>
computer science, artificial intelligence,engineering, electrical & electronic
What problem does this paper attempt to address?