Joint Spatial–Spectral Attention Network for Hyperspectral Image Classification

Lei Li,Jihao Yin,Xiuping Jia,Sen Li,Bingnan Han
DOI: https://doi.org/10.1109/lgrs.2020.3007811
IF: 5.343
2021-10-01
IEEE Geoscience and Remote Sensing Letters
Abstract:Hyperspectral images (HSIs) contain rich context information in the spatial domain and spectral domain. To fully explore that information, a data-driven joint spatial–spectral attention network (JSSAN) is proposed in this letter. Specifically, we first design a spatial–spectral attention ( <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="12.504ex" height="2.676ex" style="vertical-align: -0.338ex;" viewBox="0 -1006.6 5383.6 1152.1" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-74" x="0" y="0"></use> <use xlink:href="#MJMATHI-65" x="361" y="0"></use> <use xlink:href="#MJMATHI-78" x="828" y="0"></use> <use xlink:href="#MJMATHI-74" x="1400" y="0"></use><g transform="translate(1762,0)"> <use xlink:href="#MJMATHI-53" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-32" x="926" y="612"></use></g> <use xlink:href="#MJMATHI-74" x="2871" y="0"></use> <use xlink:href="#MJMATHI-65" x="3232" y="0"></use> <use xlink:href="#MJMATHI-78" x="3699" y="0"></use> <use xlink:href="#MJMATHI-74" x="4271" y="0"></use> <use xlink:href="#MJMATHI-41" x="4633" y="0"></use></g></svg></span> ) block to simultaneously capture long-range interdependency of spatial and spectral data via the similarity evaluation. Then we adopt a weighted sum operation of features at all spatial positions and channels to selectively aggregate discriminative spatial–spectral features. Second, the <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="12.504ex" height="2.676ex" style="vertical-align: -0.338ex;" viewBox="0 -1006.6 5383.6 1152.1" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-74" x="0" y="0"></use> <use xlink:href="#MJMATHI-65" x="361" y="0"></use> <use xlink:href="#MJMATHI-78" x="828" y="0"></use> <use xlink:href="#MJMATHI-74" x="1400" y="0"></use><g transform="translate(1762,0)"> <use xlink:href="#MJMATHI-53" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-32" x="926" y="612"></use></g> <use xlink:href="#MJMATHI-74" x="2871" y="0"></use> <use xlink:href="#MJMATHI-65" x="3232" y="0"></use> <use xlink:href="#MJMATHI-78" x="3699" y="0"></use> <use xlink:href="#MJMATHI-74" x="4271" y="0"></use> <use xlink:href="#MJMATHI-41" x="4633" y="0"></use></g></svg></span> block is inserted into simple convolutional neural network (CNN) structure to extract more representative features for classification, by adaptively emphasizing features of informative land covers and spectral bands which contribute more to class identification. The experimental results reveal that our proposed method outperforms several state-of-the-art algorithms.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-74" d="M26 385Q19 392 19 395Q19 399 22 411T27 425Q29 430 36 430T87 431H140L159 511Q162 522 166 540T173 566T179 586T187 603T197 615T211 624T229 626Q247 625 254 615T261 596Q261 589 252 549T232 470L222 433Q222 431 272 431H323Q330 424 330 420Q330 398 317 385H210L174 240Q135 80 135 68Q135 26 162 26Q197 26 230 60T283 144Q285 150 288 151T303 153H307Q322 153 322 145Q322 142 319 133Q314 117 301 95T267 48T216 6T155 -11Q125 -11 98 4T59 56Q57 64 57 83V101L92 241Q127 382 128 383Q128 385 77 385H26Z"></path><path stroke-width="1" id="MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="MJMATHI-53" d="M308 24Q367 24 416 76T466 197Q466 260 414 284Q308 311 278 321T236 341Q176 383 176 462Q176 523 208 573T273 648Q302 673 343 688T407 704H418H425Q521 704 564 640Q565 640 577 653T603 682T623 704Q624 704 627 704T632 705Q645 705 645 698T617 577T585 459T569 456Q549 456 549 465Q549 471 550 475Q550 478 551 494T553 520Q553 554 544 579T526 616T501 641Q465 662 419 662Q362 662 313 616T263 510Q263 480 278 458T319 427Q323 425 389 408T456 390Q490 379 522 342T554 242Q554 216 546 186Q541 164 528 137T492 78T426 18T332 -20Q320 -22 298 -22Q199 -22 144 33L134 44L106 13Q83 -14 78 -18T65 -22Q52 -22 52 -14Q52 -11 110 221Q112 227 130 227H143Q149 221 149 216Q149 214 148 207T144 186T142 153Q144 114 160 87T203 47T255 29T308 24Z"></path><path stroke-width="1" id="MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="MJMATHI-41" d="M208 74Q208 50 254 46Q272 46 272 35Q272 34 270 22Q267 8 264 4T251 0Q249 0 239 0T205 1T141 2Q70 2 50 0H42Q35 7 35 11Q37 38 48 46H62Q132 49 164 96Q170 102 345 401T523 704Q530 716 547 716H555H572Q578 707 578 706L606 383Q634 60 636 57Q641 46 701 46Q726 46 726 36Q726 34 723 22Q720 7 718 4T704 0Q701 0 690 0T651 1T578 2Q484 2 455 0H443Q437 6 437 9T439 27Q443 40 445 43L449 46H469Q523 49 533 63L521 213H283L249 155Q208 86 208 74ZM516 260Q516 271 504 416T490 562L463 519Q447 492 400 412L310 260L413 259Q516 259 516 260Z"></path></defs></svg>
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?