Preference-driven multi-objective GP search for regression models with new dominance principle and performance indicators

Jiayu Liang,Ludi Zheng,Han Wu,Yu Xue
DOI: https://doi.org/10.1007/s10489-022-03228-6
IF: 5.3
2022-03-18
Applied Intelligence
Abstract:<p class="a-plus-plus">Regression is a multi-objective optimization task, which aims to determine accurate and simple relationship expressions between variables. Multi-objective genetic programming (MOGP) methods are popularly-used for regression, which search for trade-off solutions of all objectives, producing a set of solutions (Pareto front). Yet, users normally are not interested in the whole Pareto front and select certain solutions based on preference for specific tasks. There are existing preference-based multi-objective methods. However, existing techniques may not be compliant to Pareto dominance, leading convergence to be deteriorated, or require extra parameters. To handle these issues, a preference-driven dominance (pd-dominance) principle is designed, which is Pareto-compliant and parameterless. Then it is introduced into two base MOGP methods (NSGP (non-dominated sorting genetic programming) and SPGP (strength Pareto genetic programming)) to form two new preference-driven MOGP methods, i.e. pdNSGP and pdSPGP. In addition, three existing performance indicators for multi-objective optimization are improved to adapt to regression tasks. Results show that pdNSGP and pdSPGP outperform MOGP methods with popular preference techniques. For example on the function <em class="a-plus-plus">Dic</em>3, pdSPGP reaches <span class="a-plus-plus inline-equation id-i-eq1"><span class="a-plus-plus equation-source format-t-e-x"><span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="6.941ex" height="2.343ex" style="vertical-align: -0.505ex;" viewBox="0 -791.3 2988.4 1008.6" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMAIN-33" x="0" y="0"></use> <use xlink:href="#MJMATHI-45" x="500" y="0"></use> <use xlink:href="#MJMAIN-2212" x="1487" y="0"></use> <use xlink:href="#MJMAIN-32" x="2487" y="0"></use></g></svg></span></span></span> based on a distance measure (the lower the better); while the reference MOGP methods achieve <span class="a-plus-plus inline-equation id-i-eq2"><span class="a-plus-plus equation-source format-t-e-x"><span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.913ex" height="2.343ex" style="vertical-align: -0.505ex;" viewBox="0 -791.3 4267.9 1008.6" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMAIN-31"></use> <use xlink:href="#MJMAIN-2E" x="500" y="0"></use> <use xlink:href="#MJMAIN-39" x="779" y="0"></use> <use xlink:href="#MJMAIN-33" x="1279" y="0"></use> <use xlink:href="#MJMATHI-45" x="1780" y="0"></use> <use xlink:href="#MJMAIN-2212" x="2766" y="0"></use> <use xlink:href="#MJMAIN-31" x="3767" y="0"></use></g></svg></span></span></span>. Moreover, compared with seven reference regression methods, the proposed methods ranks the first three places for most test cases.</p><svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="MJMATHI-45" d="M492 213Q472 213 472 226Q472 230 477 250T482 285Q482 316 461 323T364 330H312Q311 328 277 192T243 52Q243 48 254 48T334 46Q428 46 458 48T518 61Q567 77 599 117T670 248Q680 270 683 272Q690 274 698 274Q718 274 718 261Q613 7 608 2Q605 0 322 0H133Q31 0 31 11Q31 13 34 25Q38 41 42 43T65 46Q92 46 125 49Q139 52 144 61Q146 66 215 342T285 622Q285 629 281 629Q273 632 228 634H197Q191 640 191 642T193 659Q197 676 203 680H757Q764 676 764 669Q764 664 751 557T737 447Q735 440 717 440H705Q698 445 698 453L701 476Q704 500 704 528Q704 558 697 578T678 609T643 625T596 632T532 634H485Q397 633 392 631Q388 629 386 622Q385 619 355 499T324 377Q347 376 372 376H398Q464 376 489 391T534 472Q538 488 540 490T557 493Q562 493 565 493T570 492T572 491T574 487T577 483L544 351Q511 218 508 216Q505 213 492 213Z"></path><path stroke-width="1" id="MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="MJMAIN-39" d="M352 287Q304 211 232 211Q154 211 104 270T44 396Q42 412 42 436V444Q42 537 111 606Q171 666 243 666Q245 666 249 666T257 665H261Q273 665 286 663T323 651T370 619T413 560Q456 472 456 334Q456 194 396 97Q361 41 312 10T208 -22Q147 -22 108 7T68 93T121 149Q143 149 158 135T173 96Q173 78 164 65T148 49T135 44L131 43Q131 41 138 37T164 27T206 22H212Q272 22 313 86Q352 142 352 280V287ZM244 248Q292 248 321 297T351 430Q351 508 343 542Q341 552 337 562T323 588T293 615T246 625Q208 625 181 598Q160 576 154 546T147 441Q147 358 152 329T172 282Q197 248 244 248Z"></path></defs></svg>
computer science, artificial intelligence
What problem does this paper attempt to address?