Multiscale IOU: A Metric for Evaluation of Salient Object Detection with Fine Structures

Azim Ahmadzadeh,Dustin J. Kempton,Yang Chen,Rafal A. Angryk
DOI: https://doi.org/10.1109/icip42928.2021.9506337
2021-09-19
Abstract:General-purpose object-detection algorithms often dismiss the fine structure of detected objects. This can be traced back to how their proposed regions are evaluated. Our goal is to renegotiate the trade-off between the generality of these algorithms and their coarse detections. In this work, we present a new metric that is a marriage of a popular evaluation metric, namely Intersection over Union (IoU), and a geometrical concept, called fractal dimension. We propose Multiscale IoU(MIoU) which allows comparison between the detected and ground-truth regions at multiple resolution levels. Through several reproducible examples, we show that MIoU is indeed sensitive to the fine boundary structures which are completely overlooked by IoU and fl-score. We further examine the overall reliability of MIoU by comparing its distribution with that of IoU on synthetic and real-world datasets of objects. We intend this work to re-initiate exploration of new evaluation methods for object-detection algorithms.
What problem does this paper attempt to address?