Area of interest adaption using feature importance

Wolfgang Fuhl,Susanne Zabel,Theresa Harbig,Julia Astrid Moldt,Teresa Festl Wiete,Anne Herrmann Werner,Kay Nieselt
2023-03-03
Abstract:In this paper, we present two approaches and algorithms that adapt areas of interest (AOI) or regions of interest (ROI), respectively, to the eye tracking data quality and classification task. The first approach uses feature importance in a greedy way and grows or shrinks AOIs in all directions. The second approach is an extension of the first approach, which divides the AOIs into areas and calculates a direction of growth, i.e. a gradient. Both approaches improve the classification results considerably in the case of generalized AOIs, but can also be used for qualitative analysis. In qualitative analysis, the algorithms presented allow the AOIs to be adapted to the data, which means that errors and inaccuracies in eye tracking data can be better compensated for. A good application example is abstract art, where manual AOIs annotation is hardly possible, and data-driven approaches are mainly used for initial AOIs. Link: <a class="link-external link-https" href="https://es-cloud.cs.uni-tuebingen.de/d/8e2ab8c3fdd444e1a135/?p=%2FAOIGradient&amp;mode=list" rel="external noopener nofollow">this https URL</a>
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem this paper attempts to address is how to automatically adjust Areas of Interest (AOI) or Regions of Interest (ROI) based on the quality of eye-tracking data and classification tasks. Specifically, the authors propose two methods and algorithms to achieve this goal: 1. **Direct Method**: This method is based on feature importance and expands or shrinks the AOI in all directions in a greedy manner. 2. **Gradient Method**: This is an extension of the direct method, which divides the AOI into multiple regions and calculates the growth direction, i.e., the gradient. These two methods significantly improve the accuracy of classification results when dealing with generalized AOIs and are also applicable to qualitative analysis. In qualitative analysis, these algorithms can adapt to the data, thereby better compensating for errors and inaccuracies in eye-tracking data. For example, in abstract art, manually annotating AOIs is almost impossible, so data-driven methods are primarily used for the initial generation of AOIs. The main contribution of the paper is to provide a new method that can automatically adjust predefined AOIs based on eye-tracking data, thereby improving classification accuracy. This is of great significance in various application scenarios, including medicine, self-diagnosis systems, cognitive load research, human attention research, eye movement prediction in retinal rendering, personnel monitoring in safety-critical applications (such as autonomous driving, flight piloting, military), understanding programming behavior, determining individual expertise levels, teaching, and more.