An eye-tracking-based approach to evaluate the usability of government portal websites in pilot smart cities
Dezhi Li,Huan Zhou,Shenghua Zhou,Guanying Huang,Xiaoming Ma,Yongheng Zhao,Wentao Wang,S. Thomas Ng
DOI: https://doi.org/10.1108/ecam-09-2023-0932
2023-12-23
Engineering Construction & Architectural Management
Abstract:Purpose The study aims to pioneer an innovative approach for the evaluation of government portal websites (GPWs) by introducing an eye-tracking-based method. The research meticulously pinpoints and analyses the distinct usability issues and challenges that users encounter while navigating and interacting with GPWs. Design/methodology/approach This study devises an eye-tracking-based GPW usability evaluation approach, which focuses on the major functions (i.e. government information disclosure, government services and interactive responses) of GPWs. An Entropy Weighted Technique for Order Preference by Similarity to an Ideal Solution (EW-TOPSIS) method is employed to process eye-tracking indicator results for deriving GPW usability results. Findings The proposed approach is demonstrated to assess the usability of 12 GPWs in pilot smart cities in China, and it is found that most GPWs have lower-than-average usability. GPWs with low usability require more cognitive load that exhibit increased fixation and saccade. The comparisons among the GPW usability results from (1) the eye-tracking experiment, (2) questionnaire surveys and (3) the ready-made performance evaluation report validate the effectiveness of eye-tracking-based GPW usability evaluation. Originality/value The work contributes to shifting the GPW usability evaluation approach from a subjective judgment paradigm to an objective paradigm, as well as provides implications for enhancing GPW usability, including improving search function, reducing website complexity and prioritizing user needs.
engineering, civil, industrial,management