Study to evaluate the readability and visual appearance of online resources for blunt chest trauma: an evaluation of online resources using mixed methods

Hutchings,H. A.,Cochrane,M.,Battle,C.
DOI: https://doi.org/10.1136/bmjopen-2023-078552
IF: 3.006
2024-02-07
BMJ Open
Abstract:Objectives Blunt chest trauma (BCT) is characterised by forceful and non-penetrative impact to the chest region. Increased access to the internet has led to online healthcare resources becoming used by the public to educate themselves about medical conditions. This study aimed to determine whether online resources for BCT are at an appropriate readability level and visual appearance for the public. Design We undertook a (1) a narrative overview assessment of the website; (2) a visual assessment of the identified website material content using an adapted framework of predetermined key criteria based on the Centers for Medicare and Medicaid Services toolkit and (3) a readability assessment using five readability scores and the Flesch reading ease score using Readable software. Data sources Using a range of key search terms, we searched Google, Bing and Yahoo websites on 9 October 2023 for online resources about BCT. Results We identified and assessed 85 websites. The median visual assessment score for the identified websites was 22, with a range of –14 to 37. The median readability score generated was 9 (14–15 years), with a range of 4.9–15.8. There was a significant association between the visual assessment and readability scores with a tendency for websites with lower readability scores having higher scores for the visual assessment (Spearman's r=–0.485; p<0.01). The median score for Flesch reading ease was 63.9 (plain English) with a range of 21.1–85.3. Conclusions Although the readability levels and visual appearance were acceptable for the public for many websites, many of the resources had much higher readability scores than the recommended level (8–10) and visually were poor. Better use of images would improve the appearance of websites further. Less medical terminology and shorter word and sentence length would also allow the public to comprehend the contained information more easily.
medicine, general & internal
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to evaluate whether the readability and visual appearance of online resources regarding Blunt Chest Trauma (BCT) are suitable for public use. Specifically, the study aims to determine whether the readability level and visual design of these online resources meet the needs of the public, and how to improve these resources to make them easier to understand and use. ### Research Background - **Blunt Chest Trauma**: Blunt Chest Trauma is the leading cause of death among young people (aged 15 - 44) and the second - leading cause of death among all age groups after head trauma. - **Internet Usage**: Since the early 21st century, global Internet usage has increased by 1355%. As of 2023, there are more than 5 billion Internet users worldwide. This has led to an increasing use of the Internet as a medical resource, with 61% of Americans having searched for health - related information. - **Health Literacy**: In the UK, 43% - 61% of adults usually cannot understand health information, and more than 7 million adults have "very poor" literacy skills. In the United States, the average person's reading level is equivalent to that of an eighth - grader (aged 12 - 13), which means they cannot understand information that requires reasoning. ### Research Objectives - **Evaluate Readability**: The study aims to evaluate whether the readability level of online resources regarding Blunt Chest Trauma is suitable for the public. - **Evaluate Visual Appearance**: The study also evaluates whether the visual design of these resources is attractive and helpful for understanding information. ### Research Methods 1. **Identify Online Resources**: Use three search engines, Google, Bing, and Yahoo, to search for relevant websites through a series of keywords. 2. **Narrative Overview Evaluation**: Conduct a preliminary narrative overview evaluation of each identified website and summarize its advantages and disadvantages. 3. **Visual Evaluation**: Score the content organization, language use, text size and color, use of white space, illustrations, etc. of the website according to pre - defined key criteria. 4. **Readability Evaluation**: Use five readability formulas (Flesch - Kincaid Grade Index, Coleman - Liau Index, Simplified Measure of Gobbledygook Index, Gunning - Fog Index, Automated Readability Index) and the Flesch Reading Ease Score to evaluate the readability of the website. ### Main Findings - **Readability**: The readability level of most websites is higher than the recommended level (grades 8 - 10), with a median of 9 (ages 14 - 15) and a range from 4.9 to 15.8. - **Visual Appearance**: The median visual evaluation score of websites is 22 (out of 42), with a range from - 14 to 37. Many websites perform poorly in visual design and lack the use of images and charts. - **Relevance**: There is a significant correlation between the readability score and the visual evaluation score (Spearman’s r = - 0.485; p < 0.01), that is, websites with poorer readability tend to have poorer visual design as well. ### Conclusions Although the readability and visual appearance of many websites are acceptable to a certain extent, the readability level of many resources is too high and the visual design is not attractive enough. To improve the public's understanding of Blunt Chest Trauma information, it is recommended to reduce the use of medical terms, shorten sentence lengths, and increase the use of images and charts.