Development and Validation of a New Tool for Evaluating Educational Videos Discussing Skin Surgical Procedure Techniques
DOI: https://doi.org/10.2147/ccid.s469592
2024-06-05
Clinical Cosmetic and Investigational Dermatology
Abstract:Fatimah J Almuqarrab, 1 Nuha Alfurayh, 2 Khalid AlGhamdi 1, 3 1 Department of Dermatology, King Saud University Medical City, King Saud University, Riyadh, Saudi Arabia; 2 Division of dermatology, Imam Abdulrahman Alfaisal Hospital, Ministry of Health, Riyadh, Saudi Arabia; 3 Vitiligo Research Chair, Dermatology Department, College of Medicine, King Saud University, Riyadh, Saudi Arabia Correspondence: Khalid AlGhamdi, Vitiligo Research Chair, Department of Dermatology, College of Medicine, King Saud University, Riyadh, Saudi Arabia, Email Fatimah J Almuqarrab, Department of Dermatology, King Saud University Medical City, King Saud University, Riyadh, Saudi Arabia, Email Background: The available tools for evaluating scientific content target written scientific evidence and referencing without considering surgical, technical, or video graphic aspects. Objective: This study developed and validated a tool for qualitatively evaluating videos in the field of skin surgery. This will increase the quality of recorded surgical materials published online and ultimately enhance the reliability of streaming platforms as educational resources. Methodology: Tool development included several stages: draft generation, expert panel setting, internal reliability testing, and pilot study. Results: After two rounds of expert panels evaluating the developed tool, 23 relevant items evaluating the educational value, scientific accuracy, and clarity of the surgical technical steps of the videos were obtained. We applied the tool to the top 25 YouTube videos discussing elliptical excision. Internal consistency, reliability, and substantial agreement between the raters were identified. We identified a strong positive correlation between our tool score and the global rating score (r= 0.55, P= 0.004). Conclusion: It is critical to avoid relying on any video for educational purposes. The tool generated and validated in our study can determine a video's value. A pilot study of 25 YouTube videos demonstrated that the available videos are of fair-good quality, thus necessitating the need for high-quality video production. Keywords: youtube videos, skin surgery, education, tool validation, video evaluation A well-known proverb in medical education is "See one, do one, teach one", commonly referred to when mastering examination or procedural skills at medical schools, residencies, fellowships, and even in practice. In particular, skin surgery relies on visual education. Reading rigid words and images in a textbook is not comparable to being present and observing the events of examinations or operations. In the same context, video is a media that can be measured to replicate a specific event. In fact, contrary to conventional face-to-face academic teaching approaches, the use of instructional videos for studying clinical skills has been shown to produce superior learning outcomes. 1 For that purpose, visual aids that supplement current textbooks are now available to clinicians and students who want to learn how surgery is performed. 2 Those videos can help standardize the educational experience for students and learners to eliminate biases against certain learners. According to research by Rapp et al, YouTube is the most popular website among residents preparing for surgery. 3 It is the largest and most accessible free-stream platform, with a wide variety of content uploaded by individuals and societies. 4 Koya et al demonstrated YouTube enrichment regarding the most extensive dermatologic surgical video graphics media covering various topics, including Mohs surgery, shave biopsy, squamous cell/basal cell carcinoma (SCC/BCC) excisions, wart removal, cyst excision, suture techniques, tissue transfer simulations (flaps) and electrosurgery. 4 Due to YouTube's free access policy, any individual can post information about medical procedures without concern for the quality of the content. Additionally, users can post their comments under each video and rate the content publicly. As an ad hoc technique of validation and quality control, the comments with the most votes are displayed at the top of the list of comments. Furthermore, the community of YouTube contributers does regulate its content. However, reporting bias is a significant challenge for such a qualification process. Azer et al emphasized that the parameters for the videos did not distinguish between beneficial and redundant content. 5 Another recent study emphasized that surgical trainees need to be critically aware that the quality of accessible educational surgical video content varies greatly. 6 It is worth mentioning that several studie -Abstract Truncated-
dermatology