Accurate prediction of neurologic changes in critically ill infants using pose AI

Alec Gleason,Florian Richter,Nathalia Beller,Naveen Arivazhagan,Rui Feng,Emma Holmes,Benjamin S Glicksberg,Sarah U Morton,Maite La Vega-Talbott,Madeline Fields,Katherine Guttmann,Girish N Nadkarni,Felix Richter
DOI: https://doi.org/10.1101/2024.04.17.24305953
2024-06-10
Abstract:Infant alertness and neurologic changes can reflect life-threatening pathology but are assessed by physical exam, which can be intermittent and subjective. Reliable, continuous methods are needed. We hypothesized that our computer vision method to track movement, pose AI, could predict neurologic changes in the neonatal intensive care unit (NICU). We collected 4,705 hours of video linked to electroencephalograms (EEG) from 115 infants. We trained a deep learning pose algorithm that accurately predicted anatomic landmarks in three evaluation sets (ROC-AUCs 0.83-0.94), showing feasibility of applying pose AI in an ICU. We then trained machine learning classifiers on landmarks from pose AI and observed high performance for sedation (ROC-AUCs 0.87-0.91) and cerebral dysfunction (ROC-AUCs 0.76-0.91). This demonstrates that an EEG diagnosis, cerebral dysfunction, can be predicted from video data alone. Taken together, deep learning with pose AI may offer a scalable, minimally invasive method for neuro-telemetry in the NICU.
Pediatrics
What problem does this paper attempt to address?