Neura: a specialized large language model solution in neurology
Sami Barrit,Nathan Torcida,Aurélien Mazeraud,Sébastien Boulogne,Jeanne Benoit,Timothée Carette,Thibault Carron,Bertil Delsaut,Eva Diab,Hugo Kermorvant,Adil Maarouf,Sofia Maldonado Slootjes,Sylvain Redon,Alexis Robin,Sofiène Hadidane,Vincent Harlay,Vito Tota,Tanguy Madec,Alexandre Niset,Salim El Hadwe,Nicolas Massager,Stanislas Lagarde,Romain Carron
DOI: https://doi.org/10.1101/2024.02.11.24302658
2024-02-13
Abstract:Large language models’ (LLM) ability in natural language processing holds promise for diverse applications, yet their deployment in fields such as neurology faces domain-specific challenges. Hence, we introduce Neura: a scalable, explainable solution to specialize LLM. Blindly evaluated on a select set of five complex clinical cases compared to a cohort of 13 neurologists, Neura achieved normalized scores of 86.17% overall, 85% for differential diagnoses, and 88.24% for final diagnoses (55.11%, 46.15%, and 70.93% for neurologists) with rapid response times of 28.8 and 19 seconds (9 minutes and 37.2 seconds and 8 minutes and 51 seconds for neurologists) while consistently providing relevant, accurately cited information. These findings support the emerging role of LLM-driven applications to articulate human-acquired and integrated data with a vast corpus of knowledge, augmenting human experiential reasoning for clinical and research purposes.
Neurology