Abstract:Recent developments in networking and computing have enabled collaborative biomedical engineering research by geographically separated participants. One of the most promising goals is to use these technologies to extend human intellectual capabilities in medical decision making. These emerging technologies are poised to drastically reduce healthcare cost by providing service at remote locations. This also increases diagnosis capacity since information is made available to experts at any location. In this paper, we propose a novel application of a recently developed interactive and distributed system in medical consultation and education. Our approach builds on the notion that interactive and distributive capabilities of the system are crucial for medical consultation and education. The presented application uses a multiuser, collaborative environment with multimodal human/machine communication in the dimensions of sight, sound, and touch. The experimental setup, consisting of two user stations, and the multimodal interfaces, including sight (eye-tracking), sound (automatic speech), and touch (microbeam pen), were tested and evaluated. The system uses a collaborative workspace as a common visualization space. Users communicate with the application through a fusion agent by eye-tracking, speech, and microbeam pen. The audio/video teleconferencing is also included to help the radiologists to communicate with each other simultaneously while they are working on the mammograms. The system used in this study has three software agents: a fusion agent, a conversational agent, and an analytic agent. The fusion agent interprets multimodal commands by integrating the multimodal inputs. The conversational agent answers the user's questions and detects human-related or semantic errors and notifies the user about the results of the image analysis. The analytic agent enhances the digitized images using the wavelet denoising algorithm if requested by the user. To show how well the system performs in practice, we used the system for medical consultation on mammograms. Results also show that the relevant information about the region of interest (ROI) of the mammograms chosen by the users is extracted automatically and used to enhance the mammograms.

Software Solutions for Biomedical Decision Making

Integrating HL7 RIM and Ontology for Unified Knowledge and Data Representation in Clinical Decision Support Systems

Modeling Paradigms for Medical Diagnostic Decision Support: A Survey and Future Directions

A system for medical consultation and education using multimodal human/machine communication

Agent-oriented Decision Support System for Business Processes Management with Genetic Algorithm Optimization: an Application in Healthcare

SBML for optimizing decision support's tools

A systematic approach to embedded biomedical decision making

Artificial Intelligence Framework for Simulating Clinical Decision-Making: A Markov Decision Process Approach

AI Doctor: An Intelligent Approach for Medical Diagnosis

Artificial Intelligent Agent Architecture and Clinical Decision-Making in the Healthcare Sector

Closed-Loop Control, Artificial Intelligence–Based Decision-Support Systems, and Data Science

Computer-based clinical decision aids. A review of methods and assessment of systems.

Evolutionary and Neural Computing Based Decision Support System for Disease Diagnosis from Clinical Data Sets in Medical Practice

Development of an open case-based decision-support system for diagnosis in oral pathology

Medical artificial intelligence for clinicians: the lost cognitive perspective

Enhancing Medical Decision Making: A Semantic Technology-Based Framework for Efficient Diagnosis Inference

Spatial Computing Opportunities in Biomedical Decision Support: The Atlas-EHR Vision

Breathing Life Into Artificial Intelligence*

Enhancing Automated Decision Support across Medical and Oral Health Domains with Semantic Web Technologies

Computerized Decision Support in Medical Imaging.