Abstract:Recent developments in networking and computing have enabled collaborative biomedical engineering research by geographically separated participants. One of the most promising goals is to use these technologies to extend human intellectual capabilities in medical decision making. These emerging technologies are poised to drastically reduce healthcare cost by providing service at remote locations. This also increases diagnosis capacity since information is made available to experts at any location. In this paper, we propose a novel application of a recently developed interactive and distributed system in medical consultation and education. Our approach builds on the notion that interactive and distributive capabilities of the system are crucial for medical consultation and education. The presented application uses a multiuser, collaborative environment with multimodal human/machine communication in the dimensions of sight, sound, and touch. The experimental setup, consisting of two user stations, and the multimodal interfaces, including sight (eye-tracking), sound (automatic speech), and touch (microbeam pen), were tested and evaluated. The system uses a collaborative workspace as a common visualization space. Users communicate with the application through a fusion agent by eye-tracking, speech, and microbeam pen. The audio/video teleconferencing is also included to help the radiologists to communicate with each other simultaneously while they are working on the mammograms. The system used in this study has three software agents: a fusion agent, a conversational agent, and an analytic agent. The fusion agent interprets multimodal commands by integrating the multimodal inputs. The conversational agent answers the user's questions and detects human-related or semantic errors and notifies the user about the results of the image analysis. The analytic agent enhances the digitized images using the wavelet denoising algorithm if requested by the user. To show how well the system performs in practice, we used the system for medical consultation on mammograms. Results also show that the relevant information about the region of interest (ROI) of the mammograms chosen by the users is extracted automatically and used to enhance the mammograms.

Design and Implementation of Multimedia Display System for Electronic Cardiovascular Conferences with Radiological Consultation Services

Integration of teleconsultation workstations in a PACS for intra-hospital applications

Developing Image-Based Electronic Patient Records for Collaborative Medical Applications

A Streaming-Based Approach for Remote Interaction of the Multi-Channel Display System for Group Users

Design and Implementation of Software System for Remote Electrocardiographic Monitoring

Design and Performance Evaluation of Web-Based Medical Image Display System for PACS Applications

Design of Embedded Visualization Telemedicine Monitor Front-end System

A Multimedia Telemedicine System

Implement of the Radiation Therapy Case Study Multi-Media System Based on Windows Remote Desktop Feature

Design and Implementation of Picture Archiving and Communication System in Huadong Hospital

Design and development of an ecg monitoring system based on wireless system-on-chip technology

Design of Centralized Control System for Multimedia Classroom

Web-based electronic patient records for collaborative medical applications.

Design and implementation of a PDA-based wireless electrocardiographic monitoring system

A New Approach of Building 3D Visualization Framework for Multimodal Medical Images Display and Computed Assisted Diagnosis

A system for medical consultation and education using multimodal human/machine communication

Real-time Teleconsultation for Difficult Diseases with High Resolution and Large Volume Medical Images in Regional Collaborative Healthcare

Construction and Application of Electrophysiological Information System in Our Hospital

MR and ultrasound cardiac image dynamic visualization and synchronization over Internet for distributed heart function diagnosis

Design and Implementation of A Portable ECG Monitor for Multi-user

Development of a home ECG and blood pressure telemonitoring center