[Results of treatment of patients with cervical cancer by X-ray irradiation from external fields and telecobalt 60].

A. Korfel,P. Zurawski,D. Filipowska,A. Ciepal

1983-05-01

Ginekologia Polska

Abstract:

What problem does this paper attempt to address?

A Multipurpose Human–Machine Interface via 3D-Printed Pressure-Based Force Myography

Hao Zhou,Charbel Tawk,Gursel Alici

DOI: https://doi.org/10.1109/tii.2024.3375376

IF: 12.3

2024-01-01

IEEE Transactions on Industrial Informatics

Abstract:Artificially intelligent (AI), powerful, and reliable human–machine interfaces (HMIs) are highly desired for wearable technologies, which proved to be the next advancement when it comes to humans interacting with physical, digital, and mixed environments. To demonstrate them, here we report on an innovative noninvasive, lightweight, low-cost, wearable, and soft pressure-based force myography (pFMG) HMI in the form of an armband. The armband acquires stable mechanical biosignals in the form of air pressure information in response to forces induced by muscle activity consisting of contraction and relaxation that deform its pressure-sensitive chambers (PSCs). The PSCs are characterized by a fast response to a mechanical biosignal, negligible hysteresis, repeatability, reproducibility, reliability, stability, minimal calibration requirements, and durability (more than 1 500 000 cycles). The pFMG armband is resistant to sweat, body hair present on the skin, worn cloth, and scars, and resilient to external mechanical deformations. We demonstrate the capability and versatility of the pFMG-based HMI armband to interact with and control collaborative robot manipulators, robotic prosthetic hands, drones, computer games, and any system where humans are in the loop. The control signals are generated through the implementation of a machine learning algorithm to decode and classify the acquired biosignals of different hand gestures to rapidly and accurately recognize the intentions of a user. The easy and direct fabrication and customization of the armband in addition to its ability to decode any desired gesture rapidly and reliably based on stable and reliable biosignals makes it ideal to be integrated into AI-powered HMI applications.

automation & control systems,computer science, interdisciplinary applications,engineering, industrial
Design and Evaluation of an Augmented Reality Head-Mounted Display Interface for Human Robot Teams Collaborating in Physically Shared Manufacturing Tasks

Wesley P. Chan,Geoffrey Hanks,Maram Sakr,Haomiao Zhang,Tiger Zuo,H. F. Machiel van der Loos,Elizabeth Croft,H.F. Machiel Van der Loos

DOI: https://doi.org/10.1145/3524082

2022-03-18

Abstract:We provide an experimental evaluation of a wearable augmented reality (AR) system we have developed for human-robot teams working on tasks requiring collaboration in shared physical workspace. Recent advances in AR technology have facilitated the development of more intuitive user interfaces for many human-robot interaction applications. While it has been anticipated that AR can provided a more intuitive interface to robot assistants helping human workers in various manufacturing scenarios, existing studies in robotics have been largely limited to teleoperation and programming. Industry 5.0 envisions cooperation between human and robot working in teams. Indeed, there exist many industrial task that can benefit from human-robot collaboration. A prime example is high-value composite manufacturing. Working with our industry partner towards this example application, we evaluated our AR interface design for shared physical workspace collaboration in human-robot teams. We conducted a multi-dimensional analysis of our interface using establish metrics. Results from our user study (n=26) show that subjectively, the AR interface feels more novel and a standard joystick interface feels more dependable to users. However, the AR interface was found to reduce physical demand and task completion time, while increasing robot utilization. Furthermore, user’s freedom of choice to collaborate with the robot may also affect the perceived usability of the system.
Human Operation Augmentation through Wearable Robotic Limb Integrated with Mixed Reality Device

Hongwei Jing,Tianjiao Zheng,Qinghua Zhang,Kerui Sun,Lele Li,Mingzhu Lai,Jie Zhao,Yanhe Zhu

DOI: https://doi.org/10.3390/biomimetics8060479

2023-10-08

Abstract:Mixed reality technology can give humans an intuitive visual experience, and combined with the multi-source information of the human body, it can provide a comfortable human-robot interaction experience. This paper applies a mixed reality device (Hololens2) to provide interactive communication between the wearer and the wearable robotic limb (supernumerary robotic limb, SRL). Hololens2 can obtain human body information, including eye gaze, hand gestures, voice input, etc. It can also provide feedback information to the wearer through augmented reality and audio output, which is the communication bridge needed in human-robot interaction. Implementing a wearable robotic arm integrated with HoloLens2 is proposed to augment the wearer's capabilities. Taking two typical practical tasks of cable installation and electrical connector soldering in aircraft manufacturing as examples, the task models and interaction scheme are designed. Finally, human augmentation is evaluated in terms of task completion time statistics.
Persistent Human–Machine Interfaces for Robotic Arm Control Via Gaze and Eye Direction Tracking

Seunghyeb Ban,Yoon Jae Lee,Ki Jun Yu,Jae Won Chang,Jong-Hoon Kim,Woon-Hong Yeo

DOI: https://doi.org/10.1002/aisy.202200408

IF: 7.298

2023-04-08

Advanced Intelligent Systems

Abstract:Herein, a persistent human–machine interface to control robotic arms via gaze and eye direction tracking is presented. Recent advances in sensors and electronics have enabled electrooculogram (EOG) detection systems for capturing eye movements. However, EOG signals are susceptible to the sensor's skin‐contact quality, limiting the precise detection of eye angles and gaze. Herein, a two‐camera eye‐tracking system and a data classification method for persistent human–machine interfaces (HMIs) are introduced. Machine‐learning technology is used for a continuous real‐time classification of gaze and eye directions, to precisely control a robotic arm. In addition, a deep‐learning algorithm for classifying eye directions is developed and the pupil center‐corneal reflection method of an eye tracker for gaze tracking is utilized. A supervisory control and data acquisition architecture that can be universally applied to any screen‐based HMI task are used by the system. It is shown in the study that the classification algorithm using deep learning enables exceptional accuracy (99.99%) with the number of actions per command (≥64), the highest performance compared to other HMI systems. Demonstrating real‐time control of a robotic arm captures the unique advantages of the precise eye‐tracking system for playing chess and manipulating dice. Overall, this paper shows the HMI system's potential for remote control of surgery robots, warehouse systems, and construction tools.
Anatomically Designed Triboelectric Wristbands with Adaptive Accelerated Learning for Human–Machine Interfaces

Han Fang,Lei Wang,Zhongzheng Fu,Liang Xu,Wei Guo,Jian Huang,Zhong Lin Wang,Hao Wu

DOI: https://doi.org/10.1002/advs.202205960

IF: 15.1

2023-01-23

Advanced Science

Abstract:Anatomically designed triboelectric wristbands that can interpret human intention are described. The anatomical design contributes to enhanced classification accuracy due to the close correspondence between the actions of dominant muscle groups and gestures. The adaptive pruning strategy can aggressively reduce the computational operands with trivial loss of accuracy. Consequently, 97.56% accuracy is realized by only 7 sensors for 21 gestures. Recent advances in flexible wearable devices have boosted the remarkable development of devices for human–machine interfaces, which are of great value to emerging cybernetics, robotics, and Metaverse systems. However, the effectiveness of existing approaches is limited by the quality of sensor data and classification models with high computational costs. Here, a novel gesture recognition system with triboelectric smart wristbands and an adaptive accelerated learning (AAL) model is proposed. The sensor array is well deployed according to the wrist anatomy and retrieves hand motions from a distance, exhibiting highly sensitive and high‐quality sensing capabilities beyond existing methods. Importantly, the anatomical design leads to the close correspondence between the actions of dominant muscle/tendon groups and gestures, and the resulting distinctive features in sensor signals are very valuable for differentiating gestures with data from 7 sensors. The AAL model realizes a 97.56% identification accuracy in training 21 classes with only one‐third operands of the original neural network. The applications of the system are further exploited in real‐time somatosensory teleoperations with a low latency of <1 s, revealing a new possibility for endowing cyber‐human interactions with disruptive innovation and immersive experience.

materials science, multidisciplinary,nanoscience & nanotechnology,chemistry
Enabling Intuitive Human-Robot Teaming Using Augmented Reality and Gesture Control

Jason M. Gregory,Christopher Reardon,Kevin Lee,Geoffrey White,Ki Ng,Caitlyn Sims

DOI: https://doi.org/10.48550/arXiv.1909.06415

2019-09-14

Abstract:Human-robot teaming offers great potential because of the opportunities to combine strengths of heterogeneous agents. However, one of the critical challenges in realizing an effective human-robot team is efficient information exchange - both from the human to the robot as well as from the robot to the human. In this work, we present and analyze an augmented reality-enabled, gesture-based system that supports intuitive human-robot teaming through improved information exchange. Our proposed system requires no external instrumentation aside from human-wearable devices and shows promise of real-world applicability for service-oriented missions. Additionally, we present preliminary results from a pilot study with human participants, and highlight lessons learned and open research questions that may help direct future development, fielding, and experimentation of autonomous HRI systems.

Robotics,Artificial Intelligence,Human-Computer Interaction
Augmented Reality for Interactive Robot Control

Levi Manring,John Pederson,Dillon Potts,Beth Boardman,David Mascarenas,Troy Harden,Alessandro Cattaneo

DOI: https://doi.org/10.1007/978-3-030-12243-0_2

2019-06-13

Abstract:Robots are widely used to support mission-critical, high-risk and complex operations. Human supervision and remote robot control are often required to operate robots in unpredictable and changing scenarios. Often, robots are controlled remotely by technicians via joystick interfaces which require training and experience to operate. To improve robot usage and practicality, we propose using augmented reality (AR) to create a more intuitive, less training-intensive means of controlling robots than traditional joystick control. AR is a creative platform for developing robot control systems, because AR combines the real world (the environment around the user, the physical robot, etc.) with the digital world (holograms, digital displays, etc.); it can even interpret physical gestures, such as pinching two fingers.In this research, a Microsoft Hololens headset is used to create an AR environment to control a Yaskawa Motoman SIA5D robot. The control process begins with the user placing an interactable holographic robot in 3D space. The user can then select between two control methods: manual control and automatic control. In manual control, the user can move the end effector of the holographic robot and the physical robot will respond immediately. In automatic control, the user can move the end effector of the holographic robot to a desired location, view a holographic preview of the motion, and select execute if the motion plan is satisfactory. In this preview mode, the user is able to preview both the motion of the robot and the torques experienced by the joints of the manipulator. This gives the user additional feedback on the planned motion. In this project we succeeded in creating an AR control system that makes controlling a robotic manipulator intuitive and effective.
AI-Powered Interfaces for Extended Reality to support Remote Maintenance

Akos Nagy,George Amponis,Konstantinos Kyranou,Thomas Lagkas,Alexandros Apostolos Boulogeorgos,Panagiotis Sarigiannidis,Vasileios Argyriou

DOI: https://doi.org/10.48550/arXiv.2306.16961

2023-06-29

Abstract:High-end components that conduct complicated tasks automatically are a part of modern industrial systems. However, in order for these parts to function at the desired level, they need to be maintained by qualified experts. Solutions based on Augmented Reality (AR) have been established with the goal of raising production rates and quality while lowering maintenance costs. With the introduction of two unique interaction interfaces based on wearable targets and human face orientation, we are proposing hands-free advanced interactive solutions in this study with the goal of reducing the bias towards certain users. Using traditional devices in real time, a comparison investigation using alternative interaction interfaces is conducted. The suggested solutions are supported by various AI powered methods such as novel gravity-map based motion adjustment that is made possible by predictive deep models that reduce the bias of traditional hand- or finger-based interaction interfaces

Human-Computer Interaction
ElectroAR: Distributed Electro-tactile Stimulation for Tactile Transfer

Jonathan Tirado,Vladislav Panov,Vibol Yem,Dzmitry Tsetserukou,Hiroyuki Kajimoto

DOI: https://doi.org/10.48550/arXiv.2007.10897

IF: 6.4588

2020-07-21

Human-Computer Interaction

Abstract:We present ElectroAR, a visual and tactile sharing system for hand skills training. This system comprises a head-mounted display (HMD), two cameras, tactile sensing glove, and electro-stimulation glove. The trainee wears a tactile sensing glove that gets pressure data from touching different objects. His movements are recorded by two cameras, which are located in front and top side of the workspace. In the remote site, the trainer wears the electro-tactile stimulation glove. This glove transforms the remotely collected pressure data to electro-tactile stimuli. Additionally, the trainer wears an HMD to see and guide the movements of the trainee. The key part of this project is to combine distributed tactile sensor and electro-tactile display to let the trainer understand what the trainee is doing. Results show our system supports a higher user recognition performance.
Immersive augmented reality system for the training of pattern classification control with a myoelectric prosthesis

Alexander Boschmann,Dorothee Neuhaus,Sarah Vogt,Christian Kaltschmidt,Marco Platzner,Strahinja Dosen

DOI: https://doi.org/10.1186/s12984-021-00822-6

2021-02-04

Journal of NeuroEngineering and Rehabilitation

Abstract:Abstract Background Hand amputation can have a truly debilitating impact on the life of the affected person. A multifunctional myoelectric prosthesis controlled using pattern classification can be used to restore some of the lost motor abilities. However, learning to control an advanced prosthesis can be a challenging task, but virtual and augmented reality (AR) provide means to create an engaging and motivating training. Methods In this study, we present a novel training framework that integrates virtual elements within a real scene (AR) while allowing the view from the first-person perspective. The framework was evaluated in 13 able-bodied subjects and a limb-deficient person divided into intervention (IG) and control (CG) groups. The IG received training by performing simulated clothespin task and both groups conducted a pre- and posttest with a real prosthesis. When training with the AR, the subjects received visual feedback on the generated grasping force. The main outcome measure was the number of pins that were successfully transferred within 20 min (task duration), while the number of dropped and broken pins were also registered. The participants were asked to score the difficulty of the real task (posttest), fun-factor and motivation, as well as the utility of the feedback. Results The performance (median/interquartile range) consistently increased during the training sessions (4/3 to 22/4). While the results were similar for the two groups in the pretest, the performance improved in the posttest only in IG. In addition, the subjects in IG transferred significantly more pins (28/10.5 versus 14.5/11), and dropped (1/2.5 versus 3.5/2) and broke (5/3.8 versus 14.5/9) significantly fewer pins in the posttest compared to CG. The participants in IG assigned (mean ± std) significantly lower scores to the difficulty compared to CG (5.2 ± 1.9 versus 7.1 ± 0.9), and they highly rated the fun factor (8.7 ± 1.3) and usefulness of feedback (8.5 ± 1.7). Conclusion The results demonstrated that the proposed AR system allows for the transfer of skills from the simulated to the real task while providing a positive user experience. The present study demonstrates the effectiveness and flexibility of the proposed AR framework. Importantly, the developed system is open source and available for download and further development.

engineering, biomedical,rehabilitation,neurosciences
An Augmented Reality Environment to Provide Visual Feedback to Amputees During sEMG Data Acquisitions

Francesca Palermo,Matteo Cognolato,Ivan Eggel,Manfredo Atzori,Henning Müller

DOI: https://doi.org/10.1007/978-3-030-25332-5_1

2019-01-01

Abstract:Myoelectric hand prostheses have the potential to improve the quality of life of hand amputees. Still, the rejection rate of functional prostheses in the adult population is high. One of the causes is the long time for fitting the prosthesis and the lack of feedback during training. Moreover, prosthesis control is often unnatural and requires mental effort during the training. Virtual and augmented reality devices can help to improve these difficulties and reduce phantom limb pain. Amputees can start training the residual limb muscles with a weightless virtual hand earlier than possible with a real prosthesis. When activating the muscles related to a specific grasp, the subjects receive a visual feedback from the virtual hand. To the best of our knowledge, this work presents one of the first portable augmented reality environment for transradial amputees that combines two devices available on the market: the Microsoft HoloLens and the Thalmic labs Myo. In the augmented environment, rendered by the HoloLens, the user can control a virtual hand with surface electromyography. By using the virtual hand, the user can move objects in augmented reality and train to activate the right muscles for each movement through visual feedback. The environment presented represents a resource for rehabilitation and for scientists. It helps hand amputees to train using prosthetic hands right after the surgery. Scientists can use the environment to develop real time control experiments, without the logistical disadvantages related to dealing with a real prosthetic hand but with the advantages of a realistic visual feedback.
CobotAR: Interaction with Robots using Omnidirectionally Projected Image and DNN-based Gesture Recognition

Nazarova Elena,Sautenkov Oleg,Altamirano Cabrera Miguel,Tirado Jonathan,Serpiva Valerii,Rakhmatulin Viktor,Tsetserukou Dzmitry

DOI: https://doi.org/10.48550/arXiv.2110.10571

IF: 3.7

2021-10-20

Robotics

Abstract:Several technological solutions supported the creation of interfaces for Augmented Reality (AR) multi-user collaboration in the last years. However, these technologies require the use of wearable devices. We present CobotAR - a new AR technology to achieve the Human-Robot Interaction (HRI) by gesture recognition based on Deep Neural Network (DNN) - without an extra wearable device for the user. The system allows users to have a more intuitive experience with robotic applications using just their hands. The CobotAR system assumes the AR spatial display created by a mobile projector mounted on a 6 DoF robot. The proposed technology suggests a novel way of interaction with machines to achieve safe, intuitive, and immersive control mediated by a robotic projection system and DNN-based algorithm. We conducted the experiment with several parameters assessment during this research, which allows the users to define the positives and negatives of the new approach. The mental demand of CobotAR system is twice less than Wireless Gamepad and by 16\% less than Teach Pendant.
Use of preoperative visceral echo-color-Doppler in patients candidates to colonic surgery: preliminary report.

P. Del Rio,E. Bertocchi,L. Sommaruga,G. Iapichino,C. Montana,P. Dell’Abate,M. Sianesi

2012-12-01

Minerva Chirurgica

Abstract:AIM Postsurgical paralytic ileus is by definition an ileal paralysis longer than three days (72 hours) after a surgery on the gastrointestinal tract. At colorectal surgery we have performed on all candidates a visceral echo-color-Doppler to find a potential correlation with cardiovascular risk factors. METHODS We have tested patients undergone to colorectal surgical resection performed by laparoscopic and laparotomic surgery, looking for their atherosclerosis status using ultrasound scan, postsurgical complication, bowel digestive function, anastomotic leak. We have also analyzed for each case the value of glycemia, azotemia, creatinemia, cholesterolemia, triglyceridemia, leukocytemia, mean cell volume, hemoglobinemia, albuminemia and moreover age, disease, pathology localization, kind of surgery, weight and height, body mass index (BMI), ASA status (American Society of Anesthesiologists, electrocardiographic distortions, nicotine dependency, diabetes mellitus type I and II). RESULTS The study enrolled 23 patients, 10 male and 13 female. Middle age was 68.65 ± 11.85 years (range 39-90). In the female subgroup mean age was 69.48 years (range 39-90), while in the male subgroup it was 68 years (range 54-81). In 17 cases out of 23 (73.9%) there was a delay in digestive function, of over 72 hours, with a mean time duration of the paralytic ileus of 4.74 ± 1.60 days (range 3-9). Furthermore a statistically significant correlation between albuminemia and hemoglobinemia presurgery values and lower sierical albuminemia presurgery values in patients who were canalized too late (P=0.03; P=0.041) was found. The non-parametrical values analysis sec. Kruskal-Wallis emphasized a significant correlation between the canalization day, the elettrocardiographic evidence of the pathological situation (P=0.023) and the patient's smoking history (0.023). Another significant value was the creatininemia value: lower values of creatininemia were related to a delayed canalization (P=0.035). CONCLUSION The statistical analysis does not allow to highlight any correlation between the ultrasound diagnosis of atherosclerosis and the delayed canalization.
Fouille de données biomédicales : apports des arbres de décision et des règles d'association à l'étude du syndrome métabolique dans la cohorte STANISLAS

Sandy Maumus,A. Napoli,Laszlo Szathmary,S. Visvikis-Siest

Abstract:
DroneARchery: Human-Drone Interaction through Augmented Reality with Haptic Feedback and Multi-UAV Collision Avoidance Driven by Deep Reinforcement Learning

Ekaterina Dorzhieva,Ahmed Baza,Ayush Gupta,Aleksey Fedoseev,Miguel Altamirano Cabrera,Ekaterina Karmanova,Dzmitry Tsetserukou

DOI: https://doi.org/10.48550/arXiv.2210.07730

IF: 3.7

2022-10-14

Robotics

Abstract:We propose a novel concept of augmented reality (AR) human-drone interaction driven by RL-based swarm behavior to achieve intuitive and immersive control of a swarm formation of unmanned aerial vehicles. The DroneARchery system developed by us allows the user to quickly deploy a swarm of drones, generating flight paths simulating archery. The haptic interface LinkGlide delivers a tactile stimulus of the bowstring tension to the forearm to increase the precision of aiming. The swarm of released drones dynamically avoids collisions between each other, the drone following the user, and external obstacles with behavior control based on deep reinforcement learning. The developed concept was tested in the scenario with a human, where the user shoots from a virtual bow with a real drone to hit the target. The human operator observes the ballistic trajectory of the drone in an AR and achieves a realistic and highly recognizable experience of the bowstring tension through the haptic display. The experimental results revealed that the system improves trajectory prediction accuracy by 63.3% through applying AR technology and conveying haptic feedback of pulling force. DroneARchery users highlighted the naturalness (4.3 out of 5 point Likert scale) and increased confidence (4.7 out of 5) when controlling the drone. We have designed the tactile patterns to present four sliding distances (tension) and three applied force levels (stiffness) of the haptic display. Users demonstrated the ability to distinguish tactile patterns produced by the haptic display representing varying bowstring tension(average recognition rate is of 72.8%) and stiffness (average recognition rate is of 94.2%). The novelty of the research is the development of an AR-based approach for drone control that does not require special skills and training from the operator.
SoftBoMI: a non-invasive wearable body-machine interface for mapping movement of shoulder to commands

Rongkai Liu,Quanjun Song,Tingting Ma,Hongqing Pan,Hao Li,Xinyan Zhao

DOI: https://doi.org/10.1088/1741-2552/ad8b6e

IF: 5.043

2024-10-26

Journal of Neural Engineering

Abstract:Objective: Customized human-machine interfaces for controlling assistive devices are vital in improving the self-help ability of upper limb amputees and tetraplegic patients. Given that most of them possess residual shoulder mobility, using it to generate commands to operate assistive devices can serve as a complementary approach to brain-computer interfaces. Approach: We propose a hybrid body-machine interface prototype that integrates soft sensors and an inertial measurement unit. This study introduces both a rule-based data decoding method and a user intent inference-based decoding method to map human shoulder movements into continuous commands. Additionally, by incorporating prior knowledge of the user's operational performance into a shared autonomy framework, we implement an adaptive switching command mapping approach. This approach enables seamless transitions between the two decoding methods, enhancing their adaptability across different tasks. Main results: The proposed method has been validated on individuals with cervical spinal cord injury, bilateral arm amputation, and healthy subjects through a series of center-out target reaching tasks and a virtual powered wheelchair driving task. The experimental results show that using both the soft sensors and the gyroscope exhibits the most well-rounded performance in intent inference. Additionally, the rule-based method demonstrates better dynamic performance for wheelchair operation, while the intent inference method is more accurate but has higher latency. Adaptive switching decoding methods offer the best adaptability by seamlessly transitioning between decoding methods for different tasks. Furthermore, we discussed the differences and characteristics among the various types of participants in the experiment Significance: The proposed method has the potential to be integrated into clothing, enabling non-invasive interaction with assistive devices in daily life, and could serve as a tool for rehabilitation assessment in the future.

engineering, biomedical,neurosciences
Utilizing EEG Signal Data and Motion to Aid in Prosthetic Hand Motion

Harshitha Jasti

DOI: https://doi.org/10.47611/jsrhs.v12i4.5883

2023-11-30

Journal of Student Research

Abstract:Current prosthetic arm technologies are often difficult to use intuitively by amputees, require invasive surgical procedures, and can be extremely costly with prices ranging from $20,000 to $80,000. To address these challenges, the engineering goal of this project aims to design a smart, low-cost, mind-controlled transhumeral prosthesis by integrating the brain-interfacing capabilities of electroencephalography (EEG), the economical means of 3D printing technology, and gesture-detecting attributes of an accelerometer-gyroscope. Single-channel brain signals are transmitted through Bluetooth to be interpreted by a novel EEG decoding algorithm and head gestures from the inertial measurement unit actuate movement within the arm. Force sensitive resistors were employed to regulate force control in real-time to optimize grasp type. An LCD screen is integrated within the arm’s design to display the type of touch it is exerting on an object. The arm itself was printed with an original design utilizing PLA plastic filament making it extremely durable and lightweight. After thoroughly testing the prosthesis, the novel EEG decoding system boasts an accuracy of 94.7% and a user cognition to machine delay of 1.64 + - 0.37 seconds. The inertial measurement unit system recognizes user gestures with a delay of .136 seconds. With a bill of materials approximately $375 USD and ability to be moved in 4 degrees of motion, this novel upper limb prosthesis serves as a promising alternative to existing units on the market. The algorithms developed within this project have a wide range of use within other brain control interface projects.
Neuroergonomic Solutions in AR and VR Applications

Paruthi Pradhapan,Jolanda Witteveen,Navid Shahriari,Alessio Meroni,Vojkan Mihajlović

DOI: https://doi.org/10.1007/978-3-030-34784-0_20

2020-01-01

Abstract:Although Wearable sensors are omnipresent in consumer market nowadays, due to wearability and comfort issues they often avoid human head. Reliable and robust estimation of human Cognitive states and traits, unfortunately, requires positioning electrodes at this sensitive location to capture electrical activity of the brain, eyes, and/or (facial) muscles. Novel Augmented and virtual reality (AR/VR) use cases provide a new area that could lower the acceptance threshold of users toward head-worn devices and open new application spaces. To foster this new trend, head-mounted solutions have to offer clear benefits to users and also provide convenience and wearing comfort. Two prototype solutions are discussed in more detail, an AR-enhanced glasses and a VR-compatible Electroencephalography (EEG) headset, along with the methods used to assess and improve Data quality such that reliable information on brain and eye activity can be extracted. Systems and methods are evaluated through large-scale user experiments during a music festival (Lowlands) in case of AR glasses and a simulated real-life scenario for VR EEG solution. Improvements achieved in Ergonomics and Signal integrity are clear over state of the art, however, further adaptations of the solutions toward final use case could lead to increased end-user benefits.
Combination of Augmented Reality Based Brain- Computer Interface and Computer Vision for High-Level Control of a Robotic Arm.

Xiaogang Chen,Xiaoshan Huang,Yijun Wang,Xiaorong Gao

DOI: https://doi.org/10.1109/tnsre.2020.3038209

IF: 4.9

2020-01-01

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Recent advances in robotics, neuroscience, and signal processing make it possible to operate a robot through electroencephalography (EEG)-based brain-computer interface (BCI). Although some successful attempts have been made in recent years, the practicality of the entire system still has much room for improvement. The present study designed and realized a robotic arm control system by combing augmented reality (AR), computer vision, and steady-state visual evoked potential (SSVEP)-BCI. AR environment was implemented by a Microsoft HoloLens. Flickering stimuli for eliciting SSVEPs were presented on the HoloLens, which allowed users to see both the robotic arm and the user interface of the BCI. Thus users did not need to switch attention between the visual stimulator and the robotic arm. A four-command SSVEP-BCI was built for users to choose the specific object to be operated by the robotic arm. Once an object was selected, the computer vision would provide the location and color of the object in the workspace. Subsequently, the object was autonomously picked up and placed by the robotic arm. According to the online results obtained from twelve participants, the mean classification accuracy of the proposed system was 93.96 ± 5.05%. Moreover, all subjects could utilize the proposed system to successfully pick and place objects in a specific order. These results demonstrated the potential of combining AR-BCI and computer vision to control robotic arms, which is expected to further promote the practicality of BCI-controlled robots.
Soft Sensors and Actuators for Wearable Human-Machine Interfaces

Jonghwa Park,Youngoh Lee,Seungse Cho,Ayoung Choe,Jeonghee Yeom,Yun Goo Ro,Jinyoung Kim,Dong-hee Kang,Seungjae Lee,Hyunhyub Ko

DOI: https://doi.org/10.1021/acs.chemrev.3c00356

IF: 62.1

2024-02-06

Chemical Reviews

Abstract:Haptic human-machine interfaces (HHMIs) combine tactile sensation and haptic feedback to allow humans to interact closely with machines and robots, providing immersive experiences and convenient lifestyles. Significant progress has been made in developing wearable sensors that accurately detect physical and electrophysiological stimuli with improved softness, functionality, reliability, and selectivity. In addition, soft actuating systems have been developed to provide high-quality haptic...

chemistry, multidisciplinary

[Results of treatment of patients with cervical cancer by X-ray irradiation from external fields and telecobalt 60].

A Multipurpose Human–Machine Interface via 3D-Printed Pressure-Based Force Myography

Design and Evaluation of an Augmented Reality Head-Mounted Display Interface for Human Robot Teams Collaborating in Physically Shared Manufacturing Tasks

Human Operation Augmentation through Wearable Robotic Limb Integrated with Mixed Reality Device

Persistent Human–Machine Interfaces for Robotic Arm Control Via Gaze and Eye Direction Tracking

Anatomically Designed Triboelectric Wristbands with Adaptive Accelerated Learning for Human–Machine Interfaces

Enabling Intuitive Human-Robot Teaming Using Augmented Reality and Gesture Control

Augmented Reality for Interactive Robot Control

AI-Powered Interfaces for Extended Reality to support Remote Maintenance

ElectroAR: Distributed Electro-tactile Stimulation for Tactile Transfer

Immersive augmented reality system for the training of pattern classification control with a myoelectric prosthesis

An Augmented Reality Environment to Provide Visual Feedback to Amputees During sEMG Data Acquisitions

CobotAR: Interaction with Robots using Omnidirectionally Projected Image and DNN-based Gesture Recognition

Use of preoperative visceral echo-color-Doppler in patients candidates to colonic surgery: preliminary report.

Fouille de données biomédicales : apports des arbres de décision et des règles d'association à l'étude du syndrome métabolique dans la cohorte STANISLAS

DroneARchery: Human-Drone Interaction through Augmented Reality with Haptic Feedback and Multi-UAV Collision Avoidance Driven by Deep Reinforcement Learning

SoftBoMI: a non-invasive wearable body-machine interface for mapping movement of shoulder to commands

Utilizing EEG Signal Data and Motion to Aid in Prosthetic Hand Motion

Neuroergonomic Solutions in AR and VR Applications

Combination of Augmented Reality Based Brain- Computer Interface and Computer Vision for High-Level Control of a Robotic Arm.

Soft Sensors and Actuators for Wearable Human-Machine Interfaces