Abstract:Objectives: To explore the action characteristics of acupuncture manipulations by combining visual and sensor technique, so as to improve the identification and classification accuracy of acupuncture manipulations and to quantificate the classifiations. Methods: In this paper, the time domain features of acupuncture physical parameters and dynamic gesture features in the video of acupuncture manipulations are combined together to identify and classify acupuncture techniques. The acupuncture needle manipulation processes of 2 acupuncture experts and 3 young acupuncturists were selected as the study objects. The collected data included 4 basic manipulation techniques：lifting-thrusting reinforcing, lifting- thrusting reducing, twisting reinforcing and twisting reducing methods, all of which were performed by right-handed doctors. During acupuncture manipulation, a three-axis attitude sensor was used to acquire finger moving acceleration velocity and needle-rotating angle velocity, followed by analyzing the parameters of hand-moving velocity, amplitude, strength and angle. The mapping relationship among physical parameters and different manipulating methods was formed in time domain. The computer vision technology was employed to extract the spatio-temporal features of the acupuncture manipulation video images, and a hybrid model of three-dimensional convolutional neural network (3D CNN) and long- and short-term memory (LSTM) neural network were used for the recognition and classification of dynamic gestures of hand in acupuncture manipulation videos. Then the time-domain features of physical parameters were combined with the dynamic gestures in the classification process, with the manipulation classification realized. Results: In performing the lift-thrusting reinforcing method, the needle insertion speed was faster and the force was larger, while the needle lifting speed was slower and the force was smaller. And in performing the lift-thrusting reducing method, the needle lifting speed was faster, the force was stronger, and the needle insertion speed was slower and the force was smaller. In the performance of twisting reinforcing, the leftward twisting force was bigger and the rotation amplitude was larger, while in performing the reducing method, the rightward twisting force was larger and the rotation amplitude was larger. When using the mean value of time of acceleration, speed, and amplitude as the basis of discrimination, the accuracy rates of lifting-thrusting reinforcing and reducing were 95.56% and 93.33%, while those of the two twisting manipulations were 95.56% and 91.11%, respectively. Compared with the classification method that only uses the sensor to obtain the manipulation information, the recognition accuracy was significantly improved. Conclusions: The acupuncture manipulation classification system can achieve quantitative analysis of physical parameters and dynamic recognition of acupuncture techniques, providing a certain foundation for the quantification and inheritance of acupuncture techniques.

Development of a Novel Sensor Unit to Build Up Massage Manipulation for Medical Training

Research On Information Acquisition And Manipulation Representation (Mr) Method Of Traditional Chinese Medical Massage (Tcmm) Based On Multi-Dimension Force Sensor

Design and Massaging Force Analysis of Wearable Flexible Single Point Massager Imitating Traditional Chinese Medicine

Design and Application of a New High-Performance Flexible Six-Axis Force/torque Sensor for Massage Therapy

Development And Evaluation Of A Multimodal Sensor Motor Learning Assessment

Visual Feedback System for Traditional Chinese Medical Massage Robot

Biomechanical model preparation and analysis of pushing manipulation with one-finger meditation (thumb flexion)

Digital Modeling of Massage Techniques and Reproduction by Robotic Arms

A novel realtime vision-based acupoint estimation for TCM massage robot

Exercise and Rehabilitation of Chronically Ill Patients Assisted by Small Digital Bio-Pulse Sensors

Validation and prediction of traditional Chinese physical operation on spinal disease using multiple deformation models

An Intelligent Wristband for Simultaneous Multiparameter Measurement during Fumigation and Washing Therapy of Traditional Chinese Medicine

Real-time monitoring of manual acupuncture stimulation parameters based on domain adaptive 3D hand pose estimation

A three-electrode multi-module sensor for accurate bodily-kinesthetic monitoring

An ultrasensitive flexible strain sensor based on CNC/CNTs/MXene/TPU fibrous mat for human motion, sound and visually personalized rehabilitation training monitoring

A Piezoelectric Force Sensing and Gesture Monitoring-Based Technique for Acupuncture Quantification

Data-Driven 3-D Tactile Cues With Intermediate Soft Interfaces Toward Training Needle Insertions

An acupuncture manipulation classification system based on three-axis attitude sensor and computer vision

A patterned mechanical–electrical coupled sensing patch for multimodal muscle function evaluation

Development of A Hybrid Mini-Grid sEMG, NIRS and MMG Sensor System for Human-Machine Interaction

[Research and Development on the Dynamic System for Detecting the Force of Acupuncture Needle During the Acupuncture Process in the Clinical Practice of Traditional Chinese Medicine].