FaceAtlasAR: Atlas of Facial Acupuncture Points in Augmented Reality

Menghe Zhang,Jurgen Schulze,Dong Zhang

DOI: https://doi.org/10.48550/arXiv.2111.14755

2022-03-29

Abstract:Acupuncture is a technique in which practitioners stimulate specific points on the body. Those points, called acupuncture points (or acupoints), anatomically define areas on the skin relative to specific landmarks on the body. However, mapping the acupoints to individuals could be challenging for inexperienced acupuncturists. In this project, we proposed a system to localize and visualize facial acupoints for individuals in an augmented reality (AR) context. This system combines a face alignment model and a hair segmentation model to provide dense reference points for acupoints localization in real-time (60FPS). The localization process takes the proportional bone (B-cun or skeletal) measurement method, which is commonly operated by specialists; however, in the real practice, operators sometimes find it inaccurate due to skill-related error. With this system, users, even without any skills, can locate the facial acupoints as a part of the self-training or self-treatment process.

Graphics,Computer Vision and Pattern Recognition,Human-Computer Interaction

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: **How to help users, especially inexperienced ones, accurately locate and visualize facial acupoints**. Specifically, traditional acupuncture practice relies on experienced acupuncturists to locate acupoints according to the body's acupuncture atlas, and individuals are often confused when trying to locate acupoints by themselves through natural - language descriptions or standard model pictures. To solve this problem, the author proposes an augmented - reality (AR) - based system - FaceAtlas AR for real - time location and display of users' facial acupoints.

### Main problems:
1. **Complexity of acupuncture point location**: Accurate location of acupuncture points is very difficult for people who are not familiar with acupuncture, especially without professional guidance.
2. **Limitations of traditional methods**: Existing acupuncture training applications and location methods have limitations, such as relying on limited facial feature points or 3D models and being unable to adapt to different face shapes and postures.
3. **Improving the feasibility of self - treatment and education**: In order to enable more people to use acupuncture through self - training or self - treatment, a simple - to - use tool is needed to help them accurately locate acupoints.

### Solutions:
- **Combining deep - learning models**: The FaceAtlas AR system combines a facial alignment model and a hair - segmentation model to provide dense reference points, thus achieving high - precision facial acupuncture point location.
- **Real - time processing**: The system can run at a speed of 60FPS on mobile devices, ensuring real - time performance and user experience.
- **Adapting to different head postures**: The system can adapt to different head postures, enabling users to accurately find acupoints at different angles.
- **No need for additional hardware**: Users only need to use a mobile phone with a front - facing camera to complete acupoint location, without the need for additional hardware devices.

Through these technical means, FaceAtlas AR aims to make the location of acupuncture points more intuitive and easy to operate, especially suitable for acupuncture education, communication, and self - treatment scenarios.