Abstract:The rapid development of artificial intelligence places high demands on human-machine interfaces. Various types of huma-machine interfaces have been implemented, including smart keyboards, electronic skins, and wearable motion sensors. Handwriting behavior has a high degree of interaction freedom, and handwriting characteristics offer high-security standards for human-machine systems. Herein, we propose a portable smart pen integrated with triboelectric displacement vector sensors to trace handwriting trajectories for human-machine interactions and biometric identification. A triboelectric pressure sensor array is evenly distributed along the pen case to sense displacement vectors, and an additional triboelectric sensor is placed on top of the pen to detect vertical force. By leveraging the resin pen refill as a tribopositive material and a nanowired polyethylene tribonegative layer attached to a Cu electrode, triboelectric signals are generated during the writing/moving process. The calculation and analysis of the sensor signals enable the recognition of handwritten patterns, including Latin letters and Arabic numerals. Moreover, the smart pen can be used to authenticate users based on their unique handwriting patterns, which can help take human-machine interfaces and cyber security to the next level. Furthermore, a custom smart pen operation mode that enables the control of a slide presentation demonstrates the smart pen's potential for various human-machine interface applications.

Handwriting detecting system for space pen

SmartGe: Identifying Pen-Holding Gesture with Smartwatch.

SmartWriting: Pen-Holding Gesture Recognition with Smartwatch

Space Handwriting Character Recognition Method Based on Elimination of Connected Stroke

Handwriting-Assistant

3D Space Handwriting Recognition Based on Time-frequency Fusion Feature

Enable Traditional Laptops with Virtual Writing Capability Leveraging Acoustic Signals.

VPad: Virtual Writing Tablet for Laptops Leveraging Acoustic Signals

Integration of image sensing and acceleration sensors for calligrapher behavior measurement

Motion-Based Handwriting Recognition

Pen motion attitude measurement using accelerometer and gyroscope

A Smart Pen Based on Triboelectric Effects for Handwriting Pattern Tracking and Biometric Identification

Design of handwriting information acquisition system based on multi-dimensional force sensor

A novel tablet for on-line handwriting signal capture

Controlling Non-Touch Screens as Touch Screens Using Airpen, a Writing Tool with In-Air Gesturing Mode

The Design of a New Instrument for Pen-contact Force Information Acquisition During Handwriting

Digitizing Handwriting with a Sensor Pen: A Writer-Independent Recognizer

Inertial-Measurement- Based Biometric Authentication of Handwritten Signature

A handwritten character recognition system based on acceleration

Handwriting Recognition System Leveraging Vibration Signal on Smartphones

Handwriting-Assistant: Reconstructing Continuous Strokes with Millimeter-level Accuracy via Attachable Inertial Sensors