Abstract:Lip reading, the process of interpreting speech by visually observing the movements of the lips, has emerged as a critical area of research with applications spanning communication aids for the hearing impaired, silent speech interfaces, and enhanced human-computer interaction. This paper reviews recent advancements in lip reading technologies, focusing on the integration of machine learning and computer vision techniques. We explore state-of-the-art methods including convolutional neural networks (CNNs), recurrent neural networks (RNNs), and transformer-based models that have significantly improved the accuracy and robustness of lip reading systems. The study highlights the importance of large annotated datasets, such as LipNet and LRW, which have facilitated the training of deep learning models. Additionally, we examine multimodal approaches that combine visual information with audio signals to enhance performance, especially in noisy environments. Despite substantial progress, challenges remain in addressing speaker variability, low resolution, and real-time processing. Future research directions are discussed, emphasizing the need for more diverse datasets, improved model generalization, and real-world application testing. This comprehensive review underscores the potential of advanced lip reading technologies to revolutionize communication accessibility and human-computer interaction. This paper presents the method for Vision based Lip Reading system that uses convolutional neural network (CNN) with attention-based Long Short-Term Memory (LSTM). The dataset includes video clips pronouncing words sentence. The pretrained CNN is used for extracting features from pre- processed video frames which then are processed for learning temporal characteristics by LSTM. The SoftMax layer of architecture provides the result of lip reading. In the present work experiments are performed with two pre-trained models. The system provides 80% accuracy using Tensorflow and ensemble learning. Keywords— CNN; RNN; LSTM; Tensorflow; lip reading; deep learning

Comparison of DenseNet201 and ResNet50 for lip reading of decimal Digits

Automatic Lip reading for decimal digits using ResNet50 Model

Decimal Digits Recognition from Lip Movement Using GoogleNet network

An automatic lip reading for short sentences using deep learning nets

Lip Reading using Deep Learning

Efficient DNN Model for Word Lip-Reading

Lip-Reading with Visual Form Classification using Residual Networks and Bidirectional Gated Recurrent Units

Lip Reading Using Neural Networks and Deep Learning

Research on a Lip Reading Algorithm Based on Efficient-GhostNet

Improving the Performance of Automatic Lip-Reading Using Image Conversion Techniques

Exploring Lip Segmentation Techniques in Computer Vision: A Comparative Analysis

A Review on Deep Learning Based Lip-Reading

Lip Movement Detection Using 3D Convolution and Resnet

Automatic Lip Reading System Based on a Fusion Lightweight Neural Network with Raspberry Pi

Lip2AudSpec: Speech reconstruction from silent lip movements video

Pushing the limits of remote RF sensing by reading lips under the face mask

Research on lip recognition algorithm based on MobileNet + attention-GRU

Three-Dimensional Joint Geometric-Physiologic Feature For Lip-Reading

[Development and evaluation of a deep learning algorithm for German word recognition from lip movements]

Acoustic-Based Lip Reading for Mobile Devices: Dataset, Benchmark and a Self Distillation-Based Approach

Modelling Lips-State Detection Using CNN for Non-Verbal Communications