Endosomal vesicles as vehicles for viral genomes.

Adel M Nour,Y. Modis

DOI: https://doi.org/10.1016/j.tcb.2014.03.006

IF: 21.167

2014-08-01

Trends in Cell Biology

Abstract:

What problem does this paper attempt to address?

An Action Recognition Technology for Badminton Players Using Deep Learning

Jiatong Liu,Bo Liang

DOI: https://doi.org/10.1155/2022/3413584

2022-05-03

Mobile Information Systems

Abstract:With the fast development of sports in recent years, the number of people participating in various sports has increased day by day. Because of the advantages of fewer constraints on the field and ease of learning, badminton became one of the most popular sports among them. Numerous works have been done specifically for the recognition of action of badminton players to improve and popularize it, but the traditional badminton player's badminton action recognition algorithm employs the method of manually constructing a topology map to model the action sequence contained in multiple video frames. Besides, it learns each video frame in a targeted manner to reflect data changes, which is prone to high computational cost, low network generalization, and catastrophic forgetting. In response to the above problems, this paper proposes a deep learning-based action recognition technology for badminton players, which re-encodes the human hitting action sequence data with multirelational characteristics into relational triples, and learns by decoupling based on long short-term memory network. At the same time, this paper designs and completes a set of badminton action recognition schemes based on acceleration and angular velocity signals. Experimental results show that the proposed method achieves 63%, 84%, and 92%, respectively, recognition accuracy on multiple benchmark datasets, which improves the accuracy of human hitting action recognition. As a result, the evaluation will be useful in future work to improve the structure of current deep learning models for higher results in badminton action recognition.

computer science, information systems,telecommunications
Automatic Badminton Action Recognition Using CNN with Adaptive Feature Extraction on Sensor Data.

Ya Wang,Weichuang Fang,Jinwen Ma,Xiangchen Li,Albert Zhong

DOI: https://doi.org/10.1007/978-3-030-26763-6_13

2019-01-01

Abstract:With the fast development of sensor technology, a sensor chip can be easily inserted into the badminton racket so that the data of the activity of the badminton player can be recorded continuously. It has become a very challenging problem whether we can use these sensor-based data to effectively recognize the badminton actions. Although there have been some researches on the general human action recognition such as sitting, walking and running, there is few result or public dataset concerning badminton action recognition. In order to investigate the problem of badminton action recognition, we implement a specialized sensor chip being inserted into the badminton racket to collect the data of ten major badminton actions. On such a dataset, a deep convolutional neural network (CNN) can get a much better result of badminton action recognition than the conventional methods, but its recognition accuracy is not good enough for practical applications. The key difficulty is that the attributes recorded as time series in the sensor data have different measures and magnitudes so that the conventional feature normalization cannot work effectively in this complicated situation. In order to overcome this difficulty, we propose a specific block of adaptive feature extraction to enhance the performance of CNN for badminton action recognition. It is demonstrated by the experimental results on the sensor dataset that our proposed CNN with the adaptive feature extraction block can get 98.65% action recognition accuracy and outperforms the competitive methods remarkably.
Hierarchical Multi-Classification for Sensor-based Badminton Activity Recognition

Ya Wang,Jinwen Ma,Xiangchen Li,Albert Zhong

DOI: https://doi.org/10.1109/icsp48669.2020.9320935

2020-01-01

Abstract:Fast development of sensor technology makes sensor equipments more and more smart and wearable. It further boost the need of sensor-based human activity recognition. Due to the lack of large-scale labeled datasets in practical AI applications, it is important to utilize prior information of the categories in sensor-based human activity recognition. In this paper, we propose a Hierarchical Multi-Classificaion (HMC) framework for sensor-based badminton activity recognition with the help of the prior information of badminton activity categories. Specifically, the multi-class sensor-based badminton activity recognition task is performed in two steps: (1). Any input data for a badminton activity are classified into one of the major classes which are based on their characteristic features; (2). They are further classified into one of the specific categories of badminton activity as required. It is demonstrated by the experimental results on BSS-V2 dataset that our proposed method can get up to 83.9% badminton activity recognition accuracy which is 1.7% better than previous state-of-the-art models.
Attention-based LSTM Network for Wearable Human Activity Recognition

Bo Sun,Meiqin Liu,Ronghao Zheng,Senlin Zhang

DOI: https://doi.org/10.23919/chicc.2019.8865360

2019-01-01

Abstract:Sensor-based human activity recognition (HAR) has become a popular research topic because of its wide applications. Conventional machine learning approaches have made enormous progress in the past years. However, those methods rely on handcrafted features that are incapable of handling complex activities, especially with high dimensional sensor data. Deep learning technology, together with its various models, is one of the most accurate methods of working on activity data. In this paper, we propose an attention-based Long Short Term Memory (LSTM) network for wearable human activity recognition. Specifically, we construct an LSTM network to model the sensor readings, which has been proved to be very effective for time sequences. Then, we introduce the attention mechanism for the base LSTM network to learn which parts of the raw sensor data are more important for determining the overall activities. When tested with the Opportunity data set, the F1-score is increased by 2.6%, compared with baseline LSTM results.
Research on badminton take-off recognition method based on improved deep learning

Lu Lianju,Zhang Haiying

DOI: https://doi.org/10.1007/s12652-024-04809-8

IF: 3.662

2024-08-21

Journal of Ambient Intelligence and Humanized Computing

Abstract:Because of the fast take-off speed of badminton, a single action recognition method can't quickly and accurately identify the action. Therefore, a new badminton take-off recognition method based on improved deep learning is proposed to capture badminton take-off accurately. Collect badminton sports videos and get images of athletes' activity areas by tracking the moving targets in badminton competition videos. The static characteristics of badminton players' take-off actions are extracted from the athletes' activity areas' images using 3D ConvNets. According to the human joint points in the badminton player's target tracking image, the human skeleton sequence is constructed by using a 2D coordinate pseudo-image and 2D skeleton data design algorithm, and the dynamic characteristics of badminton take-off action are extracted from the human skeleton sequence by using LSTM (Long-term and Short-term Memory Network). After the static and dynamic features are fused by weighted summation, badminton take-off feature fusion results are input into a convolutional neural network (CNN) to complete badminton take-off recognition. The CNN pool layer is improved by adaptive pooling, and the network convergence is accelerated by combining batch normalization to further optimize the recognition results of badminton take-off. Experiments show that the human skeleton model can accurately match human movements and assist in extracting action features. The improved CNN has greatly improved the accuracy of recognition of take-off actions. When recognizing real images, it can accurately identify human movements and judge whether there is a take-off action.

computer science, information systems,telecommunications, artificial intelligence
Deep ConvLSTM With Self-Attention for Human Activity Decoding Using Wearable Sensors

Satya P. Singh,Madan Kumar Sharma,Deepak Gangwar,Sukrit Gupta,Aime Lay-Ekuakille

DOI: https://doi.org/10.1109/jsen.2020.3045135

IF: 4.3

2021-03-15

IEEE Sensors Journal

Abstract:Decoding human activity accurately from wearable sensors can aid in applications related to healthcare and context awareness. The present approaches in this domain use recurrent and/or convolutional models to capture the spatio-temporal features from time-series data from multiple sensors. We propose a deep neural network architecture that not only captures the spatio-temporal features of multiple sensor time-series data but also selects, learns important time points by utilizing a self-attention mechanism. We show the validity of the proposed approach across different data sampling strategies on six public datasets and demonstrate that the self-attention mechanism gave a significant improvement in performance over deep networks using a combination of recurrent and convolution networks. We also show that the proposed approach gave a statistically significant performance enhancement over previous state-of-the-art methods for the tested datasets. The proposed methods open avenues for better decoding of human activity from multiple body sensors over extended periods of time. The code implementation for the proposed model is available at https://github.com/isukrit/encodingHumanActivity

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Deep Learning for Sensor-based Activity Recognition: A Survey

Jindong Wang,Yiqiang Chen,Shuji Hao,Xiaohui Peng,Lisha Hu

DOI: https://doi.org/10.1016/j.patrec.2018.02.010

2017-12-14

Abstract:Sensor-based activity recognition seeks the profound high-level knowledge about human activities from multitudes of low-level sensor readings. Conventional pattern recognition approaches have made tremendous progress in the past years. However, those methods often heavily rely on heuristic hand-crafted feature extraction, which could hinder their generalization performance. Additionally, existing methods are undermined for unsupervised and incremental learning tasks. Recently, the recent advancement of deep learning makes it possible to perform automatic high-level feature extraction thus achieves promising performance in many areas. Since then, deep learning based methods have been widely adopted for the sensor-based activity recognition tasks. This paper surveys the recent advance of deep learning based sensor-based activity recognition. We summarize existing literature from three aspects: sensor modality, deep model, and application. We also present detailed insights on existing work and propose grand challenges for future research.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning,Neural and Evolutionary Computing
Deep Spatial/temporal-level feature engineering for Tennis-based action recognition

Bai Ning,Liu Na

DOI: https://doi.org/10.1016/j.future.2021.06.022

IF: 7.307

2021-12-01

Future Generation Computer Systems

Abstract:Tennis has becoming an increasingly popular sport throughout the world. Tennis motion recognition based on 3D video has attracted more and more attention in recent years. The algorithm based on dynamic time warping takes into account the timing sequence information of movements and can solve the uncertainty of human movement at temporal level. By increasing the training samples, the efficiency will decrease accordingly. This work presents a tennis action recognition framework based on action standard sequence. The 3D action video samples are incorporated into action sequences by feature extraction, wherein the action standard sequences are encoded as a sequence averaging optimization problem under the dynamic time normalization metric. The dynamic time normalization barycenter averaging algorithm (DBA) is leveraged to solve this problem. For the tennis scenery with significant differences in the action categories, we study the standard sequence learning of multiple actions, and accordingly propose a DBA-K-means clustering algorithm for unsupervised learning. Herein, a human tennis action recognition by integrating feature optimization and image similarity is proposed. The three dimensional reduction methods, including principal component analysis (PCA),PCA + Pearson, and PCA+ Spearman, were compared to prove that PCA+ Pearson correlation coefficient had the best dimensional reduction effect. Meanwhile, the global feature eight-star model is combined with the local feature HOG feature after dimensionally reduced to fully represent human movements. The similarity between pairwise adjacent frames of images was calculated. The statistical weight of single frame SVM classification results within a discriminant period is adaptively allocated, and finally the body pose recognition results are classified twice. Experiments on standard data set KTH show that the recognition accuracy of this algorithm is 94.5%, which is better than other methods. It has a good application value in the field of video human motion recognition. Also, we have demonstrated that this method can further improve the efficiency and accuracy of action recognition. Effective feature extraction is beneficial to improve the accuracy of subsequent human action recognition.
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition

Francisco Javier Ordóñez,Daniel Roggen,Francisco Ordóñez

DOI: https://doi.org/10.3390/s16010115

IF: 3.9

2016-01-18

Sensors

Abstract:Human activity recognition (HAR) tasks have traditionally been solved using engineered features obtained by heuristic processes. Current research suggests that deep convolutional neural networks are suited to automate feature extraction from raw sensor inputs. However, human activities are made of complex sequences of motor movements, and capturing this temporal dynamics is fundamental for successful HAR. Based on the recent success of recurrent neural networks for time series domains, we propose a generic deep framework for activity recognition based on convolutional and LSTM recurrent units, which: (i) is suitable for multimodal wearable sensors; (ii) can perform sensor fusion naturally; (iii) does not require expert knowledge in designing features; and (iv) explicitly models the temporal dynamics of feature activations. We evaluate our framework on two datasets, one of which has been used in a public activity recognition challenge. Our results show that our framework outperforms competing deep non-recurrent networks on the challenge dataset by 4% on average; outperforming some of the previous reported results by up to 9%. Our results show that the framework can be applied to homogeneous sensor modalities, but can also fuse multimodal sensors to improve performance. We characterise key architectural hyperparameters' influence on performance to provide insights about their optimisation.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
WiFi Sensing for Drastic Activity Recognition with CNN-BiLSTM Architecture.

Yang Liu,Sufang Li,Jiguo Yu,Anming Dong,Li Zhang,Chuanting Zhang,Yi Cao

DOI: https://doi.org/10.1109/smc53654.2022.9945368

2022-01-01

Abstract:Sensing human activity via WiFi Channel State Information (CSI) has considerable application prospects in future intelligent interaction scenarios such as virtual reality, intelligent games, metaverse, etc. Recently, many Deep Learning-based WiFi sensing schemes have been proposed in the literature, which gained high accuracy for a wide range of simple activities such as standing, squatting, and bending. However, the performance will be suffered when existing approaches are used to recognize drastic activities, such as actions in vigorous sports. This is mainly due to the reason that the spatiotemporal information of these actions is not well utilized. To overcome this drawback, we propose a novel DL-based WiFi sensing method for drastic activity recognition by combining the Convolutional Neural Network (CNN) and the Bidirectional Long Short-Term Memory (BiLSTM) network. The designed CNN-BiLSTM architecture is in parallel with feature extraction, which can simultaneously extract sufficient spatiotemporal features of action data and establish the mapping relationship between actions and CSI streams, thereby improving the accuracy of activity recognition. The CNN is used to extract information on the spatial dimension, while the BiLSTM extracts information on the time dimension. To verify the performance of the proposed scheme, we build a hardware experiment platform and constrain a dataset with 1400 pieces of records for 7 classes of basketball actions. After training over the dataset, the proposed CNN-BiLSTM scheme achieves 96% experimental accuracy on the test set, which is better than the benchmark methods.
Vision Based Automated Badminton Action Recognition Using the New Local Convolutional Neural Network Extractor

Nur Azmina Rahmad,Muhammad Amir As’ari,Mohamad Fauzi Ibrahim,Nur Anis Jasmin Sufri,Keerthana Rangasamy

DOI: https://doi.org/10.1007/978-981-15-3270-2_30

2020-01-01

Abstract:AbstractPerformance analysis is essential in sports practice where the athlete is evaluated to improve their performance. Due to the rapid growth of science and technology, research on automated recognition of sports actions has become ubiquitous. The implementation of automated action recognition is an effort to overcome the manual action recognition in sport performance analysis. In this study, we developed a model for automated badminton action recognition from the computer vision data inputs using the deep learning pre-trained AlexNet Convolutional Neural Network (CNN) for features extraction and classify the features using supervised machine learning method which is linear Support-Vector Machine (SVM). The data inputs consist of badminton match images of two classes: hit and non-hit action. Before pre-trained AlexNet CNN was directly extracting the features, we introduced the new local CNN extractor in recognition pipeline. The results show that the classification accuracy with this new local CNN method achieved 98.7%. In conclusion, this new local CNN extractor can contribute to the improvement of the performance accuracy of the classification task.
A Novel Deep Multifeature Extraction Framework Based on Attention Mechanism Using Wearable Sensor Data for Human Activity Recognition

Yang Wang,Hongji Xu,Yunxia Liu,Mengmeng Wang,Yuhao Wang,Yang Yang,Shuang Zhou,Jiaqi Zeng,Jie Xu,Shijie Li,Jianjun Li

DOI: https://doi.org/10.1109/jsen.2023.3242603

IF: 4.3

2023-04-05

IEEE Sensors Journal

Abstract:Human activity recognition (HAR) utilizing wearable sensors is a prominent topic in academia and has been widely used in health monitoring, medical treatment, motion analysis, and other fields. Although HAR technology based on deep learning has made some progress, there are still some problems, such as incomplete feature extraction and low utilization rate of features, which may result in false recognition. To settle the problems, we propose a novel deep multifeature extraction framework based on attention mechanism (DMEFAM), which includes the temporal attention feature extraction layer (TAFEL), the channel and spatial attention feature extraction layer (CSAFEL), and the output layer. The TAFEL is comprised of bidirectional gated recurrent unit (Bi-GRU) and self-attention (SA) mechanism, and the CSAFEL is comprised of the convolutional block attention module (CBAM) and the residual network-18 (ResNet-18). In this framework, the combination of deep learning neural networks, SA mechanism, and CBAM assigns different important degrees to features, increases the diversities of feature extraction, and improves the accuracy of HAR. To improve the practicability of the proposed framework, a daily and aggressive activity dataset (DAAD) is collected by our laboratory for performance evaluation. The experiments are conducted on the wireless sensor data mining laboratory (WISDM) dataset, the University of California Irvine-HAR (UCI-HAR) dataset, and the collected DAAD dataset. The results show that the proposed DMEFAM can upgrade the recognition performance effectually compared to other advanced HAR frameworks, with the recognition accuracies of 97.9%, 96.0%, and 99.2% on the WISDM dataset, the UCI-HAR dataset, and the DAAD dataset, respectively.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Badminton video action recognition based on time network

Juncai Zhi,Zijie Sun,Ruijie Zhang,Zhouxiang Zhao

DOI: https://doi.org/10.3233/jcm-226889

2023-06-21

Journal of Computational Methods in Sciences and Engineering

Abstract:With the continuous development of artificial intelligence research, computer vision research has shifted from traditional "feature engineering"-based methods to deep learning-based "network engineering" methods, which automatically extracts and classifies features by using deep neural networks. Traditional methods based on artificial design features are computationally expensive and are usually used to solve simple research problems, which is not conducive for large-scale data feature extraction. Deep learning-based methods greatly reduce the difficulty of artificial features by learning features from large-scale data and are successfully applied in many visual recognition tasks. Video action recognition methods also shift from traditional methods based on artificial design features to deep learning-based methods, which is oriented to building more effective deep neural network models. Through collecting and sorting related research results found that academic for timing segment network of football and basketball video action research is relatively rich, but lack of badminton research given the above research results, this study based on timing segment network of badminton video action identification can enrich the research results, provide reference for follow-up research. This paper introduces the lightweight attention mechanism into the temporal segmentation network, forming the attention mechanism-timing segmentation network, and trains the neural network to get the classifier of badminton stroke action, which can be predicted as four common types: forehand stroke, backhand stroke, overhead stroke and pick ball. The experimental results show that the recognition recall and accuracy of various stroke movements reach more than 86%, and the average size of recall and accuracy is 91.2% and 91.6% respectively, indicating that the method based on timing segmentation network can be close to the human judgment level and can effectively conduct the identification task of badminton video strokes.
Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities

Kaixuan Chen,Dalin Zhang,Lina Yao,Bin Guo,Zhiwen Yu,Yunhao Liu

DOI: https://doi.org/10.48550/arXiv.2001.07416

IF: 6.4588

2020-01-21

Human-Computer Interaction

Abstract:The vast proliferation of sensor devices and Internet of Things enables the applications of sensor-based activity recognition. However, there exist substantial challenges that could influence the performance of the recognition system in practical scenarios. Recently, as deep learning has demonstrated its effectiveness in many areas, plenty of deep methods have been investigated to address the challenges in activity recognition. In this study, we present a survey of the state-of-the-art deep learning methods for sensor-based human activity recognition. We first introduce the multi-modality of the sensory data and provide information for public datasets that can be used for evaluation in different challenge tasks. We then propose a new taxonomy to structure the deep methods by challenges. Challenges and challenge-related deep methods are summarized and analyzed to form an overview of the current research progress. At the end of this work, we discuss the open issues and provide some insights for future directions.
Deep Residual Bidir-LSTM for Human Activity Recognition Using Wearable Sensors

Yu Zhao,Rennong Yang,Guillaume Chevalier,Maoguo Gong

DOI: https://doi.org/10.48550/arXiv.1708.08989

2017-09-07

Abstract:Human activity recognition (HAR) has become a popular topic in research because of its wide application. With the development of deep learning, new ideas have appeared to address HAR problems. Here, a deep network architecture using residual bidirectional long short-term memory (LSTM) cells is proposed. The advantages of the new network include that a bidirectional connection can concatenate the positive time direction (forward state) and the negative time direction (backward state). Second, residual connections between stacked cells act as highways for gradients, which can pass underlying information directly to the upper layer, effectively avoiding the gradient vanishing problem. Generally, the proposed network shows improvements on both the temporal (using bidirectional cells) and the spatial (residual connections stacked deeply) dimensions, aiming to enhance the recognition rate. When tested with the Opportunity data set and the public domain UCI data set, the accuracy was increased by 4.78% and 3.68%, respectively, compared with previously reported results. Finally, the confusion matrix of the public domain UCI data set was analyzed.

Computer Vision and Pattern Recognition,Machine Learning
Recognition of Badminton Shot Action Based on the Improved Hidden Markov Model

Chao Ma,Dayang Yu,Hao Feng

DOI: https://doi.org/10.1155/2021/7892902

2021-10-07

Journal of Healthcare Engineering

Abstract:In recent years, with the rapid development of sports, the number of people playing various sports is increasing day by day. Among them, badminton has become one of the most popular sports because of the advantages of fewer restrictions on the field and ease of learning. This paper develops a wearable sports activity classification system for accurately recognizing badminton actions. A single acceleration sensor fixed on the end of the badminton racket handle is used to collect the data of the badminton action. The sliding window segmentation technique is used to extract the hitting signal. An improved hidden Markov model (HMM) is developed to identify standard 10 badminton strokes. These include services, forehand chop, backhand chop the goal, the forehand and backhand, forehand drive, backhand push the ball, forehand to pick, pick the ball backhand, and forehand. The experimental results show that the model designed can recognize ten standard strokes in real time. Compared with the traditional HMM, the average recognition rate of the improved HMM is improved by 7.3%. The comprehensive recognition rate of the final strokes can reach up to 95%. Therefore, this model can be used to improve the competitive level of badminton players.

health care sciences & services
Sensor-based Human Activity Recognition Using Graph LSTM and Multi-task Classification Model

Jie Cao,Youquan Wang,Haicheng Tao,Xiang Guo

DOI: https://doi.org/10.1145/3561387

2022-10-31

Abstract:This paper explores human activities recognition from sensor-based multi-dimensional streams. Recently, deep learning-based methods such as LSTM and CNN have achieved important progress in practical application scenarios. However, in most previous deep learning-based methods exist potential challenges such as class imbalance and multi-modal heterogeneity with time and sensor signals. To handle those problems, we propose a
A Multi-Task Deep Learning Approach for Sensor-based Human Activity Recognition and Segmentation

Furong Duan,Tao Zhu,Jinqiang Wang,Liming Chen,Huansheng Ning,Yaping Wan

2023-03-20

Abstract:Sensor-based human activity segmentation and recognition are two important and challenging problems in many real-world applications and they have drawn increasing attention from the deep learning community in recent years. Most of the existing deep learning works were designed based on pre-segmented sensor streams and they have treated activity segmentation and recognition as two separate tasks. In practice, performing data stream segmentation is very challenging. We believe that both activity segmentation and recognition may convey unique information which can complement each other to improve the performance of the two tasks. In this paper, we firstly proposes a new multitask deep neural network to solve the two tasks simultaneously. The proposed neural network adopts selective convolution and features multiscale windows to segment activities of long or short time durations. First, multiple windows of different scales are generated to center on each unit of the feature sequence. Then, the model is trained to predict, for each window, the activity class and the offset to the true activity boundaries. Finally, overlapping windows are filtered out by non-maximum suppression, and adjacent windows of the same activity are concatenated to complete the segmentation task. Extensive experiments were conducted on eight popular benchmarking datasets, and the results show that our proposed method outperforms the state-of-the-art methods both for activity recognition and segmentation.

Computer Vision and Pattern Recognition
A hybrid deep approach to recognizing student activity and monitoring health physique based on accelerometer data from smartphones

Lei Xiao,Kangrong Luo,Juntong Liu,Andia Foroughi

DOI: https://doi.org/10.1038/s41598-024-63934-8

IF: 4.6

2024-06-20

Scientific Reports

Abstract:Smartphone sensors have gained considerable traction in Human Activity Recognition (HAR), drawing attention for their diverse applications. Accelerometer data monitoring holds promise in understanding students' physical activities, fostering healthier lifestyles. This technology tracks exercise routines, sedentary behavior, and overall fitness levels, potentially encouraging better habits, preempting health issues, and bolstering students' well-being. Traditionally, HAR involved analyzing signals linked to physical activities using handcrafted features. However, recent years have witnessed the integration of deep learning into HAR tasks, leveraging digital physiological signals from smartwatches and learning features automatically from raw sensory data. The Long Short-Term Memory (LSTM) network stands out as a potent algorithm for analyzing physiological signals, promising improved accuracy and scalability in automated signal analysis. In this article, we propose a feature analysis framework for recognizing student activity and monitoring health based on smartphone accelerometer data through an edge computing platform. Our objective is to boost HAR performance by accounting for the dynamic nature of human behavior. Nonetheless, the current LSTM network's presetting of hidden units and initial learning rate relies on prior knowledge, potentially leading to suboptimal states. To counter this, we employ Bidirectional LSTM (BiLSTM), enhancing sequence processing models. Furthermore, Bayesian optimization aids in fine-tuning the BiLSTM model architecture. Through fivefold cross-validation on training and testing datasets, our model showcases a classification accuracy of 97.5% on the tested dataset. Moreover, edge computing offers real-time processing, reduced latency, enhanced privacy, bandwidth efficiency, offline capabilities, energy efficiency, personalization, and scalability. Extensive experimental results validate that our proposed approach surpasses state-of-the-art methodologies in recognizing human activities and monitoring health based on smartphone accelerometer data.

multidisciplinary sciences
A Framework of Combining Short-Term Spatial/Frequency Feature Extraction and Long-Term IndRNN for Activity Recognition

Beidi Zhao,Shuai Li,Yanbo Gao,Chuankun Li,Wanqing Li

DOI: https://doi.org/10.3390/s20236984

2020-12-07

Abstract:Smartphone-sensors-based human activity recognition is attracting increasing interest due to the popularization of smartphones. It is a difficult long-range temporal recognition problem, especially with large intraclass distances such as carrying smartphones at different locations and small interclass distances such as taking a train or subway. To address this problem, we propose a new framework of combining short-term spatial/frequency feature extraction and a long-term independently recurrent neural network (IndRNN) for activity recognition. Considering the periodic characteristics of the sensor data, short-term temporal features are first extracted in the spatial and frequency domains. Then, the IndRNN, which can capture long-term patterns, is used to further obtain the long-term features for classification. Given the large differences when the smartphone is carried at different locations, a group-based location recognition is first developed to pinpoint the location of the smartphone. The Sussex-Huawei Locomotion (SHL) dataset from the SHL Challenge is used for evaluation. An earlier version of the proposed method won the second place award in the SHL Challenge 2020 (first place if not considering the multiple models fusion approach). The proposed method is further improved in this paper and achieves 80.72% accuracy, better than the existing methods using a single model.

Endosomal vesicles as vehicles for viral genomes.

An Action Recognition Technology for Badminton Players Using Deep Learning

Automatic Badminton Action Recognition Using CNN with Adaptive Feature Extraction on Sensor Data.

Hierarchical Multi-Classification for Sensor-based Badminton Activity Recognition

Attention-based LSTM Network for Wearable Human Activity Recognition

Research on badminton take-off recognition method based on improved deep learning

Deep ConvLSTM With Self-Attention for Human Activity Decoding Using Wearable Sensors

Deep Learning for Sensor-based Activity Recognition: A Survey

Deep Spatial/temporal-level feature engineering for Tennis-based action recognition

Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition

WiFi Sensing for Drastic Activity Recognition with CNN-BiLSTM Architecture.

Vision Based Automated Badminton Action Recognition Using the New Local Convolutional Neural Network Extractor

A Novel Deep Multifeature Extraction Framework Based on Attention Mechanism Using Wearable Sensor Data for Human Activity Recognition

Badminton video action recognition based on time network

Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities

Deep Residual Bidir-LSTM for Human Activity Recognition Using Wearable Sensors

Recognition of Badminton Shot Action Based on the Improved Hidden Markov Model

Sensor-based Human Activity Recognition Using Graph LSTM and Multi-task Classification Model

A Multi-Task Deep Learning Approach for Sensor-based Human Activity Recognition and Segmentation

A hybrid deep approach to recognizing student activity and monitoring health physique based on accelerometer data from smartphones

A Framework of Combining Short-Term Spatial/Frequency Feature Extraction and Long-Term IndRNN for Activity Recognition