Effects of salinity on vitamin B6 deficiency in rainbow trout (Salmo gairdneri Richardson).

K. Jürss,R. Bastrop,T. Vökler

DOI: https://doi.org/10.1016/0305-0491(88)90350-1

Abstract:

What problem does this paper attempt to address?

Abnormal Network Traffic Detection Algorithm Based on Improved Convolutional Neural Network

Lu Chen,Tao Zhang,Yuanyuan Ma,Mu Chen

DOI: https://doi.org/10.1109/iist62526.2024.00098

2024-01-01

Abstract:With the increasing complexity, automation, and intelligence of network attacks, new types of attacks are constantly emerging in the network, posing great challenges to network attack detection and timely response based on prior rules. In order to more effectively and accurately identify abnormal traffic, a network abnormal traffic detection algorithm based on improved convolutional neural networks is proposed. The algorithm first inputs the key features of traffic anomaly monitoring, converts them into color images through visualization technology, extracts higher dimensional features, and then uses neural structure search technology to find a lightweight convolutional network structure with high accuracy and less time consumption. The optimal model is used to output the type of traffic anomaly. The results indicate that the algorithm has a higher accuracy and the shortest classification time for a single image.
Abnormal behavior recognition using 3D-CNN combined with LSTM

Yepeng Guan,Wei Hu,Xunyin Hu

DOI: https://doi.org/10.1007/s11042-021-10667-9

IF: 2.577

2021-02-19

Multimedia Tools and Applications

Abstract:The research of abnormal behavior recognition is critical to personal and property security. In this paper, a 3D-CNN and Long Short-Term Memory (LSTM) based abnormal behavior recognition method has been proposed. The feature image composed of optical flow (OF) and motion history image (MHI) takes place of RGB image as the input of 3D-CNN. Because of the illumination changes and background jitter in complex scenes, a structural similarity background modeling method has been developed to suppress illumination variations. It is applied to updated dynamically both optical flow and motion history image. A new sample expansion method is developed to deal with the problem of abnormal behavior class imbalance. The OF and MHI feature image clips are randomly cropped firstly. Then clustering method is applied and cluster centers are collected to get new samples in quantity. LSTM with spatial temporal attention is developed to extract long-time spatial-temporal features for abnormal behavior recognition. Compared with state-of-the-art methods, our proposed method has excellent performance in abnormal behavior recognition on some challenging datasets.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Deep Learning Based Abnormal Behavior Detection for Elderly Healthcare Using Consumer Network Cameras

Yinlong Zhang,Wei Liang,Xudong Yuan,Sichao Zhang,Geng Yang,Ziming Zeng

DOI: https://doi.org/10.1109/tce.2023.3309852

2023-01-01

IEEE Transactions on Consumer Electronics

Abstract:Abnormal behavior has become the leading cause of injuries among the elderly in the modern society. Elderly anomaly is a widespread concern in both academic and industrial fields. Detection of abnormal behaviors using deep learning techniques has been pervasively investigated due to the flourishing of powerful edge computing and the decreasing costs of consumer electronics, such as commercial vision sensors. This paper intentionally designs an innovative architecture to detect the elderly typical abnormal behaviors: falls and tumbles, aggression and wandering, using the consumer network cameras, which are configured in the residential areas, healthcare centers, to name a few. Different from the conventional abnormal behavior detection methods, which suffer the issues of improper model generalization and lack of the spatial and temporal coherence, we design a deep learning model that robustly extracts the skeleton joints, detects and classifies the abnormal behaviors while considering the spatial and temporal context. It should be noted that the images are captured with the network cameras rigidly fixed at the typical elderly activity spots. The group of captured images will be fed to the local server, equipped with GPUs, for online monitoring and alarming. Our method is extensively evaluated on the elderly anomaly detection platform. It achieves the competitive performance with mAP greater than 85%.
Abnormal behavior detection algorithm based on multi-branch convolutional fusion neural network

Zheng Xu,Yuanyao Lu

DOI: https://doi.org/10.1007/s11042-023-14501-2

IF: 2.577

2023-02-12

Multimedia Tools and Applications

Abstract:The recognition of abnormal behavior in surveillance video is the focus of current research, which has high research value and broad application possibilities. Its main applications are in the fields of intelligent surveillance, intelligent security, and smart cities, and it is of great significance to study the recognition of abnormal behaviors. Because of the complexity of human movement and the variability of the external environment, the recognition and detection of abnormal behaviors have some challenges. The recognition and detection of abnormal human behaviors in surveillance video still needs further research and development. This paper uses the multi-branch convolutional neural network to extract the spatial features of video frames for the first time, and as an encoder to pass the condensed features to the Gated Recurrent Unit (GRU), which extracts Temporal features from multiple video frames. And then the Gated Recurrent Unit output the result as the decoder. We did a series of comparative experiments on UCF-Crime dataset. And finally, we achieved an accuracy of 86.78% in the test set. The experimental results show that our multi-branch convolutional fusion neural network is better than previous surveillance video abnormal behavior recognition algorithms. At the same time, in order to verify the generalization performance and efficiency of the algorithm, we also conducted an experimental validation on the UCF-101 dataset in this paper, and the results show that the algorithm in this paper can also show a high accuracy rate on the UCF-101 dataset, and the speed of the algorithm is almost close to that of the C3D method with improved accuracy rate, making it possible to develop simple recognition applications based on the algorithm studied in this paper subsequently.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Recognition of abnormal human behavior in dual-channel convolutional 3D construction site based on deep learning

Lingzi Jiang,Beiji Zou,Shu Liu,Wenjun Yang,Min Wang,Enquan Huang

DOI: https://doi.org/10.1007/s00521-022-07881-3

2022-10-15

Neural Computing and Applications

Abstract:Human behavior recognition has widespread applications in real life, especially in the infrastructure field. Modern engineering projects involve many construction units and engineering documents, many personnel, large scales, and large amounts of information. The traditional engineering management information system also has some defects. To strictly control the construction order and work efficiency of the infrastructure site, deal with emergencies in a timely manner, and reduce the burden on staff, we design a human abnormal behavior recognition system based on deep learning and dual-channel C3D. Our main aim is to conduct an in-depth study of human behavior recognition and apply it to the safety management of existing residential construction sites. In the methods section, we first introduce the convolutional neural network in deep learning, explain the principle of neural networks and two-channel convolution, and use the C3D model as the recognition model of the algorithm. The improved model combines the convolutional neural network to obtain our improved model. In the experimental section, the working process, experimental environment, and objects of our designed human abnormal behavior recognition system are classified. The analysis comprehensively analyzes the influence of system identification, the recall rate and accuracy rate of different algorithms, the misrecognition rate of different angles, dual-channel fusion, and the influence of duration on the prediction results. We chose three different angles for behavior recognition, and the results show that from a specific angle, our anomaly recognition rate is 98.01%; from a lateral point of view, our anomaly recognition rate is 97.27%; and from a top-down point of view, the recognition rate is 95.68%. Under three different video surveillance angles, the anomaly recognition rate of our proposed dual-channel 3D convolution algorithm reaches over 95%.

computer science, artificial intelligence
Anomaly Recognition from surveillance videos using 3D Convolutional Neural Networks

R. Maqsood,UI. Bajwa,G. Saleem,Rana H. Raza,MW. Anwar

DOI: https://doi.org/10.48550/arXiv.2101.01073

2021-01-04

Computer Vision and Pattern Recognition

Abstract:Anomalous activity recognition deals with identifying the patterns and events that vary from the normal stream. In a surveillance paradigm, these events range from abuse to fighting and road accidents to snatching, etc. Due to the sparse occurrence of anomalous events, anomalous activity recognition from surveillance videos is a challenging research task. The approaches reported can be generally categorized as handcrafted and deep learning-based. Most of the reported studies address binary classification i.e. anomaly detection from surveillance videos. But these reported approaches did not address other anomalous events e.g. abuse, fight, road accidents, shooting, stealing, vandalism, and robbery, etc. from surveillance videos. Therefore, this paper aims to provide an effective framework for the recognition of different real-world anomalies from videos. This study provides a simple, yet effective approach for learning spatiotemporal features using deep 3-dimensional convolutional networks (3D ConvNets) trained on the University of Central Florida (UCF) Crime video dataset. Firstly, the frame-level labels of the UCF Crime dataset are provided, and then to extract anomalous spatiotemporal features more efficiently a fine-tuned 3D ConvNets is proposed. Findings of the proposed study are twofold 1)There exist specific, detectable, and quantifiable features in UCF Crime video feed that associate with each other 2) Multiclass learning can improve generalizing competencies of the 3D ConvNets by effectively learning frame-level information of dataset and can be leveraged in terms of better results by applying spatial augmentation.
DC3D: A Video Action Recognition Network Based on Dense Connection

Xiaofang Mu,Zhenyu Liu,Jiaji Liu,Hao Li,Yue Li,Yikun Li

DOI: https://doi.org/10.1109/CBD58033.2022.00032

2022-01-01

Abstract:Efficiently extracting the temporal and spatial information of motion in the video, and how to obtain the spatiotemporal features with high degree of differentiation, is the key issue to improve the accuracy of action recognition classification. In this paper, a dense 3D convolutional block is designed as the basic unit to construct a dense convolutional 3D network, the spatiotemporal features existing in the video are extracted at the same time, and the transmission and reuse of the features in the network are strengthened, effectively fuse the shallow and deep spatiotemporal features of the network. At the same time, in order to make the features extracted by the network sufficiently discriminative, this paper proposes a joint loss function based on the Fisher discriminant regularization term, it can make the trained network have the ability to increase the inter-class dispersion and reduce the intra-class dispersion of the classified samples, and improve the classification accuracy. Experiments on the UCF-101 human actions classes dataset show that the network recognition accuracy rate proposed in this paper reaches 92.4%, which is higher than 85.2% of the C3D network, which proves the effectiveness of the method proposed in this paper.
The Abnormal Detection of Electroencephalogram With Three-Dimensional Deep Convolutional Neural Networks

Allam Maalla,Huang Shuai,Lu Long,Hongsheng Liu,Liu Dong,Yun-Mei Du,Hui-Ying Liang

DOI: https://doi.org/10.1109/ACCESS.2020.2984677

IF: 3.9

IEEE Access

Abstract:In this work, we present and evaluate a three dimensional Convolutional Neural Network algorithm to accurately detect EEG abnormalities from multi-channel EEG signals. This research synthesizes several heterogeneous datasets, constructs a dataset 10 times larger than other datasets of its kind, uses all channel EEG signals as input, and preprocesses them into data structures that can reflect EEG spatio-temporal character, constructs and trains a 28-layer deep residual network, automatically extracts high-level features, and recognizes EEG anomalies. We collect and reorganize several heterogeneous data sets, and convert two-dimensional signal segments to three-dimensional frames after preprocessing. Thus we build a dataset of 14049 annotated samples with shape 512*11*11*1, of which 8866 are abnormal. On this dataset, we train a 28-layer convolutional network with residual blocks which classify EEG segments as normal or abnormal. Prediction on independent test sets using this trained model achieved an accuracy of 96.67%. The AUC is 99.93% and the RMSE is 0.0032. We compared the results of several methods and found that 3D frame data structure and deeper CNN model is better. The performance of our model also outperforms other related researches on EEG classification.

Computer Science,Medicine
Deep convolutional neural network based real-time abnormal behavior detection in social networks

Dinesh Mavaluru,Azath Mubarakali,Bayapa Reddy Narapureddy,Jayabrabu Ramakrishnan,Rajan John,Nadana Ravishankar,P. Karthika

DOI: https://doi.org/10.1016/j.compeleceng.2023.108987

IF: 4.152

2023-10-21

Computers & Electrical Engineering

Abstract:In this study, we introduce a novel real-time approach for detecting abnormal behaviors in online social networks, leveraging both dynamic user activities and their associated profiles through Convolutional Neural Networks (CNN). Social networks, which serve as hubs for communication, discussion, and multimedia sharing, amass a plethora of user data. This vast reservoir of information, while invaluable for genuine interactions, is susceptible to exploitation by malicious entities. Despite numerous previously proposed detection methods, the challenge of ensuring security persists. Our distinctive framework, rigorously tested using an extensive dataset sourced from the web and executed via the CNN toolbox in MATLAB, consistently demonstrates an impressive 99.9% classification accuracy. This achievement not only underscores the method's effectiveness but also marks a significant stride towards proactively identifying and neutralizing potential threats in digital social platforms.

engineering, electrical & electronic,computer science, interdisciplinary applications, hardware & architecture
Abnormal behavior capture of video dynamic target based on 3D convolutional neural network

Fei Chen

DOI: https://doi.org/10.3389/fnbot.2022.1017748

IF: 3.493

2022-10-26

Frontiers in Neurorobotics

Abstract:The use of computers to understand video content can accurately and quickly label various videos. Behavior recognition technology can help users filter the video by screening the content. However, this calculation mode, which is only sensitive to the features in a pixel neighborhood, cannot effectively extract cross-frame long-range video features. In addition, the common long-range dependency capture methods are based on pixel pairs, which contain less semantic information and cannot accurately model dependencies. Based on this, this paper generates semantic units with rich semantic information in the form of neighborhood pixel aggregation and proposes a multi-semantic long-range dependency capture algorithm to solve this problem, which makes the established dependency relationship more accurate. At the same time, this paper proposes an early dependency transfer technology to speed up the reasoning speed of the multi-semantic long-range dependency capture algorithm. By embedding the proposed algorithm into the original convolutional neural network, and conducting sufficient performance tests and evaluations on different data sets, it is shown that the proposed algorithm outperforms other current algorithms in terms of recognition accuracy and achieves the optimal recognition effect, which can effectively enhance the long-range dependency capture ability and temporal modeling ability of the convolutional network, and improve the quality of video feature representation.

robotics,computer science, artificial intelligence,neurosciences
Research into the Applications of a Multi-Scale Feature Fusion Model in the Recognition of Abnormal Human Behavior

Congcong Li,Yifan Li,Bin Wang,Yuting Zhang

DOI: https://doi.org/10.3390/s24155064

2024-08-05

Abstract:Due to the increasing severity of aging populations in modern society, the accurate and timely identification of, and responses to, sudden abnormal behaviors of the elderly have become an urgent and important issue. In the current research on computer vision-based abnormal behavior recognition, most algorithms have shown poor generalization and recognition abilities in practical applications, as well as issues with recognizing single actions. To address these problems, an MSCS-DenseNet-LSTM model based on a multi-scale attention mechanism is proposed. This model integrates the MSCS (Multi-Scale Convolutional Structure) module into the initial convolutional layer of the DenseNet model to form a multi-scale convolution structure. It introduces the improved Inception X module into the Dense Block to form an Inception Dense structure, and gradually performs feature fusion through each Dense Block module. The CBAM attention mechanism module is added to the dual-layer LSTM to enhance the model's generalization ability while ensuring the accurate recognition of abnormal actions. Furthermore, to address the issue of single-action abnormal behavior datasets, the RGB image dataset RIDS (RGB image dataset) and the contour image dataset CIDS (contour image dataset) containing various abnormal behaviors were constructed. The experimental results validate that the proposed MSCS-DenseNet-LSTM model achieved an accuracy, sensitivity, and specificity of 98.80%, 98.75%, and 98.82% on the two datasets, and 98.30%, 98.28%, and 98.38%, respectively.
3D ResNet with Ranking Loss Function for Abnormal Activity Detection in Videos

Shikha Dubey,Abhijeet Boragule,Moongu Jeon

DOI: https://doi.org/10.48550/arXiv.2002.01132

2020-02-04

Computer Vision and Pattern Recognition

Abstract:Abnormal activity detection is one of the most challenging tasks in the field of computer vision. This study is motivated by the recent state-of-art work of abnormal activity detection, which utilizes both abnormal and normal videos in learning abnormalities with the help of multiple instance learning by providing the data with video-level information. In the absence of temporal-annotations, such a model is prone to give a false alarm while detecting the abnormalities. For this reason, in this paper, we focus on the task of minimizing the false alarm rate while performing an abnormal activity detection task. The mitigation of these false alarms and recent advancement of 3D deep neural network in video action recognition task collectively give us motivation to exploit the 3D ResNet in our proposed method, which helps to extract spatial-temporal features from the videos. Afterwards, using these features and deep multiple instance learning along with the proposed ranking loss, our model learns to predict the abnormality score at the video segment level. Therefore, our proposed method 3D deep Multiple Instance Learning with ResNet (MILR) along with the new proposed ranking loss function achieves the best performance on the UCF-Crime benchmark dataset, as compared to other state-of-art methods. The effectiveness of our proposed method is demonstrated on the UCF-Crime dataset.
Skeleton Based Abnormal Behavior Recognition Using Spatio-Temporal Convolution and Attention-Based LSTM

Kai Zhou,Tingting Wu,Chunyu Wang,Junfeng Wang,Chao Li

DOI: https://doi.org/10.1016/j.procs.2020.06.110

2020-01-01

Procedia Computer Science

Abstract:Behavior recognition is a well-known computer version technology, it has been used in many applications such as video surveillance, robotics, human-computer interaction and sports video, etc. However, most of existing works ignored the depth information so that they resulted in over-fitting and the inferior performance. Consequently, a novel framework for behavior recognition is proposed which is based on spatio-temporal convolution and attention-based LSTM (ST-CNN & ATT-LSTM). In this framework, deep spatial information is merged into each segment, meanwhile we focus on the method of key information extraction, which is essential for improving behavior recognition performance. Finally, the proposed framework is evaluated with real world surveillance video data, and the results indicate that our framework is superior to existing methods.
Abnormal Behavior Recognition Based on Skeleton Key Points

Haizhuang Liu,Huili Gong,Xiangqian Ding

DOI: https://doi.org/10.1109/ITOEC57671.2023.10291587

2023-09-15

Abstract:Being aimed at the problem that most of the graph convolutions do not make full use of the context information of the skeleton data, resulting in the low accuracy of similar abnormal line recognition, this paper proposes an improved adaptive graph convolution algorithm for abnormal behavior recognition, which introduces multi-head attention on the basis of adaptive graph convolution. In addition, in order to extract multi-scale features in the network more effectively, multi-scale features in time series are extracted with the help of hole convolution with different expansion coefficients, and multi-scale features are adaptively fused through the attention mechanism. Experimental results show that the multi-head attention adaptive graph convolutional network achieves 76.0% accuracy in abnormal behavior recognition.

Computer Science
Anomaly Detection Based on a 3D Convolutional Neural Network Combining Convolutional Block Attention Module Using Merged Frames

In-Chang Hwang,Hyun-Soo Kang

DOI: https://doi.org/10.3390/s23239616

IF: 3.9

2023-12-05

Sensors

Abstract:With the recent rise in violent crime, the real-time situation analysis capabilities of the prevalent closed-circuit television have been employed for the deterrence and resolution of criminal activities. Anomaly detection can identify abnormal instances such as violence within the patterns of a specified dataset; however, it faces challenges in that the dataset for abnormal situations is smaller than that for normal situations. Herein, using datasets such as UBI-Fights, RWF-2000, and UCSD Ped1 and Ped2, anomaly detection was approached as a binary classification problem. Frames extracted from each video with annotation were reconstructed into a limited number of images of 3×3, 4×3, 4×4, 5×3 sizes using the method proposed in this paper, forming an input data structure similar to a light field and patch of vision transformer. The model was constructed by applying a convolutional block attention module that included channel and spatial attention modules to a residual neural network with depths of 10, 18, 34, and 50 in the form of a three-dimensional convolution. The proposed model performed better than existing models in detecting abnormal behavior such as violent acts in videos. For instance, with the undersampled UBI-Fights dataset, our network achieved an accuracy of 0.9933, a loss value of 0.0010, an area under the curve of 0.9973, and an equal error rate of 0.0027. These results may contribute significantly to solve real-world issues such as the detection of violent behavior in artificial intelligence systems using computer vision and real-time video monitoring.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
A study on attention-based LSTM for abnormal behavior recognition with variable pooling

Kai Zhou,Bei Hui,Junfeng Wang,Chunyu Wang,Tingting Wu

DOI: https://doi.org/10.1016/j.imavis.2021.104120

IF: 3.86

2021-04-01

Image and Vision Computing

Abstract:<p>Behavior recognition is a well-known computer vision mobile technology. It has been used in many applications such as video surveillance, motion detection on devices, human-computer interaction and sports video, etc. However, most of the existing works ignored the depth and spatio-temporal information so that they resulted in over-fitting and inferior performance. Consequently, a novel framework for behavior recognition is proposed in this paper. In this framework, we propose a target depth estimation algorithm to calculate the 3D spatial position information of the target, and take this information as the input of the behavior recognition model. Simultaneously, in order to obtain more Spatio-temporal information and better handle long-term video, combining with the idea of attention mechanism, we propose a skeleton behavior recognition model which is based on spatio-temporal convolution and attention-based LSTM (ST-CNN & ATT-LSTM). The deep spatial information is merged into each segment, and the model focuses on the key information extraction, which is essential for improving behavior recognition performance. Meanwhile, we use a feature compression method based on variable pooling to solve the problem of inconsistent input sizes caused by multi-person behavior recognition, so that the network can flexibly recognize multi-person skeleton sequences. Finally, the proposed framework is evaluated with real-world surveillance video data, and the results indicate that our framework is superior to existing methods.</p>

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, software engineering,optics
An effective framework of human abnormal behaviour recognition and tracking using multiscale dilated assisted residual attention network

Queen Mary Vidya M,S. Selvakumar

DOI: https://doi.org/10.1016/j.eswa.2024.123264

IF: 8.5

2024-01-30

Expert Systems with Applications

Abstract:The prevention of certain unwanted crime events and eliminating them even before their execution can be done by automatic identification of abnormal behavior in humans. Hence automatic prediction of abnormal human behavior is a difficult task to perform. Some of the automated model has been implemented and provided the most promising results. The manual intervention is being the greatest approach in earlier time, yet it brings with numerous errors, consumes more time and more cost effective. Henceforth, the automated model is suggested for identifying the activities. As the scholar focus on machine and deep learning, this classifier may extract the hand-crafted features. But it fails to yield the appropriate solution for finding the activities. Since it belongs to the video frames, the object detection is highly Ineffective feature vector and inadequate scale measures of the learning model paves the way for performance degradation . This issue can be resolved by including an attention mechanism in the deep learning model for both monitoring and classification purposes. The recommended Human Abnormal Behavior Recognition and Tracking (HABRT) model performs the following operations, such as the collection of video, categorizing the behavior in the video as normal or abnormal, monitoring, extraction of the object, and classification of the abnormality. The input video with such frames is initially gathered from publically available databases. By using these frames, the abnormal behavior classification is done by Multiscale Dilated assisted Residual Attention Network (MD-RAN), For further enhancement, the hyper-parameters in the MD-RAN are optimally selected by novel Modified Random Parameter-based Chimp Optimization Algorithm (MRP-ChOA). Once the abnormal frames are obtained, the activity tracking is achieved by Adaptively Modified You Only Look Once (YOLO) V3 (AM-YOLO V3). This model encompasses with multiple layers, so that utilized number of layers are determined optimally using MRP-ChOA. Consequently, the objects are extracted from the abnormal frames with the help of AM-YOLO V3. Finally, the abnormalities are classified by using the same MD-RAN. At last, the performance is analyzed and validated with diverse parameters, which are then compared with other algorithms. While implementing the dataset 1, the accuracy value attains maximum in contrast with 3.14% of DTCN, 2.308% of CNN-RNN and 13.7% of ResAttenConvLSTM, correspondingly. Thus, the findings reveal that it has the potential to deliver extensive results for abnormal recognition and tracking.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
Abnormal Behavior Detection in Video Surveillance Using Inception-v3 Transfer Learning Approaches

DOI: https://doi.org/10.33103/uot.ijccce.23.2.16

2023-06-29

Abstract:The use of video surveillance systems has increased due to security concerns and their relatively low cost. Researchers are working to create intelligent Closed Circuit Television (CCTV) cameras that can automatically analyze behavior in real-time to detect anomalous behaviors and prevent dangerous accidents. Deep Learning (DL) approaches, particularly Convolutional Neural Networks (CNNs), have shown outstanding results in video analysis and anomaly detection. This research paper focused on using Inception-v3 transfer learning approaches to improve the accuracy and efficiency of abnormal behavior detection in video surveillance. The Inception-v3 network is used to classify keyframes of a video as normal or abnormal behaviors by utilizing both pre-training and fine-tuning transfer learning approaches to extract features from the input data and develop a new classifier. The UCF-Crime dataset is used to train and evaluate the proposed models. The performance of both models was evaluated using accuracy, recall, precision, and F1 score. The fine-tuned model achieved 88.0%, 89.24%, 85.83%, and 87.50% for these measures, respectively. In contrast, the pre-trained model obtained 86.2%, 86.43%, 84.62%, and 85.52%, respectively. These results demonstrate that transfer learning using Inception-v3 architecture can effectively classify normal and abnormal behaviors in videos, and fine-tuning the weights of the layers can further improve the model's performance. Index Terms— Abnormal behavior detection, Video surveillance, Deep learning, Transfer learning, InceptionV3.
Research on Human Abnormal Behavior Detection Based on Deep Learning

Weihu Zhang,Chang Liu

DOI: https://doi.org/10.1109/ICVRIS51417.2020.00237

2020-07-01

Abstract:In order to make full use of the effective information in the video and improve the recognition rate of abnormal human behavior in complex scenes, we use a mixed Gaussian model to detect clear foreground moving target contours and perform Gaussian filtering on them to remove the effects of noise in the scene . By calculating the center point of the foreground pixel, and drawing a bounding box based on this, the key area of human motion in the video is extracted. Then we use the Farneback dense optical flow algorithm to obtain spatiotemporal information. By combining CNN and LSTM, a CNN-LSTM hybrid two-stream network model based on the Dropout mechanism is established., input the original image and the superimposed optical flow image of the key area of the video sequence motion to learn the dynamic and static features and timing information in the spatiotemporal information. The weighted fusion method is used to perform weighted calculation on the Softmax output of the two-way network to obtain results. The tresults show that the accuracy of the behavior classification reached 91.2%, and the recognition rate of abnormal behavior was 92%. Compared with the three models in the article, the improvement was 6% 8.3%, 3.4%.

Computer Science
Vehicle Behavior Recognition using Multi-Stream 3D Convolutional Neural Network

Haochuan Hou,Yaochen Li,Chi Zhang,Hao Liao,Ying Zhang,Yuehu Liu

DOI: https://doi.org/10.1109/YAC53711.2021.9486615

2021-01-01

Abstract:Vehicle behavior recognition take an essential part in the community of intelligent driving assistance systems. Recent approaches with 3D convolutional neural network (3DCNN) achieve reasonable recognition performance in laboratory settings. However, due to the complexity of network, the model is large and the reasoning is slow, so it is difficult to be applied in practice. In order to better handle the trade-off between size, precision and reasoning speed,a lightweight multi-stream 3DCNN model is proposed in this paper, which achieves fast reasoning speed and small model size while maintaining high precision. The 3DCNN model consists of three parts. Firstly, the module of SELayer-3DCNN is developed to extract appearance information from the RGB image sequence. The motion and edge information are also extracted from the optical flow sequence and edge image sequence, respectively. The edge information is applied to enhance the optical flow features. Secondly, a novel channel attention fusion strategy is proposed to improve the feature fusion and network ability. Finally, a 3D-RFB module is proposed to enhance the receptive field of the convolutional kernel. Furthermore, this paper presents a dataset of vehicle behavior. The advantages of the proposed method are verified by ablation experiments and comparative experiments while the real-time characteristics are maintained.

Effects of salinity on vitamin B6 deficiency in rainbow trout (Salmo gairdneri Richardson).

Abnormal Network Traffic Detection Algorithm Based on Improved Convolutional Neural Network

Abnormal behavior recognition using 3D-CNN combined with LSTM

Deep Learning Based Abnormal Behavior Detection for Elderly Healthcare Using Consumer Network Cameras

Abnormal behavior detection algorithm based on multi-branch convolutional fusion neural network

Recognition of abnormal human behavior in dual-channel convolutional 3D construction site based on deep learning

Anomaly Recognition from surveillance videos using 3D Convolutional Neural Networks

DC3D: A Video Action Recognition Network Based on Dense Connection

The Abnormal Detection of Electroencephalogram With Three-Dimensional Deep Convolutional Neural Networks

Deep convolutional neural network based real-time abnormal behavior detection in social networks

Abnormal behavior capture of video dynamic target based on 3D convolutional neural network

Research into the Applications of a Multi-Scale Feature Fusion Model in the Recognition of Abnormal Human Behavior

3D ResNet with Ranking Loss Function for Abnormal Activity Detection in Videos

Skeleton Based Abnormal Behavior Recognition Using Spatio-Temporal Convolution and Attention-Based LSTM

Abnormal Behavior Recognition Based on Skeleton Key Points

Anomaly Detection Based on a 3D Convolutional Neural Network Combining Convolutional Block Attention Module Using Merged Frames

A study on attention-based LSTM for abnormal behavior recognition with variable pooling

An effective framework of human abnormal behaviour recognition and tracking using multiscale dilated assisted residual attention network

Abnormal Behavior Detection in Video Surveillance Using Inception-v3 Transfer Learning Approaches

Research on Human Abnormal Behavior Detection Based on Deep Learning

Vehicle Behavior Recognition using Multi-Stream 3D Convolutional Neural Network