Dimensionality reduction for images of IoT using machine learning

Ibrahim Ali,Khaled Wassif,Hanaa Bayomi

DOI: https://doi.org/10.1038/s41598-024-57385-4

IF: 4.6

2024-03-28

Scientific Reports

Abstract:Sensors, wearables, mobile devices, and other Internet of Things (IoT) devices are becoming increasingly integrated into all aspects of our lives. They are capable of gathering enormous amounts of data, such as image data, which can then be sent to the cloud for processing. However, this results in an increase in network traffic and latency. To overcome these difficulties, edge computing has been proposed as a paradigm for computing that brings processing closer to the location where data is produced. This paper explores the merging of cloud and edge computing for IoT and investigates approaches using machine learning for dimensionality reduction of images on the edge, employing the autoencoder deep learning-based approach and principal component analysis (PCA). The encoded data is then sent to the cloud server, where it is used directly for any machine learning task without significantly impacting the accuracy of the data processed in the cloud. The proposed approach has been evaluated on an object detection task using a set of 4000 images randomly chosen from three datasets: COCO, human detection, and HDA datasets. Results show that a 77% reduction in data did not have a significant impact on the object detection task's accuracy.

multidisciplinary sciences

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that in the Internet of Things (IoT) environment, a large amount of image data transmission leads to increased network traffic and greater latency. To overcome these problems, the paper proposes a method that combines edge computing and cloud computing. It uses machine learning techniques (especially auto - encoders and principal component analysis PCA) to perform dimension reduction on images on edge devices, and then sends the compressed data to cloud - side servers, in order to reduce network bandwidth usage while trying not to significantly affect the accuracy of machine - learning tasks (such as object detection).

Specifically, the paper addresses this problem through the following four aspects:

1. **Application of edge computing**: By performing calculations near the location where data is generated, the distance for data to be transmitted to the cloud server is reduced, thereby reducing network latency and bandwidth requirements.

2. **Use of deep - learning techniques**: Using the auto - encoder, a deep - learning model, to perform efficient dimension - reduction processing on image data on edge devices. The auto - encoder can learn the internal structure of the input data and compress it into a lower - dimensional space.

3. **Comparative study of principal component analysis (PCA)**: In addition to the auto - encoder, the paper also explores the effect of using PCA for data dimension reduction and compares the results with those of the auto - encoder to evaluate the performance differences of different methods in maintaining data - processing accuracy.

4. **Experimental verification**: The paper designs four experimental scenarios to test the performance of object - detection tasks in four cases: without applying any dimension - reduction techniques, using PCA, using a two - layer auto - encoder, and using a three - layer auto - encoder, respectively, in order to verify the effectiveness of the proposed dimension - reduction method.

In summary, the main objective of this paper is to explore an effective method that can significantly reduce the amount of image - data transmission in the Internet of Things environment without affecting or only slightly affecting the performance of machine - learning tasks, thereby optimizing the efficiency of network - resource utilization.