Abstract:The proliferation of Internet-of-Things (IoT) technologies in modern smart society enables massive data exchange for offering intelligent services. It becomes essential to ensure secure communications while exchanging highly sensitive IoT data efficiently, which leads to high demands for lightweight models or algorithms with limited computation capability provided by individual IoT devices. In this study, a graph representation learning model, which seamlessly incorporates graph neural network (GNN) and knowledge distillation (KD) techniques, named reconstructed graph with global-local distillation (RG-GLD), is designed to realize the lightweight anomaly detection across IoT communication networks. In particular, a new graph network reconstruction strategy, which treats data communications as nodes in a directed graph while edges are then connected according to two specifically defined rules, is devised and applied to facilitate the graph representation learning in secure and efficient IoT communications. Both the structural and traffic features are then extracted from the graph data and flow data respectively, based on the graph attention network (GAT) and multilayer perceptron (MLP) techniques. These can benefit the GNN-based KD process in accordance with the more effective feature fusion and representation, considering both structural and data levels across the dynamic IoT networks. Furthermore, a lightweight local subgraph preservation mechanism improved by the graph attention mechanism and downsampling scheme to better utilize the topological information, and a so-called global information alignment defined based on the self-attention mechanism to effectively preserve the global information, are developed and incorporated in a refined graph attention based KD scheme. Compared with four different baseline methods, experiments and evaluations conducted based on two public datasets demonstrate the usefulness and effectiveness of our proposed model in improving the efficiency of knowledge transfer with higher classification accuracy but lower computational load, which can be deployed for lightweight anomaly detection in sustainable IoT computing environments.

An Efficient and Lightweight Approach for Intrusion Detection Based on Knowledge Distillation

A Lightweight Approach for Network Intrusion Detection based on Self-Knowledge Distillation

A Lightweight Approach for Network Intrusion Detection in Industrial Cyber-Physical Systems Based on Knowledge Distillation and Deep Metric Learning

A Dynamic Intrusion Detection System Capable of Detecting Unknown Attacks

Research on Knowledge Distillation Algorithm of Object Detection

A Novel Intrusion Detection Method Based on Lightweight Neural Network for Internet of Things

A Mixed Intrusion Detection System Utilizing K-means and Extreme Gradient Boosting

A Deep Learning Model for Network Intrusion Detection with Imbalanced Data

A Lightweight Pipeline Edge Detection Model Based on Heterogeneous Knowledge Distillation

An Efficient Knowledge Distillation-Based Detection Method for Infrared Small Targets

DualNet: Locate Then Detect Effective Payload with Deep Attention Network

Learning Lightweight Pedestrian Detector with Hierarchical Knowledge Distillation

Adaptive Knowledge Distillation for Lightweight Remote Sensing Object Detectors Optimizing

An Enhanced Intrusion Detection System for IoT Networks Based on Deep Learning and Knowledge Graph

Feature-Based Knowledge Distillation for Infrared Small Target Detection

Learn-IDS: Bridging Gaps between Datasets and Learning-Based Network Intrusion Detection

Effective Intrusion Detection in Heterogeneous Internet-of-Things Networks via Ensemble Knowledge Distillation-based Federated Learning

An efficient intrusion detection model based on convolutional spiking neural network

A Network Intrusion Detection Method for Various Information Systems Based on Federated and Deep Learning

Reconstructed Graph Neural Network With Knowledge Distillation for Lightweight Anomaly Detection

i-2NIDS Novel Intelligent Intrusion Detection Approach for a Strong Network Security