Abstract:The commonly used method for network intrusion is based on pattern matching systems, but these systems do not have high detection accuracy when facing large-scale high-speed network traffic environments. In addition, when facing a wide variety of network attacks, relying solely on a certain network security technology is difficult to ensure network security. Therefore, a distributed network intrusion prevention system based on the Spark framework and dynamic information security theory model was innovatively proposed to improve the detection efficiency of network intrusion and solve these issues. The architecture and functional structure of the network intrusion prevention system were constructed by improving the random forest algorithm and Spark. In addition, the dynamic network intrusion prevention system was designed on the basis of the Policy Protection Detection Response (P2DR) model and the Protection Detection Reaction Recovery (PDRR) model to cope with the diverse network attacks and make up for the lack of dynamic defense based on improved forest algorithm and Spark. The test results showed that the network intrusion prevention system based on the improved random forest algorithm and Spark had a maximum detection time of 13,593 ms, a minimum detection time of 13,318 ms, and an average detection time of 13,468 ms when the data were 6000 pieces. The average success rate of the dynamic network intrusion prevention system based on the dynamic information security theory model was 87.72%, the average detection rate was 71.68%, and the average false alarm rate was 17.23%. The F1 values corresponding to the improved random forest algorithm under 7 different attack types of data were 0.985, 0.983, 0.876, 0.843, 0.797, 0.983, and 0.890, respectively, which were significantly better than the comparison algorithm. It can be seen that the dynamic network intrusion prevention system based on the improved random forest algorithm, Spark, and the dynamic information security theoretical model, has good performance and can effectively detect network intrusions, providing technical support for solving network intrusion problems in reality. The contribution of the research is reflected in the improvement of the detection performance of network intrusion detection systems and the reduction of detection time and false alarm rates.

Design of Intelligent Software Security System Based on Spark Big Data Computing

Design of Computer Network Security Defense System Based on Big Data

Design of a cybersecurity defense system based on big data and artificial intelligence

Design of Safety and Integrated Disaster Prevention System Based on Big Data Technology

The Evolvement of Big Data Systems: from the Perspective of an Information Security Application

Model Design of Big Data Information Security Management Based on the Internet of Things

Building a Highly Available and Intrusion Tolerant Database Security and Protection System (DSPS)

Research on the Application of Computer Big Data Technology in Information Security Management

Computer Network Information Security Monitoring System Based on Big Data Era

Computer Network Information System Security Prevention Methods under the Background of Big Data

Analysis and research of computer information security technology under big data background

A Practical Study of Big Data Technology in Computer Network Information Security Processing

Design and Implementation of Real Time Data Processing System Based on Spark Streaming

Design of distributed network intrusion prevention system based on Spark and P2DR models

Optimization Strategy of Computer Network Security Technology in Big Data Environment

An Artificial Intelligence-based, Big Data-aware, Long-lasting Security Solution for the Internet of Things

A Survey on Spark Ecosystem for Big Data Processing

THE DESIGN AND IMPLEMENTATION OF INFORMATION SECURITY-ORIENTED HIGH DATA STREAM MANAGEMENT SYSTEM

Design and Development of a Big Data Platform for Disease Burden Based on the Spark Engine

Smart city infrastructure protection: real-time threat detection employing online reservoir computing architecture

A Multi-Source Big Data Security System of Power Monitoring Network Based on Adaptive Combined Public Key Algorithm