Abstract:Communication operators are paying more and more attention to the value of data and are demanding more and bigger data technologies. Many companies have started to take advantage of their resources to tap the value of data and develop their own core business. The use of a high-performance, secure, scalable and easy-to-manage big data management system will help companies avoid the tedious system operation and maintenance, especially in the communication business system, and help them focus on their own business development. In this paper, we first investigate existing data management systems and analyze their strengths and weaknesses. In response to the problems of not too light, insufficient timeliness of data migration, and not enough innovation in data analysis, we design a more efficient, convenient and easy-to-use big data management platform. Firstly, the big data management system is designed. According to the process of big data processing, six modules of interface acquisition, program scheduling, data aggregation, platform alerting, marketing analysis and visualization are designed based on the communication big data platform architecture. The management system mainly focuses on data access and data mining analysis, so the main modules of this paper are program scheduling, data aggregation and marketing analysis modules, while other modules are based on the original big data management system of the enterprise with a small amount of improvement. In order to realize the needs of dynamically creating data testing environment and isolating production and experimental environments under the communication application scenario, a mechanism of the big data system for production and the virtualized system for experiments acting together is proposed. Then the corresponding scheduling module architecture process is designed and built, the corresponding scheduling rules and related scheduling information field tables are designed, and the data aggregation storage is improved. The program scheduling module was designed to be more lightweight and easy to use, and the data migration module increased the timeliness of data migration.

Application analysis of data quality verification system based on resource management platform

Design and Implementation of Power Quality Supervisory Information System Based on J2EE Platform

Research and development on data quality assessment management system

Application of Information Resources in Management of Large Instrument Sharing Platform

Examination Data Analysis and Evaluation Platform Based on Cloud Computing

Design and Research of Security Service Platform for Power Terminal Business Monitoring and Data Analysis

DEVELOPMENT AND APPLICATION OF COAL QUALITY DETECTION AND QUALITY FOLLOW-UP MANAGEMENT SOFTWARE SYSTEM

Research on Design and Analysis Techniques for Surface Water Quality Monitoring Information Management

Network Operation and Maintenance System of Meticulous Management Based on Data Analysis

Big data analysis and optimization and platform components

Data quality assessment for on-line monitoring and measuring system of power quality based on big data and data provenance theory

Application of Big Data Processing Technology in the Intelligent Network Management System

Analysis of Data Quality Problems in the Digital Hospital and Relevant Solutions

Design and Implementation of Campus Data Governance Platform Based on Big Data Algorithm

Construction and Design of Resource Management System of Packaging Design Information Big Data Platform

Air quality data analysis and forecasting platform based on big data

The Research of the Quality Supervision and Management Data Platform Design in the Whole Production Process for Rail Used in Railway Transportation

Construction and Empirical Analysis of Information Management System of Engineering Investigation Quality

The Data Platform Of National Special Environment And Disaster Field Observation Stations Based On Grid Environment

Design and application research on data service platform for big data

Application of information communication network security management and control based on big data technology