Abstract:Communication operators are paying more and more attention to the value of data and are demanding more and bigger data technologies. Many companies have started to take advantage of their resources to tap the value of data and develop their own core business. The use of a high-performance, secure, scalable and easy-to-manage big data management system will help companies avoid the tedious system operation and maintenance, especially in the communication business system, and help them focus on their own business development. In this paper, we first investigate existing data management systems and analyze their strengths and weaknesses. In response to the problems of not too light, insufficient timeliness of data migration, and not enough innovation in data analysis, we design a more efficient, convenient and easy-to-use big data management platform. Firstly, the big data management system is designed. According to the process of big data processing, six modules of interface acquisition, program scheduling, data aggregation, platform alerting, marketing analysis and visualization are designed based on the communication big data platform architecture. The management system mainly focuses on data access and data mining analysis, so the main modules of this paper are program scheduling, data aggregation and marketing analysis modules, while other modules are based on the original big data management system of the enterprise with a small amount of improvement. In order to realize the needs of dynamically creating data testing environment and isolating production and experimental environments under the communication application scenario, a mechanism of the big data system for production and the virtualized system for experiments acting together is proposed. Then the corresponding scheduling module architecture process is designed and built, the corresponding scheduling rules and related scheduling information field tables are designed, and the data aggregation storage is improved. The program scheduling module was designed to be more lightweight and easy to use, and the data migration module increased the timeliness of data migration.

A Message Driven Framework for Big Data Application System

A Semantic-Driven Framework for Enterprise Integration

A Modularized StreamMedia System Development Framework

A Distributed Data Mining System Framework for Mobile Internet Access Log Based on Hadoop.

biggy: An Implementation of Unified Framework for Big Data Management System

Design of a Message Management System for Power Grid Emergency-response

A Coding-free Software Framework of Developing Web Data Management Systems

Embedded software framework based on Module-MSG

Study of Component-Ware ＆ Application Software Framework Based Decision Support System Development

MDDRSPF: A Model Driven Distributed Real-Time Stream Processing Framework

A Framework of Event-Driven Traffic Ticketing System

STUDY OF APPLICATION SERVER-WEB-BASED MIDDLEWARE SYSTEM INTEGRATED FRAMEWORK

Business Cooperation-oriented Heterogeneous System Integration Framework and its Implementation.

Data Storage and Access Framework for Business Models in Distributed Environments

Big data analysis and optimization and platform components

A Study and Implementation on Unified J2EE Server Side Software Test Framework

Design and implementation of development framework for human-oriented workflow management system

Research and design of RFID middleware framework of data fusion

A Framework for Managing Big Data in Enterprise Organizations

Design And Implementation Of A Framework Development Platform For Multi-Tiered Web Applications

Application Framework Development for Embedded Data Analysis Instrumentation Software