Big Data Security Technology
Xingshu CHEN,Lu YANG,Yonggang LUO
DOI: https://doi.org/10.15961/j.jsuese.201700726
2017-01-01
Abstract:The development and application of big data technology has a deep influence on the national governance model,corporate decision-making architecture,business strategy and personal lifestyle.The data aggretation not only increases the risk of user privacy leaks,but the huge information and potential value contained in big data also attract more potential attackers.Moreover,the big data application is a cross-disciplinary application,which introduces not only a lot of new technologies but more and higher risks.The definition and characteristics of big data is reviewed,and the big data architecture and big data security system are put forward in this paper.Based on this system,the security challenges facing the current big data and research progress of big data security technologies are analyzed from four perspectives:laws and regulations,standards,data life cycle protection and big data platform key technology.Laws and regulations in America,European Union,China and the research status of big data security standarlization of International Organization for Standardization,America,China and so on was introduced.Big data platform is needed to realize the collection,transmission,storage and analysis and so on in big data lifecycle.In this paper,the security problems and key technologies of big data are analyzed from two dimensions of big data lifecycle and big data platform.The lifeeycle includes collection,storage,usage,distribution and deletion five phases.Data value is determined by the data quality of the collection phase.Data and model inconsistency detection and data cleaning are the main technical means to improve data quality.The processed big data is transmit to external entities in big data distribution phase,so the protection of privacy and sensitive information is essential.The retalted key technologies are data anonymity,privacy-protecting data retrieval and analysis.The big data management support the effective use of big data and ensure big data security,which mainly contains metadata management and data lineage.The problems of authentication,data isolation,data encryption storage,big data platform border protection and audit between big data components can be solved by the big data platform security with the key technologies such as authentication,access control,data encryption and audit.At present,a perfect big data security standard system is still lacking in the world.The norms and guidance for privacy protection,data sharing,cross-border data transmission from standards are urgent needed.With the rapid development of big data analysis technology,it's difficult to predict the challenge of privacy protection and sensitive information protection from big data association analysis in the future.The existing data masking and privacy protection technology will face a great challenge.The data analysis without exposure to data privacy and sensitive information can be achieved by data homomorphic encryption,but the existing homomorphic encryption algorithm is far from mature.The current authentication,data encryption and access control in the big data platform use the traditional technology,which can't adapt to the new environment with large scale of data,complex processing logic and huge amount of users.Some of the big data security key technologies are also worthy of indepth study in the performance and availability for early practical application.In addition,using big data pro-cessing technology to develop security applications such as network security situation perception,intrusion detection and network threat intelligence analysis,and using big data technology to resist attacks against big data have become a new research trend in the field of big data security.The development of big data security requires the united support and promotion of laws and regulations,standards and key technologies.