A Survey on Content Retrieval on the Decentralised Web

Navin V. Keizer,Onur Ascigil,Michał Król,Dirk Kutscher,George Pavlou

DOI: https://doi.org/10.1145/3649132

IF: 16.6

2024-03-04

ACM Computing Surveys

Abstract:The control, governance, and management of the web have become increasingly centralised, resulting in security, privacy, and censorship concerns. Decentralised initiatives have emerged to address these issues, beginning with decentralised file systems. These systems have gained popularity, with major platforms serving millions of content requests daily. Complementing the file systems are decentralised search engines and name registry infrastructures, together forming the basis of a decentralised web . This survey paper analyses research trends and emerging technologies for content retrieval on the decentralised web, encompassing both academic literature and industrial projects. Several challenges hinder the realisation of a fully decentralised web. Achieving comparable performance to centralised systems without compromising decentralisation is a key challenge. Hybrid infrastructures, blending centralised components with verifiability mechanisms, show promise to improve decentralised initiatives. While decentralised file systems have seen more mature deployments, they still face challenges such as usability, performance, privacy, and content moderation. Integrating these systems with decentralised name-registries offers a potential for improved usability with human-readable and persistent names for content. Further research is needed to address security concerns in decentralised name-registries and enhance governance and crypto-economic incentive mechanisms.

computer science, theory & methods

What problem does this paper attempt to address?

This paper mainly explores the issue of content retrieval in decentralized networks. With the increasing centralization in the Internet, issues such as security, privacy, and censorship have emerged, leading to the rise of decentralized initiatives including decentralized file systems, search engines, and name registration infrastructure to build a decentralized network foundation. However, achieving a fully decentralized network still faces many challenges such as performance, usability, privacy, and content management.

Although decentralized file systems have made some progress, there is still room for improvement in user experience, performance, privacy, and content moderation. By integrating these systems with decentralized name registration services, human-readable and persistent content names can be provided to enhance the user experience. However, the security, governance mechanisms, and incentive mechanisms of decentralized name registration services still require further research.

The paper investigates current research trends and technologies, analyzing issues of incentive structures, performance, security, and privacy in decentralized content retrieval. While the goal of decentralization is openness, design security, and decentralized management and control, it is unclear whether this goal can be achieved in practice, especially considering the economic concentration that may have similar effects on decentralized networks.

The authors propose a framework for understanding and defining future research opportunities, pointing out problems existing in existing platforms such as document clarity, integration of visions, and standardization of terminology. They also emphasize the importance of industry contributions, as decentralized networks are still a rapidly developing field with many concepts not yet fully formalized in research.

The main contribution of the paper is to provide a survey of decentralized network content retrieval, covering various aspects from decentralized search to name registration and file systems, clarifying current challenges and future research directions, aiming to provide tools for understanding and analyzing new initiatives for industry practitioners and researchers.