MIPI 2023 Challenge on RGB+ToF Depth Completion: Methods and Results

Qingpeng Zhu,Wenxiu Sun,Yuekun Dai,Chongyi Li,Shangchen Zhou,Ruicheng Feng,Qianhui Sun,Chen Change Loy,Jinwei Gu,Yi Yu,Yangke Huang,Kang Zhang,Meiya Chen,Yu Wang,Yongchao Li,Hao Jiang,Amrit Kumar Muduli,Vikash Kumar,Kunal Swami,Pankaj Kumar Bajpai,Yunchao Ma,Jiajun Xiao,Zhi Ling

2023-04-27

Abstract:Depth completion from RGB images and sparse Time-of-Flight (ToF) measurements is an important problem in computer vision and robotics. While traditional methods for depth completion have relied on stereo vision or structured light techniques, recent advances in deep learning have enabled more accurate and efficient completion of depth maps from RGB images and sparse ToF measurements. To evaluate the performance of different depth completion methods, we organized an RGB+sparse ToF depth completion competition. The competition aimed to encourage research in this area by providing a standardized dataset and evaluation metrics to compare the accuracy of different approaches. In this report, we present the results of the competition and analyze the strengths and weaknesses of the top-performing methods. We also discuss the implications of our findings for future research in RGB+sparse ToF depth completion. We hope that this competition and report will help to advance the state-of-the-art in this important area of research. More details of this challenge and the link to the dataset can be found at <a class="link-external link-https" href="https://mipi-challenge.org/MIPI2023" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The main objective of this paper is to address the problem of depth map completion by combining RGB images with sparse Time-of-Flight (ToF) measurements. Specifically, the research team organized the "MIPI 2023 RGB+ToF Depth Completion Challenge" to promote research progress in this field through standardized datasets and evaluation metrics, and to compare the accuracy of different methods.

The paper mentions that traditional depth completion methods rely on stereo vision or structured light technology, while recent advances in deep learning have made it possible to more accurately and efficiently complete depth maps from RGB images and sparse ToF measurements. Therefore, this challenge focuses on how to combine RGB images and sparse depth information to predict complete dense depth maps, thereby improving the accuracy and robustness of depth estimation in various real-world scenarios. Additionally, the paper analyzes the strengths and weaknesses of the methods submitted by the participating teams and discusses the implications of these findings for future research in RGB+ToF depth completion.