Time-travel rephotography

Xuan Luo,Xuaner Zhang,Paul Yoo,Ricardo Martin-Brualla,Jason Lawrence,Steven M. Seitz,Xuaner (Cecilia) Zhang
DOI: https://doi.org/10.1145/3478513.3480485
IF: 6.2
2021-12-01
ACM Transactions on Graphics
Abstract:Many historical people were only ever captured by old, faded, black and white photos, that are distorted due to the limitations of early cameras and the passage of time. This paper simulates traveling back in time with a modern camera to rephotograph famous subjects. Unlike conventional image restoration filters which apply independent operations like denoising, colorization, and superresolution, we leverage the StyleGAN2 framework to project old photos into the space of modern high-resolution photos, achieving all of these effects in a unified framework. A unique challenge with this approach is retaining the identity and pose of the subject in the original photo, while discarding the many artifacts frequently seen in low-quality antique photos. Our comparisons to current state-of-the-art restoration filters show significant improvements and compelling results for a variety of important historical people. Please go to time-travel l -rephotography.github.io for many more results.
computer science, software engineering
What problem does this paper attempt to address?