Abstract:Quantifying the colors of objects is useful in a wide range of applications, including medical diagnosis, agricultural monitoring, and food safety. Accurate colorimetric measurement of objects is a laborious process normally performed through a color matching test in the laboratory. A promising alternative is to use digital images for colorimetric measurement, due to their portability and ease of use. However, image-based measurements suffer from errors caused by the non-linear image formation process and unpredictable environmental lighting. Solutions to this problem often perform relative color correction among multiple images through discrete color reference boards, which may yield biased results due to the lack of continuous observation. In this paper, we propose a smartphone-based solution, that couples a designated color reference board with a novel color correction algorithm, to achieve accurate and absolute color measurements. Our color reference board contains multiple color stripes with continuous color sampling at the sides. A novel correction algorithm is proposed to utilize a first-order spatial varying regression model to perform the color correction, which leverages both the absolute color magnitude and scale to maximize the correction accuracy. The proposed algorithm is implemented as a "human-in-the-loop" smartphone application, where users are guided by an augmented reality scheme with a marker tracking module to take images at an angle that minimizes the impact of non-Lambertian reflectance. Our experimental results show that our colorimetric measurement is device independent and can reduce up to 90% color variance for images collected under different lighting conditions. In the application of reading pH values from test papers, we show that our system performs 200% better than human reading. The designed color reference board, the correction algorithm, and our augmented reality guiding approach form an integrated system as a novel solution to measure color with increased accuracy. This technique has the flexibility to improve color reading performance in systems beyond existing applications, evidenced by both qualitative and quantitative experiments on example applications such as pH-test reading.

Nail Polish Try-On: Realtime Semantic Segmentation of Small Objects for Native and Browser Smartphone AR Applications

Real-time deep hair matting on mobile devices

A Scalable Real-time Semantic Segmentation Network for Autonomous Driving

Real-time Hair Segmentation and Recoloring on Mobile GPUs

ARShoe: Real-Time Augmented Reality Shoe Try-on System on Smartphones

SemanticPaint: A Framework for the Interactive Segmentation of 3D Scenes

Augmented Reality and Machine Learning Incorporation Using YOLOv3 and ARKit

Robustifying Semantic Cognition of Traversability Across Wearable RGB-depth Cameras

Edge Assisted Real-time Instance Segmentation on Mobile Devices

Lightweight real-time hand segmentation leveraging MediaPipe landmark detection

A novel systems solution for accurate colorimetric measurement through smartphone-based augmented reality

AsymFormer: Asymmetrical Cross-Modal Representation Learning for Mobile Platform Real-Time RGB-D Semantic Segmentation

Quasi Real-Time Apple Defect Segmentation Using Deep Learning

Designing an AI-Based Virtual Try-On Web Application

A Mobile Augmented Reality Application For Simulating Claude Monet’s Impressionistic Art Style

SwipeCut: Interactive Segmentation with Diversified Seed Proposals

MetaSapiens: Real-Time Neural Rendering with Efficiency-Aware Pruning and Accelerated Foveated Rendering

Toward Tiny and High-quality Facial Makeup with Data Amplify Learning

Real-time Segmentation and Facial Skin Tones Grading

PointRend: Image Segmentation as Rendering

Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric Annotations