Abstract:Quantifying the colors of objects is useful in a wide range of applications, including medical diagnosis, agricultural monitoring, and food safety. Accurate colorimetric measurement of objects is a laborious process normally performed through a color matching test in the laboratory. A promising alternative is to use digital images for colorimetric measurement, due to their portability and ease of use. However, image-based measurements suffer from errors caused by the non-linear image formation process and unpredictable environmental lighting. Solutions to this problem often perform relative color correction among multiple images through discrete color reference boards, which may yield biased results due to the lack of continuous observation. In this paper, we propose a smartphone-based solution, that couples a designated color reference board with a novel color correction algorithm, to achieve accurate and absolute color measurements. Our color reference board contains multiple color stripes with continuous color sampling at the sides. A novel correction algorithm is proposed to utilize a first-order spatial varying regression model to perform the color correction, which leverages both the absolute color magnitude and scale to maximize the correction accuracy. The proposed algorithm is implemented as a "human-in-the-loop" smartphone application, where users are guided by an augmented reality scheme with a marker tracking module to take images at an angle that minimizes the impact of non-Lambertian reflectance. Our experimental results show that our colorimetric measurement is device independent and can reduce up to 90% color variance for images collected under different lighting conditions. In the application of reading pH values from test papers, we show that our system performs 200% better than human reading. The designed color reference board, the correction algorithm, and our augmented reality guiding approach form an integrated system as a novel solution to measure color with increased accuracy. This technique has the flexibility to improve color reading performance in systems beyond existing applications, evidenced by both qualitative and quantitative experiments on example applications such as pH-test reading.

Doubling the Signal Quality of Smartphone Camera Pulse Oximetry Using the Display Screen as a Controllable Selective Light Source

Smart-phone Phase Contrast Microscope with a Singlet Lens and Deep Learning

Smartphone Camera Oximetry in an Induced Hypoxemia Study

Smartphone tristimulus colorimetry for skin-tone analysis at common pulse oximetry anatomical sites

A Multi-Channel Ratio-of-Ratios Method for Noncontact Hand Video Based SpO$_2$ Monitoring Using Smartphone Cameras

Diffuse transmittance visible spectroscopy using smartphone flashlight for photoplethysmography and vital signs measurements

A smartphone-supported portable micro-spectroscopy/imaging system to characterize morphology and spectra of samples at the microscale.

Evaluation of a New Smartphone Powered Low-cost Pulse Oximeter Device

Your smartphone could act as a pulse-oximeter and as a single-lead ECG

Chromaticity-based Real-Time Assessment of Melanopic and Luminous Efficiency of Smartphone Displays.

Development of a pulse oximeter robust to measurement errors, with the ability to estimate heartrate and transmit data to smartphones

Laser Speckle Contrast Imaging Based on a Mobile Phone Camera

A novel systems solution for accurate colorimetric measurement through smartphone-based augmented reality

Towards ultra-low-cost smartphone microscopy

Image Quality Evaluation for Smart-Phone Displays at Lighting Levels of Indoor and Outdoor Conditions

A pulse oximeter based on Time-of-Flight histograms

Improvements in Smartphone and Night Vision Imaging Technologies Enable Low Cost, On-Site Assays of Bioluminescent Cells

Noncontact Monitoring of Blood Oxygen Saturation Using Camera and Dual-Wavelength Imaging System.

Smartphone-Based Rigid Endoscopy Device with Hemodynamic Response Imaging and Laser Speckle Contrast Imaging

Artificial Neural Network Processed Linear-Light Tristimulus and Hue Parameters of Fluorescence for Smartphone Assisted Point-of-Care Testing Device

Detail-Preserving Signal Fitting for Pulse Wave Detection from Smartphone-Based Fingertip Videos