Effect of an image compression scheme on optical camera communication

Xingnan Zhu,Jian Chen,Zhengye He,Anliang Cai,Changyuan Yu

DOI: https://doi.org/10.1364/ao.523572

IF: 1.9

2024-06-08

Applied Optics

Abstract:Xingnan Zhu, Jian Chen, Zhengye He, Anliang Cai, Changyuan Yu Optical camera communication (OCC) represents a subset of visible light communication with considerable potential applications in domains ... [Appl. Opt. 63, 4713-4721 (2024)]

optics

What problem does this paper attempt to address?

Optical Camera Communication: Principles and Applications

Yitong Wang,Mohamed Shehata,Kandeepan Sithamparanathan,Yiwei Xie,Ke Wang

DOI: https://doi.org/10.1109/ACP/POEM59049.2023.10368783

2023-01-01

Abstract:With the development of modern lighting technology and wide availability of cameras, optical camera communication (OCC) has developed rapidly. In this paper, we review recent progress and challenges in both indoor and outdoor OCC systems.
Some Practical Constraints and Solutions for Optical Camera Communication

Weijie Liu,Zhengyuan Xu

DOI: https://doi.org/10.1098/rsta.2019.0191

2020-01-01

Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences

Abstract:Mobile wireless communication heavily relies on the radio frequency to convey message and data. However, its limited spectrum can hardly meet the demands for the future high data rate applications. Optical wireless communication, in particular visible light communication, opens up vast optical spectrum for communication, and meanwhile can retrofit the light sources as the communication transmitters in the existing working or living environments. In conjunction with the ubiquitous cameras in hand-held consumer electronics such as smartphones and pads, optical camera communication (OCC) further takes advantages of image sensors as the communication receivers and realizes low-cost communication systems. This article first provides an overview of OCC systems. It then addresses some practical constraints, ranging from sensor low frame rate and instability, rolling shutter readout, to visual qualities of displayed images and videos, and link blockage between the transmitter and receiver. Accordingly, it introduces existing and new solutions to deal with those constraints by data modulation, newly developed camera structures, post-processing of sensed signals and non-line of sight OCC as a new form. In particular, indirect paths by either the indoor surface reflection or the outdoor atmospheric scattering are explored for link connectivity under blockage. Finally, some future research directions are suggested. This article is part of the theme issue ‘Optical wireless communication’.
Integration of Communication and Computational Imaging

Zhenming Yu,Liming Cheng,Hongyu Huang,Wei Zhang,Liang Lin,Kun Xu

2024-10-29

Abstract:Communication enables the expansion of human visual perception beyond the limitations of time and distance, while computational imaging overcomes the constraints of depth and breadth. Although impressive achievements have been witnessed with the two types of technologies, the occlusive information flow between the two domains is a bottleneck hindering their ulterior progression. Herein, we propose a novel framework that integrates communication and computational imaging (ICCI) to break through the inherent isolation between communication and computational imaging for remote perception. By jointly considering the sensing and transmitting of remote visual information, the ICCI framework performs a full-link information transfer optimization, aiming to minimize information loss from the generation of the information source to the execution of the final vision tasks. We conduct numerical analysis and experiments to demonstrate the ICCI framework by integrating communication systems and snapshot compressive imaging systems. Compared with straightforward combination schemes, which sequentially execute sensing and transmitting, the ICCI scheme shows greater robustness against channel noise and impairments while achieving higher data compression. Moreover, an 80 km 27-band hyperspectral video perception with a rate of 30 fps is experimentally achieved. This new ICCI remote perception paradigm offers a highefficiency solution for various real-time computer vision tasks.

Image and Video Processing,Computer Vision and Pattern Recognition,Signal Processing
Characterization of Optical Camera Communication Based on a Comprehensive System Model

Anqi Liu,Wenxiao Shi,Min Ouyang,Wei Liu

DOI: https://doi.org/10.1109/jlt.2022.3187500

IF: 4.7

2022-09-12

Journal of Lightwave Technology

Abstract:Anqi Liu, Wenxiao Shi, Min Ouyang, Wei Liu Optical camera communication (OCC), as a complementary technology of radio frequency (RF), has played an important role in alleviating the ... [J. Lightwave Technol. 40, 6087-6100 (2022)]

engineering, electrical & electronic,optics,telecommunications
Investigating the angular distortion impact on vehicular optical camera communication (OCC) systems

Anqi Liu,Wenxiao Shi,Majid Safari,Wei Liu

DOI: https://doi.org/10.1364/oe.520932

IF: 3.8

2024-05-15

Optics Express

Abstract:Anqi Liu, Wenxiao Shi, Majid Safari, Wei Liu Optical camera communication (OCC) shows promise for optical wireless communication (OWC) in vehicular networks. However, vehicle ... [Opt. Express 32, 19697-19715 (2024)]

optics
Compensation schemes for uneven illumination and LED light-emitting instability in optical camera communication system

Shaoxi Ji,Aiying Yang,wenpeng fan,Lihui Feng,Zhang Zhenrong,Minglun Zhang

DOI: https://doi.org/10.1364/oe.522522

IF: 3.8

2024-04-24

Optics Express

Abstract:Shaoxi Ji, Aiying Yang, Wenpeng Fan, Lihui Feng, Zhenrong Zhang, Minglun Zhang In order to increase the data rate of the optical camera communication (OCC) system, the 8-composite-amplitude-shift-keying modulation ... [Opt. Express 32, 17116-17131 (2024)]

optics
Optical Camera Communications: Survey, Use Cases, Challenges, and Future Trends

Nasir Saeed,Shuaishuai Guo,Ki-Hong Park,Tareq Y. Al-Naffouri,Mohamed-Slim Alouini

DOI: https://doi.org/10.48550/arXiv.1812.01259

2019-10-16

Abstract:Recently, a camera or an image sensor receiver based optical wireless communications (OWC) techniques have attracted particular interest in areas such as the internet of things, indoor localization, motion capture, and intelligent transportation systems. As a supplementary technique of high-speed OWC based on photo-detectors, communications hinging on image sensors as receivers do not need much modification to the current infrastructure, such that the implementation complexity and cost are quite low. Therefore, in this paper, we present a comprehensive survey of optical camera communication (OCC) techniques, and their use in localization, navigation, and motion capture. This survey is distinguishable from the existing reviews on this topic by covering multiple aspects of OCC and its various applications. The first part of the paper focuses on the standardization, channel characterization, modulation, coding, and synchronization of OCC systems while the second part of the article presents the literature on OCC based localization, navigation, and motion capture. Finally, in the last part of the paper, we present the challenges and future research directions of OCC.

Image and Video Processing,Signal Processing
Spatial division multiplexing of LED strips for optical camera communication

Shiwen Chen,Jilong Li,Meng Xiang,Songnian Fu,Yuwen Qin

DOI: https://doi.org/10.1364/oe.531581

IF: 3.8

2024-08-18

Optics Express

Abstract:Shiwen Chen, Jilong Li, Meng Xiang, Songnian Fu, Yuwen Qin Rolling shutter based optical camera communication (RS-OCC), a promising candidate of optical wireless communication (OWC), has the ... [Opt. Express 32, 31741-31751 (2024)]

optics
An Enhanced 2-D Color Space Diversity Using RGB-LED Overlapping for Optical Camera Communication

Qinghui Chen,Wei Liu,Hong Wen,Kexiong Liu,Ming Chen,Jie Ma

DOI: https://doi.org/10.1016/j.optcom.2023.129636

IF: 2.4

2023-01-01

Optics Communications

Abstract:In this paper, an enhanced two-dimension (2-D) color space diversity technique using red, green, and blue light emitting diode (RGB LED) overlapping is proposed and investigated experimentally to improve the system reliability for optical camera communication (OCC). The transmitter adopts an 8-color shift keying (8-CSK) modulation scheme with two RGB LED overlapping. The receiver uses a camera to form a multi-input single -output system to improve capacity. Different mapping methods are proposed and compared in 2-D YCbCr and CIElab color space to avoid the influence of brightness in conventional 3-D RGB space. Besides, clustering -based demapping is applied in the OCC system to transfer the color information into a data stream. The experimental results show that the mapping scheme with the maximum Euclidean distance in 2-D YCbCr color space has the best bit error rate (BER) performance. Compared with the conventional 3-D RGB color space, the proposed enhanced 2-D YCbCr color space diversity has a higher resolution to signal, which can realize 1.46 dB Q-factor improvement at an illumination of 660 lux. In addition, it can achieve a net data rate of 11.52 kb/s and maintain a 7% forward error correction (FEC) requirement even under low illumination. It is verified that the proposed scheme is a potential application for capacity and performance improvement.
Experimental Demonstration of High-Order Modulation for Optical Camera Communication

Wei Huang,Chen Gong,Peng Tian,Zhengyuan Xu

DOI: https://doi.org/10.1109/globalsip.2015.7418353

2015-01-01

Abstract:Due to the low frame rate of the commercial image sensor widely used currently, the transmission rate of the optical camera communication (OCC) will be limited if binary modulation is employed. To tackle this issue, high-order modulation is introduced to the OCC. We provide the system diagram and the associated signal detection based on the cumulative distributed function (CDF) of the grey value in the region of interest (ROI). We also conduct experiments on the high-order modulation, to show the impact of various factors on the signal detection performance based on the grey value CDF, the pixel-wise grey value and the mean grey value, respectively. Experiment results show that high-order modulation serves as a good candidates for future OCC systems.
Display Light Panel and Rolling Shutter Image Sensor Based Optical Camera Communication (OCC) Using Frame-Averaging Background Removal and Neural Network

Chi-Wai Chow,Yang Liu,Chien-Hung Yeh,Yun-Han Chang,Yun-Shen Lin,Ke-Ling Hsu,Xin-Lan Liao,Kun-Hsien Lin

DOI: https://doi.org/10.1109/jlt.2021.3073656

IF: 4.7

2021-07-01

Journal of Lightwave Technology

Abstract:Chi-Wai Chow, Yang Liu, Chien-Hung Yeh, Yun-Han Chang, Yun-Shen Lin, Ke-Ling Hsu, Xin-Lan Liao, Kun-Hsien Lin<br/>Optical wireless communication (OWC) has emerged as a complementary or alternative technology to the radio-frequency (RF) communication. ... [J. Lightwave Technol. 39, 4360-4366 (2021)]

engineering, electrical & electronic,optics,telecommunications
ZEROES: Robust Derivative-Based Demodulation Method for Optical Camera Communication

Maugan De Murcia,Hervé Boeglen,Anne Julien-Vergonjanne

DOI: https://doi.org/10.3390/photonics11100949

IF: 2.536

2024-10-10

Photonics

Abstract:Most of Optical Camera Communication (OCC) systems benefit from the rolling shutter mechanism of Complementary Metal-Oxide Semiconductor (CMOS) cameras to record the brightness evolution of the Light-Emitting Diode (LED) through dark and bright strips within images. While this technique enhances the maximum achievable data rate, the main difficulty lies in the demodulation of the signal extracted from images, subject to blooming effect. Thus, two main approaches were proposed to deal with this issue, using adaptive thresholds whose value evolves according to amplitude changes or detecting signal variations with the first-order derivative. As the second method is more robust, a new demodulation method based on the detection of the zeros of the first-order derivative of the extracted signal was proposed in this paper. Obtained results clearly show an improvement in the extracted signal demodulation compared to other methods, achieving a raw Bit Error Rate (BER) of 10−3 around 50 cm in a Line-Of-Sight scenario, and increasing the maximum communication distance by 43.5%, reaching 330 cm in the case of a Non-Line-Of-Sight transmission.

optics
Design and Experimental Demonstration of a Real-Time 95kbps Optical Camera Communication System

Peng Tian,Wei Huang,Zhengyuan Xu

DOI: https://doi.org/10.1109/csndsp.2016.7573897

2016-01-01

Abstract:A real-time optical camera communication (OCC) system was designed and implemented. The system jointly utilizes 4 intensity levels for each color and 3 colors of each RGB LED of a 16×16 LED array, resulting in a 64-ary color-intensity modulation (CIM) carrying on 6-bit coded information in each symbol. The LED array is refreshed at 82.5 Hz, and a FPGA controlled commercial CMOS image sensor from a mobile phone operates at a frame rate of 330 fps whose outputs are fed into a PC for real-time signal demodulation. Excluding 60 boarder LEDs and 4 spatial synchronization LEDs, the remaining 192 data-carrying LEDs are able to transmit data at an effective rate of about 95 kbps. Bit error rate below 10~3 over a communication distance up to 1.2 m is achieved without any external optical lens.
OnionCode: Enabling Multi-priority Coding in LED-based Optical Camera Communications

Haonan Wu,Yi-Chao Chen,Guangtao Xue,Yuehu Jiang,Ming Wang,Shiyou Qian,Jiadi Yu,Pai-Yen Chen

DOI: https://doi.org/10.1109/infocom48880.2022.9796655

2022-01-01

Abstract:Optical camera communication (OCC) has attracted increasing attention recently thanks to the wide usage of LED and high-resolution cameras. The lens-image sensor structure enables the camera distinguish light from various source, which is ideal for spatial MIMO. Hence, OCC can be applied to several emerging application scenarios, such as vehicle and drone communications. However, distance is a major bottleneck for OCC system, because the increase in distance makes it difficult for the camera to distinguish adjacent LEDs, which we call LED spatial mixing.In this paper, we propose a novel hierarchical coding scheme named as OnionCode to support dynamic range of channel capacity in one-to-many OCC scenario. OnionCode adopts a multi-priority receiving scheme, i.e., the receivers can dynamically discard the low-priority bit streams according to the measured channel capacity. OnionCode achieves this based on a key insight that, the luminance level of a mix-LED is distinguishable. We prototype a LED-based OCC system to evaluate the efficacy of OnionCode and the results show that OnionCode achieves a higher coding efficiency and overall throughput compared with the existing hierarchical coding.
Simplified model for non-line-of-sight optical camera communication with a simple patterned reflective surface

Zhengye He,Jian Chen,Changyuan Yu

DOI: https://doi.org/10.1364/ao.506733

IF: 1.9

2024-01-09

Applied Optics

Abstract:Zhengye He, Jian Chen, Changyuan Yu Most previous studies on non-line-of-sight optical camera communication (NLOS-OCC) were conducted as practical experiments; few relevant ... [Appl. Opt. 63, 506-514 (2024)]

optics
Research on performance enhancement scheme of optical camera communication based on adaptive exponential weighted moving average algorithm

Wenyang Jia,Ming Tian,Jinliang Feng

DOI: https://doi.org/10.1002/mop.34185

IF: 1.311

2024-07-11

Microwave and Optical Technology Letters

Abstract:When the COMS camera of optical camera communication (OCC) system acquired the information image, the grayscale value of pixels fluctuated due to the influence of blooming effect and light noise, so that the data logic could not be correctly judged by the decision threshold, which affected the bit error rate (BER) performance transmission distance and data rate, and degraded the system performance. In this paper, the adaptive exponential weighted moving average algorithm is proposed, and the optimal grayscale value matrix of signal demodulation is verified by experiment, so as to reduce the fluctuation of grayscale value and improve the performance of OCC system. The experimental results show that for data processing and analysis based on ZYNQ7020 experimental platform, a 7% forward error correction(BER = 3.8 × 10−3)requirements can be satisfied at 150 cm when the data rate is 3 Kbps, and a 7% forward error correction(BER = 3.8 × 10−3)requirements can be satisfied at 100 cm when the data rate is 5 Kbps.

engineering, electrical & electronic,optics
Toward high-quality image communications: Inverse problems in image processing

Cheolkon Jung,Licheng Jiao,Bing Liu,Hongtao Qi,Tian Sun

DOI: https://doi.org/10.1117/1.OE.51.10.100901

IF: 1.3

2012-01-01

Optical Engineering

Abstract:Recently, image communications are becoming increasingly popular, and there is a growing need for consumers to be provided with high-quality services. Although the image communication services already exist over third-generation wireless networks, there are still obstacles that prevent high-quality image communications because of limited bandwidth. Thus, more research is required to overcome the limited bandwidth of current communications systems and achieve high-quality image reconstruction in real applications. From the point of view of image processing, core technologies for high-quality image reconstruction are face hallucination and compression artifact reduction. The main interests of consumers are facial regions and several compression artifacts inevitably occur by compression; these two technologies are closely related to inverse problems in image processing. We review recent studies on face hallucination and compression artifact reduction, and provide an outline of current research. Furthermore, we discuss practical considerations and possible solutions to implement these two technologies in real mobile applications. (C) 2012 Society of Photo-Optical Instrumentation Engineers (SPIE). [DOI: 10.1117/1.OE.51.10.100901]
Frame-rate adaptive fractionally spaced equalization enabled high-throughput optical camera communication

Shiwen Chen,Meng Xiang,Gai Zhou,Jilong Li,Songnian Fu,YuWen Qin

DOI: https://doi.org/10.1364/OL.529945

2024-08-15

Abstract:Optical camera communication (OCC) has garnered worldwide research attention, due to its immunity to electromagnetic interference (EMI) and efficient utilization of spectrum resources. However, the limited bandwidth of the OCC system and the timing offset of the camera result in low system throughput. To enhance the OCC throughput, we propose and experimentally demonstrate a frame-rate adaptive fractionally spaced equalization algorithm (FA-FSE) for the joint mitigation of severe inter-symbol interference (ISI) and timing offset arising in OCC. Experimental results validate its correct and power-efficient function, leading to a record aggregated throughput of 250.96 kbit/s, when the 8-level pulse amplitude modulation (PAM-8) signals are independently modulated to eight chip-on-board light emitting diode (COB-LED) light strips, while simultaneously received by a smartphone 10 cm away.
Confidential multiple-input multiple-output optical camera communication aided by a two-dimensional pilot

Shanshan Hu,xuefen chi,Fenglei Ji,Shaoqi Chen,Gaoyang Hu

DOI: https://doi.org/10.1364/ol.524542

IF: 3.6

2024-05-11

Optics Letters

Abstract:Shan-Shan Hu, Xue-Fen Chi, Feng-Lei Ji, Shao-Qi Chen, Gao-Yang Hu Optical camera communication (OCC) has attracted increased attention for its inherent security advantage. However, there still exists the ... [Opt. Lett. 49, 2757-2760 (2024)]

optics
Uncertainty of digital image correlation under video compression and DSP optimization

Xiaowen Li,Xinqiao Tang,Yinuo Xu,Wei Sun,Zhenning Chen

DOI: https://doi.org/10.1364/ao.511691

IF: 1.9

2024-03-20

Applied Optics

Abstract:Xiaowen Li, Xinqiao Tang, Yinuo Xu, Wei Sun, Zhenning Chen The storage and transmission of videos at high spatial resolution remain a great challenge in image-based optical techniques. The ... [Appl. Opt. 63, 2340-2351 (2024)]

optics

Effect of an image compression scheme on optical camera communication

Optical Camera Communication: Principles and Applications

Some Practical Constraints and Solutions for Optical Camera Communication

Integration of Communication and Computational Imaging

Characterization of Optical Camera Communication Based on a Comprehensive System Model

Investigating the angular distortion impact on vehicular optical camera communication (OCC) systems

Compensation schemes for uneven illumination and LED light-emitting instability in optical camera communication system

Optical Camera Communications: Survey, Use Cases, Challenges, and Future Trends

Spatial division multiplexing of LED strips for optical camera communication

An Enhanced 2-D Color Space Diversity Using RGB-LED Overlapping for Optical Camera Communication

Experimental Demonstration of High-Order Modulation for Optical Camera Communication

Display Light Panel and Rolling Shutter Image Sensor Based Optical Camera Communication (OCC) Using Frame-Averaging Background Removal and Neural Network

ZEROES: Robust Derivative-Based Demodulation Method for Optical Camera Communication

Design and Experimental Demonstration of a Real-Time 95kbps Optical Camera Communication System

OnionCode: Enabling Multi-priority Coding in LED-based Optical Camera Communications

Simplified model for non-line-of-sight optical camera communication with a simple patterned reflective surface

Research on performance enhancement scheme of optical camera communication based on adaptive exponential weighted moving average algorithm

Toward high-quality image communications: Inverse problems in image processing

Frame-rate adaptive fractionally spaced equalization enabled high-throughput optical camera communication

Confidential multiple-input multiple-output optical camera communication aided by a two-dimensional pilot

Uncertainty of digital image correlation under video compression and DSP optimization