Optical Camera Communication: Principles and Applications

Yitong Wang,Mohamed Shehata,Kandeepan Sithamparanathan,Yiwei Xie,Ke Wang

DOI: https://doi.org/10.1109/ACP/POEM59049.2023.10368783

2023-01-01

Abstract:With the development of modern lighting technology and wide availability of cameras, optical camera communication (OCC) has developed rapidly. In this paper, we review recent progress and challenges in both indoor and outdoor OCC systems.

What problem does this paper attempt to address?

Optical Camera Communications: Survey, Use Cases, Challenges, and Future Trends

Nasir Saeed,Shuaishuai Guo,Ki-Hong Park,Tareq Y. Al-Naffouri,Mohamed-Slim Alouini

DOI: https://doi.org/10.48550/arXiv.1812.01259

2019-10-16

Abstract:Recently, a camera or an image sensor receiver based optical wireless communications (OWC) techniques have attracted particular interest in areas such as the internet of things, indoor localization, motion capture, and intelligent transportation systems. As a supplementary technique of high-speed OWC based on photo-detectors, communications hinging on image sensors as receivers do not need much modification to the current infrastructure, such that the implementation complexity and cost are quite low. Therefore, in this paper, we present a comprehensive survey of optical camera communication (OCC) techniques, and their use in localization, navigation, and motion capture. This survey is distinguishable from the existing reviews on this topic by covering multiple aspects of OCC and its various applications. The first part of the paper focuses on the standardization, channel characterization, modulation, coding, and synchronization of OCC systems while the second part of the article presents the literature on OCC based localization, navigation, and motion capture. Finally, in the last part of the paper, we present the challenges and future research directions of OCC.

Image and Video Processing,Signal Processing
Some Practical Constraints and Solutions for Optical Camera Communication

Weijie Liu,Zhengyuan Xu

DOI: https://doi.org/10.1098/rsta.2019.0191

2020-01-01

Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences

Abstract:Mobile wireless communication heavily relies on the radio frequency to convey message and data. However, its limited spectrum can hardly meet the demands for the future high data rate applications. Optical wireless communication, in particular visible light communication, opens up vast optical spectrum for communication, and meanwhile can retrofit the light sources as the communication transmitters in the existing working or living environments. In conjunction with the ubiquitous cameras in hand-held consumer electronics such as smartphones and pads, optical camera communication (OCC) further takes advantages of image sensors as the communication receivers and realizes low-cost communication systems. This article first provides an overview of OCC systems. It then addresses some practical constraints, ranging from sensor low frame rate and instability, rolling shutter readout, to visual qualities of displayed images and videos, and link blockage between the transmitter and receiver. Accordingly, it introduces existing and new solutions to deal with those constraints by data modulation, newly developed camera structures, post-processing of sensed signals and non-line of sight OCC as a new form. In particular, indirect paths by either the indoor surface reflection or the outdoor atmospheric scattering are explored for link connectivity under blockage. Finally, some future research directions are suggested. This article is part of the theme issue ‘Optical wireless communication’.
Characterization of Optical Camera Communication Based on a Comprehensive System Model

Anqi Liu,Wenxiao Shi,Min Ouyang,Wei Liu

DOI: https://doi.org/10.1109/jlt.2022.3187500

IF: 4.7

2022-09-12

Journal of Lightwave Technology

Abstract:Anqi Liu, Wenxiao Shi, Min Ouyang, Wei Liu Optical camera communication (OCC), as a complementary technology of radio frequency (RF), has played an important role in alleviating the ... [J. Lightwave Technol. 40, 6087-6100 (2022)]

engineering, electrical & electronic,optics,telecommunications
Design and Implementation of a Hybrid Optical Camera Communication System for Indoor Applications

Huy Nguyen,Nam Tuan Le,Duy Tuan Anh Le,Yeong Min Jang

DOI: https://doi.org/10.3390/s24010300

IF: 3.9

2024-01-05

Sensors

Abstract:Optical wireless communication is a promising emerging technology that addresses the limitations of radio-frequency-based wireless technologies. This study presents a new hybrid modulation method for optical camera communication (OCC), which integrates two waveforms transmitted from a single transmitter light-emitting diode (LED) and receives data through two rolling shutter camera devices on the receiver side. Then, a smart camera with a high-resolution image sensor captures the high-frequency signal, and a low-resolution image sensor from a smartphone camera captures the low-frequency signal. Based on this hybrid scheme, two data streams are transmitted from a single LED, which reduces the cost of the indoor OCC device compared with transmitting two signals from two different LEDs. In the proposed scheme, rolling-shutter orthogonal frequency-division multiplexing is used for the high-frequency signals, and M-ary frequency-shift keying is used for the low-frequency signals in the time domain. This proposed scheme is compatible with smartphone and USB cameras. By controlling the OCC parameters, the hybrid scheme can be implemented with high performance for a communication distance of 10 m.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Effect of an image compression scheme on optical camera communication

Xingnan Zhu,Jian Chen,Zhengye He,Anliang Cai,Changyuan Yu

DOI: https://doi.org/10.1364/ao.523572

IF: 1.9

2024-06-08

Applied Optics

Abstract:Xingnan Zhu, Jian Chen, Zhengye He, Anliang Cai, Changyuan Yu Optical camera communication (OCC) represents a subset of visible light communication with considerable potential applications in domains ... [Appl. Opt. 63, 4713-4721 (2024)]

optics
Emerging Optical Wireless Communications-Advances and Challenges

Zabih Ghassemlooy,Shlomi Arnon,Murat Uysal,Zhengyuan Xu,Julian Cheng

DOI: https://doi.org/10.1109/jsac.2015.2458511

IF: 16.4

2015-01-01

IEEE Journal on Selected Areas in Communications

Abstract:New data services and applications are emerging continuously and enhancing the mobile broadband experience. The ability to cope with these varied and sophisticated services and applications will be a key success factor for the highly demanding future network infrastructure. One such technology that could help address the problem would be optical wireless communications (OWC), which presents a growing research interest in the last few years for indoor and outdoor applications. This paper is an overview of the OWC systems focusing on visible light communications, free space optics, transcutaneous OWC, underwater OWC, and optical scattering communications.
Spatial division multiplexing of LED strips for optical camera communication

Shiwen Chen,Jilong Li,Meng Xiang,Songnian Fu,Yuwen Qin

DOI: https://doi.org/10.1364/oe.531581

IF: 3.8

2024-08-18

Optics Express

Abstract:Shiwen Chen, Jilong Li, Meng Xiang, Songnian Fu, Yuwen Qin Rolling shutter based optical camera communication (RS-OCC), a promising candidate of optical wireless communication (OWC), has the ... [Opt. Express 32, 31741-31751 (2024)]

optics
Investigating the angular distortion impact on vehicular optical camera communication (OCC) systems

Anqi Liu,Wenxiao Shi,Majid Safari,Wei Liu

DOI: https://doi.org/10.1364/oe.520932

IF: 3.8

2024-05-15

Optics Express

Abstract:Anqi Liu, Wenxiao Shi, Majid Safari, Wei Liu Optical camera communication (OCC) shows promise for optical wireless communication (OWC) in vehicular networks. However, vehicle ... [Opt. Express 32, 19697-19715 (2024)]

optics
Display Light Panel and Rolling Shutter Image Sensor Based Optical Camera Communication (OCC) Using Frame-Averaging Background Removal and Neural Network

Chi-Wai Chow,Yang Liu,Chien-Hung Yeh,Yun-Han Chang,Yun-Shen Lin,Ke-Ling Hsu,Xin-Lan Liao,Kun-Hsien Lin

DOI: https://doi.org/10.1109/jlt.2021.3073656

IF: 4.7

2021-07-01

Journal of Lightwave Technology

Abstract:Chi-Wai Chow, Yang Liu, Chien-Hung Yeh, Yun-Han Chang, Yun-Shen Lin, Ke-Ling Hsu, Xin-Lan Liao, Kun-Hsien Lin<br/>Optical wireless communication (OWC) has emerged as a complementary or alternative technology to the radio-frequency (RF) communication. ... [J. Lightwave Technol. 39, 4360-4366 (2021)]

engineering, electrical & electronic,optics,telecommunications
Visible light communications: current challenges and prospects

Alina-Elena Marcu,Robert-Alexandru Dobre,Marian Vlădescu,Alina Elena Marcu

DOI: https://doi.org/10.1117/12.2572074

2020-12-31

Abstract:As time passes, the optical wireless communication systems (OWC) are seeing more and more technological advancement. The complete replacement of conventional lighting with LED based solutions seems to be in sight. Technology and its development always match the world's current needs, and as the whole economy is shifting towards ecology and sustainability, moving towards low consumption LEDs would seem to be a good approach. The LED's ability to switch on and off at a fast rate enables the possibility of developing new optical communication systems. In Visible Light Communication (VLC) systems, the LEDs represent the transmitter and the photodetectors represent the receiver. A similar technology to VLC, known as Optical Camera Communications (OCC) uses image sensors as the receiver. The paper investigates the performances of different OWC technologies and provides a detailed overview of the areas and applications in which they can be found.
A Comparative Survey of Optical Wireless Technologies: Architectures and Applications

Mostafa Zaman Chowdhury,Md. Tanvir Hossan,Amirul Islam,Yeong Min Jang

DOI: https://doi.org/10.48550/arXiv.1810.02594

2018-10-05

Networking and Internet Architecture

Abstract:New high-data-rate multimedia services and applications are evolving continuously and exponentially increasing the demand for wireless capacity of fifth-generation (5G) and beyond. The existing radio frequency (RF) communication spectrum is insufficient to meet the demands of future high-datarate 5G services. Optical wireless communication (OWC), which uses an ultra-wide range of unregulated spectrum, has emerged as a promising solution to overcome the RF spectrum crisis. It has attracted growing research interest worldwide in the last decade for indoor and outdoor applications. OWC offloads huge data traffic applications from RF networks. A 100 Gb/s data rate has already been demonstrated through OWC. It offers services indoors as well as outdoors, and communication distances range from several nm to more than 10000 km. This paper provides a technology overview and a review on optical wireless technologies, such as visible light communication, light fidelity, optical camera communication, free space optical communication, and light detection and ranging. We survey the key technologies for understanding OWC and present state-of-the-art criteria in aspects, such as classification, spectrum use, architecture, and applications. The key contribution of this paper is to clarify the differences among different promising optical wireless technologies and between these technologies and their corresponding similar existing RF technologies
Practical Optical Camera Communication Behind Unseen and Complex Backgrounds

Rui Xiao,Leqi Zhao,Feng Qian,Lei Yang,Jinsong Han

DOI: https://doi.org/10.1145/3643832.3661866

2024-01-01

Abstract:Optical camera communication (OCC) holds potential for location-aware data transfer, facilitating applications such as localization and overlaying digital content for mixed reality experiences. However, existing OCC designs commonly require a clean background for reliable demodulation, rendering its use disruptive and impractical. To this end, we propose WinkLink , a novel OCC system capable of robust transmission behind complex backgrounds, even under low signal-to-noise ratio (SNR) conditions. We address the key challenge of extracting subtle signals in the lossy OCC channel by designing a two-stage deep neural network and a context-aware demodulation protocol. The proposed system is trained solely on a synthesized dataset yet generalizes effectively to unseen real-world backgrounds. Through experiments in 12 diverse environments, we demonstrate that WinkLink successfully transmits OCC signals under a low SNR of -20 dB, achieving a substantial 5.8 dB SNR gain. This low SNR translates to an extended distance to 5.5× of baseline (11m with a 10W LED transmitter) and negligible interference on concurrent vision applications. Finally, WinkLink proves its efficacy even when the device is moving, i.e., dynamic backgrounds, making it ready for deployment on mobile devices.
Design and Implementation of a 2D MIMO OCC System Based on Deep Learning

Ones Sanjerico Sitanggang,Van Linh Nguyen,Huy Nguyen,Radityo Fajar Pamungkas,Muhammad Miftah Faridh,Yeong Min Jang

DOI: https://doi.org/10.3390/s23177637

2023-09-03

Abstract:Optical camera communication (OCC) is one of the most promising optical wireless technology communication systems. This technology has a number of benefits compared to radio frequency, including unlimited spectrum, no congestion due to high usage, and low operating costs. OCC operates in order to transmit an optical signal from a light-emitting diode (LED) and receive the signal with a camera. However, identifying, detecting, and extracting data in a complex area with very high mobility is the main challenge in operating the OCC. In this paper, we design and implement a real-time OCC system that can communicate in high mobility conditions, based on You Only Look Once version 8 (YOLOv8). We utilized an LED array that can be identified accurately and has an enhanced data transmission rate due to a greater number of source lights. Our system is validated in a highly mobile environment with camera movement speeds of up to 10 m/s at 2 m, achieving a bit error rate of 10-2. In addition, this system achieves high accuracy of the LED detection algorithm with mAP0.5 and mAP0.5:0.95 values of 0.995 and 0.8604, respectively. The proposed method has been tested in real time and achieves processing speeds up to 1.25 ms.
Evolution of Short-Range Optical Wireless Communications

Ke Wang,Tingting Song,Yitong Wang,Chengwei Fang,Jiayuan He,Ampalavanapillai Nirmalathas,Christina Lim,Elaine Wong,Sithamparanathan Kandeepan

DOI: https://doi.org/10.1109/jlt.2022.3215590

IF: 4.7

2023-02-15

Journal of Lightwave Technology

Abstract:The optical wireless communication (OWC) technology explores the broad unregulated optical spectrum to provide high-speed wireless communications, and the visible, ultraviolet and near-infrared wavelength ranges all have been investigated. Compared with the conventional radio frequency (RF) band, the spectrum in OWC systems is much less congested and the interference is much lower. The OWC technology also provides enhanced physical layer security due to the natural confinement of optical beams that makes it difficult to intercept the transmitted signal. Hence, the OWC technology has been widely studied and considered as a promising candidate in future beyond-5G communications. The OWC technology has been considered for both long-range and short-range applications, and in this paper we will introduce the fundamentals and recent developments of short-range OWC systems. In particular, we will focus on the key short-range OWC applications in indoor personal or local area communications, underwater wireless communications, wireless data center networks, and vehicular communications. We will also introduce some recent widely studied advanced techniques to boost the performance of short-range OWC systems, including the spatial domain diversity, multiplexing and modulation principles to improve the system robustness and data rate, and the machine learning algorithms and hardware accelerators to suppress both linear and nonlinear effects to improve OWC signal quality and bit-error-rate performance.

engineering, electrical & electronic,optics,telecommunications
Optical Wireless Communication Systems, A Survey

Osama Alsulami,Ahmed Taha Hussein,Mohammed T. Alresheedi,Jaafar M. H. Elmirghani

DOI: https://doi.org/10.48550/arXiv.1812.11544

2018-12-30

Abstract:In the past few years, the demand for high data rate services has increased dramatically. The congestion in the radio frequency (RF) spectrum (3 kHz ~ 300 GHz) is expected to limit the growth of future wireless systems unless new parts of the spectrum are opened. Even with the use of advanced engineering, such as signal processing and advanced modulation schemes, it will be very challenging to meet the demands of the users in the next decades using the existing carrier frequencies. On the other hand, there is a potential band of the spectrum available that can provide tens of Gbps to Tbps for users in the near future. Optical wireless communication (OWC) systems are among the promising solutions to the bandwidth limitation problem faced by radio systems. In this paper, we give a tutorial survey of the most significant issues in OWC systems that operate at short ranges such as indoor systems. We consider the challenging issues facing these systems such as (i) link design and system requirements, (ii) transmitter structures, (iii) receiver structures, (iv) challenges and possible techniques to mitigate the impairments in these systems, (v) the main applications and (vi) open research issues. In indoor OWC systems we describe channel modelling, mobility and dispersion mitigation techniques. Infrared communication (IRC) and visible light communication (VLC) are presented as potential implementation approaches for OWC systems and are comprehensively discussed. Moreover, open research issues in OWC systems are discussed.

Signal Processing
Convolutional Neural Network-based Optical Camera Communication System for Internet of Vehicles

Amirul Islam

DOI: https://doi.org/10.48550/arXiv.1911.09529

2019-11-21

Abstract:The evolution of internet of vehicles (IoV) and the growing use of mobile devices with the development of the Internet of Things, demand has grown for alternative wireless communication technologies. As a promising alternative, optical-camera communication (OCC) has emerged that uses light-emitting diode (LED) and camera as transmitter and receiver respectively. Since LEDs and cameras are exploring in traffic lights, vehicles, and public lightings, OCC has the potential to handle the transport systems intelligently. Though some technologies have been proposed or developed, these are not mature enough to uphold the huge requirements of IoV. However, most of the OCC applications are limited to single vehicle and there has been limited focus on the use of multiple vehicles detection (spatial) or fast processing (temporal) systems. Also, there has no system to challenge with the bad weather condition. In this research, a vision camera and high-speed camera has been proposed to provide multiple vehicle detection and fast data processing. Here, a convolutional neural network (CNN) based vehicular OCC system has been introduced to guarantee communication to maintain communication at the adverse condition and near-infrared is proposed in addition to visible lights to provide long range and secure communication. To support IoV communication, software-defined networking (SDN) has been proposed. Finally, the results represent the required conditions for vehicular OCC system analysis and improved performance demonstration using the proposed intelligent system.

Signal Processing
Motion-Aware Optical Camera Communication with Event Cameras

Hang Su,Ling Gao,Tao Liu,Laurent Kneip

2024-12-01

Abstract:As the ubiquity of smart mobile devices continues to rise, Optical Camera Communication systems have gained more attention as a solution for efficient and private data streaming. This system utilizes optical cameras to receive data from digital screens via visible light. Despite their promise, most of them are hindered by dynamic factors such as screen refreshing and rapid camera motion. CMOS cameras, often serving as the receivers, suffer from limited frame rates and motion-induced image blur, which degrade overall performance. To address these challenges, this paper unveils a novel system that utilizes event cameras. We introduce a dynamic visual marker and design event-based tracking algorithms to achieve fast localization and data streaming. Remarkably, the event camera's unique capabilities mitigate issues related to screen refresh rates and camera motion, enabling a high throughput of up to 114 Kbps in static conditions, and a 1 cm localization accuracy with 1% bit error rate under various camera motions.

Computer Vision and Pattern Recognition,Robotics
Frame-rate adaptive fractionally spaced equalization enabled high-throughput optical camera communication

Shiwen Chen,Meng Xiang,Gai Zhou,Jilong Li,Songnian Fu,YuWen Qin

DOI: https://doi.org/10.1364/OL.529945

2024-08-15

Abstract:Optical camera communication (OCC) has garnered worldwide research attention, due to its immunity to electromagnetic interference (EMI) and efficient utilization of spectrum resources. However, the limited bandwidth of the OCC system and the timing offset of the camera result in low system throughput. To enhance the OCC throughput, we propose and experimentally demonstrate a frame-rate adaptive fractionally spaced equalization algorithm (FA-FSE) for the joint mitigation of severe inter-symbol interference (ISI) and timing offset arising in OCC. Experimental results validate its correct and power-efficient function, leading to a record aggregated throughput of 250.96 kbit/s, when the 8-level pulse amplitude modulation (PAM-8) signals are independently modulated to eight chip-on-board light emitting diode (COB-LED) light strips, while simultaneously received by a smartphone 10 cm away.
Simplified model for non-line-of-sight optical camera communication with a simple patterned reflective surface

Zhengye He,Jian Chen,Changyuan Yu

DOI: https://doi.org/10.1364/ao.506733

IF: 1.9

2024-01-09

Applied Optics

Abstract:Zhengye He, Jian Chen, Changyuan Yu Most previous studies on non-line-of-sight optical camera communication (NLOS-OCC) were conducted as practical experiments; few relevant ... [Appl. Opt. 63, 506-514 (2024)]

optics
Design and Experimental Demonstration of a Real-Time 95kbps Optical Camera Communication System

Peng Tian,Wei Huang,Zhengyuan Xu

DOI: https://doi.org/10.1109/csndsp.2016.7573897

2016-01-01

Abstract:A real-time optical camera communication (OCC) system was designed and implemented. The system jointly utilizes 4 intensity levels for each color and 3 colors of each RGB LED of a 16×16 LED array, resulting in a 64-ary color-intensity modulation (CIM) carrying on 6-bit coded information in each symbol. The LED array is refreshed at 82.5 Hz, and a FPGA controlled commercial CMOS image sensor from a mobile phone operates at a frame rate of 330 fps whose outputs are fed into a PC for real-time signal demodulation. Excluding 60 boarder LEDs and 4 spatial synchronization LEDs, the remaining 192 data-carrying LEDs are able to transmit data at an effective rate of about 95 kbps. Bit error rate below 10~3 over a communication distance up to 1.2 m is achieved without any external optical lens.

Optical Camera Communication: Principles and Applications

Optical Camera Communications: Survey, Use Cases, Challenges, and Future Trends

Some Practical Constraints and Solutions for Optical Camera Communication

Characterization of Optical Camera Communication Based on a Comprehensive System Model

Design and Implementation of a Hybrid Optical Camera Communication System for Indoor Applications

Effect of an image compression scheme on optical camera communication

Emerging Optical Wireless Communications-Advances and Challenges

Spatial division multiplexing of LED strips for optical camera communication

Investigating the angular distortion impact on vehicular optical camera communication (OCC) systems

Display Light Panel and Rolling Shutter Image Sensor Based Optical Camera Communication (OCC) Using Frame-Averaging Background Removal and Neural Network

Visible light communications: current challenges and prospects

A Comparative Survey of Optical Wireless Technologies: Architectures and Applications

Practical Optical Camera Communication Behind Unseen and Complex Backgrounds

Design and Implementation of a 2D MIMO OCC System Based on Deep Learning

Evolution of Short-Range Optical Wireless Communications

Optical Wireless Communication Systems, A Survey

Convolutional Neural Network-based Optical Camera Communication System for Internet of Vehicles

Motion-Aware Optical Camera Communication with Event Cameras

Frame-rate adaptive fractionally spaced equalization enabled high-throughput optical camera communication

Simplified model for non-line-of-sight optical camera communication with a simple patterned reflective surface

Design and Experimental Demonstration of a Real-Time 95kbps Optical Camera Communication System