Image sensor communication
April 01, 2021

Image sensor communication

We conduct research on image-sensor communication (ISC), one of the visible light communication (VLC) system.



Visible light communication

The 2014 Nobel Prize in Physics has been awarded for the invention of blue light-emitting diodes (LEDs). Meanwhile, it is generally recognized that LEDs offer a new and revolutionary light source that saves energy. The LED market continues to grow, with LEDs successfully competing with conventional light sources used in traffic signals and pedestrian lights, electronic signage boards, street and area lights, automotive headlights, and brake lights.

Visible light communication (VLC) uses LEDs not only to provide light but also to broadcast data. Because LEDs are solid-state lighting devices, they can be modulated at a high speed that cannot be detected by the human eye. In fact, LED traffic lights in Japan blink at a rate that is twice the rate of the AC line, 100 Hz in eastern Japan and 120 Hz in western Japan. The LED headlights in the new Lexus cars also blink at the rate of several hundred Hertz. If LEDs already blink at a fast rate, why not send information by controlling the blinking pattern according to the data to be transmitted?

VLC and its application to intelligent transport systems

The widespread use of LEDs in traffic applications and the growing interest in intelligent transport systems (ITS) present many opportunities for VLC applications. Data transmission using LED traffic and brake lights is a typical application. Previous studies have documented the effectiveness of vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) communication using radio technology for improving automotive safety. These communication systems are called V2X.

In V2X systems, VLC can offer several advantages. Because VLC links are based on visible light, the installation of roadside equipment is much easier. In addition, previously installed facilities, such as LED traffic lights or LED signboards, can be used. Furthermore, since the transmitters or LED light sources are designed for lighting purposes (and thus generally have high radiation power), the SNR is high for VLC, and eye safety is maintained for this “dual-use” lighting, which is defined here as VLC incorporated with LED illumination. Simultaneous data transmission and range estimation are possible.

We have conducted research on VLC, especially for VLC application to ITS, in particular, (a) infrastructure-to-vehicle VLC (I2V-VLC), (b) V2I-VLC, and (c) V2V-VLC.

Image-sensor communications

Visible-light communication systems that utilize image sensors as reception devices are referred to as image-sensor communication (ISC) systems.

Nowadays, every smartphone and portable device is equipped with a camera, and the heart of these image-capturing devices is an image sensor. ISC utilize the image sensor as a reception device of a visible-light-modulated signal.

In general, a photodiode (PD) is used as a reception device of the visible-light signal. However, in a vehicular environment when cars are moving, the PD may receive not only the desired visible-light sources but also various noise sources such as sunlight, streetlights, and other ambient lights and LED transmission sources. As results, all background lights in the field of view (FOV) are summed up as noise, and the received SNR becomes severely low.

To remove such enormous amount of noise signals, one may use an optical band-pass filter (OBPF). However, the direct sunlight is typically strong and can often be received at an average power that is much higher than that of the desired signal. A telephoto lens that achieves an extremely narrow FOV can be used, but such a receiver requires complex mechanical tracking, which makes it unsuitable for mobile usage.

A suitable reception device for the VLC signal in an outdoor mobile environment is an image sensor. An image sensor comprises a massive number of PDs called pixels, typically organized in an orthogonal grid. The PD outputs, often referred to as luminance, are arranged in a square matrix forming a digital electronic representation of the scene. In other words, each pixel represents one spatially separated source. This spatial separation feature of the image sensor can easily discard the noise sources and focus only on a desired visible-light signal.

A particular advantage of complementary metal-oxide-semiconductor image-sensor usage is, owing to the massive number of pixels available, its ability to spatially separate sources. Here the sources include both noise sources, such as sunlight, streetlights, and other ambient lights and LED transmission sources. The ability to spatially separate sources also provides an additional feature to VLC, in particular, the ability to receive and process multiple transmitting sources.

Toward the widespread use of visible light communication and optical wireless communication technologies

Yamazato Laboratory provides technical support for the OWC Workshops held at the Global Communications Conference (Globecom) and the International Conference on Communications (ICC) organized by the Institute of Electrical and Electronics Engineers (IEEE). The OWC Workshops contribute to optical wireless and visible light communication research.

We have hosted the OWC Workshop web page in red.

VTC Workshop

ISCC Workshop

ICC Workshops

  • First held at London, UK, June. 8, 2015.
  • Second held at Kuala Lumpur, Malaysia, May 23, 2016
  • Third held at Paris, France, May 21, 2017
  • Fourth held at Kansas City, USA, May 20, 2018
  • Fifth held at Shanghai, China, May 24, 2019
  • Sixth held at Dublin, Ireland, June 7, 2020
  • Seventh held at ICC 2022, Seoul, Korea, May 20, 2022

Globecom Workshops

  • First held at Globecom 2010, Miami, USA, 6 – 10 December 2010
  • Second held at Globecom 2011, Houston TX, USA, 5 December 2011
  • Third held at Globecom 2012, Anaheim, CA, USA, Dec 3, 2012
  • Fourth held at Globecom 2013, Atlanta, GA, USA, Dec 9, 2013
  • Fifth held at Globecom 2014, Austin, TX, USA, Dec 8, 2014
  • Sixth held at Globecom 2015, San Diego, CA, USA, Dec 6, 2015
  • Seventh held at Globecom 2017, Singapore, Singapore, Dec 8, 2017
  • Eighth held at Globecom 2018, Abu Dhabi, UAE, Dec 9, 2018
  • Ninth held at Globecom 2020, Taipei, Taiwan, Monday, Dec 7, 2020

IECVLC2018

In addition, we have hosted the 2nd ICEVLC organized by the Visible Light Communications Association of Japan (now the Visible Light Communications Subcommittee of the Photonics Council of Japan).