Unleashing the Power of LED-to-Camera Communications for IoT Devices

International audienceIn this paper, we propose a line of sight LED-to-camera communication system based on a small color LED and a smartphone. We design a cheap prototype as proof of concept of a near communication framework for the Internet of Things. We evaluate the system performance, its reliability and the environment influence on the LED-to-camera communication, highlighting that a throughput of a few kilobits per second is reachable. Finally, we design a real time, efficient LED detection and image processing algorithm to leverage the specific issues encountered in the system

Optical autonomous sensor module communicating with a smartphone using its camera

Wireless optical communication is a viable alternative to conventional RF technology. Our novel design combines optical communication and energy harvesting in one device with a size of 30 x 10 x 5 mm using the latest innovations in lowpower electronics and solar cell technology. In our study, we implement visible light communication between a sensor module and a smartphone. The proposed system design and a communication protocol are specifically developed for environments with illumination levels of 100-500 lux, like industrial halls. The sensor integrated into the module can vary according to application requirements. As an example, in our work, we use a temperature and pressure sensor and an accelerometer. A bright flash from a smartphones build-in LED activates the module. The module takes measurements and sends the result in form of an optical data signal, which is then received by the smartphone camera. This technique is able to provide reliable communication despite low-power restrictions of energy harvesting. By using a smartphone this approach offers more convenience to a user and enables flexible deployment of the modules in industrial machinery. © 2019 SPIE

Decoding Methods in LED-to-Smartphone Bidirectional Communication for the IoT

International audienceThe use of visible light for bidirectional communication between regular smartphones and the small LEDs integrated in most consumer electronics nowadays raises new challenges. In this paper, we enhance the state of the art with an efficient image processing algorithm to accurately detect the LEDs and decode their signal in real time. To enable flash-to-LED communication on non-rooted smartphones, we propose encoding and decoding methods that cope with the inaccurate flashlight clock rate

CamComSim: un simulateur de communication LED vers camera

In this paper, we present CamComSim, the first simulator for development and rapidprototyping of LED-to-Camera communication systems. Our event driven simulator relies on astandalone Java application that is easily extensible through a set of interfaces. A range of lowand high-level parameters, such as the camera characteristics, the physical layer data unit size, orthe redundancy mechanism can be chosen. CamComSim uses empirically validated models for theLED-to-Camera channel and the broadcast protocols, configurable with a finely grained precision.To validate CamComSim implementation and accuracy, we use a real life testbed based on a colorLED and a smartphone and compare the performance reached by the testbed with the resultsgiven by our simulator. We illustrate with a real use case the full usage of CamComSim, tuninga broadcast protocol that implements the transmission of 1 kbyte of information. The resultshighlight that our simulator is very precise and predicts the performance of a real LED-to-Camerasystem with less than 10% of error in most cases.Dans cet article, nous présentons CamComSim, le premier simulateur de systèmesde communication par lumière visible d’une LED vers une caméra. Notre simulateur repose surune application Java autonome qui est facilement extensible grâce un ensemble d’interfaces. Denombreux paramètres bas et haut niveau, tels que les caractéristiques de la caméra, la taille destrames PHY ou le mécanisme de redondance utilisé peuvent être choisis. CamComSim utilise desmodèles de canal et de protocole de broadcast validés empiriquement, et finement configurable.Pour valider l’implémentation et la précision de CamComSim, nous utilisons un banc de testbasé sur une LED couleur et un smartphone et comparons les performances obtenues par le bancde test avec les résultats fournis par notre simulateur. Nous illustrons avec un cas d’utilisationréel l’utilisation de CamComSim, en ajustant les paramètres d’un protocole de broadcast lors dela transmission de 1 Ko d’information. Les résultats mettent en évidence que notre simulateurest très précis et prédit les performances d’un vrai système LED vers caméra avec moins de 10

Etäisyyden huomioiva kaksiulotteinen viivakoodi mobiilikäyttötapauksiin

Global internet use is becoming increasingly mobile, and mobile data usage is growing exponentially. This puts increasing stress on the radio frequency spectrum that cellular and Wi-Fi networks use. As a consequence, research has also been conducted to develop wireless technologies for other parts of the electromagnetic spectrum – namely, visible light. One approach of using the visible light channel for wireless communication leverages barcodes. In this thesis, we propose a 2D barcode that can display different information based on the distance between the barcode and the scanner. Earlier research on distance-sensitive barcodes has focused on providing a closer viewer more information as a closer viewer can see more detail. In contrast, we target use cases where a clear physical separation between users of different roles can be made, such as presentation systems. We evaluate two methods of achieving distance-awareness: color-shifting of individual colors, where a color changes tone at longer distances, and color blending, where two colors blend into a third color at longer viewing distances. Our results show that a modern smartphone is capable of leveraging color-shifting in ideal conditions, but external changes such as ambient lighting render color-shifting unusable in practical scenarios. On the other hand, color blending is robust in varying indoor conditions and can be used to construct a reliable distance-aware barcode. Accordingly, we employ color blending to design a distance-aware barcode. We implement our solution in an off-the-shelf Android smartphone. Experimental results show that our scheme achieves a clear separation between close and far viewers. As a representative use case, we also implement a presentation system where a single barcode provides the presenter access to presentation tools and the audience access to auxiliary presentation material.Maailmanlaajuinen internetin käyttö muuttuu yhä liikkuvammaksi, ja mobiilidatan käyttö kasvaa eksponentiaalisesti. Tämä kohdistaa yhä suurempia vaatimuksia radiotaajuusspektriin, jota mobiili- ja Wi-Fi-verkot käyttävät. Näin ollen tutkijat ovat kehittäneet langattomia teknologioita hyödyntäen myös muita sähkömagneettisen spektrin osia – erityisesti näkyvää valoa. Yksi näkyvän valon sovellus langattomassa viestinnässä ovat viivakoodit. Tässä työssä kehitämme kaksiulotteisen viivakoodin, joka pystyy välittämään eri tietoa katselijoille eri etäisyyksillä. Aiempi etäisyyden huomioivien viivakoodien tutkimus on keskittynyt tarjoamaan lähellä olevalle katselijalle enemmän tietoa, koska läheinen katselija näkee viivakoodin tarkemmin. Sitä vastoin me keskitymme käyttötapauksiin, joissa eri käyttäjäroolien välillä on selkeä etäisyydellinen ero, kuten esimerkiksi esitelmissä puhujan ja yleisön välillä. Tarkastelemme kahta menetelmää: yksittäisten värien muutoksia etäisyyden muuttuessa ja kahden värin sekoittumista etäisyyden kasvaessa. Tulostemme perusteella nykyaikainen älypuhelin pystyy hyödyntämään yksittäisten värien muutoksia ihanteellisissa olosuhteissa, mutta ulkoiset tekijät, kuten ympäristön valaistus, aiheuttavat liian suuria värimuutoksia käytännön käyttötapauksissa. Toisaalta värien sekoittuminen on johdonmukaista muuttuvassa sisäympäristössä ja sitä voidaan käyttää luotettavan viivakoodin luomisessa. Näin ollen me suunnittelemme etäisyyden huomioivan viivakoodin hyödyntäen värien sekoittumista. Toteutamme ratkaisumme yleisesti saatavilla olevalle Android-älypuhelimelle. Kokeellisten tulostemme perusteella menetelmämme saavuttaa selkeän erottelun läheisten ja kaukaisten katselijoiden välillä. Esimerkkikäyttötapauksena toteutamme myös esitelmäjärjestelmän, jossa sama viivakoodi antaa lähellä olevalle puhujalle nopean pääsyn esitystyökaluihin ja kauempana olevalle yleisölle pääsyn esityksen apumateriaaliin

A Survey of Positioning Systems Using Visible LED Lights

© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.As Global Positioning System (GPS) cannot provide satisfying performance in indoor environments, indoor positioning technology, which utilizes indoor wireless signals instead of GPS signals, has grown rapidly in recent years. Meanwhile, visible light communication (VLC) using light devices such as light emitting diodes (LEDs) has been deemed to be a promising candidate in the heterogeneous wireless networks that may collaborate with radio frequencies (RF) wireless networks. In particular, light-fidelity has a great potential for deployment in future indoor environments because of its high throughput and security advantages. This paper provides a comprehensive study of a novel positioning technology based on visible white LED lights, which has attracted much attention from both academia and industry. The essential characteristics and principles of this system are deeply discussed, and relevant positioning algorithms and designs are classified and elaborated. This paper undertakes a thorough investigation into current LED-based indoor positioning systems and compares their performance through many aspects, such as test environment, accuracy, and cost. It presents indoor hybrid positioning systems among VLC and other systems (e.g., inertial sensors and RF systems). We also review and classify outdoor VLC positioning applications for the first time. Finally, this paper surveys major advances as well as open issues, challenges, and future research directions in VLC positioning systems.Peer reviewe

A reliable asynchronous protocol for VLC communications based on the rolling shutter effect

In this paper we introduce a novel reliable asynchronous protocol that allows to establish a VLC link between a LED luminary and an off-the- shelf smartphone. Our protocol and decoding algorithms benefit from the access to advanced camera settings available in the latest generations of mobile devices to outperform previous VLC designs in the state of the art. In particular, in the paper we provide an experimental evaluation using a commercial Nexus 5 device where it is shown how our designed prototype can achieve transmission speeds of up to 700 bps and operating distances of up to 3 meters. The previous performance figures have the potential to spark a wide set of novel applications

Visible Light and Camera-based Receiver Employing Machine Learning for Indoor Positioning Systems and Data Communications

Indoor location-based services have played a crucial role in the development of various Internet of Things applications over the last few decades. The use of radio frequency (RF)-based systems in indoor environments suffers from additional interference due to the high penetration rate and reflections of the RF, which may severely affect positioning accuracy. Alternatively, the optical technology using the existing light-emitting diode (LED)-based lights, photodetectors (PDs), and/or image sensors could be utilised to provide indoor positioning with high accuracy. Because of its resilience to electromagnetic interference, license-free operation, large bandwidth, and dual-use for illumination and communication, visible light positioning (VLP) systems have shown great potential in achieving high-precision indoor positioning. This thesis focus is on investigating VLP systems based on employing a single PD, or an array of PDs in the form of a single image sensor (i.e. a camera) for both localization and data communication. Following a comprehensive literature review on VLP, the key challenges in existing positioning methods for achieving a low-cost, accurate, and less complex indoor positioning systems design are highlighted by considering the design characteristics of an indoor environment, position accuracy, number of light-emitting LED, PD, and any additional sensors utilized. The thesis focuses on the major constraints of VLP and provides novel contributions. In most reported VLP schemes, the assumptions of fixed transmitter (Tx) angle and height may not be valid in many physical environments. In this work, the impact of tilting Tx and multipath reflections are investigated. The findings demonstrated that tilting Tx can be beneficial in VLP by leveraging the influence of reflections from both near- and far-walls. It also showed that proposed system offers a significant accuracy improvement by up to ~66% compared with a typical non-tilted Tx VLP system.Furthermore, increasing robustness of image sensor-based receiver (Rx) is a major challenge, which is being addressed using a novel angle of arrival-received signal intensity and a single LED. Experimental results show that the proposed algorithm can achieve a three-dimensional root mean squared error of 7.56 cm. Visible light communications employing a camera-based Rx is best known as optical camera communications (OCC), which can also be used for VLP. However, in OCC the transmission data rate is mainly limited by the exposure time and the frame rate of the camera. In addition, the camera's sampling introduces intersymbol interference Indoor location-based services have played a crucial role in the development of various Internet of Things applications over the last few decades. The use of radio frequency (RF)-based systems in indoor environments suffers from additional interference due to the high penetration rate and reflections of the RF, which may severely affect positioning accuracy. Alternatively, the optical technology using the existing light-emitting diode (LED)-based lights, photodetectors (PDs), and/or image sensors could be utilised to provide indoor positioning with high accuracy. Because of its resilience to electromagnetic interference, license-free operation, large bandwidth, and dual-use for illumination and communication, visible light positioning (VLP) systems have shown great potential in achieving high-precision indoor positioning. This thesis focus is on investigating VLP systems based on employing a single PD, or an array of PDs in the form of a single image sensor (i.e. a camera) for both localization and data communication. Following a comprehensive literature review on VLP, the key challenges in existing positioning methods for achieving a low-cost, accurate, and less complex indoor positioning systems design are highlighted by considering the design characteristics of an indoor environment, position accuracy, number of light-emitting LED, PD, and any additional sensors utilized. The thesis focuses on the major constraints of VLP and provides novel contributions. In most reported VLP schemes, the assumptions of fixed transmitter (Tx) angle and height may not be valid in many physical environments. In this work, the impact of tilting Tx and multipath reflections are investigated. The findings demonstrated that tilting Tx can be beneficial in VLP by leveraging the influence of reflections from both near- and far-walls. It also showed that proposed system offers a significant accuracy improvement by up to ~66% compared with a typical non-tilted Tx VLP system.Furthermore, increasing robustness of image sensor-based receiver (Rx) is a major challenge, which is being addressed using a novel angle of arrival-received signal intensity and a single LED. Experimental results show that the proposed algorithm can achieve a three-dimensional root mean squared error of 7.56 cm. Visible light communications employing a camera-based Rx is best known as optical camera communications (OCC), which can also be used for VLP. However, in OCC the transmission data rate is mainly limited by the exposure time and the frame rate of the camera. In addition, the camera's sampling introduces intersymbol interference