Multi-sensor data fusion and modelling in mobile devices for enhanced user experience

Multi-sensor data fusion and modelling in mobile devices for enhanced user experienc

Development of a Full-Field Time-of-Flight Range Imaging System

A full-field, time-of-flight, image ranging system or 3D camera has been developed from a proof-of-principle to a working prototype stage, capable of determining the intensity and range for every pixel in a scene. The system can be adapted to the requirements of various applications, producing high precision range measurements with sub-millimetre resolution, or high speed measurements at video frame rates. Parallel data acquisition at each pixel provides high spatial resolution independent of the operating speed. The range imaging system uses a heterodyne technique to indirectly measure time of flight. Laser diodes with highly diverging beams are intensity modulated at radio frequencies and used to illuminate the scene. Reflected light is focused on to an image intensifier used as a high speed optical shutter, which is modulated at a slightly different frequency to that of the laser source. The output from the shutter is a low frequency beat signal, which is sampled by a digital video camera. Optical propagation delay is encoded into the phase of the beat signal, hence from a captured time variant intensity sequence, the beat signal phase can be measured to determine range for every pixel in the scene. A direct digital synthesiser (DDS) is designed and constructed, capable of generating up to three outputs at frequencies beyond 100 MHz with the relative frequency stability in excess of nine orders of magnitude required to control the laser and shutter modulation. Driver circuits were also designed to modulate the image intensifier photocathode at 50 Vpp, and four laser diodes with a combined power output of 320 mW, both over a frequency range of 10-100 MHz. The DDS, laser, and image intensifier response are characterised. A unique method of measuring the image intensifier optical modulation response is developed, requiring the construction of a pico-second pulsed laser source. This characterisation revealed deficiencies in the measured responses, which were mitigated through hardware modifications where possible. The effects of remaining imperfections, such as modulation waveform harmonics and image intensifier irising, can be calibrated and removed from the range measurements during software processing using the characterisation data. Finally, a digital method of generating the high frequency modulation signals using a FPGA to replace the analogue DDS is developed, providing a highly integrated solution, reducing the complexity, and enhancing flexibility. In addition, a novel modulation coding technique is developed to remove the undesirable influence of waveform harmonics from the range measurement without extending the acquisition time. When combined with a proposed modification to the laser illumination source, the digital system can enhance range measurement precision and linearity. From this work, a flexible full-field image ranging system is successfully realised. The system is demonstrated operating in a high precision mode with sub-millimetre depth resolution, and also in a high speed mode operating at video update rates (25 fps), in both cases providing high (512 512) spatial resolution over distances of several metres

Noncontact Vital Signs Detection

Human health condition can be accessed by measurement of vital signs, i.e., respiratory rate (RR), heart rate (HR), blood oxygen level, temperature and blood pressure. Due to drawbacks of contact sensors in measurement, non-contact sensors such as imaging photoplethysmogram (IPPG) and Doppler radar system have been proposed for cardiorespiratory rates detection by researchers.The UWB pulse Doppler radars provide high resolution range-time-frequency information. It is bestowed with advantages of low transmitted power, through-wall capabilities, and high resolution in localization. However, the poor signal to noise ratio (SNR) makes it challenging for UWB radar systems to accurately detect the heartbeat of a subject. To solve the problem, phased-methods have been proposed to extract the phase variations in the reflected pulses modulated by human tiny thorax motions. Advance signal processing method, i.e., state space method, can not only be used to enhance SNR of human vital signs detection, but also enable the micro-Doppler trajectories extraction of walking subject from UWB radar data.Stepped Frequency Continuous Wave (SFCW) radar is an alternative technique useful to remotely monitor human subject activities. Compared with UWB pulse radar, it relieves the stress on requirement of high sampling rate analog-to-digital converter (ADC) and possesses higher signal-to-noise-ratio (SNR) in vital signs detection. However, conventional SFCW radar suffers from long data acquisition time to step over many frequencies. To solve this problem, multi-channel SFCW radar has been proposed to step through different frequency bandwidths simultaneously. Compressed sensing (CS) can further reduce the data acquisition time by randomly stepping through 20% of the original frequency steps.In this work, SFCW system is implemented with low cost, off-the-shelf surface mount components to make the radar sensors portable. Experimental results collected from both pulse and SFCW radar systems have been validated with commercial contact sensors and satisfactory results are shown

Reproducing single-carrier digital modulation schemes for VLC by controlling the first switching harmonic of the dc-dc power converter output voltage ripple

A DC-DC power converter based on a two-phase synchronous buck converter that reproduces single-carrier digital modulation schemes by controlling the first switching harmonic of the output voltage ripple is presented in this work. The DC-DC power converter carries out both the lighting and the transmission functionalities of Visible Light Communication (VLC) transmitters. Control of both the amplitude and the phase of sinusoidal currents injected towards High-Brightness LEDs (HB-LEDs) enables the use of efficient modulation schemes such as Quadrature Amplitude Modulation (QAM), Carrier-less Amplitude and Phase modulation (CAP), Amplitude-Shift Keying (ASK) and Phase-Shift Keying (PSK). These modulation schemes achieve higher spectral efficiency (i.e. more data can be transmitted using the same bandwidth) than previously proposed modulation schemes performed by VLC transmitters based on the use of DC-DC power converters. To the author's knowledge, the ratio between the bit rate achieved and the switching frequency of the DC-DC power converter presented in this paper is the highest that can be found in literatur

NON-CONTACT TECHNIQUES FOR HUMAN VITAL SIGN DETECTION AND GAIT ANALYSIS

Human vital signs including respiratory rate, heart rate, oxygen saturation, blood pressure, and body temperature are important physiological parameters that are used to track and monitor human health condition. Another important biological parameter of human health is human gait. Human vital sign detection and gait investigations have been attracted many scientists and practitioners in various fields such as sport medicine, geriatric medicine, bio-mechanic and bio-medical engineering and has many biological and medical applications such as diagnosis of health issues and abnormalities, elderly care and health monitoring, athlete performance analysis, and treatment of joint problems. Thoroughly tracking and understanding the normal motion of human limb joints can help to accurately monitor human subjects or patients over time to provide early flags of possible complications in order to aid in a proper diagnosis and development of future comprehensive treatment plans. With the spread of COVID-19 around the world, it has been getting more important than ever to employ technology that enables us to detect human vital signs in a non-contact way and helps protect both patients and healthcare providers from potentially life-threatening viruses, and have the potential to also provide a convenient way to monitor people health condition, remotely. A popular technique to extract biological parameters from a distance is to use cameras. Radar systems are another attractive solution for non-contact human vital signs monitoring and gait investigation that track and monitor these biological parameters without invading people privacy. The goal of this research is to develop non-contact methods that is capable of extracting human vital sign parameters and gait features accurately. To do that, in this work, optical systems including cameras and proper filters have been developed to extract human respiratory rate, heart rate, and oxygen saturation. Feasibility of blood pressure extraction using the developed optical technique has been investigated, too. Moreover, a wideband and low-cost radar system has been implemented to detect single or multiple human subject’s respiration and heart rate in dark or from behind the wall. The performance of the implemented radar system has been enhanced and it has been utilized for non-contact human gait analysis. Along with the hardware, advanced signal processing schemes have been enhanced and applied to the data collected using the aforementioned radar system. The data processing algorithms have been extended for multi-subject scenarios with high accuracy for both human vital sign detection and gait analysis. In addition, different configurations of this and high-performance radar system including mono-static and MIMO have been designed and implemented with great success. Many sets of exhaustive experiments have been conducted using different human subjects and various situations and accurate reference sensors have been used to validate the performance of the developed systems and algorithms

Design, analysis and optimization of visible light communications based indoor access systems for mobile and internet of things applications

Demands for indoor broadband wireless access services are expected to outstrip the spectrum capacity in the near-term spectrum crunch . Deploying additional femtocells to address spectrum crunch is cost-inefficient due to the backhaul challenge and the exorbitant system maintenance. According to an Alcatel-Lucent report, most mobile Internet access traffic happens indoors. To alleviate the spectrum crunch and the backhaul challenge problems, visible light communication (VLC) emerges as an attractive candidate for indoor wireless access in the 5G architecture. In particular, VLC utilizes LED or fluorescent lamps to send out imperceptible flickering light that can be captured by a smart phone camera or photodetector. Leveraging power line communication and the available indoor infrastructure, VLC can be utilized with a small one-time cost. VLC also facilitates the great advantage of being able to jointly perform illumination and communications. Integration of VLC into the existing indoor wireless access networks embraces many challenges, such as lack of uplink infrastructure, excessive delay caused by blockage in heterogeneous networks, and overhead of power consumption. In addition, applying VLC to Internet-of-Things (IoT) applications, such as communication and localization, faces the challenges including ultra-low power requirement, limited modulation bandwidth, and heavy computation and sensing at the device end. In this dissertation, to overcome the challenges of VLC, a VLC enhanced WiFi system is designed by incorporating VLC downlink and WiFi uplink to connect mobile devices to the Internet. To further enhance robustness and throughput, WiFi and VLC are aggregated in parallel by leveraging the bonding technique in Linux operating system. Based on dynamic resource allocation, the delay performance of heterogeneous RF-VLC network is analyzed and evaluated for two different configurations - aggregation and non-aggregation. To mitigate the power consumption overhead of VLC, a problem of minimizing the total power consumption of a general multi-user VLC indoor network while satisfying users traffic demands and maintaining an acceptable level of illumination is formulated. The optimization problem is solved by the efficient column generation algorithm. With ultra-low power consumption, VLC backscatter harvests energy from indoor light sources and transmits optical signals by modulating the reflected light from a reflector. A novel pixelated VLC backscatter is proposed and prototyped to address the limited modulation bandwidth by enabling more advanced modulation scheme than the state-of-the-art on-off keying (OOK) scheme and allowing for the first time orthogonal multiple access. VLC-based indoor access system is also suitable for indoor localization due to its unique properties, such as utilization of existing ubiquitous lighting infrastructure, high location and orientation accuracy, and no interruption to RF-based devices. A novel retroreflector-based visible light localization system is proposed and prototyped to establish an almost zero-delay backward channel using a retroreflector to reflect light back to its source. This system can localize passive IoT devices without requiring computation and heavy sensing (e.g., camera) at the device end

Autonomous support for microorganism research in space

A preliminary design for performing on orbit, autonomous research on microorganisms and cultured cells/tissues is presented. An understanding of gravity and its effects on cells is crucial for space exploration as well as for terrestrial applications. The payload is designed to be compatible with the Commercial Experiment Transporter (COMET) launch vehicle, an orbiter middeck locker interface, and with Space Station Freedom. Uplink/downlink capabilities and sample return through controlled reentry are available for all carriers. Autonomous testing activities are preprogrammed with in-flight reprogrammability. Sensors for monitoring temperature, pH, light, gravity levels, vibrations, and radiation are provided for environmental regulation and experimental data collection. Additional experimental data acquisition includes optical density measurement, microscopy, video, and film photography. On-board full data storage capabilities are provided. A fluid transfer mechanism is utilized for inoculation, sampling, and nutrient replenishment of experiment cultures. In addition to payload design, representative experiments were developed to ensure scientific objectives remained compatible with hardware capabilities. The project is defined to provide biological data pertinent to extended duration crewed space flight including crew health issues and development of a Controlled Ecological Life Support System (CELSS). In addition, opportunities are opened for investigations leading to commercial applications of space, such as pharmaceutical development, modeling of terrestrial diseases, and material processing