Distributed Fiber Ultrasonic Sensor and Pattern Recognition Analytics

Ultrasound interrogation and structural health monitoring technologies have found a wide array of applications in the health care, aerospace, automobile, and energy sectors. To achieve high spatial resolution, large array electrical transducers have been used in these applications to harness sufficient data for both monitoring and diagnoses. Electronic-based sensors have been the standard technology for ultrasonic detection, which are often expensive and cumbersome for use in large scale deployments. Fiber optical sensors have advantageous characteristics of smaller cross-sectional area, humidity-resistance, immunity to electromagnetic interference, as well as compatibility with telemetry and telecommunications applications, which make them attractive alternatives for use as ultrasonic sensors. A unique trait of fiber sensors is its ability to perform distributed acoustic measurements to achieve high spatial resolution detection using a single fiber. Using ultrafast laser direct-writing techniques, nano-reflectors can be induced inside fiber cores to drastically improve the signal-to-noise ratio of distributed fiber sensors. This dissertation explores the applications of laser-fabricated nano-reflectors in optical fiber cores for both multi-point intrinsic Fabry–Perot (FP) interferometer sensors and a distributed phase-sensitive optical time-domain reflectometry (φ-OTDR) to be used in ultrasound detection. Multi-point intrinsic FP interferometer was based on swept-frequency interferometry with optoelectronic phase-locked loop that interrogated cascaded FP cavities to obtain ultrasound patterns. The ultrasound was demodulated through reassigned short time Fourier transform incorporating with maximum-energy ridges tracking. With tens of centimeters cavity length, this approach achieved 20kHz ultrasound detection that was finesse-insensitive, noise-free, high-sensitivity and multiplex-scalability. The use of φ-OTDR with enhanced Rayleigh backscattering compensated the deficiencies of low inherent signal-to-noise ratio (SNR). The dynamic strain between two adjacent nano-reflectors was extracted by using 3×3 coupler demodulation within Michelson interferometer. With an improvement of over 35 dB SNR, this was adequate for the recognition of the subtle differences in signals, such as footstep of human locomotion and abnormal acoustic echoes from pipeline corrosion. With the help of artificial intelligence in pattern recognition, high accuracy of events’ identification can be achieved in perimeter security and structural health monitoring, with further potential that can be harnessed using unsurprised learning

Unscented Particle Filtering Algorithm for Optical-fiber Sensing Intrusion Localization Based on Particle Swarm Optimization

To improve the convergence and precision of intrusion localization in optical-fiber sensing perimeter protection applications, we present an algorithm based on an unscented particle filter (UPF). The algorithm employs particle swarm optimization (PSO) to mitigate the sample degeneracy and impoverishment problem of the particle filter. By comparing the present fitness value of particles with the optimum fitness value of the objective function, PSO moves particles with insignificant UPF weights towards the higher likelihood region and determines the optimal positions for particles with larger weights. The particles with larger weights results in a new sample set with a more balanced distribution between the priors and the likelihood. Simulations demonstrate that the algorithm speeds up convergence and improves the precision of intrusion localization

An Overview on Application of Machine Learning Techniques in Optical Networks

Today's telecommunication networks have become sources of enormous amounts of widely heterogeneous data. This information can be retrieved from network traffic traces, network alarms, signal quality indicators, users' behavioral data, etc. Advanced mathematical tools are required to extract meaningful information from these data and take decisions pertaining to the proper functioning of the networks from the network-generated data. Among these mathematical tools, Machine Learning (ML) is regarded as one of the most promising methodological approaches to perform network-data analysis and enable automated network self-configuration and fault management. The adoption of ML techniques in the field of optical communication networks is motivated by the unprecedented growth of network complexity faced by optical networks in the last few years. Such complexity increase is due to the introduction of a huge number of adjustable and interdependent system parameters (e.g., routing configurations, modulation format, symbol rate, coding schemes, etc.) that are enabled by the usage of coherent transmission/reception technologies, advanced digital signal processing and compensation of nonlinear effects in optical fiber propagation. In this paper we provide an overview of the application of ML to optical communications and networking. We classify and survey relevant literature dealing with the topic, and we also provide an introductory tutorial on ML for researchers and practitioners interested in this field. Although a good number of research papers have recently appeared, the application of ML to optical networks is still in its infancy: to stimulate further work in this area, we conclude the paper proposing new possible research directions

Machine Learning for Optical Network Security Monitoring: A Practical Perspective

In order to accomplish cost-efficient management of complex optical communication networks, operators are seeking automation of network diagnosis and management by means of Machine Learning (ML). To support these objectives, new functions are needed to enable cognitive, autonomous management of optical network security. This paper focuses on the challenges related to the performance of ML-based approaches for detectionand localization of optical-layer attacks, and to their integration with standard Network Management Systems (NMSs). We propose a framework for cognitive security diagnostics that comprises an attack detection module with Supervised Learning (SL), Semi-Supervised Learning (SSL) and Unsupervised Learning (UL) approaches, and an attack localization module that deduces the location of a harmful connection and/or a breached link. The influence of false positives and false negatives is addressed by a newly proposed Window-based Attack Detection (WAD) approach. We provide practical implementation\ua0guidelines for the integration of the framework into the NMS and evaluate its performance in an experimental network testbed subjected to attacks, resulting with the largest optical-layer security experimental dataset reported to date

Data-Driven Distributed Optical Vibration Sensors: A Review

Distributed optical vibration sensors (DOVS) have attracted much attention recently since it can be used to monitor mechanical vibrations or acoustic waves with long reach and high sensitivity. Phase-sensitive optical time domain reflectometry (Φ-OTDR) is one of the most commonly used DOVS schemes. For Φ-OTDR, the whole length of fiber under test (FUT) works as the sensing instrument and continuously generates sensing data during measurement. Researchers have made great efforts to try to extract external intrusions from the redundant data. High signal-to-noise ratio (SNR) is necessary in order to accurately locate and identify external intrusions in Φ-OTDR systems. Improvement in SNR is normally limited by the properties of light source, photodetector and FUT. But this limitation can also be overcome by post-processing of the received optical signals. In this context, detailed methodologies of SNR enhancement post-processing algorithms in Φ-OTDR systems have been described in this paper. Furthermore, after successfully locating the external vibrations, it is also important to identify the types of source of the vibrations. Pattern classification is a powerful tool in recognizing the intrusion types from the vibration signals in practical applications. Recent reports of Φ-OTDR systems employed with pattern classification algorithms are subsequently reviewed and discussed. This thorough review will provide a design pathway for improving the performance of Φ-OTDR while maintaining the cost of the system as no additional hardware is required

Aplicações De Métodos De Sensoriamento De Vibração Baseados Em Técnicas

Orientadores: Fabiano Fruett, Claudio FloridiaTese (doutorado) - Universidade Estadual de Campinas, Faculdade de Engenharia Elétrica e de ComputaçãoResumo: Sensores à fibra óptica distribuídos têm sido empregados para monitorar vários parâmetros, tais como temperatura, vibração, tensão mecânica, campo magnético e corrente elétrica. Quando comparados a outras técnicas convencionais, tais sensores são vantajosos devido a suas pequenas dimensões, imunidade a interferências eletromagnéticas, alta adaptabilidade, robustez a ambientes nocivos, dentre outros. Sensores acústicos distribuídos em particular são interessantes devido a sua capacidade em serem usados em aplicações tais como monitoração de saúde de estruturas e vigilância de perímetros. Através da análise em frequência da estrutura, por exemplo uma aeronave, uma ponte, um edifício ou mesmo máquinas em uma fábrica, é possível avaliar sua condição e detectar danos e falhas em um estágio primário. Tais soluções podem cobrir ambas as aplicações de detecção de intrusão e monitoração estrutural com mínimas adaptações no sistema sensor. Desta forma, vibrações e distúrbios pequenas estruturas com resolução de dezenas de centímetros e em grandes estruturas ou perímetros com alguns metros de resolução espacial e centenas de quilômetros de alcance podem ser detectadas. Outra característica útil desta solução baseada em fibra óptica é a possibilidade de ser combinada com técnicas de processamento digital de sinais, permitindo a detecção e localização de perturbações rápidas, reconhecimento de padrões de intrusão em tempo real e multiplexação de dados de superfícies estruturais para aplicações SHM. O principal objetivo desta tese é fazer uso desses recursos para empregar técnicas de DAS como soluções de tecnologias- chave para várias aplicações. Neste trabalho, as técnicas de phase-OTDR foram estudadas e as principais contribuições da tese focaram em trazer soluções inovadoras e validações para aplicações de vigilância e vigilância. Este doutorado teve um período sanduíche nas instalações da RISE Acreo AB, Estocolmo, Suécia, onde experimentos foram realizados e foi parte da 42ª Chamada CISB/Saab/CNPqAbstract: Distributed optical fiber sensors have been increasingly employed for monitoring several parameters, such as temperature, vibration, strain, magnetic field and current. When compared to other conventional techniques, these sensors are advantageous due to their small dimensions, lightweight, immunity to electromagnetic interference, high adaptability, robustness to hazardous environments, less complex data multiplexing, the feasibility to be embedded into structures with minimum invasion, the capability to extract data with high resolution from long perimeters using a single optical fiber and detect multiple events along the fiber. In particular, distributed acoustic sensors (DAS) based on optical time domain reflectometry (OTDR), are of high interest, due to their capability to be used in applications such as structural health monitoring (SHM) and perimeter surveillance. Through the frequency analysis of a structure, for instance an aircraft, a bridge, a building or even machines in a workshop, it is possible to evaluate its condition and detect damages and failures at an early stage. Also, OTDR based solutions for vibration monitoring can be easily adapted with minimum setup modifications to detect intrusion in a perimeter, a useful tool for surveillance of military facilities, laboratories, power plants and homeland security. The same OTDR technique can be used as a non-destructive diagnostic tool to evaluate vibrations and disturbances on both small structures with some dozens of centimeters¿ resolution and in big structures or perimeters with some meters of spatial resolution and hundreds of kilometers of reach. Another useful feature of this optical fiber based solution is the possibility to be combined with high-performance digital signal processing techniques, enabling fast disturbance detection and location, real-time intrusion pattern recognition and fast data multiplexing of structure surfaces for SHM applications. The main goal of this thesis is to make use of these features to employ DAS techniques as key enabling technologies solutions for several applications. In this work, OTDR based techniques were studied and the thesis main contributions were focused on bringing innovative solutions and validations for SHM and surveillance applications. This PhD had a sandwich period at Acreo AB, Stockholm, Sweden, where experimental tests were performed and it was part of the 42ª CISB/Saab/CNPq CalDoutoradoEletrônica, Microeletrônica e OptoeletrônicaDoutora em Engenharia Elétrica202816/2015-0CAPESCNP

A Contextual GMM-HMM Smart Fiber Optic Surveillance System for Pipeline Integrity Threat Detection

This paper presents a novel pipeline integrity surveillance system aimed to the detection and classification of threats in the vicinity of a long gas pipeline. The sensing system is based on phase-sensitive optical time domain reflectometry ( $\phi$ -OTDR) technology for signal acquisition and pattern recognition strategies for threat identification. The proposal incorporates contextual information at the feature level in a Gaussian Mixture Model-Hidden Markov Model (GMM-HMM)-based pattern classification system and applies a system combination strategy for acoustic trace decision. System combination relies on majority voting of the decisions given by the individual contextual information sources and the number of states used for HMM modelling. The system runs in two different modes: (1) machine+activity identification, which recognizes the activity being carried out by a certain machine, and (2) threat detection, aimed to detect threats no matter what the real activity being conducted is. In comparison with the previous systems based on the same rigorous experimental setup, the results show that the system combination from the contextual feature information and the GMM-HMM approach improves the results for both machine+activity identification (7.6% of relative improvement with respect to the best published result in the literature on this task) and threat detection (26.6% of relative improvement in the false alarm rate with 2.1% relative reduction in the threat detection rate).European CommissionMinisterio de Economía y CompetitividadComunidad de Madri

Advances in Computer Recognition, Image Processing and Communications, Selected Papers from CORES 2021 and IP&C 2021

As almost all human activities have been moved online due to the pandemic, novel robust and efficient approaches and further research have been in higher demand in the field of computer science and telecommunication. Therefore, this (reprint) book contains 13 high-quality papers presenting advancements in theoretical and practical aspects of computer recognition, pattern recognition, image processing and machine learning (shallow and deep), including, in particular, novel implementations of these techniques in the areas of modern telecommunications and cybersecurity

One-Dimensional Sensor Learns to Sense Three-Dimensional Space

A sensor system with ultra-high sensitivity, high resolution, rapid response time, and a high signal-to-noise ratio can produce raw data that is exceedingly rich in information, including signals that have the appearances of noise . The noise feature directly correlates to measurands in orthogonal dimensions, and are simply manifestations of the off-diagonal elements of 2nd-order tensors that describe the spatial anisotropy of matter in physical structures and spaces. The use of machine learning techniques to extract useful meanings from the rich information afforded by ultra-sensitive one-dimensional sensors may offer the potential for probing mundane events for novel embedded phenomena. Inspired by our very recent invention of ultra-sensitive optical-based inclinometers, this work aims to answer a transformative question for the first time: can a single-dimension point sensor with ultra-high sensitivity, fidelity, and signal-to-noise ratio identify an arbitrary mechanical impact event in three-dimensional space? This work is expected to inspire researchers in the fields of sensing and measurement to promote the development of a new generation of powerful sensors or sensor networks with expanded functionalities and enhanced intelligence, which may provide rich n-dimensional information, and subsequently, data-driven insights into significant problems

Multi-wavelength, multi-beam, photonic based sensor for object discrimination and positioning

Over the last decade, substantial research efforts have been dedicated towards the development of advanced laser scanning systems for discrimination in perimeter security, defence, agriculture, transportation, surveying and geosciences. Military forces, in particular, have already started employing laser scanning technologies for projectile guidance, surveillance, satellite and missile tracking; and target discrimination and recognition. However, laser scanning is relatively a new security technology. It has previously been utilized for a wide variety of civil and military applications. Terrestrial laser scanning has found new use as an active optical sensor for indoors and outdoors perimeter security. A laser scanning technique with moving parts was tested in the British Home Office - Police Scientific Development Branch (PSDB) in 2004. It was found that laser scanning has the capability to detect humans in 30m range and vehicles in 80m range with low false alarm rates. However, laser scanning with moving parts is much more sensitive to vibrations than a multi-beam stationary optic approach. Mirror device scanners are slow, bulky and expensive and being inherently mechanical they wear out as a result of acceleration, cause deflection errors and require regular calibration. Multi-wavelength laser scanning represent a potential evolution from object detection to object identification and classification, where detailed features of objects and materials are discriminated by measuring their reflectance characteristics at specific wavelengths and matching them with their spectral reflectance curves. With the recent advances in the development of high-speed sensors and high-speed data processors, the implementation of multi-wavelength laser scanners for object identification has now become feasible. A two-wavelength photonic-based sensor for object discrimination has recently been reported, based on the use of an optical cavity for generating a laser spot array and maintaining adequate overlapping between tapped collimated laser beams of different wavelengths over a long optical path. While this approach is capable of discriminating between objects of different colours, its main drawback is the limited number of security-related objects that can be discriminated. This thesis proposes and demonstrates the concept of a novel photonic based multi-wavelength sensor for object identification and position finding. The sensor employs a laser combination module for input wavelength signal multiplexing and beam overlapping, a custom-made curved optical cavity for multi-beam spot generation through internal beam reflection and transmission and a high-speed imager for scattered reflectance spectral measurements. Experimental results show that five different laser wavelengths, namely 473nm, 532nm, 635nm, 670nm and 785nm, are necessary for discriminating various intruding objects of interest through spectral reflectance and slope measurements. Various objects were selected to demonstrate the proof of concept. We also demonstrate that the object position (coordinates) is determined using the triangulation method, which is based on the projection of laser spots along determined angles onto intruding objects and the measurement of their reflectance spectra using an image sensor. Experimental results demonstrate the ability of the multi-wavelength spectral reflectance sensor to simultaneously discriminate between different objects and predict their positions over a 6m range with an accuracy exceeding 92%. A novel optical design is used to provide additional transverse laser beam scanning for the identification of camouflage materials. A camouflage material is chosen to illustrate the discrimination capability of the sensor, which has complex patterns within a single sample, and is successfully detected and discriminated from other objects over a 6m range by scanning the laser beam spots along the transverse direction. By using more wavelengths at optimised points in the spectrum where different objects show different optical characteristics, better discrimination can be accomplished