Transfer Learning for Device Fingerprinting with Application to Cognitive Radio Networks

Primary user emulation (PUE) attacks are an emerging threat to cognitive radio (CR) networks in which malicious users imitate the primary users (PUs) signals to limit the access of secondary users (SUs). Ascertaining the identity of the devices is a key technical challenge that must be overcome to thwart the threat of PUE attacks. Typically, detection of PUE attacks is done by inspecting the signals coming from all the devices in the system, and then using these signals to form unique fingerprints for each device. Current detection and fingerprinting approaches require certain conditions to hold in order to effectively detect attackers. Such conditions include the need for a sufficient amount of fingerprint data for users or the existence of both the attacker and the victim PU within the same time frame. These conditions are necessary because current methods lack the ability to learn the behavior of both SUs and PUs with time. In this paper, a novel transfer learning (TL) approach is proposed, in which abstract knowledge about PUs and SUs is transferred from past time frames to improve the detection process at future time frames. The proposed approach extracts a high level representation for the environment at every time frame. This high level information is accumulated to form an abstract knowledge database. The CR system then utilizes this database to accurately detect PUE attacks even if an insufficient amount of fingerprint data is available at the current time frame. The dynamic structure of the proposed approach uses the final detection decisions to update the abstract knowledge database for future runs. Simulation results show that the proposed method can improve the performance with an average of 3.5% for only 10% relevant information between the past knowledge and the current environment signals.Comment: 6 pages, 3 figures, in Proceedings of IEEE 26th International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Hong Kong, P.R. China, Aug. 201

Automatic Wi-Fi Fingerprint System based on Unsupervised Learning

Recently, smartphones and Wi-Fi appliances have been generalized in daily life, and location-based service(LBS) has gradually been extended to indoor environments. Unlike outdoor positioning, which is typically handled by the global positioning system(GPS), indoor positioning technologies for providing LBSs have been studied with algorithms using various short-range wireless communications such as Wi-Fi, Ultra-wideband, Bluetooth, etc. Fingerprint-based positioning technology, a representative indoor LBS, estimates user locations using the received signal strength indicator(RSSI), indicating the relative transmission power of the access point(AP). Therefore, a fingerprint-based algorithm has the advantage of being robust to distorted wireless environments, such as radio wave reflections and refractions, compared to the time-of-arrival(TOA) method for non-line-of-sight(NLOS), where many obstacles exist. Fingerprint is divided into a training phase in which a radio map is generated by measuring the RSSIs of all indoor APs and positioning phase in which the positions of users are estimated by comparing the RSSIs of the generated radio map in real-time. In the training phase, the user collects the RSSIs of all APs measured at reference points set at regular intervals of 2 to 3m, creating a radio map. In the positioning phase, the reference point, which is most similar to the RSSI, compares the generated radio map from the training phase to the RSSI measured from user movements. This estimates the real-time indoor position. Fingerprint algorithms based on supervised and semi-supervised learning such as support vector machines and principal component analysis are essential for measuring the RSSIs in all indoor areas to produce a radio map. As the building size and the complexity of structures increases, the amount of work and time required also increase. The radio map generation algorithm that uses channel modeling does not require direct measurement, but it requires considerable effort because of building material, three-dimensional reflection coefficient, and numerical modeling of all obstacles. To overcome these problems, this thesis proposes an automatic Wi-Fi fingerprint system that combines an unsupervised dual radio mapping(UDRM) algorithm that reduces the time taken to acquire Wi-Fi signals and leverages an indoor environment with a minimum description length principle(MDLP)-based radio map feedback(RMF) algorithm to simultaneously optimize and update the radio map. The proposed UDRM algorithm in the training phase generates a radio map of the entire building based on the measured radio map of one reference floor by selectively applying the autoencoder and the generative adversarial network(GAN) according to the spatial structures. The proposed learning-based UDRM algorithm does not require labeled data, which is essential for supervised and semi-supervised learning algorithms. It has a relatively low dependency on RSSI datasets. Additionally, it has a high accuracy of radio map prediction than existing models because it learns the indoor environment simultaneously via a indoor two-dimensional map(2-D map). The produced radio map is used to estimate the real-time positioning of users in the positioning phase. Simultaneously, the proposed MDLP-based RMF algorithm analyzes the distribution characteristics of the RSSIs of newly measured APs and feeds the analyzed results back to the radio map. The MDLP, which is applied to the proposed algorithm, improves the performance of the positioning and optimizes the size of the radio map by preventing the indefinite update of the RSSI and by updating the newly added APs to the radio map. The proposed algorithm is compared with a real measurement-based radio map, confirming the high stability and accuracy of the proposed fingerprint system. Additionally, by generating a radio map of indoor areas with different structures, the proposed system is shown to be robust against the change in indoor environment, thus reducing the time cost. Finally, via a euclidean distance-based experiment, it is confirmed that the accuracy of the proposed fingerprint system is almost the same as that of the RSSI-based fingerprint system.|최근 스마트폰과 Wi-Fi가 실생활에 보편화되면서 위치기반 서비스에 대한 개발 분야가 실내 환경으로 점차 확대되고 있다. GPS로 대표되는 실외 위치 인식과 달리 위치기반 서비스를 제공하기 위한 실내 위치 인식 기술은 Wi-Fi, UWB, 블루투스 등과 같은 다양한 근거리 무선 통신 기반의 알고리즘들이 연구되고 있다. 대표적인 실내 위치인식 알고리즘 중 하나인 Fingerprint는 사용자가 수신한 AP 신호의 상대적인 크기를 나타내는 RSSI를 사용하여 위치를 추정한다. 따라서 Fingerprint기반의 알고리즘은 장애물이 많이 존재하는 비가시 거리에서 TOA 방식에 비해 전파의 반사 및 굴절과 같이 왜곡된 무선 환경에 강인하다는 장점이 있다. Fingerprint는 실내의 모든 AP의 RSSI들을 측정하여 Radio map을 제작하는 과정인 학습 단계와 생성된 Radio map의 RSSI들을 실시간으로 측정된 RSSI와 비교하여 사용자의 위치를 추정하는 위치인식 단계로 나누어진다. 학습 단계에서는 위치를 구분하기 위하여 사용자가 2~3m의 일정한 간격으로 설정된 참조 위치들마다 측정되는 모든 AP들의 RSSI를 수집하고 Radio map으로 제작한다. 위치인식 단계에서는 학습 단계에서 제작된 Radio map과 사용자의 이동에 의해 측정되는 RSSI의 비교를 통해 가장 유사한 RSSI 패턴을 가지는 참조 위치가 실시간 실내 위치로 추정된다. 서포트 벡터 머신(SVM), 주성분 분석(PCA) 등과 같이 지도 및 준지도 학습기반의 Fingerprint 알고리즘은 Radio map을 제작하기 위해 모든 실내 공간에서 RSSI의 측정이 필수적이다. 이러한 알고리즘들은 건물이 대형화되고 구조가 복잡해질수록 측정 공간이 늘어나면서 작업과 시간 소모가 또한 급격히 증가한다. 채널모델링을 통한 Radio map 생성 알고리즘은 직접적인 측정 과정이 불필요한 반면에 건물의 재질, 3차원적인 구조에 따른 반사 계수 및 모든 장애물에 대한 수치적인 모델링이 필수적이기 때문에 상당히 많은 작업량이 요구된다. 따라서 본 논문에서는 이러한 문제점들을 해결하고자 학습 단계에서 Wi-Fi 신호의 수집시간을 최소화하면서 실내 환경이 고려된 Unsupervised Dual Radio Mapping(UDRM) 알고리즘과 위치인식 단계에서 Radio map의 최적화가 동시에 가능한 Minimum description length principle(MDLP)기반의 Radio map Feedback(RMF) 알고리즘이 결합된 비지도학습기반의 자동 Wi-Fi Fingerprint를 제안한다. 학습 단계에서 제안하는 UDRM 알고리즘은 뉴럴 네트워크 기반의 비지도 학습 알고리즘인 Autoencoder와 Generative Adversarial Network (GAN)를 공간구조에 따라 선택적으로 적용하여 하나의 참조 층에서 측정된 Radio map을 기반으로 건물전체의 Radio map을 생성한다. 제안하는 비지도 학습 기반 UDRM 알고리즘은 지도 및 준지도 학습에서 필수적인 Labeled data가 필요하지 않으며 RSSI 데이터 세트의 의존성이 상대적으로 낮다. 또한 2차원 실내 지도를 통해 실내 환경을 동시에 학습하기 때문에 기존의 예측 모델에 비해 Radio map의 예측 정확도가 높다. 제안한 알고리즘에 의해 제작된 Radio map은 위치인식 단계에서 사용자의 실시간 위치인식에 적용된다. 동시에 제안하는 MDLP 기반의 자동 Wi-Fi 업데이트 알고리즘은 새롭게 측정되는 AP들의 RSSI의 분포특성을 분석하고 그 결과를 Radio map에 피드백한다. 제안한 알고리즘에 적용된 MDLP는 무분별한 RSSI의 업데이팅을 방지하고 추가되는 AP를 Radio map에 업데이트함으로서 위치인식의 성능을 향상시키고 Radio map의 크기의 최적화가 가능하다. 제안한 알고리즘은 실제 측정기반의 Radio map과 서로 비교를 통해 제안한 Fingerprint 시스템의 높은 안정성과 정확도를 확인하였다. 또한 구조가 다른 실내공간의 Radio map 생성 결과를 통해 실내 환경 변화에 강인함과 학습 시간 측정을 통한 시간 비용이 감소함을 확인하였다. 마지막으로 Euclidean distance 기반 실험을 통하여 실제 측정한 RSSI기반의 Fingerprint 시스템과 제안한 시스템의 위치인식 정확도가 거의 일치함을 확인하였다.Contents Contents ⅰ Lists of Figures and Tables ⅲ Abstract ⅵ Chapter 1 Introduction 01 1.1 Background and Necessity for Research 01 1.2 Objectives and Contents for Research 04 Chapter 2 Wi-Fi Positioning and Unsupervised Learning 07 2.1 Wi-Fi Positioning 07 2.1.1 Wi-Fi Signal and Fingerprint 07 2.1.2 Fingerprint Techniques 15 2.2 Unsupervised Learning 23 2.2.1 Neural Network 23 2.2.2 Autoencoder 28 2.2.3 Generative Adversarial Network 31 Chapter 3 Proposed Fingerprint System 36 3.1 Unsupervised Dual Radio Mapping Algorithm 36 3.2 MDLP-based Radio Map Feedback Algorithm 47 Chapter 4 Experiment and Result 51 4.1 Experimental Environment and Configuration 51 4.2 Results of Unsupervised Dual Radio Mapping Algorithm 56 4.2 Results of MDLP-based Radio Map Feedback Algorithm 69 Chapter 5 Conclusion 79 Reference 81Docto

Real-Time Machine Learning for Quickest Detection

Safety-critical Cyber-Physical Systems (CPS) require real-time machine learning for control and decision making. One promising solution is to use deep learning to discover useful patterns for event detection from heterogeneous data. However, deep learning algorithms encounter challenges in CPS with assurability requirements: 1) Decision explainability, 2) Real-time and quickest event detection, and 3) Time-eficient incremental learning. To address these obstacles, I developed a real-time Machine Learning Framework for Quickest Detection (MLQD). To be specific, I first propose the zero-bias neural network, which removes decision bias and preferabilities from regular neural networks and provides an interpretable decision process. Second, I discover the latent space characteristic of the zero-bias neural network and the method to mathematically convert a Deep Neural Network (DNN) classifier into a performance-assured binary abnormality detector. In this way, I can seamlessly integrate the deep neural networks\u27 data processing capability with Quickest Detection (QD) and provide real-time sequential event detection paradigm. Thirdly, after discovering that a critical factor that impedes the incremental learning of neural networks is the concept interference (confusion) in latent space, and I prove that to minimize interference, the concept representation vectors (class fingerprints) within the latent space need to be organized orthogonally and I invent a new incremental learning strategy using the findings, I facilitate deep neural networks in the CPS to evolve eficiently without retraining. All my algorithms are evaluated on real-world applications, ADS-B (Automatic Dependent Surveillance Broadcasting) signal identification, and spoofing detection in the aviation communication system. Finally, I discuss the current trends in MLQD and conclude this dissertation by presenting the future research directions and applications. As a summary, the innovations of this dissertation are as follows: i) I propose the zerobias neural network, which provides transparent latent space characteristics, I apply it to solve the wireless device identification problem. ii) I discover and prove the orthogonal memory organization mechanism in artificial neural networks and apply this mechanism in time-efficient incremental learning. iii) I discover and mathematically prove the converging point theorem, with which we can predict the latent space topological characteristics and estimate the topological maturity of neural networks. iv) I bridge the gap between machine learning and quickest detection with assurable performance

Machine Learning Algorithm for Wireless Indoor Localization

Smartphones equipped with Wi-Fi technology are widely used nowadays. Due to the need for inexpensive indoor positioning systems (IPSs), many researchers have focused on Wi-Fi-based IPSs, which use wireless local area network received signal strength (RSS) data that are collected at distinct locations in indoor environments called reference points. In this study, a new framework based on symmetric Bregman divergence, which incorporates k-nearest neighbor (kNN) classification in signal space, was proposed. The coordinates of the target were determined as a weighted combination of the nearest fingerprints using Jensen-Bregman divergences, which unify the squared Euclidean and Mahalanobis distances with information-theoretic Jensen-Shannon divergence measures. To validate our work, the performance of the proposed algorithm was compared with the probabilistic neural network and multivariate Kullback-Leibler divergence. The distance error for the developed algorithm was less than 1 m

Class-Incremental Learning for Wireless Device Identification in IoT

Deep Learning (DL) has been utilized pervasively in the Internet of Things (IoT). One typical application of DL in IoT is device identification from wireless signals, namely Noncryptographic Device Identification (NDI). However, learning components in NDI systems have to evolve to adapt to operational variations, such a paradigm is termed as Incremental Learning (IL). Various IL algorithms have been proposed and many of them require dedicated space to store the increasing amount of historical data, and therefore, they are not suitable for IoT or mobile applications. However, conventional IL schemes can not provide satisfying performance when historical data are not available. In this paper, we address the IL problem in NDI from a new perspective, firstly, we provide a new metric to measure the degree of topological maturity of DNN models from the degree of conflict of class-specific fingerprints. We discover that an important cause for performance degradation in IL enabled NDI is owing to the conflict of devices’ fingerprints. Second, we also show that the conventional IL schemes can lead to low topological maturity of DNN models in NDI systems. Thirdly, we propose a new Channel Separation Enabled Incremental Learning (CSIL) scheme without using historical data, in which our strategy can automatically separate devices’ fingerprints in different learning stages and avoid potential conflict. Finally, We evaluated the effectiveness of the proposed framework using real data from ADS-B (Automatic Dependent Surveillance-Broadcast), an application of IoT in aviation. The proposed framework has the potential to be applied to accurate identification of IoT devices in a variety of IoT applications and services