Data Mining in Internet of Things Systems: A Literature Review

The Internet of Things (IoT) and cloud technologies have been the main focus of recent research, allowing for the accumulation of a vast amount of data generated from this diverse environment. These data include without any doubt priceless knowledge if could correctly discovered and correlated in an efficient manner. Data mining algorithms can be applied to the Internet of Things (IoT) to extract hidden information from the massive amounts of data that are generated by IoT and are thought to have high business value. In this paper, the most important data mining approaches covering classification, clustering, association analysis, time series analysis, and outlier analysis from the knowledge will be covered. Additionally, a survey of recent work in in this direction is included. Another significant challenges in the field are collecting, storing, and managing the large number of devices along with their associated features. In this paper, a deep look on the data mining for the IoT platforms will be given concentrating on real applications found in the literatur

Design of a Controlled Language for Critical Infrastructures Protection

We describe a project for the construction of controlled language for critical infrastructures protection (CIP). This project originates from the need to coordinate and categorize the communications on CIP at the European level. These communications can be physically represented by official documents, reports on incidents, informal communications and plain e-mail. We explore the application of traditional library science tools for the construction of controlled languages in order to achieve our goal. Our starting point is an analogous work done during the sixties in the field of nuclear science known as the Euratom Thesaurus.JRC.G.6-Security technology assessmen

Advanced sequential Monte Carlo methods and their applications to sparse sensor network for detection and estimation

The general state space models present a flexible framework for modeling dynamic systems and therefore have vast applications in many disciplines such as engineering, economics, biology, etc. However, optimal estimation problems of non-linear non-Gaussian state space models are analytically intractable in general. Sequential Monte Carlo (SMC) methods become a very popular class of simulation-based methods for the solution of optimal estimation problems. The advantages of SMC methods in comparison with classical filtering methods such as Kalman Filter and Extended Kalman Filter are that they are able to handle non-linear non-Gaussian scenarios without relying on any local linearization techniques. In this thesis, we present an advanced SMC method and the study of its asymptotic behavior. We apply the proposed SMC method in a target tracking problem using different observation models. Specifically, a distributed SMC algorithm is developed for a wireless sensor network (WSN) that incorporates with an informative-sensor detection technique. The novel SMC algorithm is designed to surmount the degeneracy problem by employing a multilevel Markov chain Monte Carlo (MCMC) procedure constructed by engaging drift homotopy and likelihood bridging techniques. The observations are gathered only from the informative sensors, which are sensing useful observations of the nearby moving targets. The detection of those informative sensors, which are typically a small portion of the WSN, is taking place by using a sparsity-aware matrix decomposition technique. Simulation results showcase that our algorithm outperforms current popular tracking algorithms such as bootstrap filter and auxiliary particle filter in many scenarios

Representation Learning for Natural Language Processing

This open access book provides an overview of the recent advances in representation learning theory, algorithms and applications for natural language processing (NLP). It is divided into three parts. Part I presents the representation learning techniques for multiple language entries, including words, phrases, sentences and documents. Part II then introduces the representation techniques for those objects that are closely related to NLP, including entity-based world knowledge, sememe-based linguistic knowledge, networks, and cross-modal entries. Lastly, Part III provides open resource tools for representation learning techniques, and discusses the remaining challenges and future research directions. The theories and algorithms of representation learning presented can also benefit other related domains such as machine learning, social network analysis, semantic Web, information retrieval, data mining and computational biology. This book is intended for advanced undergraduate and graduate students, post-doctoral fellows, researchers, lecturers, and industrial engineers, as well as anyone interested in representation learning and natural language processing

Speech-based automatic depression detection via biomarkers identification and artificial intelligence approaches

Depression has become one of the most prevalent mental health issues, affecting more than 300 million people all over the world. However, due to factors such as limited medical resources and accessibility to health care, there are still a large number of patients undiagnosed. In addition, the traditional approaches to depression diagnosis have limitations because they are usually time-consuming, and depend on clinical experience that varies across different clinicians. From this perspective, the use of automatic depression detection can make the diagnosis process much faster and more accessible. In this thesis, we present the possibility of using speech for automatic depression detection. This is based on the findings in neuroscience that depressed patients have abnormal cognition mechanisms thus leading to the speech differs from that of healthy people. Therefore, in this thesis, we show two ways of benefiting from automatic depression detection, i.e., identifying speech markers of depression and constructing novel deep learning models to improve detection accuracy. The identification of speech markers tries to capture measurable depression traces left in speech. From this perspective, speech markers such as speech duration, pauses and correlation matrices are proposed. Speech duration and pauses take speech fluency into account, while correlation matrices represent the relationship between acoustic features and aim at capturing psychomotor retardation in depressed patients. Experimental results demonstrate that these proposed markers are effective at improving the performance in recognizing depressed speakers. In addition, such markers show statistically significant differences between depressed patients and non-depressed individuals, which explains the possibility of using these markers for depression detection and further confirms that depression leaves detectable traces in speech. In addition to the above, we propose an attention mechanism, Multi-local Attention (MLA), to emphasize depression-relevant information locally. Then we analyse the effectiveness of MLA on performance and efficiency. According to the experimental results, such a model can significantly improve performance and confidence in the detection while reducing the time required for recognition. Furthermore, we propose Cross-Data Multilevel Attention (CDMA) to emphasize different types of depression-relevant information, i.e., specific to each type of speech and common to both, by using multiple attention mechanisms. Experimental results demonstrate that the proposed model is effective to integrate different types of depression-relevant information in speech, improving the performance significantly for depression detection

Personalized functional health and fall risk prediction using electronic health records and in-home sensor data

Research has shown the importance of Electronic Health Records (EHR) and in-home sensor data for continuous health tracking and health risk predictions. With the increased computational capabilities and advances in machine learning techniques, we have new opportunities to use multi-modal health big data to develop accurate health tracking models. This dissertation describes the development, evaluation, and testing of systems for predicting functional health and fall risks in community-dwelling older adults using health data and machine learning techniques. In an initial study, we focused on organizing and de-identifying EHR data for analysis using HIPAA regulations. The dataset contained nine years of structured and unstructured EHR data obtained from TigerPlace, a senior living facility at Columbia, MO. The de-identification of this data was done using custom automated algorithms. The de-identified EHR data was used in several studies described in this dissertation. We then developed personalized functional health tracking models using geriatric assessments in the EHR data. Studies show that higher levels of functional health in older adults lead to a higher quality of life and improves the ability to age-in-place. Even though several geriatric assessments capture several aspects of functional health, there is limited research in longitudinally tracking the personalized functional health of older adults using a combination of these assessments. In this study, data from 150 older adult residents were used to develop a composite functional health prediction model using Activities of Daily Living (ADL), Instrumental Activities of Daily Living (IADL), Mini-Mental State Examination (MMSE), Geriatric Depression Scale (GDS), and Short Form 12 (SF12). Tracking functional health objectively could help clinicians to make decisions for interventions in case of functional health deterioration. We next constructed models for fall risk prediction in older adults using geriatric assessments, demographic data, and GAITRite assessment data. A 6-month fall risk prediction model was developed with data from 93 older adult residents. Explainable AI techniques were used to provide explanations to the model predictions, such as which specific features increased the risk of fall in a particular model prediction. Such explanations to model predictions provide valuable insights for targeted interventions. In another study, we developed deep neural network models to predict fall risk from de-identified nursing notes data from 162 older adult residents from TigerPlace. Clinical nursing notes have been shown to contain valuable information related to fall risk factors. This analysis provides the groundwork for future experiments to predict fall risk in older adults using clinical notes. In addition to using EHR data to predict functional health and fall risk in older adults, two studies were conducted to predict fall and functional health from in-home sensor data. Models for in-home fall prediction using depth sensor imagery have been successfully used at TigerPlace. However, the model is prone to false fall alarms in several scenarios, such as pillows thrown on the floor and pets jumping from couches. A secondary fall analysis was performed by analyzing fall alert videos to further identify and remove false alarms. In the final study, we used in-home sensor data streaming from depth sensors and bed sensors to predict functional health and absolute geriatric assessment values. These prediction models can be used to predict the functional health of residents in absence of sparse and infrequent geriatric assessments. This can also provide continuous tracking of functional health in older adults using the streaming in-home sensor data

ASA 2021 Statistics and Information Systems for Policy Evaluation

This book includes 40 peer-reviewed short papers submitted to the Scientific Conference titled Statistics and Information Systems for Policy Evaluation, aimed at promoting new statistical methods and applications for the evaluation of policies and organized by the Association for Applied Statistics (ASA) and the Dept. of Statistics, Computer Science, Applications DiSIA “G. Parenti” of the University of Florence, jointly with the partners AICQ (Italian Association for Quality Culture), AICQ-CN (Italian Association for Quality Culture North and Centre of Italy), AISS (Italian Academy for Six Sigma), ASSIRM (Italian Association for Marketing, Social and Opinion Research), Comune di Firenze, the SIS – Italian Statistical Society, Regione Toscana and Valmon – Evaluation & Monitoring