A Comparison of Classification Models in Predicting Graduate Admission Decision

While the decision process of graduate admissions remains elusive, specific criteria are decidedly significant in determining admission outcome. Prospective students applying to graduate programs experience a real predicament of selecting the right schools to invest limited resources for the application. This paper presents comparisons of various machine learning classification models, including Naïve Bayes, Logistic Regression, Multilayer Perceptron and Decisions Tree models, in predicting the admission outcome of candidates with a set of known parameters using a dataset of 400 applicant records. By comparing the performance metrics of these methods, the study finds Naïve Bayes to be the most accurate model for this type of dataset. Predictive models such as the ones discussed in this paper can be a valuable tool for prospective students in shortlisting universities in their application process. The study also proposes a framework that incorporates machine learning-based classification into the admissions decision process. Implementing such methods may help support graduate admissions committees in streamlining large pools of applications or observing and understanding trends in their past admission decisions

Integration of Empirical Mode Decomposition and Machine Learning for operating condition classification: a proposal

During the last decades, advances related to the Internet of Things technologies have led to the widespread adoption of condition monitoring approaches for failure diagnosis. This fundamental vision has resulted in the introduction of advanced maintenance techniques such as Condition-Based Maintenance and Predictive Maintenance. Within this context, one of the main challenges arises from pre-processing the data acquired through sensors and, more specifically, the denoising procedures. Choosing a solid tool to separate the noise signal from the true one is usually considered a difficult task. In addition, data are usually collected from several different sensors, each of which monitors a specific process variable. Reducing the number of features analyzed could be helpful to improve the accuracy of the subsequent diagnosis and, at the same time, in making it less time-consuming. As a result, this paper aims at presenting a diagnosis approach based on Empirical Mode Decomposition (EMD) and Principal Component Analysis (PCA) for noise removal and feature reduction respectively. Indeed, EMD is very suitable for highly dynamic and non-stationary signals, while PCA is a good renowned approach for reducing the dimension of a multi-variate signal. Subsequently, a supervised machine learning approach is employed to classify the acquired signal. To demonstrate the applicability of the methodology, a compressor operating within a geothermal plant is considered as a case study, while the selected failure mode is the surge. The developed approach could be exploited by maintenance engineers and asset managers to perform diagnoses on relevant equipment

Novel finger movement classification method based on multi-centered binary pattern using surface electromyogram signals

The number of individuals who have lost their fingers in our world is quite high and these individuals experience great difficulties in performing their daily work. Finger movements classification and prediction are one of the hot-topic research areas for biomedical engineering, machine learning and computer sciences. This study purposes finger movements classification and prediction. For this purpose, a novel finger movements classification method is presented by using surface electromyogram (sEMG) signals. To accurately classify these movements, a novel binary pattern like textural feature extractor is presented and this textural micro pattern is called as multi-centered binary pattern (MCBP). In the MCBP, five odd-indexed values of a block are utilized as center. The proposed MCBP based multileveled finger movements classification method evaluate by three cases. In the first case, the raw sEMG signals are utilized as input. In the second and third case, sEMG signals are divided into frames and these frames are utilized as input. A two-layered feature selector is used to choose the most valuable features. The purpose of using these two feature selectors together is to choose the optimum number of features. In the classification phase, two fine-tuned classifiers have been used and they are k-nearest neighbor (k-NN) and support vector machine (SVM). The proposed MCBP based method achieved 99.17%, 99.70% and 99.62% classification rates using SVM classifier according to Case 1, Case 2 and Case3 respectively. The results show that the study is a highly accurate method.</p

A novel automated tower graph based ECG signal classification method with hexadecimal local adaptive binary pattern and deep learning

Electrocardiography (ECG) signal recognition is one of the popular research topics for machine learning. In this paper, a novel transformation called tower graph transformation is proposed to classify ECG signals with high accuracy rates. It employs a tower graph, which uses minimum, maximum and average pooling methods altogether to generate novel signals for the feature extraction. In order to extract meaningful features, we presented a novel one-dimensional hexadecimal pattern. To select distinctive and informative features, an iterative ReliefF and Neighborhood Component Analysis (NCA) based feature selection is utilized. By using these methods, a novel ECG signal classification approach is presented. In the preprocessing phase, tower graph-based pooling transformation is applied to each signal. The proposed one-dimensional hexadecimal adaptive pattern extracts 1536 features from each node of the tower graph. The extracted features are fused and 15,360 features are obtained and the most discriminative 142 features are selected by the ReliefF and iterative NCA (RFINCA) feature selection approach. These selected features are used as an input to the artificial neural network and deep neural network and 95.70% and 97.10% classification accuracy was obtained respectively. These results demonstrated the success of the proposed tower graph-based method.</p

EEG-based driving fatigue detection using multilevel feature extraction and iterative hybrid feature selection

Brain activities can be evaluated by using Electroencephalogram (EEG) signals. One of the primary reasons for traffic accidents is driver fatigue, which can be identified by using EEG signals. This work aims to achieve a highly accurate and straightforward process to detect driving fatigue by using EEG signals. Two main problems, which are feature generation and feature selection, are defined to achieve this aim. This work solves these problems by using two different approaches. Deep networks are efficient feature generators and extract features in low, medium, and high levels. These features can be generated by using multileveled or multilayered feature extraction. Therefore, we proposed a multileveled feature generator that uses a one-dimensional binary pattern (BP) and statistical features together, and levels are created using a one-dimensional discrete wavelet transform (1D-DWT). A five-level fused feature extractor is presented by using BP, statistical features of 1D-DWT together. Moreover, a 2-layered feature selection method is proposed using ReliefF and iterative neighborhood component analysis (RFINCA) to solve the feature selection problem. The goals of the RFINCA are to choose the optimal number of features automatically and use the effectiveness of ReliefF and neighborhood component analysis (NCA) together. A driving fatigue EEG dataset was used as a testbed to denote the effectiveness of eighteen conventional classifiers. According to the experimental results, a highly accurate EEG classification approach is presented. The proposed method also reached 100.0% classification accuracy by using a k-nearest neighborhood classifier.</p

Hybrid dragonfly algorithm with neighbourhood component analysis and gradient tree boosting for crime rates modelling

In crime studies, crime rates time series prediction helps in strategic crime prevention formulation and decision making. Statistical models are commonly applied in predicting time series crime rates. However, the time series crime rates data are limited and mostly nonlinear. One limitation in the statistical models is that they are mainly linear and are only able to model linear relationships. Thus, this study proposed a time series crime prediction model that can handle nonlinear components as well as limited historical crime rates data. Recently, Artificial Intelligence (AI) models have been favoured as they are able to handle nonlinear and robust to small sample data components in crime rates. Hence, the proposed crime model implemented an artificial intelligence model namely Gradient Tree Boosting (GTB) in modelling the crime rates. The crime rates are modelled using the United States (US) annual crime rates of eight crime types with nine factors that influence the crime rates. Since GTB has no feature selection, this study proposed hybridisation of Neighbourhood Component Analysis (NCA) and GTB (NCA-GTB) in identifying significant factors that influence the crime rates. Also, it was found that both NCA and GTB are sensitive to input parameter. Thus, DA2-NCA-eGTB model was proposed to improve the NCA-GTB model. The DA2-NCA-eGTB model hybridised a metaheuristic optimisation algorithm namely Dragonfly Algorithm (DA) with NCA-GTB model to optimise NCA and GTB parameters. In addition, DA2-NCA-eGTB model also improved the accuracy of the NCA-GTB model by using Least Absolute Deviation (LAD) as the GTB loss function. The experimental result showed that DA2-NCA-eGTB model outperformed existing AI models in all eight modelled crime types. This was proven by the smaller values of Mean Absolute Percentage Error (MAPE), which was between 2.9195 and 18.7471. As a conclusion, the study showed that DA2-NCA-eGTB model is statistically significant in representing all crime types and it is able to handle the nonlinear component in limited crime rate data well

비침습적 뇌파 신호를 이용한 응급환자의 생체반응 모니터링 기법

학위논문 (박사) -- 서울대학교 대학원 : 공과대학 협동과정 바이오엔지니어링전공, 2021. 2. 김희찬.뇌파는 대뇌피질이나 두피의 전극을 통해서 뇌의 전기적 신호를 기록한 것을 의미한다. 뇌 기능 관찰을 위한 진단도구로써 뇌파는 뇌전증이나 치매 진단 등의 목적으로 활용되고 있다. 본 논문에서는 비침습적 뇌파를 이용하여 응급환자의 주요 생리학적 지표를 모니터링하는 기술을 개발하였다. 처음 두 연구에서 심폐소생술의 효과를 평가하기 위한 심정지 돼지실험모델을 고안하였다. 현재의 심폐소생술 지침은 체순환 평가를 위해 기도삽관을 통한 호기말 이산화탄소 분압의 측정을 권고한다. 하지만, 정확한 기도삽관이 특히 병원 밖 상황에서 어려울 수 있다. 따라서, 간편히 측정할 수 있고 소생 환자의 신경학적 예후를 진단하는데 사용되는 뇌파를 이용한 예측 기술이 심폐소생술 품질평가지표의 대안으로 제안되었다. 첫 번째 실험에서는 고품질과 저품질 기본심폐소생술을 10회 반복하면서 측정된 뇌파를 분석하였다. 심폐소생술의 품질에 따른 뇌파의 변화를 이용하여 체순환 평가를 위한 EEG-based Brain Resuscitation Index (EBRI) 모델을 도출하였다. EBRI 모델에서 획득한 호기말 이산화탄소 분압 예측치는 실제 값과 양의 상관관계를 보이며, 병원 밖 상황에서의 활용 가능성을 보였다. 두 번째 실험에서는 두 가지 심폐소생술(기본심폐소생술, 전문심폐소생술)이 수행되었다. 제세동 직전에 수집된 뇌파는 심폐소생술 도중 경동맥혈류의 회복률과 함께 분석되었다. 심폐소생술 도중 경동맥혈류의 회복률을 반영하는 뇌파 변수를 규명한 후, 이를 이용하여 높은 회복률(30% 이상)과 낮은 회복률(30% 미만)을 구분하는 기계학습 기반 이진분류모델을 도출하였다. 서포트 벡터 머신 기반의 예측모델이 0.853의 정확도와 0.909의 곡선하면적을 보이며 가장 우수한 성능을 보였다. 이러한 예측모델은 심정지 환자의 뇌 소생을 향상시켜 빠른 뇌 기능 회복을 가능하게 할 것으로 기대된다. 세 번째 연구에서 비침습적 뇌파를 이용하여 두개내압을 예측하는 모델을 개발하기 위한 외상성 뇌손상 돼지실험모델이 고안되었다. 외상성 뇌손상은 물리적 충격에 의해 정상적인 뇌 기능이 중단된 상태를 의미하며, 이 때의 두개내압 상승과 관류저하가 뇌파에 영향을 끼칠 수 있다. 따라서, 우리는 뇌파 기반 두개내압 예측모델을 개발하였다. 폴리카테터로 실험동물의 두개내압을 변경하면서 뇌파를 획득하였다. 두개내압의 정상구간(25 mmHg 미만)과 위험구간(25 mmHg 이상)을 유의미하게 구분하는 뇌파 변수를 규명한 후 기계학습 기반 이진분류모델을 도출하였다. 다층 퍼셉트론 기반의 예측모델이 0.686의 정확도와 0.754의 곡선하면적을 보이며 가장 우수한 성능을 보였다. 또다른 비침습 데이터인 심박수 정보와 함께 사용하였을 때 정확도와 곡선하면적은 각각 0.760과 0.834로 향상되었다. 제안된 예측모델은 응급상황에서 비침습적으로 두개내압을 관찰하여 정상 수준의 두개내압을 유지하는데 도움을 줄 것으로 기대된다. 본 논문은 응급환자의 주요 생리학적 지표를 비침습적 뇌파를 이용하여 관찰하는 예측모델을 제안하고 성능을 검증하였다. 본 연구에서는 뇌파를 이용하여 즉각적인 호기말 이산화탄소 분압, 경동맥혈류, 두개내압을 추정하기 위한 예측모델을 수립하였다. 하지만, 뇌파 데이터는 장기간의 신경학적, 기능적 회복과 함께 평가되어야 한다. 본 논문에서 개발한 예측모델의 성능과 적용 가능성은 향후 다양한 임상연구를 통해 cerebral performance category와 modified Rankin scale 등의 신경학적 평가지표와 함께 분석, 개선되어야 할 것이다.Electroencephalogram (EEG) is a recording of the electrical activity of the brain, measured using electrodes attached to the cerebrum cortex or the scalp. As a diagnostic tool for brain disorders, EEG has been widely used for clinical purposes such as epilepsy- and dementia diagnosis. This study develops an EEG-based noninvasive critical care monitoring method for emergency patients. In the first two studies, ventricular fibrillation swine models were designed to develop EEG-based monitoring methods for evaluating the effectiveness of cardiopulmonary resuscitation (CPR). The CPR guidelines recommend measuring end-tidal carbon dioxide (ETCO2) via endotracheal intubation to assess systemic circulation. However, accurate insertion of the endotracheal tube might be difficult in an out-of-hospital setting (OOHS). Therefore, an easily measurable EEG, which has been used to predict resuscitated patients neurologic prognosis, was suggested as a surrogate indicator for CPR feedback. In the first experimental setup, the high- and low quality CPRs were altered 10 times repeatedly, and the EEG parameters were analyzed. Linear regression of an EEG-based brain resuscitation index (EBRI) was used to estimate ETCO2 levels as a novel feedback indicator of systemic circulation during CPR. A positive correlation was found between the EBRI and the real ETCO2, which indicates the feasibility of EBRI in OOHSs. In the second experimental setup, two types of CPR mode were performed: basic life support and advanced cardiovascular life support. EEG signals that were measured between chest compressions and defibrillation shocks were analyzed to monitor the cerebral circulation with respect to the recovery of carotid blood flow (CaBF) during CPR. Significant EEG parameters were identified to represent the CaBF recovery, and machine learning (ML)-based classification models were established to differentiate between the higher (≥ 30%) and lower (< 30%) CaBF recovery. The prediction model based on the support vector machine (SVM) showed the best performance, with an accuracy of 0.853 and an area under the curve (AUC) of 0.909. The proposed models are expected to guide better cerebral resuscitation and enable early recovery of brain function. In the third study, a swine model of traumatic brain injury (TBI) was designed to develop an EEG-based prediction model of an elevated intracranial pressure (ICP). TBI is defined as the disruption of normal brain function due to physical impact. This can increase ICP, and the resulting hypoperfusion can affect the cerebral electrical activity. Thus, we developed EEG-based prediction models to monitor ICP levels. During the experiments, EEG was measured while the ICP was adjusted with the Foley balloon catheter. Significant EEG parameters were determined to differentiate between the normal (< 25 mmHg) and dangerous (≥ 25 mmHg) ICP levels and ML-based binary classifiers were established to distinguish between these two groups. The multilayer perceptron model showed the best performance with an accuracy of 0.686 and an AUC of 0.754, which were improved to 0.760 and 0.834, respectively, when a noninvasive heart rate was also used as an input. The proposed prediction models are expected to instantly treat an elevated ICP (≥ 25 mmHg) in emergency settings. This study presents a new EEG-based noninvasive monitoring method of the physiologic parameters of emergency patients, especially in an OOHS, and evaluates the performance of the proposed models. In this study, EEG was analyzed to predict immediate ETCO2, CaBF, and ICP. The prediction models demonstrate that a noninvasive EEG can yield clinically important predictive outcomes. Eventually, the EEG parameters should be investigated with regard to the long-term neurological and functional outcomes. Further clinical trials are warranted to improve and evaluate the feasibility of the proposed method with respect to the neurological evaluation scores, such as the cerebral performance category and modified Rankin scale.Abstract i Contents iv List of Tables viii List of Figures x List of Abbreviations xii Chapter 1 General Introduction 1 1.1 Electroencephalogram 1 1.2 Clinical use of spontaneous EEG 5 1.3 EEG and cerebral hemodynamics 7 1.4 EEG use in emergency settings 9 1.5 Noninvasive CPR assessment 10 1.6 Noninvasive traumatic brain injury assessment 16 1.7 Thesis objectives 21 Chapter 2 EEG-based Brain Resuscitation Index for Monitoring Systemic Circulation During CPR 23 2.1 Introduction 23 2.2 Methods 25 2.2.1 Ethical statement 25 2.2.2 Study design and setting 25 2.2.3 Experimental animals and housing 27 2.2.4 Surgical preparation and hemodynamic measurements 27 2.2.5 EEG measurement 29 2.2.6 Data analysis 32 2.2.7 EBRI calculation 33 2.2.8 Delta-EBRI calculation 34 2.3 Results 36 2.3.1 Hemodynamic parameters 36 2.3.2 Changes in EEG parameters 37 2.3.3 EBRI calculation 39 2.3.4 Delta-EBRI calculation 41 2.4 Discussion 42 2.4.1 Accomplishment 42 2.4.2 Limitations 45 2.5 Conclusion 46 Chapter 3 EEG-based Prediction Model of the Recovery of Carotid Blood Flow for Monitoring Cerebral Circulation During CPR 47 3.1 Introduction 47 3.2 Methods 50 3.2.1 Ethical statement 50 3.2.2 Study design and setting 50 3.2.3 Experimental animals and housing 52 3.2.4 Surgical preparation and hemodynamic measurements 54 3.2.5 EEG measurement 55 3.2.6 Data processing 57 3.2.7 Data analysis 58 3.2.8 Development of machine-learning based prediction model 59 3.3 Results 63 3.3.1 Results of CPR process 63 3.3.2 EEG changes with the recovery of CaBF 66 3.3.3 Changes in EEG parameters depending on four CaBF groups 68 3.3.4 Changes in EEG parameters depending on two CaBF groups 69 3.3.5 EEG parameters for prediction models 70 3.3.6 Performances of prediction models 73 3.4 Discussion 76 3.4.1 Accomplishment 76 3.4.2 Limitations 78 3.5 Conclusion 80 Chapter 4 EEG-based Prediction Model of an Increased Intra-Cranial Pressure for TBI patients 81 4.1 Introduction 81 4.2 Methods 83 4.2.1 Ethical statement 83 4.2.2 Study design and setting 83 4.2.3 Experimental animals and housing 85 4.2.4 Surgical preparation and hemodynamic measurements 86 4.2.5 EEG measurement 88 4.2.6 Data processing 90 4.2.7 Data analysis 90 4.2.8 Development of machine-learning based prediction model 91 4.3 Results 92 4.3.1 Hemodynamic changes during brain injury phase 92 4.3.2 EEG changes with an increase of ICP 93 4.3.3 EEG parameters for prediction models 94 4.3.4 Performances for prediction models 95 4.4 Discussion 100 4.4.1 Accomplishment 100 4.4.2 Limitations 104 4.5 Conclusion 104 Chapter 5 Summary and Future works 105 5.1 Thesis summary and contributions 105 5.2 Future direction 108 Bibilography 113 Abstract in Korean 135Docto

Developing artificial intelligence models for classification of brain disorder diseases based on statistical techniques

The Abstract is currently unavailable, due to the thesis being under Embargo