353 research outputs found

    ์‹œ๊ณ„์—ด ๋ฐ์ดํ„ฐ ํŒจํ„ด ๋ถ„์„์„ ์œ„ํ•œ ์ข…๋‹จ ์‹ฌ์ธต ํ•™์Šต๋ง ์„ค๊ณ„ ๋ฐฉ๋ฒ•๋ก 

    Get PDF
    ํ•™์œ„๋…ผ๋ฌธ (๋ฐ•์‚ฌ)-- ์„œ์šธ๋Œ€ํ•™๊ต ๋Œ€ํ•™์› : ๊ณต๊ณผ๋Œ€ํ•™ ์ปดํ“จํ„ฐ๊ณตํ•™๋ถ€, 2019. 2. ์žฅ๋ณ‘ํƒ.Pattern recognition within time series data became an important avenue of research in artificial intelligence following the paradigm shift of the fourth industrial revolution. A number of studies related to this have been conducted over the past few years, and research using deep learning techniques are becoming increasingly popular. Due to the nonstationary, nonlinear and noisy nature of time series data, it is essential to design an appropriate model to extract its significant features for pattern recognition. This dissertation not only discusses the study of pattern recognition using various hand-crafted feature engineering techniques using physiological time series signals, but also suggests an end-to-end deep learning design methodology without any feature engineering. Time series signal can be classified into signals having periodic and non-periodic characteristics in the time domain. This thesis proposes two end-to-end deep learning design methodologies for pattern recognition of periodic and non-periodic signals. The first proposed deep learning design methodology is Deep ECGNet. Deep ECGNet offers a design scheme for an end-to-end deep learning model using periodic characteristics of Electrocardiogram (ECG) signals. ECG, recorded from the electrophysiologic patterns of heart muscle during heartbeat, could be a promising candidate to provide a biomarker to estimate event-based stress level. Conventionally, the beat-to-beat alternations, heart rate variability (HRV), from ECG have been utilized to monitor the mental stress status as well as the mortality of cardiac patients. These HRV parameters have the disadvantage of having a 5-minute measurement period. In this thesis, human's stress states were estimated without special hand-crafted feature engineering using only 10-second interval data with the deep learning model. The design methodology of this model incorporates the periodic characteristics of the ECG signal into the model. The main parameters of 1D CNNs and RNNs reflecting the periodic characteristics of ECG were updated corresponding to the stress states. The experimental results proved that the proposed method yielded better performance than those of the existing HRV parameter extraction methods and spectrogram methods. The second proposed methodology is an automatic end-to-end deep learning design methodology using Bayesian optimization for non-periodic signals. Electroencephalogram (EEG) is elicited from the central nervous system (CNS) to yield genuine emotional states, even at the unconscious level. Due to the low signal-to-noise ratio (SNR) of EEG signals, spectral analysis in frequency domain has been conventionally applied to EEG studies. As a general methodology, EEG signals are filtered into several frequency bands using Fourier or wavelet analyses and these band features are then fed into a classifier. This thesis proposes an end-to-end deep learning automatic design method using optimization techniques without this basic feature engineering. Bayesian optimization is a popular optimization technique for machine learning to optimize model hyperparameters. It is often used in optimization problems to evaluate expensive black box functions. In this thesis, we propose a method to perform whole model hyperparameters and structural optimization by using 1D CNNs and RNNs as basic deep learning models and Bayesian optimization. In this way, this thesis proposes the Deep EEGNet model as a method to discriminate human emotional states from EEG signals. Experimental results proved that the proposed method showed better performance than that of conventional method based on the conventional band power feature method. In conclusion, this thesis has proposed several methodologies for time series pattern recognition problems from the feature engineering-based conventional methods to the end-to-end deep learning design methodologies with only raw time series signals. Experimental results showed that the proposed methodologies can be effectively applied to pattern recognition problems using time series data.์‹œ๊ณ„์—ด ๋ฐ์ดํ„ฐ์˜ ํŒจํ„ด ์ธ์‹ ๋ฌธ์ œ๋Š” 4์ฐจ ์‚ฐ์—… ํ˜๋ช…์˜ ํŒจ๋Ÿฌ๋‹ค์ž„ ์ „ํ™˜๊ณผ ํ•จ๊ป˜ ๋งค์šฐ ์ค‘์š”ํ•œ ์ธ๊ณต ์ง€๋Šฅ์˜ ํ•œ ๋ถ„์•ผ๊ฐ€ ๋˜์—ˆ๋‹ค. ์ด์— ๋”ฐ๋ผ, ์ง€๋‚œ ๋ช‡ ๋…„๊ฐ„ ์ด์™€ ๊ด€๋ จ๋œ ๋งŽ์€ ์—ฐ๊ตฌ๋“ค์ด ์ด๋ฃจ์–ด์ ธ ์™”์œผ๋ฉฐ, ์ตœ๊ทผ์—๋Š” ์‹ฌ์ธต ํ•™์Šต๋ง (deep learning networks) ๋ชจ๋ธ์„ ์ด์šฉํ•œ ์—ฐ๊ตฌ๋“ค์ด ์ฃผ๋ฅผ ์ด๋ฃจ์–ด ์™”๋‹ค. ์‹œ๊ณ„์—ด ๋ฐ์ดํ„ฐ๋Š” ๋น„์ •์ƒ, ๋น„์„ ํ˜• ๊ทธ๋ฆฌ๊ณ  ์žก์Œ (nonstationary, nonlinear and noisy) ํŠน์„ฑ์œผ๋กœ ์ธํ•˜์—ฌ ์‹œ๊ณ„์—ด ๋ฐ์ดํ„ฐ์˜ ํŒจํ„ด ์ธ์‹ ์ˆ˜ํ–‰์„ ์œ„ํ•ด์„ , ๋ฐ์ดํ„ฐ์˜ ์ฃผ์š”ํ•œ ํŠน์ง•์ ์„ ์ถ”์ถœํ•˜๊ธฐ ์œ„ํ•œ ์ตœ์ ํ™”๋œ ๋ชจ๋ธ์˜ ์„ค๊ณ„๊ฐ€ ํ•„์ˆ˜์ ์ด๋‹ค. ๋ณธ ๋…ผ๋ฌธ์€ ๋Œ€ํ‘œ์ ์ธ ์‹œ๊ณ„์—ด ๋ฐ์ดํ„ฐ์ธ ์ƒ์ฒด ์‹ ํ˜ธ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์—ฌ๋Ÿฌ ํŠน์ง• ๋ฒกํ„ฐ ์ถ”์ถœ ๋ฐฉ๋ฒ• (hand-crafted feature engineering methods)์„ ์ด์šฉํ•œ ํŒจํ„ด ์ธ์‹ ๊ธฐ๋ฒ•์— ๋Œ€ํ•˜์—ฌ ๋…ผํ•  ๋ฟ๋งŒ ์•„๋‹ˆ๋ผ, ๊ถ๊ทน์ ์œผ๋กœ๋Š” ํŠน์ง• ๋ฒกํ„ฐ ์ถ”์ถœ ๊ณผ์ •์ด ์—†๋Š” ์ข…๋‹จ ์‹ฌ์ธต ํ•™์Šต๋ง ์„ค๊ณ„ ๋ฐฉ๋ฒ•๋ก ์— ๋Œ€ํ•œ ์—ฐ๊ตฌ ๋‚ด์šฉ์„ ๋‹ด๊ณ  ์žˆ๋‹ค. ์‹œ๊ณ„์—ด ์‹ ํ˜ธ๋Š” ์‹œ๊ฐ„ ์ถ• ์ƒ์—์„œ ํฌ๊ฒŒ ์ฃผ๊ธฐ์  ์‹ ํ˜ธ์™€ ๋น„์ฃผ๊ธฐ์  ์‹ ํ˜ธ๋กœ ๊ตฌ๋ถ„ํ•  ์ˆ˜ ์žˆ๋Š”๋ฐ, ๋ณธ ์—ฐ๊ตฌ๋Š” ์ด๋Ÿฌํ•œ ๋‘ ์œ ํ˜•์˜ ์‹ ํ˜ธ๋“ค์— ๋Œ€ํ•œ ํŒจํ„ด ์ธ์‹์„ ์œ„ํ•ด ๋‘ ๊ฐ€์ง€ ์ข…๋‹จ ์‹ฌ์ธต ํ•™์Šต๋ง์— ๋Œ€ํ•œ ์„ค๊ณ„ ๋ฐฉ๋ฒ•๋ก ์„ ์ œ์•ˆํ•œ๋‹ค. ์ฒซ ๋ฒˆ์งธ ์ œ์•ˆ๋œ ๋ฐฉ๋ฒ•๋ก ์„ ์ด์šฉํ•ด ์„ค๊ณ„๋œ ๋ชจ๋ธ์€ ์‹ ํ˜ธ์˜ ์ฃผ๊ธฐ์  ํŠน์„ฑ์„ ์ด์šฉํ•œ Deep ECGNet์ด๋‹ค. ์‹ฌ์žฅ ๊ทผ์œก์˜ ์ „๊ธฐ ์ƒ๋ฆฌํ•™์  ํŒจํ„ด์œผ๋กœ๋ถ€ํ„ฐ ๊ธฐ๋ก๋œ ์‹ฌ์ „๋„ (Electrocardiogram, ECG)๋Š” ์ด๋ฒคํŠธ ๊ธฐ๋ฐ˜ ์ŠคํŠธ๋ ˆ์Šค ์ˆ˜์ค€์„ ์ถ”์ •ํ•˜๊ธฐ ์œ„ํ•œ ์ฒ™๋„ (bio marker)๋ฅผ ์ œ๊ณตํ•˜๋Š” ์œ ํšจํ•œ ๋ฐ์ดํ„ฐ๊ฐ€ ๋  ์ˆ˜ ์žˆ๋‹ค. ์ „ํ†ต์ ์œผ๋กœ ์‹ฌ์ „๋„์˜ ์‹ฌ๋ฐ•์ˆ˜ ๋ณ€๋™์„ฑ (Herat Rate Variability, HRV) ๋งค๊ฐœ๋ณ€์ˆ˜ (parameter)๋Š” ์‹ฌ์žฅ ์งˆํ™˜ ํ™˜์ž์˜ ์ •์‹ ์  ์ŠคํŠธ๋ ˆ์Šค ์ƒํƒœ ๋ฐ ์‚ฌ๋ง๋ฅ ์„ ๋ชจ๋‹ˆํ„ฐ๋งํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ๋˜์—ˆ๋‹ค. ํ•˜์ง€๋งŒ, ํ‘œ์ค€ ์‹ฌ๋ฐ•์ˆ˜ ๋ณ€๋™์„ฑ ๋งค๊ฐœ ๋ณ€์ˆ˜๋Š” ์ธก์ • ์ฃผ๊ธฐ๊ฐ€ 5๋ถ„ ์ด์ƒ์œผ๋กœ, ์ธก์ • ์‹œ๊ฐ„์ด ๊ธธ๋‹ค๋Š” ๋‹จ์ ์ด ์žˆ๋‹ค. ๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” ์‹ฌ์ธต ํ•™์Šต๋ง ๋ชจ๋ธ์„ ์ด์šฉํ•˜์—ฌ 10์ดˆ ๊ฐ„๊ฒฉ์˜ ECG ๋ฐ์ดํ„ฐ๋งŒ์„ ์ด์šฉํ•˜์—ฌ, ์ถ”๊ฐ€์ ์ธ ํŠน์ง• ๋ฒกํ„ฐ์˜ ์ถ”์ถœ ๊ณผ์ • ์—†์ด ์ธ๊ฐ„์˜ ์ŠคํŠธ๋ ˆ์Šค ์ƒํƒœ๋ฅผ ์ธ์‹ํ•  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์ธ๋‹ค. ์ œ์•ˆ๋œ ์„ค๊ณ„ ๊ธฐ๋ฒ•์€ ECG ์‹ ํ˜ธ์˜ ์ฃผ๊ธฐ์  ํŠน์„ฑ์„ ๋ชจ๋ธ์— ๋ฐ˜์˜ํ•˜์˜€๋Š”๋ฐ, ECG์˜ ์€๋‹‰ ํŠน์ง• ์ถ”์ถœ๊ธฐ๋กœ ์‚ฌ์šฉ๋œ 1D CNNs ๋ฐ RNNs ๋ชจ๋ธ์˜ ์ฃผ์š” ๋งค๊ฐœ ๋ณ€์ˆ˜์— ์ฃผ๊ธฐ์  ํŠน์„ฑ์„ ๋ฐ˜์˜ํ•จ์œผ๋กœ์จ, ํ•œ ์ฃผ๊ธฐ ์‹ ํ˜ธ์˜ ์ŠคํŠธ๋ ˆ์Šค ์ƒํƒœ์— ๋”ฐ๋ฅธ ์ฃผ์š” ํŠน์ง•์ ์„ ์ข…๋‹จ ํ•™์Šต๋ง ๋‚ด๋ถ€์ ์œผ๋กœ ์ถ”์ถœํ•  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์˜€๋‹ค. ์‹คํ—˜ ๊ฒฐ๊ณผ ์ œ์•ˆ๋œ ๋ฐฉ๋ฒ•์ด ๊ธฐ์กด ์‹ฌ๋ฐ•์ˆ˜ ๋ณ€๋™์„ฑ ๋งค๊ฐœ๋ณ€์ˆ˜์™€ spectrogram ์ถ”์ถœ ๊ธฐ๋ฒ• ๊ธฐ๋ฐ˜์˜ ํŒจํ„ด ์ธ์‹ ๋ฐฉ๋ฒ•๋ณด๋‹ค ์ข‹์€ ์„ฑ๋Šฅ์„ ๋‚˜ํƒ€๋‚ด๊ณ  ์žˆ์Œ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ์—ˆ๋‹ค. ๋‘ ๋ฒˆ์งธ ์ œ์•ˆ๋œ ๋ฐฉ๋ฒ•๋ก ์€ ๋น„ ์ฃผ๊ธฐ์ ์ด๋ฉฐ ๋น„์ •์ƒ, ๋น„์„ ํ˜• ๊ทธ๋ฆฌ๊ณ  ์žก์Œ ํŠน์„ฑ์„ ์ง€๋‹Œ ์‹ ํ˜ธ์˜ ํŒจํ„ด์ธ์‹์„ ์œ„ํ•œ ์ตœ์  ์ข…๋‹จ ์‹ฌ์ธต ํ•™์Šต๋ง ์ž๋™ ์„ค๊ณ„ ๋ฐฉ๋ฒ•๋ก ์ด๋‹ค. ๋‡ŒํŒŒ ์‹ ํ˜ธ (Electroencephalogram, EEG)๋Š” ์ค‘์ถ” ์‹ ๊ฒฝ๊ณ„ (CNS)์—์„œ ๋ฐœ์ƒ๋˜์–ด ๋ฌด์˜์‹ ์ƒํƒœ์—์„œ๋„ ๋ณธ์—ฐ์˜ ๊ฐ์ • ์ƒํƒœ๋ฅผ ๋‚˜ํƒ€๋‚ด๋Š”๋ฐ, EEG ์‹ ํ˜ธ์˜ ๋‚ฎ์€ ์‹ ํ˜ธ ๋Œ€ ์žก์Œ๋น„ (SNR)๋กœ ์ธํ•ด ๋‡ŒํŒŒ๋ฅผ ์ด์šฉํ•œ ๊ฐ์ • ์ƒํƒœ ํŒ์ •์„ ์œ„ํ•ด์„œ ์ฃผ๋กœ ์ฃผํŒŒ์ˆ˜ ์˜์—ญ์˜ ์ŠคํŽ™ํŠธ๋Ÿผ ๋ถ„์„์ด ๋‡ŒํŒŒ ์—ฐ๊ตฌ์— ์ ์šฉ๋˜์–ด ์™”๋‹ค. ํ†ต์ƒ์ ์œผ๋กœ ๋‡ŒํŒŒ ์‹ ํ˜ธ๋Š” ํ‘ธ๋ฆฌ์— (Fourier) ๋˜๋Š” ์›จ์ด๋ธ”๋ › (wavelet) ๋ถ„์„์„ ์‚ฌ์šฉํ•˜์—ฌ ์—ฌ๋Ÿฌ ์ฃผํŒŒ์ˆ˜ ๋Œ€์—ญ์œผ๋กœ ํ•„ํ„ฐ๋ง ๋œ๋‹ค. ์ด๋ ‡๊ฒŒ ์ถ”์ถœ๋œ ์ฃผํŒŒ์ˆ˜ ํŠน์ง• ๋ฒกํ„ฐ๋Š” ๋ณดํ†ต ์–•์€ ํ•™์Šต ๋ถ„๋ฅ˜๊ธฐ (shallow machine learning classifier)์˜ ์ž…๋ ฅ์œผ๋กœ ์‚ฌ์šฉ๋˜์–ด ํŒจํ„ด ์ธ์‹์„ ์ˆ˜ํ–‰ํ•˜๊ฒŒ ๋œ๋‹ค. ๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” ์ด๋Ÿฌํ•œ ๊ธฐ๋ณธ์ ์ธ ํŠน์ง• ๋ฒกํ„ฐ ์ถ”์ถœ ๊ณผ์ •์ด ์—†๋Š” ๋ฒ ์ด์ง€์•ˆ ์ตœ์ ํ™” (Bayesian optimization) ๊ธฐ๋ฒ•์„ ์ด์šฉํ•œ ์ข…๋‹จ ์‹ฌ์ธต ํ•™์Šต๋ง ์ž๋™ ์„ค๊ณ„ ๊ธฐ๋ฒ•์„ ์ œ์•ˆํ•œ๋‹ค. ๋ฒ ์ด์ง€์•ˆ ์ตœ์ ํ™” ๊ธฐ๋ฒ•์€ ์ดˆ ๋งค๊ฐœ๋ณ€์ˆ˜ (hyperparamters)๋ฅผ ์ตœ์ ํ™”ํ•˜๊ธฐ ์œ„ํ•œ ๊ธฐ๊ณ„ ํ•™์Šต ๋ถ„์•ผ์˜ ๋Œ€ํ‘œ์ ์ธ ์ตœ์ ํ™” ๊ธฐ๋ฒ•์ธ๋ฐ, ์ตœ์ ํ™” ๊ณผ์ •์—์„œ ํ‰๊ฐ€ ์‹œ๊ฐ„์ด ๋งŽ์ด ์†Œ์š”๋˜๋Š” ๋ชฉ์  ํ•จ์ˆ˜ (expensive black box function)๋ฅผ ๊ฐ–๊ณ  ์žˆ๋Š” ์ตœ์ ํ™” ๋ฌธ์ œ์— ์ ํ•ฉํ•˜๋‹ค. ์ด๋Ÿฌํ•œ ๋ฒ ์ด์ง€์•ˆ ์ตœ์ ํ™”๋ฅผ ์ด์šฉํ•˜์—ฌ ๊ธฐ๋ณธ์ ์ธ ํ•™์Šต ๋ชจ๋ธ์ธ 1D CNNs ๋ฐ RNNs์˜ ์ „์ฒด ๋ชจ๋ธ์˜ ์ดˆ ๋งค๊ฐœ๋ณ€์ˆ˜ ๋ฐ ๊ตฌ์กฐ์  ์ตœ์ ํ™”๋ฅผ ์ˆ˜ํ–‰ํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•˜์˜€์œผ๋ฉฐ, ์ œ์•ˆ๋œ ๋ฐฉ๋ฒ•๋ก ์„ ๋ฐ”ํƒ•์œผ๋กœ Deep EEGNet์ด๋ผ๋Š” ์ธ๊ฐ„์˜ ๊ฐ์ •์ƒํƒœ๋ฅผ ํŒ๋ณ„ํ•  ์ˆ˜ ์žˆ๋Š” ๋ชจ๋ธ์„ ์ œ์•ˆํ•˜์˜€๋‹ค. ์—ฌ๋Ÿฌ ์‹คํ—˜์„ ํ†ตํ•ด ์ œ์•ˆ๋œ ๋ชจ๋ธ์ด ๊ธฐ์กด์˜ ์ฃผํŒŒ์ˆ˜ ํŠน์ง• ๋ฒกํ„ฐ (band power feature) ์ถ”์ถœ ๊ธฐ๋ฒ• ๊ธฐ๋ฐ˜์˜ ์ „ํ†ต์ ์ธ ๊ฐ์ • ํŒจํ„ด ์ธ์‹ ๋ฐฉ๋ฒ•๋ณด๋‹ค ์ข‹์€ ์„ฑ๋Šฅ์„ ๋‚˜ํƒ€๋‚ด๊ณ  ์žˆ์Œ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ์—ˆ๋‹ค. ๊ฒฐ๋ก ์ ์œผ๋กœ ๋ณธ ๋…ผ๋ฌธ์€ ์‹œ๊ณ„์—ด ๋ฐ์ดํ„ฐ๋ฅผ ์ด์šฉํ•œ ํŒจํ„ด ์ธ์‹๋ฌธ์ œ๋ฅผ ์—ฌ๋Ÿฌ ํŠน์ง• ๋ฒกํ„ฐ ์ถ”์ถœ ๊ธฐ๋ฒ• ๊ธฐ๋ฐ˜์˜ ์ „ํ†ต์ ์ธ ๋ฐฉ๋ฒ•์„ ํ†ตํ•ด ์„ค๊ณ„ํ•˜๋Š” ๋ฐฉ๋ฒ•๋ถ€ํ„ฐ, ์ถ”๊ฐ€์ ์ธ ํŠน์ง• ๋ฒกํ„ฐ ์ถ”์ถœ ๊ณผ์ • ์—†์ด ์›๋ณธ ๋ฐ์ดํ„ฐ๋งŒ์„ ์ด์šฉํ•˜์—ฌ ์ข…๋‹จ ์‹ฌ์ธต ํ•™์Šต๋ง์„ ์„ค๊ณ„ํ•˜๋Š” ๋ฐฉ๋ฒ•๊นŒ์ง€ ์ œ์•ˆํ•˜์˜€๋‹ค. ๋˜ํ•œ, ๋‹ค์–‘ํ•œ ์‹คํ—˜์„ ํ†ตํ•ด ์ œ์•ˆ๋œ ๋ฐฉ๋ฒ•๋ก ์ด ์‹œ๊ณ„์—ด ์‹ ํ˜ธ ๋ฐ์ดํ„ฐ๋ฅผ ์ด์šฉํ•œ ํŒจํ„ด ์ธ์‹ ๋ฌธ์ œ์— ํšจ๊ณผ์ ์œผ๋กœ ์ ์šฉ๋  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์˜€๋‹ค.Chapter 1 Introduction 1 1.1 Pattern Recognition in Time Series 1 1.2 Major Problems in Conventional Approaches 7 1.3 The Proposed Approach and its Contribution 8 1.4 Thesis Organization 10 Chapter 2 Related Works 12 2.1 Pattern Recognition in Time Series using Conventional Methods 12 2.1.1 Time Domain Features 12 2.1.2 Frequency Domain Features 14 2.1.3 Signal Processing based on Multi-variate Empirical Mode Decomposition (MEMD) 15 2.1.4 Statistical Time Series Model (ARIMA) 18 2.2 Fundamental Deep Learning Algorithms 20 2.2.1 Convolutional Neural Networks (CNNs) 20 2.2.2 Recurrent Neural Networks (RNNs) 22 2.3 Hyper Parameters and Structural Optimization Techniques 24 2.3.1 Grid and Random Search Algorithms 24 2.3.2 Bayesian Optimization 25 2.3.3 Neural Architecture Search 28 2.4 Research Trends related to Time Series Data 29 2.4.1 Generative Model of Raw Audio Waveform 30 Chapter 3 Preliminary Researches: Patten Recognition in Time Series using Various Feature Extraction Methods 31 3.1 Conventional Methods using Time and Frequency Features: Motor Imagery Brain Response Classification 31 3.1.1 Introduction 31 3.1.2 Methods 32 3.1.3 Ensemble Classification Method (Stacking & AdaBoost) 32 3.1.4 Sensitivity Analysis 33 3.1.5 Classification Results 36 3.2 Statistical Feature Extraction Methods: ARIMA Model Based Feature Extraction Methodology 38 3.2.1 Introduction 38 3.2.2 ARIMA Model 38 3.2.3 Signal Processing 39 3.2.4 ARIMA Model Conformance Test 40 3.2.5 Experimental Results 40 3.2.6 Summary 43 3.3 Application on Specific Time Series Data: Human Stress States Recognition using Ultra-Short-Term ECG Spectral Feature 44 3.3.1 Introduction 44 3.3.2 Experiments 45 3.3.3 Classification Methods 49 3.3.4 Experimental Results 49 3.3.5 Summary 56 Chapter 4 Master Framework for Pattern Recognition in Time Series 57 4.1 The Concept of the Proposed Framework for Pattern Recognition in Time Series 57 4.1.1 Optimal Basic Deep Learning Models for the Proposed Framework 57 4.2 Two Categories for Pattern Recognition in Time Series Data 59 4.2.1 The Proposed Deep Learning Framework for Periodic Time Series Signals 59 4.2.2 The Proposed Deep Learning Framework for Non-periodic Time Series Signals 61 4.3 Expanded Models of the Proposed Master Framework for Pattern Recogntion in Time Series 63 Chapter 5 Deep Learning Model Design Methodology for Periodic Signals using Prior Knowledge: Deep ECGNet 65 5.1 Introduction 65 5.2 Materials and Methods 67 5.2.1 Subjects and Data Acquisition 67 5.2.2 Conventional ECG Analysis Methods 72 5.2.3 The Initial Setup of the Deep Learning Architecture 75 5.2.4 The Deep ECGNet 78 5.3 Experimental Results 83 5.4 Summary 98 Chapter 6 Deep Learning Model Design Methodology for Non-periodic Time Series Signals using Optimization Techniques: Deep EEGNet 100 6.1 Introduction 100 6.2 Materials and Methods 104 6.2.1 Subjects and Data Acquisition 104 6.2.2 Conventional EEG Analysis Methods 106 6.2.3 Basic Deep Learning Units and Optimization Technique 108 6.2.4 Optimization for Deep EEGNet 109 6.2.5 Deep EEGNet Architectures using the EEG Channel Grouping Scheme 111 6.3 Experimental Results 113 6.4 Summary 124 Chapter 7 Concluding Remarks 126 7.1 Summary of Thesis and Contributions 126 7.2 Limitations of the Proposed Methods 128 7.3 Suggestions for Future Works 129 Bibliography 131 ์ดˆ ๋ก 139Docto

    A Cluster-Based Opposition Differential Evolution Algorithm Boosted by a Local Search for ECG Signal Classification

    Full text link
    Electrocardiogram (ECG) signals, which capture the heart's electrical activity, are used to diagnose and monitor cardiac problems. The accurate classification of ECG signals, particularly for distinguishing among various types of arrhythmias and myocardial infarctions, is crucial for the early detection and treatment of heart-related diseases. This paper proposes a novel approach based on an improved differential evolution (DE) algorithm for ECG signal classification for enhancing the performance. In the initial stages of our approach, the preprocessing step is followed by the extraction of several significant features from the ECG signals. These extracted features are then provided as inputs to an enhanced multi-layer perceptron (MLP). While MLPs are still widely used for ECG signal classification, using gradient-based training methods, the most widely used algorithm for the training process, has significant disadvantages, such as the possibility of being stuck in local optimums. This paper employs an enhanced differential evolution (DE) algorithm for the training process as one of the most effective population-based algorithms. To this end, we improved DE based on a clustering-based strategy, opposition-based learning, and a local search. Clustering-based strategies can act as crossover operators, while the goal of the opposition operator is to improve the exploration of the DE algorithm. The weights and biases found by the improved DE algorithm are then fed into six gradient-based local search algorithms. In other words, the weights found by the DE are employed as an initialization point. Therefore, we introduced six different algorithms for the training process (in terms of different local search algorithms). In an extensive set of experiments, we showed that our proposed training algorithm could provide better results than the conventional training algorithms.Comment: 44 pages, 9 figure

    Machine Learning for Biomedical Application

    Get PDF
    Biomedicine is a multidisciplinary branch of medical science that consists of many scientific disciplines, e.g., biology, biotechnology, bioinformatics, and genetics; moreover, it covers various medical specialties. In recent years, this field of science has developed rapidly. This means that a large amount of data has been generated, due to (among other reasons) the processing, analysis, and recognition of a wide range of biomedical signals and images obtained through increasingly advanced medical imaging devices. The analysis of these data requires the use of advanced IT methods, which include those related to the use of artificial intelligence, and in particular machine learning. It is a summary of the Special Issue โ€œMachine Learning for Biomedical Applicationโ€, briefly outlining selected applications of machine learning in the processing, analysis, and recognition of biomedical data, mostly regarding biosignals and medical images

    Hardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applications

    Get PDF
    With the advent of dedicated Deep Learning (DL) accelerators and neuromorphic processors, new opportunities are emerging for applying deep and Spiking Neural Network (SNN) algorithms to healthcare and biomedical applications at the edge. This can facilitate the advancement of the medical Internet of Things (IoT) systems and Point of Care (PoC) devices. In this paper, we provide a tutorial describing how various technologies ranging from emerging memristive devices, to established Field Programmable Gate Arrays (FPGAs), and mature Complementary Metal Oxide Semiconductor (CMOS) technology can be used to develop efficient DL accelerators to solve a wide variety of diagnostic, pattern recognition, and signal processing problems in healthcare. Furthermore, we explore how spiking neuromorphic processors can complement their DL counterparts for processing biomedical signals. After providing the required background, we unify the sparsely distributed research on neural network and neuromorphic hardware implementations as applied to the healthcare domain. In addition, we benchmark various hardware platforms by performing a biomedical electromyography (EMG) signal processing task and drawing comparisons among them in terms of inference delay and energy. Finally, we provide our analysis of the field and share a perspective on the advantages, disadvantages, challenges, and opportunities that different accelerators and neuromorphic processors introduce to healthcare and biomedical domains. This paper can serve a large audience, ranging from nanoelectronics researchers, to biomedical and healthcare practitioners in grasping the fundamental interplay between hardware, algorithms, and clinical adoption of these tools, as we shed light on the future of deep networks and spiking neuromorphic processing systems as proponents for driving biomedical circuits and systems forward.Comment: Submitted to IEEE Transactions on Biomedical Circuits and Systems (21 pages, 10 figures, 5 tables

    Advanced Signal Processing in Wearable Sensors for Health Monitoring

    Get PDF
    Smart, wearables devices on a miniature scale are becoming increasingly widely available, typically in the form of smart watches and other connected devices. Consequently, devices to assist in measurements such as electroencephalography (EEG), electrocardiogram (ECG), electromyography (EMG), blood pressure (BP), photoplethysmography (PPG), heart rhythm, respiration rate, apnoea, and motion detection are becoming more available, and play a significant role in healthcare monitoring. The industry is placing great emphasis on making these devices and technologies available on smart devices such as phones and watches. Such measurements are clinically and scientifically useful for real-time monitoring, long-term care, and diagnosis and therapeutic techniques. However, a pertaining issue is that recorded data are usually noisy, contain many artefacts, and are affected by external factors such as movements and physical conditions. In order to obtain accurate and meaningful indicators, the signal has to be processed and conditioned such that the measurements are accurate and free from noise and disturbances. In this context, many researchers have utilized recent technological advances in wearable sensors and signal processing to develop smart and accurate wearable devices for clinical applications. The processing and analysis of physiological signals is a key issue for these smart wearable devices. Consequently, ongoing work in this field of study includes research on filtration, quality checking, signal transformation and decomposition, feature extraction and, most recently, machine learning-based methods

    Deep Learning in Cardiology

    Full text link
    The medical field is creating large amount of data that physicians are unable to decipher and use efficiently. Moreover, rule-based expert systems are inefficient in solving complicated medical tasks or for creating insights using big data. Deep learning has emerged as a more accurate and effective technology in a wide range of medical problems such as diagnosis, prediction and intervention. Deep learning is a representation learning method that consists of layers that transform the data non-linearly, thus, revealing hierarchical relationships and structures. In this review we survey deep learning application papers that use structured data, signal and imaging modalities from cardiology. We discuss the advantages and limitations of applying deep learning in cardiology that also apply in medicine in general, while proposing certain directions as the most viable for clinical use.Comment: 27 pages, 2 figures, 10 table

    An algorithm for heart rate extraction from acoustic recordings at the neck

    No full text
    Heart rate is an important physiological parameter to assess the cardiac condition of an individual and is traditionally determined by attaching multiple electrodes on the chest of a subject to record the electrical activity of the heart. The installation and handling complexities of such systems does not prove feasible for a user to undergo a long-term monitoring in the home settings. A small-sized, battery-operated wearable monitoring device is placed on the suprasternal notch at neck to record acoustic signals containing information about breathing and cardiac sounds. The heart sounds obtained are heavily corrupted by the respiratory cycles and other external artifacts. This paper presents a novel algorithm for reliably extracting the heart rate from such acoustic recordings, keeping in mind the constraints posed by the wearable technology. The methodology constructs the Hilbert energy envelope of the signal by calculating its instantaneous characteristics to segment and classify a cardiac cycle into S1 and S2 sounds using their timing characteristics. The algorithm is tested on a dataset consisting of 13 subjects with an approximate data length of 75 hours and achieves an accuracy of 94.34%, an RMS error of 3.96 bpm and a correlation coefficient of 0.93 with reference to a commercial device in use

    Cardiovascular information for improving biometric recognition

    Get PDF
    Menciรณn Internacional en el tรญtulo de doctorThe improvements of the last two decades in data modeling and computing have lead to new biometric modalities. The Electrocardiogram (ECG) modality is part of them, and has been mainly researched by using public databases related to medical training. Despite of being useful for initial approaches, they are not representative of a real biometric environment. In addition, publishing and creating a new database is none trivial due to human resources and data protection laws. The main goal of this thesis is to successfully use ECG as a biometric signal while getting closer to the real case scenario. Every experiment considers low computational calculations and transformations to help in potential portability. The core experiments in this work come from a private database with different positions, time and heart rate scenarios. An initial segmentation evaluation is achieved with the help of fiducial point detection which determines the QRS selection as the input data for all the experiments. The approach of training a model per user (open-set) is tested with different machine learning algorithms, only getting an acceptable result with Gaussian Mixture Models (GMM). However, the concept of training all users in one model (closed-set) shows more potential with Linear Discriminant Analysis (LDA), whose results were improved in 40%. The results with LDA are also tested as a multi-modality technique, decreasing the Equal Error Rate (EER) of fingerprint verification in up to 70.64% with score fusion, and reaching 0% in Protection Attack Detection (PAD). The Multilayer Perceptron (MLP) algorithm enhances these results in verification while applying the first differentiation to the signal. The network optimization is achieved with EER as an observation metric, and improves the results of LDA in 22% for the worst case scenario, and decreases the EER to 0% in the best case. Complexity is added creating a Convolutional Neural Network (CNN) and Long-Short Term Memory (LSTM) based network, BioECG. The tuning process is achieved without extra feature transformation and is evaluated through accuracy, aiming for good identification. The inclusion of a second day of enrollment in improves results from MLP, reaching the overall lowest results of 0.009%โ€“1.352% in EER. Throughout the use of good quality signals, position changes did not noticeably impact the verification. In addition, collecting data in a different day or in a different hour did not clearly affect the performance. Moreover, modifying the verification process based on attempts, improves the overall results, up to reach a 0% EER when applying BioECG. Finally, to get closer to a real scenario, a smartband prototype is used to collect new databases. A private database with limited scenarios but controlled data, and another local database with a wider range of scenarios and days, and with a more relaxed use of the device. Applying the concepts of first differentiation and MLP, these signals required the Stationary Wavelet Transform (SWT) and new fiducial point detection to improve their results. The first database gave subtle chances of being used in identification with up to 78.2% accuracy, but the latter was completely discarded for this purpose. These realistic experiments show the impact of a low fidelity sensor, even considering the same modifications in previous successful experiments with better quality data, reaching up to 13.530% EER. In the second database, results reach a range of 0.068%โ€“31.669% EER. This type of sensor is affected by heart rate changes, but also by position variations, given its sensitivity to movement.Las mejoras en modelado de datos y computaciรณn de las รบltimas dos dรฉcadas, han llevado a la creaciรณn de nuevas modalidades biomรฉtricas. La modalidad de electrocardiograma (ECG) es una de ellas, la cual se ha investigado usando bases de datos pรบblicas que fueron creadas para entrenamiento de profesional mรฉdico. Aunque estos datos han sido รบtiles para los estados iniciales de la modalidad, no son representativos de un entorno biomรฉtrico real. Ademรกs, publicar y crear bases de datos nuevas son problemas no triviales debido a los recursos humanos y las leyes de protecciรณn de datos. El principal objetivo de esta tesis es usar exitosamente datos de ECG como seรฑales biomรฉtricas a la vez que nos acercamos a un escenario realista. Cada experimento considera cรกlculos y transformadas de bajo coste computacional para ayudar en su potencial uso en aparatos mรณviles. Los principales experimentos de este trabajo se producen con una base de datos privada con diferentes escenarios en tรฉrminos de postura, tiempo y frecuencia cardรญaca. Con ella se evalรบan las diferentes selecciรณns del complejo QRS mediante detecciรณn de puntos fiduciales, lo cual servirรก como datos de entrada para el resto de experimentos. El enfoque de entrenar un modelo por usuario (open-set) se prueba con diferentes algoritmos de aprendizaje mรกquina (machine learning), obteniendo resultados aceptables รบnicamente mediante el uso de modelos de mezcla de Gaussianas (Gaussian Mixture Models, GMM). Sin embargo, el concepto de entrenar un modelo con todos los usuarios (closed-set) demuestra mayor potencial con Linear Discriminant Analysis (Anรกlisis de Discriminante Lineal, LDA), cuyos resultados mejoran en un 40%. Los resultados de LDA tambiรฉn se utilizan como tรฉcnica multi-modal, disminuyendo la Equal Error Rate (Tasa de Igual Error, EER) de la verificaciรณn mediante huella en hasta un 70.64% con fusiรณn de puntuaciรณn, y llegando a un sistema con un 0% de EER en Detecciรณn de Ataques de Presentaciรณn (Presentation Attack Detection, PAD). El algoritmo de Perceptrรณn Multicapa (Multilayer Perceptron, MLP) mejora los resultados previos en verificaciรณn aplicando la primera derivada a la seรฑal. La optimizaciรณn de la red se consigue en base a su EER, mejora la de LDA en hasta un 22% en el peor caso, y la lleva hasta un 0% en el mejor caso. Se aรฑade complejidad creando una red neural convolucional (Convolutional Neural Network, CNN) con una red de memoria a largo-corto plazo (Long-Short Term Memory, LSTM), llamada BioECG. El proceso de ajuste de hiperparรกmetros se lleva acabo sin transformaciones y se evalรบa observando la accuracy (precisiรณn), para mejorar la identificaciรณn. Sin embargo, incluir un segundo dรญa de registro (enrollment) con BioECG, estos resultados mejoran hasta un 74% para el peor caso, llegando a los resultados mรกs bajos hasta el momento con 0.009%โ€“1.352% en la EER. Durante el uso de seรฑales de buena calidad, los cambios de postura no afectaron notablemente a la verificaciรณn. Ademรกs, adquirir los datos en dรญas u horas diferentes tampoco afectรณ claramente a los resultados. Asimismo, modificar el proceso de verificaciรณn en base a intentos tambiรฉn produce mejorรญa en todos los resultados, hasta el punto de llegar a un 0% de EER cuando se aplica BioECG. Finalmente, para acercarnos al caso mรกs realista, se usa un prototipo de pulsera para capturar nuevas bases de datos. Una base de datos privada con escenarios limitados pero datos mรกs controlados, y otra base de datos local con mรกs espectro de escenarios y dรญas y un uso del dispositivo mรกs relajado. Para estos datos se aplican los conceptos de primera diferenciaciรณn en MLP, cuyas seรฑales requieren la Transformada de Wavelet Estacionaria (Stationary Wavelet Transform, SWT) y un detector de puntos fiduciales para mejorar los resultados. La primera base de datos da opciones a ser usada para identificaciรณn con un mรกximo de precisiรณn del 78.2%, pero la segunda se descartรณ completamente para este propรณsito. Estos experimentos mรกs realistas demuestran el impact de tener un sensor de baja fidelidad, incluso considerando las mismas modificaciones que previamente tuvieron buenos resultados en datos mejores, llegando a un 13.530% de EER. En la segunda base de datos, los resultados llegan a un rango de 0.068%โ€“31.669% en EER. Este tipo de sensor se ve afectado por las variaciones de frecuencia cardรญaca, pero tambiรฉn por el cambio de posiciรณn, dado que es mรกs sensible al movimiento.Programa de Doctorado en Ingenierรญa Elรฉctrica, Electrรณnica y Automรกtica por la Universidad Carlos III de MadridPresidente: Cristina Conde Vilda.- Secretario: Mariano Lรณpez Garcรญa.- Vocal: Young-Bin Know

    A survey of the application of soft computing to investment and financial trading

    Get PDF

    Computational Intelligence in Healthcare

    Get PDF
    This book is a printed edition of the Special Issue Computational Intelligence in Healthcare that was published in Electronic
    • โ€ฆ
    corecore