생물학적 서열 데이터에 대한 표현 학습

학위논문(박사) -- 서울대학교대학원 : 공과대학 전기·정보공학부, 2021.8. 윤성로.As we are living in the era of big data, the biomedical domain is not an exception. With the advent of technologies such as next-generation sequencing, developing methods to capitalize on the explosion of biomedical data is one of the most major challenges in bioinformatics. Representation learning, in particular deep learning, has made significant advancements in diverse fields where the artificial intelligence community has struggled for many years. However, although representation learning has also shown great promises in bioinformatics, it is not a silver bullet. Off-the-shelf applications of representation learning cannot always provide successful results for biological sequence data. There remain full of challenges and opportunities to be explored. This dissertation presents a set of representation learning methods to address three issues in biological sequence data analysis. First, we propose a two-stage training strategy to address throughput and information trade-offs within wet-lab CRISPR-Cpf1 activity experiments. Second, we propose an encoding scheme to model interaction between two sequences for functional microRNA target prediction. Third, we propose a self-supervised pre-training method to bridge the exponentially growing gap between the numbers of unlabeled and labeled protein sequences. In summary, this dissertation proposes a set of representation learning methods that can derive invaluable information from the biological sequence data.우리는 빅데이터의 시대를 맞이하고 있으며, 의생명 분야 또한 예외가 아니다. 차세대 염기서열 분석과 같은 기술들이 도래함에 따라, 폭발적인 의생명 데이터의 증가를 활용하기 위한 방법론의 개발은 생물정보학 분야의 주요 과제 중의 하나이다. 심층 학습을 포함한 표현 학습 기법들은 인공지능 학계가 오랫동안 어려움을 겪어온 다양한 분야에서 상당한 발전을 이루었다. 표현 학습은 생물정보학 분야에서도 많은 가능성을 보여주었다. 하지만 단순한 적용으로는 생물학적 서열 데이터 분석의 성공적인 결과를 항상 얻을 수는 않으며, 여전히 연구가 필요한 많은 문제들이 남아있다. 본 학위논문은 생물학적 서열 데이터 분석과 관련된 세 가지 사안을 해결하기 위해, 표현 학습에 기반한 일련의 방법론들을 제안한다. 첫 번째로, 유전자가위 실험 데이터에 내재된 정보와 수율의 균형에 대처할 수 있는 2단계 학습 기법을 제안한다. 두 번째로, 두 염기 서열 간의 상호 작용을 학습하기 위한 부호화 방식을 제안한다. 세 번째로, 기하급수적으로 증가하는 특징되지 않은 단백질 서열을 활용하기 위한 자기 지도 사전 학습 기법을 제안한다. 요약하자면, 본 학위논문은 생물학적 서열 데이터를 분석하여 중요한 정보를 도출할 수 있는 표현 학습에 기반한 일련의 방법론들을 제안한다.1 Introduction 1 1.1 Motivation 1 1.2 Contents of Dissertation 4 2 Background 8 2.1 Representation Learning 8 2.2 Deep Neural Networks 12 2.2.1 Multi-layer Perceptrons 12 2.2.2 Convolutional Neural Networks 14 2.2.3 Recurrent Neural Networks 16 2.2.4 Transformers 19 2.3 Training of Deep Neural Networks 23 2.4 Representation Learning in Bioinformatics 26 2.5 Biological Sequence Data Analyses 29 2.6 Evaluation Metrics 32 3 CRISPR-Cpf1 Activity Prediction 36 3.1 Methods 39 3.1.1 Model Architecture 39 3.1.2 Training of Seq-deepCpf1 and DeepCpf1 41 3.2 Experiment Results 44 3.2.1 Datasets 44 3.2.2 Baselines 47 3.2.3 Evaluation of Seq-deepCpf1 49 3.2.4 Evaluation of DeepCpf1 51 3.3 Summary 55 4 Functional microRNA Target Prediction 56 4.1 Methods 62 4.1.1 Candidate Target Site Selection 63 4.1.2 Input Encoding 64 4.1.3 Residual Network 67 4.1.4 Post-processing 68 4.2 Experiment Results 70 4.2.1 Datasets 70 4.2.2 Classification of Functional and Non-functional Targets 71 4.2.3 Distinguishing High-functional Targets 73 4.2.4 Ablation Studies 76 4.3 Summary 77 5 Self-supervised Learning of Protein Representations 78 5.1 Methods 83 5.1.1 Pre-training Procedure 83 5.1.2 Fine-tuning Procedure 86 5.1.3 Model Architecturen 87 5.2 Experiment Results 90 5.2.1 Experiment Setup 90 5.2.2 Pre-training Results 92 5.2.3 Fine-tuning Results 93 5.2.4 Comparison with Larger Protein Language Models 97 5.2.5 Ablation Studies 100 5.2.6 Qualitative Interpreatation Analyses 103 5.3 Summary 106 6 Discussion 107 6.1 Challenges and Opportunities 107 7 Conclusion 111 Bibliography 113 Abstract in Korean 130박

An efficient emotion classification system using EEG

Emotion classification via Electroencephalography (EEG) is used to find the relationships between EEG signals and human emotions. There are many available channels, which consist of electrodes capturing brainwave activity. Some applications may require a reduced number of channels and frequency bands to shorten the computation time, facilitate human comprehensibility, and develop a practical wearable. In prior research, different sets of channels and frequency bands have been used. In this study, a systematic way of selecting the set of channels and frequency bands has been investigated, and results shown that by using the reduced number of channels and frequency bands, it can achieve similar accuracies. The study also proposed a method used to select the appropriate features using the Relief F method. The experimental results of this study showed that the method could reduce and select appropriate features confidently and efficiently. Moreover, the Fuzzy Support Vector Machine (FSVM) is used to improve emotion classification accuracy, as it was found from this research that it performed better than the Support Vector Machine (SVM) in handling the outliers, which are typically presented in the EEG signals. Furthermore, the FSVM is treated as a black-box model, but some applications may need to provide comprehensible human rules. Therefore, the rules are extracted using the Classification and Regression Trees (CART) approach to provide human comprehensibility to the system. The FSVM and rule extraction experiments showed that The FSVM performed better than the SVM in classifying the emotion of interest used in the experiments, and rule extraction from the FSVM utilizing the CART (FSVM-CART) had a good trade-off between classification accuracy and human comprehensibility

Aerospace Medicine and Biology: A continuing bibliography with indexes (supplement 134)

This special bibliography lists 301 reports, articles, and other documents introduced into the NASA Scientific and Technical Information System in October 1974

Neuroinformatics in Functional Neuroimaging

This Ph.D. thesis proposes methods for information retrieval in functional neuroimaging through automatic computerized authority identification, and searching and cleaning in a neuroscience database. Authorities are found through cocitation analysis of the citation pattern among scientific articles. Based on data from a single scientific journal it is shown that multivariate analyses are able to determine group structure that is interpretable as particular “known ” subgroups in functional neuroimaging. Methods for text analysis are suggested that use a combination of content and links, in the form of the terms in scientific documents and scientific citations, respectively. These included context sensitive author ranking and automatic labeling of axes and groups in connection with multivariate analyses of link data. Talairach foci from the BrainMap ™ database are modeled with conditional probability density models useful for exploratory functional volumes modeling. A further application is shown with conditional outlier detection where abnormal entries in the BrainMap ™ database are spotted using kernel density modeling and the redundancy between anatomical labels and spatial Talairach coordinates. This represents a combination of simple term and spatial modeling. The specific outliers that were found in the BrainMap ™ database constituted among others: Entry errors, errors in the article and unusual terminology

Activation of the pro-resolving receptor Fpr2 attenuates inflammatory microglial activation

Poster number: P-T099 Theme: Neurodegenerative disorders & ageing Activation of the pro-resolving receptor Fpr2 reverses inflammatory microglial activation Authors: Edward S Wickstead - Life Science & Technology University of Westminster/Queen Mary University of London Inflammation is a major contributor to many neurodegenerative disease (Heneka et al. 2015). Microglia, as the resident immune cells of the brain and spinal cord, provide the first line of immunological defence, but can become deleterious when chronically activated, triggering extensive neuronal damage (Cunningham, 2013). Dampening or even reversing this activation may provide neuronal protection against chronic inflammatory damage. The aim of this study was to determine whether lipopolysaccharide (LPS)-induced inflammation could be abrogated through activation of the receptor Fpr2, known to play an important role in peripheral inflammatory resolution. Immortalised murine microglia (BV2 cell line) were stimulated with LPS (50ng/ml) for 1 hour prior to the treatment with one of two Fpr2 ligands, either Cpd43 or Quin-C1 (both 100nM), and production of nitric oxide (NO), tumour necrosis factor alpha (TNFα) and interleukin-10 (IL-10) were monitored after 24h and 48h. Treatment with either Fpr2 ligand significantly suppressed LPS-induced production of NO or TNFα after both 24h and 48h exposure, moreover Fpr2 ligand treatment significantly enhanced production of IL-10 48h post-LPS treatment. As we have previously shown Fpr2 to be coupled to a number of intracellular signaling pathways (Cooray et al. 2013), we investigated potential signaling responses. Western blot analysis revealed no activation of ERK1/2, but identified a rapid and potent activation of p38 MAP kinase in BV2 microglia following stimulation with Fpr2 ligands. Together, these data indicate the possibility of exploiting immunomodulatory strategies for the treatment of neurological diseases, and highlight in particular the important potential of resolution mechanisms as novel therapeutic targets in neuroinflammation. References Cooray SN et al. (2013). Proc Natl Acad Sci U S A 110: 18232-7. Cunningham C (2013). Glia 61: 71-90. Heneka MT et al. (2015). Lancet Neurol 14: 388-40

Effects of Diversity and Neuropsychological Performance in an NFL Cohort

Objective: The aim of this study was to examine the effect of ethnicity on neuropsychological test performance by comparing scores of white and black former NFL athletes on each subtest of the WMS. Participants and Methods: Data was derived from a de-identified database in South Florida consisting of 63 former NFL white (n=28, 44.4%) and black (n=35, 55.6%) athletes (Mage= 50.38; SD= 11.57). Participants completed the following subtests of the WMS: Logical Memory I and II, Verbal Paired Associates I and II, and Visual Reproduction I and II. Results: A One-Way ANOVA yielded significant effect between ethnicity and performance on several subtests from the WMS-IV. Black athletes had significantly lower scores compared to white athletes on Logical Memory II: F(1,61) = 4.667, p= .035, Verbal Paired Associates I: F(1,61) = 4.536, p = .037, Verbal Paired Associates: II F(1,61) = 4.677, p = .034, and Visual Reproduction I: F(1,61) = 6.562, p = .013. Conclusions: Results suggest significant differences exist between white and black athletes on neuropsychological test performance, necessitating the need for proper normative samples for each ethnic group. It is possible the differences found can be explained by the psychometric properties of the assessment and possibility of a non-representative sample for minorities, or simply individual differences. Previous literature has found white individuals to outperform African-Americans on verbal and non-verbal cognitive tasks after controlling for socioeconomic and other demographic variables (Manly & Jacobs, 2002). This highlights the need for future investigators to identify cultural factors and evaluate how ethnicity specifically plays a role on neuropsychological test performance. Notably, differences between ethnic groups can have significant implications when evaluating a sample of former athletes for cognitive impairment, as these results suggest retired NFL minorities may be more impaired compared to retired NFL white athletes

Distinguishing Performance on Tests of Executive Functions Between Those with Depression and Anxiety

Objective: To see if there are differences in executive functions between those diagnosed with Major Depressive Disorder (MDD) and those with Generalized Anxiety Disorder (GAD).Participants and Methods: The data were chosen from a de-identified database at a neuropsychological clinic in South Florida. The sample used was adults diagnosed with MDD (n=75) and GAD (n=71) and who had taken the Halstead Category Test, Trail Making Test, Stroop Test, and the Wisconsin Card Sorting Test. Age (M=32.97, SD=11.75), gender (56.7% female), and race (52.7% White) did not differ between groups. IQ did not differ but education did (MDD=13.41 years, SD=2.45; GAD=15.11 years, SD=2.40), so it was ran as a covariate in the analyses. Six ANCOVAs were run separately with diagnosis being held as the fixed factor and executive function test scores held as dependent variables. Results: The MDD group only performed worse on the Category Test than the GAD group ([1,132]=4.022, p\u3c .05). Even though both WCST scores used were significantly different between the two groups, both analyses failed Levene’s test of Equality of Error Variances, so the data were not interpreted. Conclusions: Due to previous findings that those diagnosed with MDD perform worse on tests of executive function than normal controls (Veiel, 1997), this study wanted to compare executive function performance between those diagnosed with MDD and those with another common psychological disorder. The fact that these two groups only differed on the Category Test shows that there may not be much of a difference in executive function deficits between those with MDD and GAD. That being said, not being able to interpret the scores on the WCST test due to a lack of homogeneity of variance indicates that a larger sample size is needed to compare these two types of patients, as significant differences may be found. The results of this specific study, however, could mean that the Category Test could be used in assisting the diagnosis of a MDD patient

The Effect of Ethnicity on Neuropsychological Test Performance of Former NFL Athletes

Objective: To investigate the effect of ethnicity on neuropsychological test performance by specifically exploring differences between white and black former NFL athletes on subtests of the WAIS-IV. Participants and Methods: Data was derived from a de-identified database in Florida consisting of 63 former NFL athletes (Mage=50.38; SD=11.57); 28 white and 35 black. Participants completed the following subtests of the WAIS-IV: Block Design, Similarities, Digit Span, Matrix Reasoning, Arithmetic, Symbol Search, Visual Puzzles, Coding, and Cancellation. Results: One-Way ANOVA yielded a significant effect between ethnicity and performance on several subtests. Black athletes had significantly lower scaled scores than white athletes on Block Design F(1,61)=14.266, p\u3c.001, Similarities F(1,61)=5.904, p=.018, Digit Span F(1,61)=8.985, p=.004, Arithmetic F(1,61)=16.07, p\u3c.001 and Visual Puzzles F(1,61)=16.682, p\u3c .001. No effect of ethnicity was seen on performance of Matrix Reasoning F(1,61)=2.937, p=.092, Symbol Search F(1,61)=3.619, p=.062, Coding F(1,61)=3.032, p=.087 or Cancellation F(1,61)=2.289, p=.136. Conclusions: Results reveal significant differences between white and black athletes on all subtests of the WAIS-IV but those from the Processing Speed Scale and Matrix Reasoning. These findings align with previous literature that found white individuals to outperform African-Americans on verbal and non-verbal tasks after controlling for socioeconomic and demographic variables (Manly & Jacobs, 2002). These differences may also be a reflection of the WAIS-IV’s psychometric properties and it is significant to consider the normative sample used may not be appropriate for African-Americans. This study highlights the need for future research to identify how ethnicity specifically influences performance, sheds light on the importance of considering cultural factors when interpreting test results, and serves as a call to action to further understand how and why minorities may not be accurately represented in neuropsychological testing

Regional Cerebral Blood Flow Patterns in Children vs. Adults with ADHD Combined and Inattentive Types: A SPECT Study

Objective: The current study sought to determine whether ADHD Combined Type (ADHD-C) and ADHD Primarily Inattentive Type (ADHD-PI) showed differential regional cerebral blood flow (rCBF) patterns in children vs. adults. Participants and Methods: The overall sample (N=1484) was effectively split into four groups: adults with ADHD-PI (n=519), adults with ADHD-C (n=405), children with ADHD-PI (n=192), children with ADHD-C (n=368). All participants were void of bipolar, schizophrenia, autism, neurocognitive disorders, and TBI. The data were collected from a de-identified archival database of individuals who underwent SPECT scans at rest. Results: Using αConclusions: Overall, the current study suggested that children may show rCBF differences between different ADHD subtypes, but adults may not. The current study did not find significance in any of the 17 brain regions examined when comparing adults with ADHD-C to adults with ADHD-PI. All significant findings were attributed to the children with ADHD-C group showing aberrant blood flow rate than at least one other group. Previous research has supported that the differentiation of these subtypes as distinctive disorders is difficult to make in adults (Sobanski et al., 2006). Other research has indicated the potential of imaging techniques to differentiate the two in children (Al-Amin, Zinchenko, & Geyer, 2018). The current findings support nuanced ways in which rCBF patterns of ADHD-C and ADHD-PI differ between children and adults

Mining EEG scalp maps of independent components related to HCT tasks

This work presents an unsupervised mining strat- egy, applied to an independent component analysis (ICA) of segments of data collected while participants are answering to the items of the Halstead Category Test (HCT). This new methodology was developed to achieve signal components at trial level and therefore to study signal dynamics which are not available within participants’ ensemble average signals. The study will be focused on the signal component that can be elicited by the binary visual feedback which is part of the HCT protocol. The experimental study is conducted using a cohort of 58 participants.info:eu-repo/semantics/publishedVersio