Optimized Gated Deep Learning Architectures for Sensor Fusion

Sensor fusion is a key technology that integrates various sensory inputs to allow for robust decision making in many applications such as autonomous driving and robot control. Deep neural networks have been adopted for sensor fusion in a body of recent studies. Among these, the so-called netgated architecture was proposed, which has demonstrated improved performances over the conventional convolutional neural networks (CNN). In this paper, we address several limitations of the baseline negated architecture by proposing two further optimized architectures: a coarser-grained gated architecture employing (feature) group-level fusion weights and a two-stage gated architectures leveraging both the group-level and feature level fusion weights. Using driving mode prediction and human activity recognition datasets, we demonstrate the significant performance improvements brought by the proposed gated architectures and also their robustness in the presence of sensor noise and failures.Comment: 10 pages, 5 figures. Submitted to ICLR 201

Robust Deep Multi-Modal Sensor Fusion using Fusion Weight Regularization and Target Learning

Sensor fusion has wide applications in many domains including health care and autonomous systems. While the advent of deep learning has enabled promising multi-modal fusion of high-level features and end-to-end sensor fusion solutions, existing deep learning based sensor fusion techniques including deep gating architectures are not always resilient, leading to the issue of fusion weight inconsistency. We propose deep multi-modal sensor fusion architectures with enhanced robustness particularly under the presence of sensor failures. At the core of our gating architectures are fusion weight regularization and fusion target learning operating on auxiliary unimodal sensing networks appended to the main fusion model. The proposed regularized gating architectures outperform the existing deep learning architectures with and without gating under both clean and corrupted sensory inputs resulted from sensor failures. The demonstrated improvements are particularly pronounced when one or more multiple sensory modalities are corrupted.Comment: 8 page

A Survey of Automatic Protocol Reverse Engineering Approaches, Methods, and Tools on the Inputs and Outputs View

A network protocol defines rules that control communications between two or more machines on the Internet, whereas Automatic Protocol Reverse Engineering (APRE) defines the way of extracting the structure of a network protocol without accessing its specifications. Enough knowledge on undocumented protocols is essential for security purposes, network policy implementation, and management of network resources. This paper reviews and analyzes a total of 39 approaches, methods, and tools towards Protocol Reverse Engineering (PRE) and classifies them into four divisions, approaches that reverse engineer protocol finite state machines, protocol formats, and both protocol finite state machines and protocol formats to approaches that focus directly on neither reverse engineering protocol formats nor protocol finite state machines. The efficiency of all approaches’ outputs based on their selected inputs is analyzed in general along with appropriate reverse engineering inputs format. Additionally, we present discussion and extended classification in terms of automated to manual approaches, known and novel categories of reverse engineered protocols, and a literature of reverse engineered protocols in relation to the seven layers’ OSI (Open Systems Interconnection) model

Altered resting-state connectivity in subjects at ultra-high risk for psychosis: an fMRI study

<p>Abstract</p> <p>Background</p> <p>Individuals at ultra-high risk (UHR) for psychosis have self-disturbances and deficits in social cognition and functioning. Midline default network areas, including the medial prefrontal cortex and posterior cingulate cortex, are implicated in self-referential and social cognitive tasks. Thus, the neural substrates within the default mode network (DMN) have the potential to mediate self-referential and social cognitive information processing in UHR subjects.</p> <p>Methods</p> <p>This study utilized functional magnetic resonance imaging (fMRI) to investigate resting-state DMN and task-related network (TRN) functional connectivity in 19 UHR subjects and 20 matched healthy controls. The bilateral posterior cingulate cortex was selected as a seed region, and the intrinsic organization for all subjects was reconstructed on the basis of fMRI time series correlation.</p> <p>Results</p> <p>Default mode areas included the posterior/anterior cingulate cortices, the medial prefrontal cortex, the lateral parietal cortex, and the inferior temporal region. Task-related network areas included the dorsolateral prefrontal cortex, supplementary motor area, the inferior parietal lobule, and middle temporal cortex. Compared to healthy controls, UHR subjects exhibit hyperconnectivity within the default network regions and reduced anti-correlations (or negative correlations nearer to zero) between the posterior cingulate cortex and task-related areas.</p> <p>Conclusions</p> <p>These findings suggest that abnormal resting-state network activity may be related with the clinical features of UHR subjects. Neurodevelopmental and anatomical alterations of cortical midline structure might underlie altered intrinsic networks in UHR subjects.</p

Reduced cortical folding of the anterior cingulate cortex in obsessive-compulsive disorder

Background: Anterior cingulate cortex (ACC) abnormalities have been implicated consistently in the pathophysiology of obsessive-compulsive disorder (OCD), yet it remains unclear whether these abnormalities originated during early neurodevelopment. In this study, we examined the ACC sulcal/gyral patterns to investigate whether neurodevelopmental anomalies of the ACC were present in patients with OCD. We hypothesized that patients with OCD would show reduced cortical folding of the ACC compared with controls. Methods: We used magnetic resonance imaging (MRI) of 169 healthy volunteers and 110 patients with OCD to examine the paracingulate sulcus and cingulate sulcus. We assessed cortical folding patterns according to established classification criteria and constructed 3 categories of paracingulate sulcus morphology according to its presence and anteroposterior extent: "prominent," "present" and "absent." We classified the cingulate sulcus as "interrupted" or "continuous" according to the interruptions in its course. In addition, we evaluated ACC sulcal asymmetry based on interhemispheric comparisons of paracingulate sulcus morphology. Results: Analyses revealed that patients with OCD were significantly less likely than controls to show a well-developed left paracingulate sulcus: 50.0% of patients and 65.1% of controls showed a "prominent" or "present" paracingulate sulcus in the left hemisphere. However, there were no differences in regard to cingulate sulcus continuity, and patients also showed the same leftward ACC sulcal asymmetry as controls. Limitations: Our study was limited by the fact that we obtained the MRI scans from 2 different scanners, and we did not calculate cerebral fissurization as our study was restricted to 1 specific brain region. Moreover, patients and controls differed significantly in terms of sex ratio and IQ, although we controlled these variables as covariates. Conclusion: Our findings imply a subtle deviation in the early neurodevelopment of the ACC in patients with OCD, but the extent to which these anomalies contributed to the pathogenesis of OCD remains unclear. Further studies that link the ACC morphologic anomalies to the pathophysiology of OCD are recommended.This work was supported by Cognitive Neuroscience Program of the Korean Ministry of Science and Technology (M10644020003-08N4402-00310).Jung MH, 2009, PROG NEURO-PSYCHOPH, V33, P605, DOI 10.1016/j.pnpbp.2009.02.017Whittle S, 2009, PSYCHIAT RES-NEUROIM, V172, P68, DOI 10.1016/j.pscychresns.2008.06.005Gu BM, 2008, BRAIN, V131, P155, DOI 10.1093/brain/awm277Fornito A, 2007, ACTA PSYCHIAT SCAND, V116, P467, DOI 10.1111/j.1600-0447.2007.01069.xShin YW, 2007, HUM BRAIN MAPP, V28, P1128, DOI 10.1002/hbm.20338Huster RJ, 2007, NEUROIMAGE, V34, P888, DOI 10.1016/j.neuroimage.2006.10.023De Geus F, 2007, PSYCHIAT CLIN NEUROS, V61, P45, DOI 10.1111/j.1440-1819.2007.01609.xFornito A, 2006, SCHIZOPHR RES, V88, P192, DOI 10.1016/j.schres.2006.06.034Jang JH, 2006, AM J PSYCHIAT, V163, P1202Kim YY, 2006, BRAIN TOPOGR, V18, P201, DOI 10.1007/s10548-006-0269-2Klimkeit EI, 2006, CORTEX, V42, P113Valente AA, 2005, BIOL PSYCHIAT, V58, P479, DOI 10.1016/j.biopsych.2005.04.021Rosenberg DR, 2004, J AM ACAD CHILD PSY, V43, P1146, DOI 10.1097/01.chi.0000132812.44664.2dFornito A, 2004, CEREB CORTEX, V14, P424, DOI 10.1093/cercor/bhh004Shin YW, 2004, PSYCHIAT CLIN NEUROS, V58, P16Yucel M, 2003, BRIT J PSYCHIAT, V182, P518Yucel M, 2002, BIOL PSYCHIAT, V52, P15Lyoo IK, 2001, J CLIN PSYCHIAT, V62, P637Allman JM, 2001, ANN NY ACAD SCI, V935, P107Yucel M, 2001, CEREB CORTEX, V11, P17Bradshaw JL, 2000, BRAIN LANG, V73, P297Bush G, 2000, TRENDS COGN SCI, V4, P215Penalva J, 2000, BIOSENS BIOELECTRON, V15, P99Lohmann G, 1999, CEREB CORTEX, V9, P754Magnotta VA, 1999, CEREB CORTEX, V9, P151Tibbo P, 1999, J PSYCHIATR NEUROSCI, V24, P15Rosenberg DR, 1998, BIOL PSYCHIAT, V43, P623Purcell R, 1998, BIOL PSYCHIAT, V43, P348SAXENA S, 1998, BRIT J PSYCHIAT S, V35, P26FIRST MB, 1998, STRUCTURED CLIN INTESIEGEL S, 1998, NONPARAMETRIC STAT BRauch SL, 1997, J NEUROPSYCH CLIN N, V9, P568Bartley AJ, 1997, BRAIN, V120, P257VanEssen DC, 1997, NATURE, V385, P313Paus T, 1996, CEREB CORTEX, V6, P207FIRST MB, 1996, STRUCTURED CLIN INTEVOGT BA, 1995, J COMP NEUROL, V359, P490DEVINSKY O, 1995, BRAIN, V118, P279ARMSTRONG E, 1995, CEREB CORTEX, V5, P56PAULS DL, 1995, AM J PSYCHIAT, V152, P76KIM JS, 1995, KOREAN J CLIN PSYCHO, V14, P111*AM PSYCH ASS, 1994, DIAGN STAT MAN MENTBAXTER LR, 1992, ARCH GEN PSYCHIAT, V49, P681HUANG CC, 1991, BRAIN DEV-JPN, V13, P27WELKER W, 1990, CEREBRAL CORTEX B, V8, P3DIXON WJ, 1990, BMDP STAT SOFTWARE MHOLLANDER E, 1990, ARCH GEN PSYCHIAT, V47, P27CROW TJ, 1989, ARCH GEN PSYCHIAT, V46, P1145GOODMAN WK, 1989, ARCH GEN PSYCHIAT, V46, P1006GOODMAN WK, 1989, ARCH GEN PSYCHIAT, V46, P1012SWEDO SE, 1989, ARCH GEN PSYCHIAT, V46, P518RAKIC P, 1988, SCIENCE, V241, P170BEAR D, 1986, ARCH NEUROL-CHICAGO, V43, P598GESCHWIND N, 1985, ARCH NEUROL-CHICAGO, V42, P521FLORHENRY P, 1983, CEREBRAL BASIS PSYCH, P301CHI JG, 1977, ANN NEUROL, V1, P86ANNETT M, 1970, BRIT J PSYCHOL, V61, P303CRICHTONBROWNE J, 1879, BRAIN, V2, P42

Hearing Threshold of Korean Adolescents Associated with the Use of Personal Music Players

Purpose: Hearing loss can lead to a number of disabilities and can reduce quality of life. Noise-induced hearing losses have become more common among adolescents due to increased exposure to personal music players. We, therefore, investigated the use of personal music player among Korean adolescents and the relationship between hearing threshold and usage pattern of portable music players. Materials and Methods: A total of 490 adolescents were interviewed personally regarding their use of portable music players, including the time and type of player and the type of headphone used. Pure tone audiometry was performed in each subject. Results: Of the 490 subjects, 462 (94.3%) used personal music players and most of them have used the personal music player for 1-3 hours per day during 1-3 years. The most common type of portable music player was the MP3 player, and the most common type of headphone was the earphone (insert type). Significant elevations of hearing threshold were observed in males, in adolescents who had used portable music players for over 5 years, for those over 15 years in cumulative period and in those who had used earphones. Conclusion: Portable music players can have a deleterious effect on hearing threshold in adolescents. To preserve hearing, adolescents should avoid using portable music players for long periods of time and should avoid using earphones

Small anisotropy of the lower critical field and s±s_\pm-wave two-gap feature in single crystal LiFeAs

The in- and out-of-plane lower critical fields and magnetic penetration depths for LiFeAs were examined. The anisotropy ratio $\gamma_{H_{c1}}(0)$ is smaller than the expected theoretical value, and increased slightly with increasing temperature from 0.6$T_c$ to $T_c$. This small degree of anisotropy was numerically confirmed by considering electron correlation effect. The temperature dependence of the penetration depths followed a power law($\sim$$T^n$) below 0.3$T_c$, with $n$$>$3.5 for both $\lambda_{ab}$ and $\lambda_c$. Based on theoretical studies of iron-based superconductors, these results suggest that the superconductivity of LiFeAs can be represented by an extended $s_\pm$-wave due to weak impurity scattering effect. And the magnitudes of the two gaps were also evaluted by fitting the superfluid density for both the in- and out-of-plane to the two-gap model. The estimated values for the two gaps are consistent with the results of angle resolved photoemission spectroscopy and specific heat experiments.Comment: 10 pages, 5 figure

Diagnostic Efficacy of PET/CT Plus Brain MR Imaging for Detection of Extrathoracic Metastases in Patients with Lung Adenocarcinoma

We aimed to evaluate prospectively the efficacy of positron emission tomography (PET)/computed tomography (CT) plus brain magnetic resonance imaging (MRI) for detecting extrathoracic metastases in lung adenocarcinoma. Metastatic evaluations were feasible for 442 consecutive patients (M:F=238:204; mean age, 54 yr) with a lung adenocarcinoma who underwent PET/CT (CT, without IV contrast medium injection) plus contrast-enhanced brain MRI. The presence of metastases in the brain was evaluated by assessing brain MRI or PET/CT, and in other organs by PET/CT. Diagnostic efficacies for metastasis detection with PET/CT plus brain MRI and with PET/CT only were calculated on a per-patient basis and compared from each other. Of 442 patients, 88 (20%, including 50 [11.3%] with brain metastasis) had metastasis. Regarding sensitivity of overall extrathoracic metastasis detection, a significant difference was found between PET/CT and PET/CT plus brain MRI (68% vs. 84%; P=0.03). As for brain metastasis detection sensitivity, brain MRI was significantly higher than PET/CT (88% vs. 24%; P<0.001). By adding MRI to PET/CT, brain metastases were detected in additional 32 (7% of 442 patients) patients. In lung adenocarcinoma patients, significant increase in sensitivity can be achieved for detecting extrathoracic metastases by adding dedicated brain MRI to PET/CT and thus enhancing brain metastasis detection

A Correlation between Low Back Pain and Associated Factors: A Study Involving 772 Patients who Had Undergone General Physical Examination

Many factors are associated with the development of low back pain. Among them, exercise, obesity, smoking, age, educational level and stress are the most common. This study examined the association of these factors with low back pain. An additional aim was to determine a procedure for preventing low back pain. This study analyzed the responses to a questionnaire sent to 772 individuals who had undergone a medical examination at this hospital in 2003 and excluded the individuals who had shown symptoms or their test results indicated a particular disease. Assuming that there were no variables, individuals who exercised regularly 3-4 times per week would have a lower chance of having low back pain than those who did not exercise regularly. The analysis revealed that individuals with a college degree or higher education have a lower chance of experiencing low back pain than those with only a high school education or even college drop-outs. When the other variables were constant, age, extent of obesity (body mass index), smoking and level of stress were not found to affect the development of low back pain. The level of education was associated with the development of low back pain. However, regular exercise 3-4 times per week or more would be most effective in reducing the incidence and duration of low back pain

Immunohistochemical Analysis of Non-Small Cell Lung Cancer: Correlation with Clinical Parameters and Prognosis

Non-small cell lung cancers (NSCLC) vary in their biologic behavior. Recurrence and tumor-related mortality may be attributable to molecular abnormalities in primary tumors. This study evaluated such immunophenotypes with regard to cell cycle regulation and proliferation, apoptosis, and angiogenesis, to determine their significance for patient outcome. Core biopsies from 219 patients with NSCLC were assembled on tissue microarrays, and the expressions of p16, p21, p27, cyclin B1, cyclin E, Ki-67, caspase-3, survivin, bcl-2, VEGF, and endostatin were evaluated by immunohistochemistry. Despite previously described prognostic relevance of some of the investigated molecules, many of those markers were not directly associated with recurrence or survival. However, there was a trend for p16 immunoreactivity to be associated with a good prognosis (57% vs. 42% in 5-yr survival) (p=0.071). bcl-2 expression was strongly correlated with a better outcome (65% vs. 45% in 5-yr survival) (p=0.029), and the hazard of death for bcl-2 positive patients was 0.42 times of that for bcl-2 negative patients (p=0.047). A multivariate analysis with Cox proportional hazards model confirmed that the lymph node status (p=0.043) and stage (p=0.003) were other independent prognostic factors. Our results suggest that p16 and bcl-2 provide prognostic information independent of the TNM stage in NSCLC