Box-level Segmentation Supervised Deep Neural Networks for Accurate and Real-time Multispectral Pedestrian Detection

Effective fusion of complementary information captured by multi-modal sensors (visible and infrared cameras) enables robust pedestrian detection under various surveillance situations (e.g. daytime and nighttime). In this paper, we present a novel box-level segmentation supervised learning framework for accurate and real-time multispectral pedestrian detection by incorporating features extracted in visible and infrared channels. Specifically, our method takes pairs of aligned visible and infrared images with easily obtained bounding box annotations as input and estimates accurate prediction maps to highlight the existence of pedestrians. It offers two major advantages over the existing anchor box based multispectral detection methods. Firstly, it overcomes the hyperparameter setting problem occurred during the training phase of anchor box based detectors and can obtain more accurate detection results, especially for small and occluded pedestrian instances. Secondly, it is capable of generating accurate detection results using small-size input images, leading to improvement of computational efficiency for real-time autonomous driving applications. Experimental results on KAIST multispectral dataset show that our proposed method outperforms state-of-the-art approaches in terms of both accuracy and speed

Fusion of Multispectral Data Through Illumination-aware Deep Neural Networks for Pedestrian Detection

Multispectral pedestrian detection has received extensive attention in recent years as a promising solution to facilitate robust human target detection for around-the-clock applications (e.g. security surveillance and autonomous driving). In this paper, we demonstrate illumination information encoded in multispectral images can be utilized to significantly boost performance of pedestrian detection. A novel illumination-aware weighting mechanism is present to accurately depict illumination condition of a scene. Such illumination information is incorporated into two-stream deep convolutional neural networks to learn multispectral human-related features under different illumination conditions (daytime and nighttime). Moreover, we utilized illumination information together with multispectral data to generate more accurate semantic segmentation which are used to boost pedestrian detection accuracy. Putting all of the pieces together, we present a powerful framework for multispectral pedestrian detection based on multi-task learning of illumination-aware pedestrian detection and semantic segmentation. Our proposed method is trained end-to-end using a well-designed multi-task loss function and outperforms state-of-the-art approaches on KAIST multispectral pedestrian dataset

Unsupervised Domain Adaptation for Multispectral Pedestrian Detection

Multimodal information (e.g., visible and thermal) can generate robust pedestrian detections to facilitate around-the-clock computer vision applications, such as autonomous driving and video surveillance. However, it still remains a crucial challenge to train a reliable detector working well in different multispectral pedestrian datasets without manual annotations. In this paper, we propose a novel unsupervised domain adaptation framework for multispectral pedestrian detection, by iteratively generating pseudo annotations and updating the parameters of our designed multispectral pedestrian detector on target domain. Pseudo annotations are generated using the detector trained on source domain, and then updated by fixing the parameters of detector and minimizing the cross entropy loss without back-propagation. Training labels are generated using the pseudo annotations by considering the characteristics of similarity and complementarity between well-aligned visible and infrared image pairs. The parameters of detector are updated using the generated labels by minimizing our defined multi-detection loss function with back-propagation. The optimal parameters of detector can be obtained after iteratively updating the pseudo annotations and parameters. Experimental results show that our proposed unsupervised multimodal domain adaptation method achieves significantly higher detection performance than the approach without domain adaptation, and is competitive with the supervised multispectral pedestrian detectors

On some impulsive fractional differential equations in Banach spaces

This paper deals with some impulsive fractional differential equations in Banach spaces. Utilizing the Leray-Schauder fixed point theorem and the impulsive nonlinear singular version of the Gronwall inequality, the existence of $PC$-mild solutions for some fractional differential equations with impulses are obtained under some easily checked conditions. At last, an example is given for demonstration

On some existence results of mild solutions for nonlocal integrodifferential Cauchy problems in Banach spaces

In this paper, we study a class of integrodifferential evolution equations with nonlocal initial conditions in Banach spaces. Existence results of mild solutions are proved for a class of integrodifferential evolution equations with nonlocal initial conditions in Banach spaces. The main results are obtained by using the Schaefer fixed point theorem and semigroup theory. Finally, an example is given for demonstration

Study on Resource Configuration on Cloud Manufacturing

The purpose of manufacturing is to realize the requirement of customer. In manufacturing process of cloud system, there exist a lot of resource services which have similar functional characteristics to realize the requirement. It makes the manufacturing process more diverse. To develop the quality and reduce cost, a resource configuration model on cloud-manufacturing platform is put forward in this paper. According to the generalized six-point location principle, a growth design from the requirement of customers to entities with geometric constraints is proposed. By the requirement growing up to product, a configuration process is used to match the entities with the instances which the resources in the database could supply. Different from most existing studies, this paper studies the tolerance design with multiple candidate resource suppliers on cloud manufacturing to make the market play a two-level game considering the benefit of customers and the profit of resources to give an optimal result. A numerical case study is used to illustrate the proposed model and configuration process. The performance and advantage of the proposed method are discussed at the end

Systemic-Lupus-Erythematosus-Related Acute Pancreatitis: A Cohort from South China

Acute pancreatitis (AP) is a rare but life-threatening complication of SLE. The current study evaluated the clinical characteristics and risk factors for the mortality of patients with SLE-related AP in a cohort of South China. Methods. Inpatient medical records of SLE-related AP were retrospectively reviewed. Results. 27 out of 4053 SLE patients were diagnosed as SLE-related AP, with an overall prevalence of 0.67%, annual incidence of 0.56‰ and mortality of 37.04%. SLE patients with AP presented with higher SLEDAI score (21.70 ± 10.32 versus 16.17 ± 7.51, P = 0.03), more organ systems involvement (5.70 ± 1.56 versus 3.96 ± 1.15, P = 0.001), and higher mortality (37.04% versus 0, P = 0.001), compared to patients without AP. Severe AP (SAP) patients had a significant higher mortality rate compared to mild AP (MAP) (75% versus 21.05%, P = 0.014). 16 SLE-related AP patients received intensive GC treatment, 75% of them exhibited favorable prognosis. Conclusion. SLE-related AP is rare but concomitant with high mortality in South Chinese people, especially in those SAP patients. Activity of SLE, multiple-organ systems involvement may attribute to the severity and mortality of AP. Appropriate glucocorticosteroid (GC) treatment leads to better prognosis in majority of SLE patients with AP