Finding Temporally Consistent Occlusion Boundaries in Videos using Geometric Context

We present an algorithm for finding temporally consistent occlusion boundaries in videos to support segmentation of dynamic scenes. We learn occlusion boundaries in a pairwise Markov random field (MRF) framework. We first estimate the probability of an spatio-temporal edge being an occlusion boundary by using appearance, flow, and geometric features. Next, we enforce occlusion boundary continuity in a MRF model by learning pairwise occlusion probabilities using a random forest. Then, we temporally smooth boundaries to remove temporal inconsistencies in occlusion boundary estimation. Our proposed framework provides an efficient approach for finding temporally consistent occlusion boundaries in video by utilizing causality, redundancy in videos, and semantic layout of the scene. We have developed a dataset with fully annotated ground-truth occlusion boundaries of over 30 videos ($5000 frames). This dataset is used to evaluate temporal occlusion boundaries and provides a much needed baseline for future studies. We perform experiments to demonstrate the role of scene layout, and temporal information for occlusion reasoning in dynamic scenes.Comment: Applications of Computer Vision (WACV), 2015 IEEE Winter Conference o

Facial Feature Tracking and Occlusion Recovery in American Sign Language

Facial features play an important role in expressing grammatical information in signed languages, including American Sign Language(ASL). Gestures such as raising or furrowing the eyebrows are key indicators of constructions such as yes-no questions. Periodic head movements (nods and shakes) are also an essential part of the expression of syntactic information, such as negation (associated with a side-to-side headshake). Therefore, identification of these facial gestures is essential to sign language recognition. One problem with detection of such grammatical indicators is occlusion recovery. If the signer's hand blocks his/her eyebrows during production of a sign, it becomes difficult to track the eyebrows. We have developed a system to detect such grammatical markers in ASL that recovers promptly from occlusion. Our system detects and tracks evolving templates of facial features, which are based on an anthropometric face model, and interprets the geometric relationships of these templates to identify grammatical markers. It was tested on a variety of ASL sentences signed by various Deaf native signers and detected facial gestures used to express grammatical information, such as raised and furrowed eyebrows as well as headshakes.National Science Foundation (IIS-0329009, IIS-0093367, IIS-9912573, EIA-0202067, EIA-9809340

Optimization of Occlusion-Inducing Depth Pixels in 3-D Video Coding

The optimization of occlusion-inducing depth pixels in depth map coding has received little attention in the literature, since their associated texture pixels are occluded in the synthesized view and their effect on the synthesized view is considered negligible. However, the occlusion-inducing depth pixels still need to consume the bits to be transmitted, and will induce geometry distortion that inherently exists in the synthesized view. In this paper, we propose an efficient depth map coding scheme specifically for the occlusion-inducing depth pixels by using allowable depth distortions. Firstly, we formulate a problem of minimizing the overall geometry distortion in the occlusion subject to the bit rate constraint, for which the depth distortion is properly adjusted within the set of allowable depth distortions that introduce the same disparity error as the initial depth distortion. Then, we propose a dynamic programming solution to find the optimal depth distortion vector for the occlusion. The proposed algorithm can improve the coding efficiency without alteration of the occlusion order. Simulation results confirm the performance improvement compared to other existing algorithms

Occlusion Coherence: Detecting and Localizing Occluded Faces

The presence of occluders significantly impacts object recognition accuracy. However, occlusion is typically treated as an unstructured source of noise and explicit models for occluders have lagged behind those for object appearance and shape. In this paper we describe a hierarchical deformable part model for face detection and landmark localization that explicitly models part occlusion. The proposed model structure makes it possible to augment positive training data with large numbers of synthetically occluded instances. This allows us to easily incorporate the statistics of occlusion patterns in a discriminatively trained model. We test the model on several benchmarks for landmark localization and detection including challenging new data sets featuring significant occlusion. We find that the addition of an explicit occlusion model yields a detection system that outperforms existing approaches for occluded instances while maintaining competitive accuracy in detection and landmark localization for unoccluded instances

Feasibility and performance of a device for automatic self-detection of symptomatic acute coronary artery occlusion in outpatients with coronary artery disease : a multicentre observational study

Background Time delay between onset of symptoms and seeking medical attention is a major determinant of mortality and morbidity in patients with acute coronary artery occlusion. Response time might be reduced by reliable self-detection. We aimed to formally assess the proof-of-concept and accuracy of self-detection of acute coronary artery occlusion by patients during daily life situations and during the very early stages of acute coronary artery occlusion. Methods In this multicentre, observational study, we tested the operational feasibility, specificity, and sensitivity of our RELF method, a three-lead detection system with an automatic algorithm built into a mobile handheld device, for detection of acute coronary artery occlusion. Patients were recruited continuously by physician referrals from three Belgian hospitals until the desired sample size was achieved, had been discharged with planned elective percutaneous coronary intervention, and were able to use a smartphone; they were asked to perform random ambulatory selfrecordings for at least 1 week. A similar self-recording was made before percutaneous coronary intervention and at 60 s of balloon occlusion. Patients were clinically followed up until 1 month after discharge. We quantitatively assessed the operational feasibility with an automated dichotomous quality check of self-recordings. Performance was assessed by analysing the receiver operator characteristics of the ST difference vector magnitude. This trial is registered with ClinicalTrials.gov, number NCT02983396. Findings From Nov 18, 2016, to April 25, 2018, we enrolled 64 patients into the study, of whom 59 (92%) were eligible for self-applications. 58 (91%) of 64 (95% CI 81.0-95.6) patients were able to perform ambulatory self-recordings. Of all 5011 self-recordings, 4567 (91%) were automatically classified as successful within 1 min. In 65 balloon occlusions, 63 index tests at 60 s of occlusion in 55 patients were available. The mean specificity of daily life recordings was 0.96 (0.95-0.97). The mean false positive rate during daily life conditions was 4.19% (95% CI 3.29-5.10). The sensitivity for the target conditions was 0.87 (55 of 63; 95% CI 0.77-0.93) for acute coronary artery occlusion, 0.95 (54 of 57; 0.86-0.98) for acute coronary artery occlusion with electrocardiogram (ECG) changes, and 1.00 (35 of 35) for acute coronary artery occlusion with ECG changes and ST-segment elevation myocardial infarction criteria (STEMI). The index test was more sensitive to detect a 60 s balloon occlusion than the STEMI criteria on 12-lead ECG (87% vs 56%; p<0.0001). The proportion of total variation in study estimates due to heterogeneity between patients (I-2) was low (12.6%). The area under the receiver operator characteristics curve was 0.973 (95% CI 0.956-0.990) for acute coronary artery occlusion at different cutoff values of the magnitude of the ST difference vector. No patients died during the study. Interpretation Self-recording with our RELF device is feasible for most patients with coronary artery disease. The sensitivity and specificity for automatic detection of the earliest phase of acute coronary artery occlusion support the concept of our RELF device for patient empowerment to reduce delay and increase Survival without overloading emergency services. Copyright (C) 2019 The Author(s). Published by Elsevier Ltd

Corrective treatment and anatomic considerations for laparoscopic cholecystectomy injuries

BACKGROUND: Complete reports of biliary and vascular injuries after laparoscopic cholecystectomy are rare. STUDY DESIGN: Fifteen patients with complex laparoscopic cholecystectomy injuries underwent corrective operations. The injuries consisted of 14 bile duct injuries and one large laceration of a cirrhotic liver. Five of the bile duct injuries were accompanied by inadvertent occlusion of the right hepatic artery, and one was further complicated by portal vein occlusion. One hepatic artery occlusion and one portal vein occlusion were successfully reconstructed. Two patients with arterial occlusion required right hepatic lobectomy. Corrective biliary operations consisted of common hepaticojejunostomy (seven cases), right and left hepaticojejunostomies (one case), right anterior and left hepaticojejunostomies (two cases), right hepaticojejunostomy (one case), right posterior hepaticojejunostomy (one case), and left hepaticojejunostomy after right lobectomy (two cases). RESULTS: Except for a patient with a severe laceration of a cirrhotic liver who died as a result of hepatic failure, the remaining 14 patients are alive and well with normal hepatic function tests at six and 37 months after corrective operations. CONCLUSIONS: A knowledge of anatomy is critical to the prevention of injuries to the hepatobiliary tree and related structures during laparoscopic cholecystectomy