Fast Shadow Detection from a Single Image Using a Patched Convolutional Neural Network

In recent years, various shadow detection methods from a single image have been proposed and used in vision systems; however, most of them are not appropriate for the robotic applications due to the expensive time complexity. This paper introduces a fast shadow detection method using a deep learning framework, with a time cost that is appropriate for robotic applications. In our solution, we first obtain a shadow prior map with the help of multi-class support vector machine using statistical features. Then, we use a semantic- aware patch-level Convolutional Neural Network that efficiently trains on shadow examples by combining the original image and the shadow prior map. Experiments on benchmark datasets demonstrate the proposed method significantly decreases the time complexity of shadow detection, by one or two orders of magnitude compared with state-of-the-art methods, without losing accuracy.Comment: 6 pages, 5 figures, Submitted to IROS 201

Joint Learning of Intrinsic Images and Semantic Segmentation

Semantic segmentation of outdoor scenes is problematic when there are variations in imaging conditions. It is known that albedo (reflectance) is invariant to all kinds of illumination effects. Thus, using reflectance images for semantic segmentation task can be favorable. Additionally, not only segmentation may benefit from reflectance, but also segmentation may be useful for reflectance computation. Therefore, in this paper, the tasks of semantic segmentation and intrinsic image decomposition are considered as a combined process by exploring their mutual relationship in a joint fashion. To that end, we propose a supervised end-to-end CNN architecture to jointly learn intrinsic image decomposition and semantic segmentation. We analyze the gains of addressing those two problems jointly. Moreover, new cascade CNN architectures for intrinsic-for-segmentation and segmentation-for-intrinsic are proposed as single tasks. Furthermore, a dataset of 35K synthetic images of natural environments is created with corresponding albedo and shading (intrinsics), as well as semantic labels (segmentation) assigned to each object/scene. The experiments show that joint learning of intrinsic image decomposition and semantic segmentation is beneficial for both tasks for natural scenes. Dataset and models are available at: https://ivi.fnwi.uva.nl/cv/intrinsegComment: ECCV 201

Moving cast shadows detection methods for video surveillance applications

Moving cast shadows are a major concern in today’s performance from broad range of many vision-based surveillance applications because they highly difficult the object classification task. Several shadow detection methods have been reported in the literature during the last years. They are mainly divided into two domains. One usually works with static images, whereas the second one uses image sequences, namely video content. In spite of the fact that both cases can be analogously analyzed, there is a difference in the application field. The first case, shadow detection methods can be exploited in order to obtain additional geometric and semantic cues about shape and position of its casting object (’shape from shadows’) as well as the localization of the light source. While in the second one, the main purpose is usually change detection, scene matching or surveillance (usually in a background subtraction context). Shadows can in fact modify in a negative way the shape and color of the target object and therefore affect the performance of scene analysis and interpretation in many applications. This chapter wills mainly reviews shadow detection methods as well as their taxonomies related with the second case, thus aiming at those shadows which are associated with moving objects (moving shadows).Peer Reviewe

An approach for Shadow Detection and Removal based on Multiple Light Sources

Shadows in images are essential but sometimes unwanted as they can decline the result of computer vision algorithms. A shadow is obtained by the interaction of light with objects in an image surface. Shadows may letdown the image analysis processes and also cause a poor quality of information which in turn leads to problems in execution of algorithms. In this paper, a method has been proposed to detect and remove the shadows where multiple sources of light is been estimated, as we can take an example of playground stadium where multiple floodlights are fixed, multiple shadows can be observed originating from each of the targets. To successfully track individual target, it is essential to achieve an accurate image of the foreground. Also, an effort has been done to list some of the very crucial techniques related to shadow detection and removal. Many times, the shadow of the background information is merged with the foreground object and makes the process more complex. DOI: 10.17762/ijritcc2321-8169.150517

Highly accurate texture-based vehicle segmentation method

In modern traffic surveillance, computer vision methods have often been employed to detect vehicles of interest because of the rich information content contained in an image. Segmentation of moving vehicles using image processing and analysis algorithms has been an important research topic in the past decade. However, segmentation results are strongly affected by two issues: moving cast shadows and reflective regions, both of which reduce accuracy and require postprocessing to alleviate the degradation. We propose an efficient and highly accurate texture-based method for extracting the boundary of vehicles from the stationary background that is free from the effect of moving cast shadows and reflective regions. The segmentation method utilizes the differences in textural property between the road, vehicle cast shadow, reflection on the vehicle, and the vehicle itself, rather than just the intensity differences between them. By further combining the luminance and chrominance properties into an OR map, a number of foreground vehicle masks are constructed through a series of morphological operations, where each mask describes the outline of a moving vehicle. The proposed method has been tested on real-world traffic image sequences and achieved an average error rate of 3.44% for 50 tested vehicle images. © 2004 Society of Photo-Optical Instrumentation Engineers.published_or_final_versio