554 research outputs found

    Learning to Extract Motion from Videos in Convolutional Neural Networks

    Full text link
    This paper shows how to extract dense optical flow from videos with a convolutional neural network (CNN). The proposed model constitutes a potential building block for deeper architectures to allow using motion without resorting to an external algorithm, \eg for recognition in videos. We derive our network architecture from signal processing principles to provide desired invariances to image contrast, phase and texture. We constrain weights within the network to enforce strict rotation invariance and substantially reduce the number of parameters to learn. We demonstrate end-to-end training on only 8 sequences of the Middlebury dataset, orders of magnitude less than competing CNN-based motion estimation methods, and obtain comparable performance to classical methods on the Middlebury benchmark. Importantly, our method outputs a distributed representation of motion that allows representing multiple, transparent motions, and dynamic textures. Our contributions on network design and rotation invariance offer insights nonspecific to motion estimation

    Dense Motion Estimation for Smoke

    Full text link
    Motion estimation for highly dynamic phenomena such as smoke is an open challenge for Computer Vision. Traditional dense motion estimation algorithms have difficulties with non-rigid and large motions, both of which are frequently observed in smoke motion. We propose an algorithm for dense motion estimation of smoke. Our algorithm is robust, fast, and has better performance over different types of smoke compared to other dense motion estimation algorithms, including state of the art and neural network approaches. The key to our contribution is to use skeletal flow, without explicit point matching, to provide a sparse flow. This sparse flow is upgraded to a dense flow. In this paper we describe our algorithm in greater detail, and provide experimental evidence to support our claims.Comment: ACCV201

    ADQPCI: Data Acquisition Board for Educational purposes

    Get PDF
    En este trabajo se presenta una de las placas de adquisición de datos que se ha desarrollado con fines docentes para su utilización en prácticas relacionadas con sistemas en tiempo real e informática industrial y se plantean algunas de las ventajas e inconvenientes frente a la utilización de placas comerciales. A lo largo del trabajo se detalla el diseño del hardware, en el que se ha priorizado la facilidad de programación, siendo ésta una de las ventajas frente a las placas comerciales. En estas prácticas es fundamental que el alumno tome conciencia de la importancia de la interfaz hardware-software, si se quiere conseguir un sistema fiable y que explote al máximo las características del hardware. Con el desarrollo de una placa de adquisición de datos se consigue un sistema que el alumno puede utilizar en varias asignaturas de su titulación que están relacionadas con el desarrollo y programación de sistemas empotrados.In this work a data acquisition board developed for educational use in subjects related to real-time systems and industrial computing, is presented. The main advantages and disadvantages of using these boards versus the use of commercial boards are discussed. The hardware design described along this work emphasizes the facility of programming the board, which is one of the main advantages versus the commercial boards. In these practices it is essential that student comprehend the importance of the hardware-software interface in order to obtain a reliable system which exploits in a maximum way the characteristics of the hardware. The development of a data acquisition board allows to obtain a system that the students can use in several course during his university career which are related to the development and programming of embedded system

    CAN2PCI: Board with Interface to CAN and PCI Bus for educational purposes

    Get PDF
    En este trabajo se presenta una placa con interfaz al bus CAN y PCI desarrollada para la utilización en prácticas de las asignaturas relacionadas con redes de control. Se trata de una placa de altas prestaciones pensada para su utilización docente gracias a su facilidad de programación. La placa dispone de dos canales CAN independientes y permite acceso directo a los registros del controlador CAN. Las prácticas tienen como objetivo conocer la red de control en los niveles físico y de enlace y desarrollar un software de conectividad (middleware) que realice la interfaz entre estas capas y la de aplicación de usuario. Se exponen también brevemente las prácticas realizadas en una de las asignaturas donde se imparte redes de control, en la que es fundamental la utilización de un hardware conocido que permita programar las funciones básicas que operan directamente con el controlador de bus CANIn this work the development of a board with interface to the CAN and PCI bus for its use in lab courses related to control networks, is presented. This board has high benefits and advantages and has been implemented for educational purposes due to its programming facility. The board has two independent CAN channels and it allows direct access to the registers of the CAN controller. The objective of the lab experiments is to study the control networks in the physical and link levels and to develop a middleware that performs the interface between these layers and the user application. The experiments done in one of the courses, which includes control networks, are briefly described. In these practical labs it is very important the use of a known hardware that allows programming the basic functions which directly operate with the CAN bus controlle

    Occlusion and Motion Reasoning for Long-Term Tracking

    Get PDF
    International audienceObject tracking is a reoccurring problem in computer vision. Tracking-by-detection approaches, in particular Struck (Hare et al., 2011), have shown to be competitive in recent evaluations. However, such approaches fail in the presence of long-term occlusions as well as severe viewpoint changes of the object. In this paper we propose a principled way to combine occlusion and motion reasoning with a tracking-by-detection approach. Occlusion and motion reasoning is based on state-of-the-art long-term trajectories which are labeled as object or background tracks with an energy-based formulation. The overlap between labeled tracks and detected regions allows to identify occlusions. The motion changes of the object between consecutive frames can be estimated robustly from the geometric relation between object trajectories. If this geometric change is significant, an additional detector is trained. Experimental results show that our tracker obtains state-of-the-art results and handles occlusion and viewpoints changes better than competing tracking methods
    corecore