Stochastic uncertainty models for the luminance consistency assumption

International audienceIn this paper, a stochastic formulation of the brightness consistency used in many computer vision problems involving dynamic scenes (motion estimation or point tracking for instance) is proposed. Usually, this model which assumes that the luminance of a point is constant along its trajectory is expressed in a differential form through the total derivative of the luminance function. This differential equation links linearly the point velocity to the spatial and temporal gradients of the luminance function. However when dealing with images, the available informations only hold at discrete time and on a discrete grid. In this paper we formalize the image luminance as a continuous function transported by a flow known only up to some uncertainties related to such a discretization process. Relying on stochastic calculus, we define a formulation of the luminance function preservation in which these uncertainties are taken into account. From such a framework, it can be shown that the usual deterministic optical flow constraint equation corresponds to our stochastic evolution under some strong constraints. These constraints can be relaxed by imposing a weaker temporal assumption on the luminance function and also in introducing anisotropic intensity-based uncertainties. We in addition show that these uncertainties can be computed at each point of the image grid from the image data and provide hence meaningful information on the reliability of the motion estimates. To demonstrate the benefit of such a stochastic formulation of the brightness consistency assumption, we have considered a local least squares motion estimator relying on this new constraint. This new motion estimator improves significantly the quality of the results

Fluid flow estimation with multiscale ensemble filters based on motion measurements under location uncertainty

International audienceThis paper proposes a novel multi-scale fluid flow data assimilation approach, which integrates and complements the advantages of a Bayesian sequential assimilation technique, the Weighted Ensemble Kalman filter (WEnKF). The data assimilation proposed in this work incorporates measurement brought by an efficient multiscale stochastic formulation of the well-known Lucas-Kanade (LK) estimator. This estimator has the great advantage to provide uncertainties associated to the motion measurements at different scales. The proposed assimilation scheme benefits from this multiscale uncertainty information and enables to enforce a physically plausible dynamical consistency of the estimated motion fields along the image sequence. Experimental evaluations are presented on synthetic and real fluid flow sequences

Visual Detection Under Uncertainty Operates Via an Early Static, Not Late Dynamic, Non-Linearity

Signals in the environment are rarely specified exactly: our visual system may know what to look for (e.g., a specific face), but not its exact configuration (e.g., where in the room, or in what orientation). Uncertainty, and the ability to deal with it, is a fundamental aspect of visual processing. The MAX model is the current gold standard for describing how human vision handles uncertainty: of all possible configurations for the signal, the observer chooses the one corresponding to the template associated with the largest response. We propose an alternative model in which the MAX operation, which is a dynamic non-linearity (depends on multiple inputs from several stimulus locations) and happens after the input stimulus has been matched to the possible templates, is replaced by an early static non-linearity (depends only on one input corresponding to one stimulus location) which is applied before template matching. By exploiting an integrated set of analytical and experimental tools, we show that this model is able to account for a number of empirical observations otherwise unaccounted for by the MAX model, and is more robust with respect to the realistic limitations imposed by the available neural hardware. We then discuss how these results, currently restricted to a simple visual detection task, may extend to a wider range of problems in sensory processing

Visual Preferences and Human Interactions with Shading and Electric Lighting Systems

Buildings in the United States are responsible for 40% of the primary energy use and 30% of carbon dioxide emissions. As awareness is being raised for the energy consumption and environmental impacts of buildings, it is not surprising that improving building performance has gained significant attention over the past years. Increasing the energy efficiency and reducing the emissions associated with buildings is possible through the use of high-performance building design and implementation of advanced building controls. Moreover, as part of the modern life style, people in developed countries spend most of their time inside the buildings. This fact necessitates consideration of two important requirements. First that energy saving achieved by efficiency methods in practice should not compromise occupants’ comfort. Second, energy impacts of building users and their indoor environment preferences should be taken into account at both design and operation phases. Therefore, understanding and modeling human-building interactions and their links to energy consumption and occupant satisfaction with the indoor environment is the main goal of this research. To this end and with a focus on the visual environment, systematic data collection from a large number of participants is undertaken and novel probabilistic modeling approaches are explored to provide new insights towards human-centered sustainable buildings. The specific research objectives of this thesis are: 1. Study human interactions with motorized roller shades and dimmable electric lights as well as human perception and satisfaction with the luminous environment in private offices with variable daylight and electric light conditions. 2. Develop a novel Bayesian approach to model the interrelated human interactions with window shades and electric lights. 3. Develop a Bayesian classification and inference modeling framework for occupants’ visual preferences in daylit perimeter offices. To this end, four identical private offices in a high performance building located in West Lafayette, IN were equipped with sensing network and online survey questionnaires to study almost 300 occupants during the two sets of field studies conducted for this thesis. The first field study extends the knowledge of human-building interactions to advanced building systems such as motorized roller shades and dimmable electric lights and reveals behavioral patterns enabled through side-by-side comparisons of different environmental controls and user interfaces ranging from fully automated to fully manual and from low to high levels of accessibility (wall switch, remote controller and graphical web interface). Results of the field study reveal: (a) occupational dynamics and human variables as two key features, in addition to environmental variables, in describing human-shading and -electric lighting interactions; (b) higher daylight utilization in offices with easy-to-access controls; (c) strong preference for customized indoor climate, along with a relationship between occupant perception of control and acceptability of a wider range of visual conditions. With the insights gained from the first field study, the research extends to exploit the resulted dataset as a basis for the development of a hierarchical Bayesian approach which is used, for the first time, to model human interactions with motorized roller shades and dimmable electric lights. Bayesian multivariate binary-choice logit models have been constructed to predict shade raising/lowering and electric light increasing actions while Bayesian regression models with built-in physical constraints to estimate the magnitude of shading and electric lighting actions. The proposed models, in their structure, account for (a) intermediate operating states of the systems; (b) interrelated operation of shades and lights; (c) personal characteristics and human attributes. Moreover, the developed human-building interaction modeling framework benefits from the advantages of the Bayesian formalism as it (a) provides a systematic approach to identify significant features in describing the human-building interactions; (b) incorporates prior beliefs about the systems; (c) captures the epistemic uncertainty, which is important when dealing with small-sized datasets, a ubiquitous issue in human data collection in actual buildings. The second field study was designed and conducted to collect data for occupants’ satisfaction with the visual environment when exposed to different combinations of daylight and electric light conditions, along with data from room sensors, shading and light dimming states. The resulted dataset is then used as a basis to model occupants’ visual preferences such as prefer darker, prefer brighter, or satisfied with current conditions. Bayesian multinomial logistic regression is augmented with Dirichlet process prior to encode within the model structure that occupants’ visual preferences are influenced by a combination of environmental and control state variables as well as individual visual characteristics. The latter is treated as a hidden random variable which is used to cluster occupants with similar visual preference characteristics and to determine the optimal number of clusters among the observed population. Modeling results based on observations from 75 occupants in glare-free conditions suggest work plane illuminance, window unshaded area, and electric light ratio as significant features of the general visual preference model and reveal the existence of three distinct clusters with physical interpretation; preference for bright, moderate, and dark conditions. In the final step, a method for learning the visual preferences of new occupants is deployed which uses a mixture of the general probabilistic sub-models to infer new occupants’ cluster values and personalized preference profiles. The proposed approach proves to be efficient as it is shown to predict personalized profiles with 81% prediction accuracy with very few observations (less than 16) from each new occupant. In summary, the systematic data collection methods and prototype interfaces used in this dissertation establish a consistent and reliable approach for studying human interactions with building systems and satisfaction with the indoor environment. Unique datasets for human attributes towards the visual environment in perimeter building zones have been generated especially for the occupants’ direct preference votes with different visual conditions which is currently lacked in the literature. The probabilistic models for human interactions with shading and lighting systems and occupants’ visual preferences incorporate individual characteristics and account for uncertainties associated with limited data, thus, are to increase prediction accuracy when implemented in Building Performance Simulation tools. The research presented herein facilitates an effective pathway towards implementation of adaptive personalized environments and is a necessary precursor for future investigation and expansion to human-centered building controls

Detecting Abnormal Vehicular Dynamics at Intersections Based on an Unsupervised Learning Approach and a Stochastic Model

This investigation demonstrates an unsupervised approach for modeling traffic flow and detecting abnormal vehicle behaviors at intersections. In the first stage, the approach reveals and records the different states of the system. These states are the result of coding and grouping the historical motion of vehicles as long binary strings. In the second stage, using sequences of the recorded states, a stochastic graph model based on a Markovian approach is built. A behavior is labeled abnormal when current motion pattern cannot be recognized as any state of the system or a particular sequence of states cannot be parsed with the stochastic model. The approach is tested with several sequences of images acquired from a vehicular intersection where the traffic flow and duration used in connection with the traffic lights are continuously changed throughout the day. Finally, the low complexity and the flexibility of the approach make it reliable for use in real time systems