Looking through the eyes of the painter: from visual perception to non-photorealistic rendering

In this paper we present a brief overview of the processing in the primary visual cortex, the multi-scale line/edge and keypoint representations, and a model of brightness perception. This model, which is being extended from 1D to 2D, is based on a symbolic line and edge interpretation: lines are represented by scaled Gaussians and edges by scaled, Gaussian-windowed error functions. We show that this model, in combination with standard techniques from graphics, provides a very fertile basis for non-photorealistic image rendering

Cortical 3D Face Recognition Framework

Empirical studies concerning face recognition suggest that faces may be stored in memory by a few canonical representations. In cortical area V1 exist double-opponent colour blobs, also simple, complex and end-stopped cells which provide input for a multiscale line/edge representation, keypoints for dynamic routing and saliency maps for Focus-of-Attention. All these combined allow us to segregate faces. Events of different facial views are stored in memory and combined in order to identify the view and recognise the face including facial expression. In this paper we show that with five 2D views and their cortical representations it is possible to determine the left-right and frontal-lateral-profile views and to achieve view-invariant recognition of 3D faces

Artistic rendering of the visual cortex

In this paper we explain the processing in the first layers of the visual cortex by simple, complex and endstopped cells, plus grouping cells for line, edge, keypoint and saliency detection. Three visualisations are presented: (a) an integrated scheme that shows activities of simple, complex and end-stopped cells, (b) artistic combinations of selected activity maps that give an impression of global image structure and/or local detail, and (c) NPR on the basis of a 2D brightness model. The cortical image representations offer many possibilities for non-photorealistic rendering

Cortical multiscale line-edge disparity model

Most biological approaches to disparity extraction rely on the disparity energy model (DEM). In this paper we present an alternative approach which can complement the DEM model. This approach is based on the multiscale coding of lines and edges, because surface structures are composed of lines and edges and contours of objects often cause edges against their background. We show that the line/edge approach can be used to create a 3D wireframe representation of a scene and the objects therein. It can also significantly improve the accuracy of the DEM model, such that our biological models can compete with some state-of-the-art algorithms from computer vision

GyGSLA: A portable glove system for learning sign language alphabet

The communication between people with normal hearing with those having hearing or speech impairment is difficult. Learning a new alphabet is not always easy, especially when it is a sign language alphabet, which requires both hand skills and practice. This paper presents the GyGSLA system, standing as a completely portable setup created to help inexperienced people in the process of learning a new sign language alphabet. To achieve it, a computer/mobile game-interface and an hardware device, a wearable glove, were developed. When interacting with the computer or mobile device, using the wearable glove, the user is asked to represent alphabet letters and digits, by replicating the hand and fingers positions shown in a screen. The glove then sends the hand and fingers positions to the computer/mobile device using a wireless interface, which interprets the letter or digit that is being done by the user, and gives it a corresponding score. The system was tested with three completely inexperience sign language subjects, achieving a 76% average recognition ratio for the Portuguese sign language alphabet.info:eu-repo/semantics/publishedVersio

Higher-order Generalized Hydrodynamics: Foundations Within A Nonequilibrium Statistical Ensemble Formalism.

Construction, in the framework of a nonequilibrium statistical ensemble formalism, of a higher-order generalized hydrodynamics, also referred to as mesoscopic hydrothermodynamics, that is, covering phenomena involving motion of fluids displaying variations short in space and fast in time-unrestricted values of Knudsen numbers, is presented. In that way, an approach is provided enabling the coupling and simultaneous treatment of the kinetics and hydrodynamic levels of descriptions. It is based on a complete thermostatistical approach in terms of the densities of matter and energy and their fluxes of all orders covering systems arbitrarily driven away from equilibrium. The set of coupled nonlinear integrodifferential hydrodynamic equations is derived. They are the evolution equations of the Gradlike moments of all orders, derived from a generalized kinetic equation built in the framework of the nonequilibrium statistical ensemble formalism. For illustration, the case of a system of particles embedded in a fluid acting as a thermal bath is fully described. The resulting enormous set of coupled evolution equations is of unmanageable proportions, thus requiring in practice to introduce an appropriate description using the smallest possible number of variables. We have obtained a hierarchy of Maxwell times, associated to the set of all the higher-order fluxes, which have a particular relevance in the process of providing criteria for establishing the contraction of description.9106301

Building the what and where systems: multi-scale lines, edges and keypoints

Computer vision for realtime applications requires tremendous computational power because all images must be processed from the first to the last pixel. Ac tive vision by probing specific objects on the basis of already acquired context may lead to a significant reduction of processing. This idea is based on a few concepts from our visual cortex (Rensink, Visual Cogn. 7, 17-42, 2000): (1) our physical surround can be seen as memory, i.e. there is no need to construct detailed and complete maps, (2) the bandwidth of the what and where systems is limited, i.e. only one object can be probed at any time, and (3) bottom-up, low-level feature extraction is complemented by top-down hypothesis testing, i.e. there is a rapid convergence of activities in dendritic/axonal connections

A disparity energy model improved by line, edge and keypoint correspondences

Disparity energy models (DEMs) estimate local depth information on the basis ofVl complex cells. Our recent DEM (Martins et al, 2011 ISSPlT261-266) employs a population code. Once the population's cells have been trained with randorn-dot stereograms, it is applied at all retinotopic positions in the visual field. Despite producing good results in textured regions, the model needs to be made more precise, especially at depth transitions

Effect of the effluent released from the canine internal mammary artery after intraluminal and extraluminal perfusion of acetylcholine and adenosine diphosphate

Segments of the canine internal mammary artery (35 mm in length) were suspended in vitro in an organ chamber containing physiological salt solution (95% O2/5% CO2, pH = 7.4, 37°C). Segments were individually cannulated and perfused at 5 ml/minute using a roller pump. Vasorelaxant activity of the effluent from the perfused internal mammary arteries was bioassayed by measuring the decrease in tension induced by the effluent of the coronary artery endothelium-free ring which had been contracted with prostaglandin F2α (2 × 10-6 M). Intraluminal perfusion of adenosine diphosphate (10-5 M) induced significant increase in relaxant activity in the effluent from the perfused blood vessel. However, when adenosine diphosphate (10-5 M) was added extraluminally to the internal mammary artery, no change in relaxant activity in the effluent was noted. In contrast, acetylcholine produced significant increase in the relaxant activity on the effluent of the perfused internal mammary artery with both intraluminal and extraluminal perfusion. The intraluminal and extraluminal release of endothelium-derived relaxing factor (EDRF) by acetylcholine (10-5 M) can be inhibited by site-specific administration of atropine (10-5 M). These experiments indicate that certain agonists can induce the release of EDRF only by binding to intravascular receptors while other agonists can induce endothelium-dependent vasodilatation by acting on neural side receptors

An integrated framework for combining gist vision with object segregation categorisation and recognition

There are roughly two processing systems: (1) very fast gist vision of entire scenes, completely bottom-up and data driven, and (2) Focus-of-Attention (FoA) with sequential screening of specific image regions and objects. The latter system has to be sequential because unnormalised input objects must be matched against normalised templates of canonical object views stored in memory, which involves dynamic routing of features in the visual pathways