Audio-Visual Target Speaker Extraction on Multi-Talker Environment using Event-Driven Cameras

In this work, we propose a new method to address audio-visual target speaker extraction in multi-talker environments using event-driven cameras. All audio-visual speech separation approaches use a frame-based video to extract visual features. However, these frame-based cameras usually work at 30 frames per second. This limitation makes it difficult to process an audio-visual signal with low latency. In order to overcome this limitation, we propose using event-driven cameras due to their high temporal resolution and low latency. Recent work showed that the use of landmark motion features is very important in order to get good results on audio-visual speech separation. Thus, we use event-driven vision sensors from which the extraction of motion is available at lower latency computational cost. A stacked Bidirectional LSTM is trained to predict an Ideal Amplitude Mask before post-processing to get a clean audio signal. The performance of our model is close to those yielded in frame-based fashion

Audio-Visual Target Speaker Enhancement on Multi-Talker Environment using Event-Driven Cameras

We propose a method to address audio-visual target speaker enhancement in multi-talker environments using event-driven cameras. State of the art audio-visual speech separation methods shows that crucial information is the movement of the facial landmarks related to speech production. However, all approaches proposed so far work offline, using frame-based video input, making it difficult to process an audio-visual signal with low latency, for online applications. In order to overcome this limitation, we propose the use of event-driven cameras and exploit compression, high temporal resolution and low latency, for low cost and low latency motion feature extraction, going towards online embedded audio-visual speech processing. We use the event-driven optical flow estimation of the facial landmarks as input to a stacked Bidirectional LSTM trained to predict an Ideal Amplitude Mask that is then used to filter the noisy audio, to obtain the audio signal of the target speaker. The presented approach performs almost on par with the frame-based approach, with very low latency and computational cost.Comment: Accepted at ISCAS 202

evaluation of wild animals browsing preferences in forage resources

Excessive presence of wild ungulates can produce negative effects on herbaceous crops or woody species, and to face this problem, habitat improvements are often performed to recreate suitable environments for a given animal species and to attract animals far from cultivated crops. A common example of these interventions is represented by grassland restoration and to evaluate the real animal preferences on restored forage resources a proper trial was established in a hilly area of Tuscany (central Italy), inside the historical Park of Pratolino, near Florence. The trial compared six different forage species or mixtures sown in plots: vegetal material was represented by two pure stands (Onobrychis viciifolia and Medicago sativa) and four mixtures differing in number and kind of used species. Plots were utilised only by wild animals occurring in the area. Data collection consisted of botanical samples in each plot in different periods to obtain the percent presence of each species. At the same time, a visual estimation of animal intake on all occurring species was performed to obtain the browsing ratio of single species and overall defoliation rate for each species/mixture. Moreover, six camera traps were placed on the boundary of the experimental site to record videos of wild animals browsing in the area for identification of animals actually occurring on different plots and for comparison of these results with botanical data. Vegetation surveys permitted a proper evaluation of animals intake and of their feeding preferences. In general, sown species performed a major role in animal browsing, even if in some periods also a few native species (such as Plantago lanceolata or Cichorium intybus) were utilised in a strong way, depending on vegetation context and existing biomass. Camera traps results permitted the identification of browsing animal species (mainly represented by roe deer) and plots frequentation resulted to be highly related to animal intake found by botanical relevés

A multidisciplinary approach to the investigation of "La Caverna dell'Antimateria" (1958–1959) by Pinot Gallizio

Background: This study concerns the application of non-invasive and micro-invasive analyses for the study of a contemporary artwork entitled La Caverna dell'Antimateria ("The Cave of Antimatter") which was created by Pinot Gallizio in 1958–1959. The work represents one of the most significant examples of industrial painting. It consists of a total of 145 meters of painted canvas, designed in order to cover the entire floor plan of the Rene Drouin gallery in Paris, where it was displayed for the first time. Gallizio wanted to create an environment in which visitors could find themselves immersed in painting, in what he termed as a "work-environment". Non-invasive (Fibre Optic Reflectance Spectroscopy) and micro-invasive analyses (Fourier Transform Infrared and micro-Raman Spectroscopies, Pyrolysis-Gas Chromatography and Gas Chromatography/Mass Spectrometry) were performed on three of the canvases which constitute this work of art in order to obtain information regarding the artistic materials used by Gallizio. Results: Pigments and unconventional materials (such as metal wires, sand) are present in the canvases that form the ceiling. The colours are unevenly distributed on the surface, thus revealing large areas of the white preparation below. In the canvas of the wall, instead, the paint is applied more uniformly and gives a dark colour cast. The analytical results led to the identification of many of the materials used by Gallizio. The pictorial palette consists of both inorganic and organic pigments, while polyvinylacetate, pure or mixed with a siccative oil, was identified as a binder thus confirming what was reported by the artist in his notes. Conclusions: The results of this research provide information concerning the artistic technique used by Pinot Gallizio. The analyses were successfully performed both in situ and on micro-samples in order to characterise the pigments of the coloured area, the ground layer and the organic binders

Multi-technical approach for the characterization of polychrome decorative surfaces at Spanish Mission Churches in Nueva Vizcaya (Chihuahua, Mexico)

An interdisciplinary and multi-institutional group of science and art conservation specialists has provided new insight into the painting materials used in the polychrome walls and wooden ceilings in four seventeenth century Spanish colonial churches of Nueva Vizcaya (Chihuahua, Mexico). A multi-analytical study of the decorative surfaces was performed in situ using spectroscopic approaches (XRF, FORS), False Colour Infrared Reflectography – IRFC, as well as micro sampling (ATR-FTIR, LM, GC/MS). A survey of natural resources and study (ATR-FTIR, LM) was carried out to elucidate the natural occurrence of a select number of materials in the surrounding areas of the churches. The present paper presents a multi-analytical study and characterization of green, red-orange and black colour pigments and binders selected from the decorative surfaces. The aim of this study is to highlight relationships between local materials and those from the original polychrome ceilings, in order to understand the material and technological influences that converged in the Spanish colonial architecture of northern Mexico

Italian natural history museums on the verge of collapse?

The Italian natural history museums are facing a critical situation, due to the progressive loss of scientific relevance, decreasing economic investments, and scarcity of personnel. This is extremely alarming, especially for ensuring the long-term preservation of the precious collections they host. Moreover, a commitment in fieldwork to increase scientific collections and concurrent taxonomic research are rarely considered priorities, while most of the activities are addressed to public events with political payoffs, such as exhibits, didactic meetings, expositions, and talks. This is possibly due to the absence of a national museum that would have better steered research activities and overall concepts for collection management. We here propose that Italian natural history museums collaborate to instate a “metamuseum”, by establishing a reciprocal interaction network aimed at sharing budgetary and technical resources, which would assure better coordination of common long-term goals and scientific activities

Novel high-fidelity tyre model for motorcycles to be characterised by quasi-static manoeuvres – rationale and numerical validation

Although diverse tyre model formulations exist in the literature, they are suited for characterisation using a dedicated test bench, preventing parameters' estimation in driving conditions. This study defined a novel motorcycle tyre model, characterisable through driving manoeuvres using simple instrumentation consisting in an inertial measurement unit, steering position sensor and wheel speed sensors. Acquired signals were used to estimate instantaneous tyre forces, moments, slip angle and other properties, which were employed to calculate tyre model's parameters. Tyre model development and validation were performed in a simulation environment: we used a Magic Formula tyre-equipped motorcycle model to perform a set of manoeuvres, which were employed to characterise the proposed tyre model. Lastly, a set of quasi-static manoeuvres was conducted using the same motorcycle model equipped with the two tyre models, and results were compared. Comparison results showed a close reproduction of real tyre forces, moments and slips by the proposed tyre model for quasi-static manoeuvres, accurately reproducing motorcycle dynamics. Therefore, steering torque was correctly predicted for different lateral acceleration values. These results show that the proposed tyre model can be characterised, for both longitudinal and lateral dynamics, using this limited set of manoeuvres and simple instrumentation; the correctly predicted steering torque could allow the use of this tyre model for handling description

La serenata di Ciapino e Il lamento della Ghita Stanze rusticali

[Venezia : Giovanni Battista Albrizzi], 1750 Per il nome dell'A., Bartolomeo Vitturi, cfr. G. Melzi, Dizionario di opere anonime e pseudonime, v. 3, p. 54; per l'editore e il luogo di edizione cfr. Library of Congress on-line Vignetta calcogr. sul front Il sonetto introduttivo siglato da Gaspare Gozzi e versi finali di Giovanni Marsili Le c. di tav. incise da Francesco Bartolozzi; le ill. calcogr. siglate Piazzetta, Fiorenza Marcello e Felicita Sartori Paginaz. assente Segn.: [ast]-2[ast]⁸