Proposing a speech to gesture translation architecture for Spanish deaf people.

This article describes an architecture for translating speech into Spanish Sign Language (SSL). The architecture proposed is made up of four modules: speech recognizer, semantic analysis, gesture sequence generation and gesture playing. For the speech recognizer and the semantic analysis modules, we use software developed by IBM and CSLR (Center for Spoken Language Research at University of Colorado), respectively. Gesture sequence generation and gesture animation are the modules on which we have focused our main effort. Gesture sequence generation uses semantic concepts (obtained from the semantic analysis) associating them with several SSL gestures. This association is carried out based on a number of generation rules. For gesture animation, we have developed an animated agent (virtual representation of a human person) and a strategy for reducing the effort in gesture animation. This strategy consists of making the system automatically generate all agent positions necessary for the gesture animation. In this process, the system uses a few main agent positions (two or three per second) and some interpolation strategies, both issues previously generated by the service developer (the person who adapts the architecture proposed in this paper to a specific domain). Related to this module, we propose a distance between agent positions and a measure of gesture complexity. This measure can be used to analyze the gesture perception versus its complexity. With the architecture proposed, we are not trying to build a domain independent translator but a system able to translate speech utterances into gesture sequences in a restricted domain: railway, flights or weather information

Instance-based natural language generation

In recent years, ranking approaches to Natural Language Generation have become increasingly popular. They abandon the idea of generation as a deterministic decision¬ making process in favour of approaches that combine overgeneration with ranking at some stage in processing.In this thesis, we investigate the use of instance-based ranking methods for surface realization in Natural Language Generation. Our approach to instance-based Natural Language Generation employs two basic components: a rule system that generates a number of realization candidates from a meaning representation and an instance-based ranker that scores the candidates according to their similarity to examples taken from a training corpus. The instance-based ranker uses information retrieval methods to rank output candidates.Our approach is corpus-based in that it uses a treebank (a subset of the Penn Treebank II containing management succession texts) in combination with manual semantic markup to automatically produce a generation grammar. Furthermore, the corpus is also used by the instance-based ranker. The semantic annotation of a test portion of the compiled subcorpus serves as input to the generator.In this thesis, we develop an efficient search technique for identifying the optimal candidate based on the A*-algorithm, detail the annotation scheme and grammar con¬ struction algorithm and show how a Rete-based production system can be used for efficient candidate generation. Furthermore, we examine the output of the generator and discuss issues like input coverage (completeness), fluency and faithfulness that are relevant to surface generation in general

HBIM MODELLING FOR AN HISTORICAL URBAN CENTRE

Abstract. The research in the geospatial data structuring and formats interoperability direction is the crucial task for creating a 3D Geodatabase at the urban scale. Both geometric and semantic data structuring should be considered, mainly regarding the interoperability of objects and formats generated outside the geographical space. Current reflections on 3D database generation, based on geospatial data, are mostly related to visualisation issues and context-related application. The purposes and scale of representation according to LoDs require some reflections, particularly for the transmission of semantic information.This contribution adopts and develops the integration of some tools to derive object-oriented modelling in the HBIM environment, both at the urban and architectural scale, from point clouds obtained by UAV (Unmanned Aerial Vehicle) photogrammetry.One of the paper's objectives is retracing the analysis phases of the point clouds acquired by UAV photogrammetry technique and their suitability for multiscale modelling. Starting from UAV clouds, through the optimisation and segmentation, the proposed workflow tries to trigger the modelling of the objects according to the LODs, comparing the one coming from CityGML and the one in use in the BIM community. The experimentation proposed is focused on the case study of the city of Norcia, which like many other historic centres spread over the territory of central Italy, was deeply damaged by the 2016-17 earthquake

HBIM MODELLING FOR AN HISTORICAL URBAN CENTRE

The research in the geospatial data structuring and formats interoperability direction is the crucial task for creating a 3D Geodatabase at the urban scale. Both geometric and semantic data structuring should be considered, mainly regarding the interoperability of objects and formats generated outside the geographical space. Current reflections on 3D database generation, based on geospatial data, are mostly related to visualisation issues and context-related application. The purposes and scale of representation according to LoDs require some reflections, particularly for the transmission of semantic information. This contribution adopts and develops the integration of some tools to derive object-oriented modelling in the HBIM environment, both at the urban and architectural scale, from point clouds obtained by UAV (Unmanned Aerial Vehicle) photogrammetry. One of the paper’s objectives is retracing the analysis phases of the point clouds acquired by UAV photogrammetry technique and their suitability for multiscale modelling. Starting from UAV clouds, through the optimisation and segmentation, the proposed workflow tries to trigger the modelling of the objects according to the LODs, comparing the one coming from CityGML and the one in use in the BIM community. The experimentation proposed is focused on the case study of the city of Norcia, which like many other historic centres spread over the territory of central Italy, was deeply damaged by the 2016-17 earthquake

Semantic model-driven development of service-centric software architectures

Service-oriented architecture (SOA) is a recent architectural paradigm that has received much attention. The prevalent focus on platforms such as Web services, however, needs to be complemented by appropriate software engineering methods. We propose the model-driven development of service-centric software systems. We present in particular an investigation into the role of enriched semantic modelling for a modeldriven development framework for service-centric software systems. Ontologies as the foundations of semantic modelling and its enhancement through architectural pattern modelling are at the core of the proposed approach. We introduce foundations and discuss the benefits and also the challenges in this context