Image summarisation: human action description from static images

Dissertação de Mestrado, Processamento de Linguagem Natural e Indústrias da Língua, Faculdade de Ciências Humanas e Sociais, Universidade do Algarve, 2014The object of this master thesis is Image Summarisation and more specifically the automatic human action description from static images. The work has been organised into three main phases, with first one being the data collection, second the actual system implementation and third the system evaluation. The dataset consists of 1287 images depicting human activities belonging in fours semantic categories; "walking a dog", "riding a bike", "riding a horse" and "playing the guitar". The images were manually annotated with an approach based in the idea of crowd sourcing, and the annotation of each sentence is in the form of one or two simple sentences. The system is composed by two parts, a Content-based Image Retrieval part and a Natural Language Processing part. Given a query image the first part retrieves a set of images perceived as visually similar and the second part processes the annotations following each of the images in order to extract common information by using a graph merging technique of the dependency graphs of the annotated sentences. An optimal path consisting of a subject-verb-complement relation is extracted and transformed into a proper sentence by applying a set of surface processing rules. The evaluation of the system was carried out in three different ways. Firstly, the Content-based Image Retrieval sub-system was evaluated in terms of precision and recall and compared to a baseline classification system based on randomness. In order to evaluate the Natural Language Processing sub-system, the Image Summarisation task was considered as a machine translation task, and therefore it was evaluated in terms of BLEU score. Given images that correspond to the same semantic as a query image the system output was compared to the corresponding reference summary as provided during the annotation phase, in terms of BLEU score. Finally, the whole system has been qualitatively evaluated by means of a questionnaire. The conclusions reached by the evaluation is that even if the system does not always capture the right human action and subjects and objects involved in it, it produces understandable and efficient in terms of language summaries.O objetivo desta dissertação é sumarização imagem e, mais especificamente, a geração automática de descrições de ações humanas a partir de imagens estáticas. O trabalho foi organizado em três fases principais: a coleta de dados, a implementação do sistema e, finalmente, a sua avaliação. O conjunto de dados é composto por 1.287 imagens que descrevem atividades humanas pertencentes a quatro categorias semânticas: "passear o cão", "andar de bicicleta", "andar a cavalo" e "tocar guitarra". As imagens foram anotadas manualmente com uma abordagem baseada na ideia de 'crowd-sourcing' e a anotação de cada frase foi feita sob a forma de uma ou duas frases simples. O sistema é composto por duas partes: uma parte consiste na recuperação de imagens baseada em conteúdo e a outra parte, que envolve Processamento de Língua Natural. Dada uma imagem para procura, a primeira parte recupera um conjunto de imagens percebidas como visualmente semelhantes e a segunda parte processa as anotações associadas a cada uma dessas imagens, a fim de extrair informações comuns, usando uma técnica de fusão de grafos a partir dos grafos de dependência das frases anotadas. Um caminho ideal consistindo numa relação sujeito-verbo-complemento é então extraído desses grafos e transformado numa frase apropriada, pela aplicação de um conjunto de regras de processamento de superfície. A avaliação do sistema foi realizado de três maneiras diferentes. Em primeiro lugar, o subsistema de recuperação de imagens baseado em conteúdo foi avaliado em termos de precisão e abrangência (recall) e comparado com um limiar de referência (baseline) definido com base num resultado aleatório. A fim de avaliar o subsistema de Processamento de Linguagem Natural, a tarefa de sumarização imagem foi considerada como uma tarefa de tradução automática e foi, portanto, avaliada com base na medida BLEU. Dadas as imagens que correspondem ao mesmo significado da imagem de consulta, a saída do sistema foi comparada com o resumo de referência correspondente, fornecido durante a fase de anotação, utilizando a medida BLEU. Por fim, todo o sistema foi avaliado qualitativamente por meio de um questionário. Em conclusão, verificou-se que o sistema, apesar de nem sempre capturar corretamente a ação humana e os sujeitos ou objetos envolvidos, produz, no entanto, descrições compreensíveis e e linguisticamente adequadas.Erasmus Mundu

The Effect of Biopsychosocial Variables in Fatigue in Patients with Hemoglobinopathies

Purpose: The purpose of the present study was to explore the biopsychosocial variables affecting fatigue in patients with hemoglobinopathies. Methods: 102 patients undergoing transfusion treatment from one hospital in Athens, Greece participated in the study. Fatigue was measured with the Multidimensional Fatigue Inventory (MFI), quality of life with the Euro5D thermometer as self-perceived health and psychological variables with the Depression, Anxiety and Stress Scale (DASS 21). Statistical analysis was performed with SPSS21. Results: 63 were females (61,4%) and 39 males (38,6%). The mean age of the sample was 41.7±9.2 years, while the majority of participants were patients with a diagnosis of homozygous ?-Thalassemia (81.4%). Multivariate analysis revealed 6 independent models for each dimension of fatigue, while every one of the five dimensions of MFI as well the total score of the inventory, revealed a different model of correlations with mixed variables, related with disease complications, adherence to treatment, sex, the self-perceived quality of life, as well as the qualitative characteristics of fatigue related with disease complications. Conclusions: Fatigue has been identified as a very common symptom in patients with thalassemia with many variables affecting it in this population. Our results broadens the evidence regarding fatigue in hemoglobinopathies and leads us to the need for distinguishing the etiologies leading to fatigue in hemoglobinopathies since it is an important factor affecting HPQoL. Longitudinal studies are needed in order to understand the path of fatigue and the factors influencing the condition

Touché: Data-Driven Interactive Sword Fighting in Virtual Reality

VR games offer new freedom for players to interact naturally using motion. This makes it harder to design games that react to player motions convincingly. We present a framework for VR sword fighting experiences against a virtual character that simplifies the necessary technical work to achieve a convincing simulation. The framework facilitates VR design by abstracting from difficult details on the lower “physical” level of interaction, using data-driven models to automate both the identification of user actions and the synthesis of character animations. Designers are able to specify the character's behaviour on a higher “semantic” level using parameterised building blocks, which allow for control over the experience while minimising manual development work. We conducted a technical evaluation, a questionnaire study and an interactive user study. Our results suggest that the framework produces more realistic and engaging interactions than simple hand-crafted interaction logic, while supporting a controllable and understandable behaviour design

The efficacy of iron chelator regimes in reducing cardiac and hepatic iron in patients with thalassaemia major: a clinical observational study

<p>Abstract</p> <p>Background</p> <p>Available iron chelation regimes in thalassaemia may achieve different changes in cardiac and hepatic iron as assessed by MR. The aim of this study was to assess the efficacy of four available iron chelator regimes in 232 thalassaemia major patients by assessing the rate of change in repeated measurements of cardiac and hepatic MR.</p> <p>Results</p> <p>For the heart, deferiprone and the combination of deferiprone and deferoxamine significantly reduced cardiac iron at all levels of iron loading. As patients were on deferasirox for a shorter time, a second analysis ("Initial interval analysis") assessing the change between the first two recorded MR results for both cardiac and hepatic iron (minimum interval 12 months) was made. Combination therapy achieved the most rapid fall in cardiac iron load at all levels and deferiprone alone was significantly effective with moderate and mild iron load. In the liver, deferasirox effected significant falls in iron load and combination therapy resulted in the most rapid decline.</p> <p>Conclusion</p> <p>With the knowledge of the efficacy of the different available regimes and the specific iron load in the heart and the liver, appropriate tailoring of chelation therapy should allow clearance of iron. Combination therapy is best in reducing both cardiac and hepatic iron, while monotherapy with deferiprone or deferasirox are effective in the heart and liver respectively. The outcomes of this study may be useful to physicians as to the chelation they should prescribe according to the levels of iron load found in the heart and liver by MR.</p

Training of SMEs for frozen food shelf life testing and novel smart packaging application for cold chain monitoring

<p class="MsoNormal" style="margin: 0cm 0cm 0pt; text-align: justify; line-height: 150%; text-justify: inter-ideograph;"> </p><p>Application of an optimized cold chain management system for frozen products can be assisted by monitoring with Time Temperature Integrators (TTI). TTI are smart labels that cumulatively show the product history in an easily measurable, time-temperature dependent change. In the IQ-Freshlabel European project enzymatic and photochromic TTI were developed and tested for frozen products. Further to the technical objectives, training activities were implemented to provide information and training to the staff of Small and Medium-sized Enterprises (SMEs) regarding the properties of the developed TTI and their utilization within food packaging, transport, storage and sale. In total, more than 276 European companies and consumers representing the frozen food industry, the packaging industry and food business operators were successfully trained. The objective of the present article is to describe a general methodology for frozen food shelf life testing and modelling, and the selection of appropriate TTI for specific foods. This document serves as a technical manual for SMEs, including a case study for frozen shrimp and application of enzymatic and photochromic TTI, aiming to build their capacities to understand and use TTI for frozen food products. The value of systematic modelling of the food quality kinetics as well as the response of the TTI in building an effective chill chain management system is also demonstrated. The TTI response study allows a reliable optimization and selection of TTI to be correlated to the target food product for which accurate information on temperature dependence is available.</p><p class="MsoNormal" style="margin: 0cm 0cm 0pt; text-align: justify; line-height: 150%; text-justify: inter-ideograph;"><span style="line-height: 150%; font-family: 'Calibri','sans-serif'; font-size: 11pt; mso-ansi-language: EN-US; mso-fareast-language: EN-US;" lang="EN-US"><br /></span></p

Choroidal vascular occlusion in a young male patient with sickle cell trait

Letter to the edito

Ground Deformation and Seismic Fault Model of the M6.4 Durres (Albania) Nov. 26, 2019 Earthquake, Based on GNSS/INSAR Observations

International audienc