Integrating Deep Learning with Correlation-based Multimedia Semantic Concept Detection

The rapid advances in technologies make the explosive growth of multimedia data possible and available to the public. Multimedia data can be defined as data collection, which is composed of various data types and different representations. Due to the fact that multimedia data carries knowledgeable information, it has been widely adopted to different genera, like surveillance event detection, medical abnormality detection, and many others. To fulfil various requirements for different applications, it is important to effectively classify multimedia data into semantic concepts across multiple domains. In this dissertation, a correlation-based multimedia semantic concept detection framework is seamlessly integrated with the deep learning technique. The framework aims to explore implicit and explicit correlations among features and concepts while adopting different Convolutional Neural Network (CNN) architectures accordingly. First, the Feature Correlation Maximum Spanning Tree (FC-MST) is proposed to remove the redundant and irrelevant features based on the correlations between the features and positive concepts. FC-MST identifies the effective features and decides the initial layer\u27s dimension in CNNs. Second, the Negative-based Sampling method is proposed to alleviate the data imbalance issue by keeping only the representative negative instances in the training process. To adjust dierent sizes of training data, the number of iterations for the CNN is determined adaptively and automatically. Finally, an Indirect Association Rule Mining (IARM) approach and a correlation-based re-ranking method are proposed to reveal the implicit relationships from the correlations among concepts, which are further utilized together with the classification scores to enhance the re-ranking process. The framework is evaluated using two benchmark multimedia data sets, TRECVID and NUS-WIDE, which contain large amounts of multimedia data and various semantic concepts

Semantic multimedia modelling & interpretation for annotation

The emergence of multimedia enabled devices, particularly the incorporation of cameras in mobile phones, and the accelerated revolutions in the low cost storage devices, boosts the multimedia data production rate drastically. Witnessing such an iniquitousness of digital images and videos, the research community has been projecting the issue of its significant utilization and management. Stored in monumental multimedia corpora, digital data need to be retrieved and organized in an intelligent way, leaning on the rich semantics involved. The utilization of these image and video collections demands proficient image and video annotation and retrieval techniques. Recently, the multimedia research community is progressively veering its emphasis to the personalization of these media. The main impediment in the image and video analysis is the semantic gap, which is the discrepancy among a user’s high-level interpretation of an image and the video and the low level computational interpretation of it. Content-based image and video annotation systems are remarkably susceptible to the semantic gap due to their reliance on low-level visual features for delineating semantically rich image and video contents. However, the fact is that the visual similarity is not semantic similarity, so there is a demand to break through this dilemma through an alternative way. The semantic gap can be narrowed by counting high-level and user-generated information in the annotation. High-level descriptions of images and or videos are more proficient of capturing the semantic meaning of multimedia content, but it is not always applicable to collect this information. It is commonly agreed that the problem of high level semantic annotation of multimedia is still far from being answered. This dissertation puts forward approaches for intelligent multimedia semantic extraction for high level annotation. This dissertation intends to bridge the gap between the visual features and semantics. It proposes a framework for annotation enhancement and refinement for the object/concept annotated images and videos datasets. The entire theme is to first purify the datasets from noisy keyword and then expand the concepts lexically and commonsensical to fill the vocabulary and lexical gap to achieve high level semantics for the corpus. This dissertation also explored a novel approach for high level semantic (HLS) propagation through the images corpora. The HLS propagation takes the advantages of the semantic intensity (SI), which is the concept dominancy factor in the image and annotation based semantic similarity of the images. As we are aware of the fact that the image is the combination of various concepts and among the list of concepts some of them are more dominant then the other, while semantic similarity of the images are based on the SI and concept semantic similarity among the pair of images. Moreover, the HLS exploits the clustering techniques to group similar images, where a single effort of the human experts to assign high level semantic to a randomly selected image and propagate to other images through clustering. The investigation has been made on the LabelMe image and LabelMe video dataset. Experiments exhibit that the proposed approaches perform a noticeable improvement towards bridging the semantic gap and reveal that our proposed system outperforms the traditional systems

Processo e desconstrução: estruturas recursivas entre cozinha e design

From the triangulation kitchen, design and process this study searches evidence for bridging process between the fields of kitchen and design following Buchanan’s theory of rethinking placements over categories by way of signs, things, actions and thoughts. Kitchen and design are thus understood as liberal arts disciplines seeking to privilege a placement-based approach to projectual practice. Deconstruction was instrumental for exploring and testing the presence of recursive structures —elements carrying the essential information that generates similar patterns visible on different fields— intersecting the two fields, aiming to prove if and whence kitchen may contribute to expand the knowledge of design. Pallasmaa’s conception of an architecture of the senses, for whom the role of the body is understood as the locus of perception, thought and consciousness, helped explore and convoke the space of kitchen visited by artists and designers throughout recent history, as a means to establish relations between theories, processes, and projectual methodologies in kitchen and design. The reading of the space finds its translation through diverse processes applied by these creators leading to an understanding of a kitchen milieu: process as context. The empirical work with the research sample practices allowed for a discourse within, between and beyond individual samples to reveal the dialogical abilities of the applied processes. From the interpretation of the empirical work it is suggested that kitchen multiplies design (k x d). It implies that the context of kitchen multiplies the space of the discipline of design, becoming, in Buchanan’s term, a “quasi-subject matter of design thinking”. If so, kitchen as other placements may offer, or are open to receive and edify, an expanded view of the discipline of design. Considering findings of the three main typologies (education, research, process) it suggests transversality and integrates fundamental knowledge dimensions as the capability for negotiation between different actors/disciplines. This is made visible through the practices that comprise the research sample, namely curiosity, context, scale, desire, care. This study recommends further research into the transformative potential and imaginary of the kitchen/canteen in liberal arts education.A partir da triangulação cozinha, design e processo, este estudo investiga a evidência para o processo de ligação entre as áreas de cozinha e de design, de acordo com a teoria de Buchanan de repensar mais os posicionamentos que as categorias mediante sinais, coisas, ações e pensamentos. Assim, cozinha e design são entendidos como disciplinas das artes liberais, procurando privilegiar uma abordagem baseada no posicionamento em relação à prática projectual. A desconstrução foi fundamental para explorar e testar a presença de estruturas recursivas —elementos que comportam a informação essencial que gera padrões semelhantes em áreas diferentes— entrecruzando as duas áreas, visando provar se e a partir de onde a cozinha pode contribuir para expandir o conhecimento sobre o design. A concepção de Pallasmaa de uma arquitetura dos sentidos, para quem o papel do corpo é entendido como o locus da percepção, do pensamento e da consciência, ajudou a explorar e a convocar o espaço da cozinha, visitado por artistas e designers ao longo da história recente, como um meio de estabelecer relações entre teorias, processos e metodologias projectuais na cozinha e no design. A leitura do espaço encontra a sua tradução através de diversos processos aplicados por estes criadores, levando a um entendimento de um milieu de cozinha: o processo como contexto. O trabalho empírico com as práticas da amostra de investigação permitiu um discurso dentro, entre e para além das amostras individuais para revelar as capacidades dialógicas dos processos aplicados. A partir da interpretação do trabalho empírico, sugere-se que a cozinha multiplica o design (k x d). Isto implica que o contexto da cozinha multiplica o espaço da disciplina de design, tornando-se, na terminologia de Buchanan, uma “matéria de quase-sujeito de design thinking”. Se assim for, a cozinha, tal como outros posicionamentos, pode oferecer ou estar aberta a receber e a edificar uma visão alargada da disciplina de design. Considerando os resultados das três principais tipologias (educação, investigação, processo), sugere transversalidade e integra dimensões de conhecimento fundamentais como a capacidade de negociação entre diferentes actores/disciplinas. Isto torna-se visível através das práticas que incluem amostra de investigação, nomeadamente curiosidade, contexto, escala, desejo, cuidado. Este estudo recomenda desenvolver investigação sobre o potencial e o imaginário transformadores da cozinha/cantina na educação das artes liberais.Programa Doutoral em Desig

Seventh Annual Workshop on Space Operations Applications and Research (SOAR 1993), volume 1

This document contains papers presented at the Space Operations, Applications and Research Symposium (SOAR) Symposium hosted by NASA/Johnson Space Center (JSC) on August 3-5, 1993, and held at JSC Gilruth Recreation Center. SOAR included NASA and USAF programmatic overview, plenary session, panel discussions, panel sessions, and exhibits. It invited technical papers in support of U.S. Army, U.S. Navy, Department of Energy, NASA, and USAF programs in the following areas: robotics and telepresence, automation and intelligent systems, human factors, life support, and space maintenance and servicing. SOAR was concerned with Government-sponsored research and development relevant to aerospace operations. More than 100 technical papers, 17 exhibits, a plenary session, several panel discussions, and several keynote speeches were included in SOAR '93

Old Meets New: Media in Education – Proceedings of the 61st International Council for Educational Media and the XIII International Symposium on Computers in Education (ICEM&SIIE'2011) Joint Conference

A conferência ICEM&SIIE'2011 foi organizada pela Universidade de Aveiro (Portugal) – membro do European Consortium of Innovative Universities – e pretendeu reunir investigadores, professores e outros profissionais, a nível nacional e internacional, em torno de um tema aglutinador que pretendeu despoletar e colocar a tónica da discussão na dualidade ―old/new‖, ou seja, os participantes foram convidados a discutir: - os media na educação em ambas as perspetivas, mais tradicionais ou modernas, com incidência numas ou noutras ou, ainda, numa perspetiva comparativa; - a conjugação, adaptação e adoção dos media consoante os contextos e objetivos de utilização; - o que os media implicam em termos de tecnologia, barreiras profissionais e /ou sociais; - a relação custo-benefício da utilização dos media em contexto de aprendizagem; - os media em função dos diversos contextos educativos e dos perfis de aprendizagem dos alunos. Para a conferência foram selecionados 76 artigos organizados em 15 sessões paralelas, 13 posters e 9 workshops. A conferência caracterizou-se pelo caráter internacional dos contributos, reunindo 38 artigos em português, 32 em língua inglesa e 6 em espanhol. Estas atas encontram-se organizadas de acordo com o programa da conferência. Em primeiro lugar incluem-se os artigos (full paper e short paper) por sessão, seguem-se os posters e, finalmente, o resumo relativo aos workshops.The ICEM&SIIE'2011 conference was organised by the University of Aveiro (Portugal) – a member of the European Consortium of Innovative Universities – and aimed at gathering researchers, teachers and other professionals, at national and international level, around a focal topic that might trigger and centre the discussion on the ―old/new‖ duality of media in education. Participants were invited to discuss: - old and new media in education, in isolation or comparatively; - how old and new media in education can be combined, adopted and adapted; - what old and new media in education imply in terms of technological, professional and social barriers; - what cost-benefit relationships old and new media in education entail; - how to compare old and new media in education given their particular educational contexts and the students' learning profiles. 76 papers were selected and organised in 15 paralel sessions, 13 posters and 9 workshops. The conference is characterized by the international character of contributions, gathering 38 papers in Portuguese, 32 in English and 6 in Spanish. These procedings are organised according to the programme of the conference. First we find the full and short papers, per session, then posters and finally the abstracts for the workshops