3,490 research outputs found

    Contextualized vocabulary learning

    Get PDF

    CHORUS Deliverable 2.1: State of the Art on Multimedia Search Engines

    Get PDF
    Based on the information provided by European projects and national initiatives related to multimedia search as well as domains experts that participated in the CHORUS Think-thanks and workshops, this document reports on the state of the art related to multimedia content search from, a technical, and socio-economic perspective. The technical perspective includes an up to date view on content based indexing and retrieval technologies, multimedia search in the context of mobile devices and peer-to-peer networks, and an overview of current evaluation and benchmark inititiatives to measure the performance of multimedia search engines. From a socio-economic perspective we inventorize the impact and legal consequences of these technical advances and point out future directions of research

    TRECVID 2004 - an overview

    Get PDF

    Access to recorded interviews: A research agenda

    Get PDF
    Recorded interviews form a rich basis for scholarly inquiry. Examples include oral histories, community memory projects, and interviews conducted for broadcast media. Emerging technologies offer the potential to radically transform the way in which recorded interviews are made accessible, but this vision will demand substantial investments from a broad range of research communities. This article reviews the present state of practice for making recorded interviews available and the state-of-the-art for key component technologies. A large number of important research issues are identified, and from that set of issues, a coherent research agenda is proposed

    FrameNet annotation for multimodal corpora: devising a methodology for the semantic representation of text-image interactions in audiovisual productions

    Get PDF
    Multimodal analyses have been growing in importance within several approaches to Cognitive Linguistics and applied fields such as Natural Language Understanding. Nonetheless fine-grained semantic representations of multimodal objects are still lacking, especially in terms of integrating areas such as Natural Language Processing and Computer Vision, which are key for the implementation of multimodality in Computational Linguistics. In this dissertation, we propose a methodology for extending FrameNet annotation to the multimodal domain, since FrameNet can provide fine-grained semantic representations, particularly with a database enriched by Qualia and other interframal and intraframal relations, as it is the case of FrameNet Brasil. To make FrameNet Brasil able to conduct multimodal analysis, we outlined the hypothesis that similarly to the way in which words in a sentence evoke frames and organize their elements in the syntactic locality accompanying them, visual elements in video shots may, also, evoke frames and organize their elements on the screen or work complementarily with the frame evocation patterns of the sentences narrated simultaneously to their appearance on screen, providing different profiling and perspective options for meaning construction. The corpus annotated for testing the hypothesis is composed of episodes of a Brazilian TV Travel Series critically acclaimed as an exemplar of good practices in audiovisual composition. The TV genre chosen also configures a novel experimental setting for research on integrated image and text comprehension, since, in this corpus, text is not a direct description of the image sequence but correlates with it indirectly in a myriad of ways. The dissertation also reports on an eye-tracker experiment conducted to validate the approach proposed to a text-oriented annotation. The experiment demonstrated that it is not possible to determine that text impacts gaze directly and was taken as a reinforcement to the approach of valorizing modes combination. Last, we present the Frame2 dataset, the product of the annotation task carried out for the corpus following both the methodology and guidelines proposed. The results achieved demonstrate that, at least for this TV genre but possibly also for others, a fine-grained semantic annotation tackling the diverse correlations that take place in a multimodal setting provides new perspective in multimodal comprehension modeling. Moreover, multimodal annotation also enriches the development of FrameNets, to the extent that correlations found between modalities can attest the modeling choices made by those building frame-based resources.AnĂĄlises multimodais vĂȘm crescendo em importĂąncia em vĂĄrias abordagens da LinguĂ­stica Cognitiva e em diversas ĂĄreas de aplicação, como o da CompreensĂŁo de Linguagem Natural. No entanto, hĂĄ significativa carĂȘncia de representaçÔes semĂąnticas refinadas de objetos multimodais, especialmente em termos de integração de ĂĄreas como Processamento de Linguagem Natural e VisĂŁo Computacional, que sĂŁo fundamentais para a implementação de multimodalidade no campo da LinguĂ­stica Computacional. Nesta tese, propomos uma metodologia para estender o mĂ©todo de anotação da FrameNet ao domĂ­nio multimodal, uma vez que a FrameNet pode fornecer representaçÔes semĂąnticas refinadas, particularmente com um banco de dados enriquecido por Qualia e outras relaçÔes interframe e intraframe, como Ă© o caso do FrameNet Brasil. Para tornar a FrameNet Brasil capaz de realizar anĂĄlises multimodais, delineamos a hipĂłtese de que, assim como as palavras em uma frase evocam frames e organizam seus elementos na localidade sintĂĄtica que os acompanha, os elementos visuais nos planos de vĂ­deo tambĂ©m podem evocar frames e organizar seus elementos na tela ou trabalhar de forma complementar aos padrĂ”es de evocação de frames das sentenças narradas simultaneamente ao seu aparecimento na tela, proporcionando diferentes perfis e opçÔes de perspectiva para a construção de sentido. O corpus anotado para testar a hipĂłtese Ă© composto por episĂłdios de um programa televisivo de viagens brasileiro aclamado pela crĂ­tica como um exemplo de boas prĂĄticas em composição audiovisual. O gĂȘnero televisivo escolhido tambĂ©m configura um novo conjunto experimental para a pesquisa em imagem integrada e compreensĂŁo textual, uma vez que, neste corpus, o texto nĂŁo Ă© uma descrição direta da sequĂȘncia de imagens, mas se correlaciona com ela indiretamente em uma mirĂ­ade de formas diversa. A Tese tambĂ©m relata um experimento de rastreamento ocular realizado para validar a abordagem proposta para uma anotação orientada por texto. O experimento demonstrou que nĂŁo Ă© possĂ­vel determinar que o texto impacta diretamente o direcionamento do olhar e foi tomado como um reforço para a abordagem de valorização da combinação de modos. Por fim, apresentamos o conjunto de dados Frame2, produto da tarefa de anotação realizada para o corpus seguindo a metodologia e as diretrizes propostas. Os resultados obtidos demonstram que, pelo menos para esse gĂȘnero de TV, mas possivelmente tambĂ©m para outros, uma anotação semĂąntica refinada que aborde as diversas correlaçÔes que ocorrem em um ambiente multimodal oferece uma nova perspectiva na modelagem da compreensĂŁo multimodal. AlĂ©m disso, a anotação multimodal tambĂ©m enriquece o desenvolvimento de FrameNets, na medida em que as correlaçÔes encontradas entre as modalidades podem atestar as escolhas de modelagem feitas por aqueles que criam recursos baseados em frames.CAPES - Coordenação de Aperfeiçoamento de Pessoal de NĂ­vel Superio

    The effect of using same language subtitling (SLS) in content comprehension and vocabulary acquisition in Arabic as a foreign language (AFL)

    Get PDF
    This study investigates the effects of SLS (Same-Language subtitling) on content comprehension and vocabulary acquisition of MSA (Modern Standard Arabic) as L2 at the intermediate level and addresses three research questions: (1) Does SLS enhance or hinder L2 content comprehension when the writing script of L2 is different than that of L1? (2) Does SLS enhance or hinder L2 vocabulary acquisition when the writing script of L2 is different than that of L1? (3) What is students\u27 attitude towards the use of SLS? Twenty seven students of AUC\u27s ALI program with English as L1 were chosen for the study and divided between a control group (without SLS) and a treatment group (with SLS). Instructions concerning the procedure were given in L1 to rule out any false results due to task misinterpretation. Both groups watched an authentic 3:11 minute documentary twice after completing an individual background questionnaire and taking a multiple choice vocabulary pre-viewing test. Post-viewing, participants took the same vocabulary test, then wrote a summary in L1 based on their notes taken during/and in-between the viewings and completed a questionnaire/questions related to their experience with and -/out captions. L1 summaries were analyzed in terms of 23 semantic units related to content comprehension. The degree of vocabulary acquisition was calculated by comparing the responses between the pre- and post-viewing vocabulary multiply choice tests. Results using t-test and one way ANOVA indicate that SLS neither facilitates nor hinders comprehension and vocabulary acquisition. The majority of students enjoyed captions and wanted to continue using them in class. Pedagogical suggestions and future research recommended training with captions and focus on other text- aids, e.g. reverse subtitling at other proficiency levels. Contains 84 references, 17 figures, 5 pictures and 5 tables

    The Mobile Generation: Global Transformations at the Cellular Level

    Get PDF
    Every year we see a new dimension of the ongoing Digital Revolution, which is enabling an abundance of information to move faster, cheaper, in more intelligible forms, in more directions, and across borders of every kind. The exciting new dimension on which the Aspen Institute focused its 2006 Roundtable on Information Technology was mobility, which is making the Digital Revolution ubiquitous. As of this writing, there are over two billion wireless subscribers worldwide and that number is growing rapidly. People are constantly innovating in the use of mobile technologies to allow them to be more interconnected. Almost a half century ago, Ralph Lee Smith conjured up "The Wired Nation," foretelling a world of interactive communication to and from the home that seems commonplace in developed countries today. Now we have a "Wireless World" of communications potentially connecting two billion people to each other with interactive personal communications devices. Widespead adoption of wireless handsets, the increasing use of wireless internet, and the new, on-the-go content that characterizes the new generation of users are changing behaviors in social, political and economic spheres. The devices are easy to use, pervasive and personal. The affordable cell phone has the potential to break down the barriers of poverty and accessibility previously posed by other communications devices. An entire generation that is dependant on ubiquitous mobile technologies is changing the way it works, plays and thinks. Businesses, governments, educational institutions, religious and other organizations in turn are adapting to reach out to this mobile generation via wireless technologies -- from SMS-enabled vending machines in Finland to tech-savvy priests in India willing to conduct prayers transmitted via cell phones. Cellular devices are providing developing economies with opportunities unlike any others previously available. By opening the lines of communication, previously disenfranchised groups can have access to information relating to markets, economic opportunities, jobs, and weather to name just a few. When poor village farmers from Bangladesh can auction their crops on a craigslist-type service over the mobile phone, or government officials gain instantaneous information on contagious diseases via text message, the miracles of mobile connectivity move us from luxury to necessity. And we are only in the early stages of what the mobile electronic communications will mean for mankind. We are now "The Mobile Generation." Aspen Institute Roundtable on Information Technology. To explore the implications of these phenomena, the Aspen Institute Communications and Society Program convened 27 leaders from business, academia, government and the non-profit sector to engage in three days of dialogue on related topics. Some are experts in information and communications technologies, others are leaders in the broader society affected by these innovations. Together, they examined the profound changes ahead as a result of the convergence of wireless technologies and the Internet. In the following report of the Roundtable meeting held August 1-4, 2006, J. D. Lasica, author of Darknet and co-founder of Ourmedia.org, deftly sets up, contextualizes, and captures the dialogue on the impact of the new mobility on economic models for businesses and governments, social services, economic development, and personal identity
    • 

    corecore