CHORUS Deliverable 2.2: Second report - identification of multi-disciplinary key issues for gap analysis toward EU multimedia search engines roadmap

After addressing the state-of-the-art during the first year of Chorus and establishing the existing landscape in multimedia search engines, we have identified and analyzed gaps within European research effort during our second year. In this period we focused on three directions, notably technological issues, user-centred issues and use-cases and socio- economic and legal aspects. These were assessed by two central studies: firstly, a concerted vision of functional breakdown of generic multimedia search engine, and secondly, a representative use-cases descriptions with the related discussion on requirement for technological challenges. Both studies have been carried out in cooperation and consultation with the community at large through EC concertation meetings (multimedia search engines cluster), several meetings with our Think-Tank, presentations in international conferences, and surveys addressed to EU projects coordinators as well as National initiatives coordinators. Based on the obtained feedback we identified two types of gaps, namely core technological gaps that involve research challenges, and “enablers”, which are not necessarily technical research challenges, but have impact on innovation progress. New socio-economic trends are presented as well as emerging legal challenges

Some Research Questions and Results of UC3M in the E-Madrid Excellence Network

32 slides.-- Contributed to: 2010 IEEE Global Engineering Education Conference (EDUCON), Madrid, Spain, 14-16 April, 2010.-- Presented by C. Delgado Kloos.Proceedings of: 2010 IEEE Global Engineering Education Conference (EDUCON), Madrid, Spain, 14-16 April, 2010Universidad Carlos III de Madrid is one of the six main participating institutions in the eMadrid excellence network, as well as its coordinating partner. In this paper, the network is presented together with some of the main research lines carried out by UC3M. The remaining papers in this session present the work carried out by the other five universities in the consortium.The Excellence Network eMadrid, “Investigación y Desarrollo de Tecnologías para el e-Learning en la Comunidad de Madrid” is being funded by the Madrid Regional Government under grant No. S2009/TIC-1650. In addition, we acknowledge funding from the following research projects: iCoper: “Interoperable Content for Performance in a Competency-driven Society” (eContentPlus Best Practice Network No. ECP-2007-EDU-417007), Learn3: Hacia el Aprendizaje en la 3ª Fase (“Plan Nacional de I+D+I” TIN2008-05163/ TSI), Flexo: “Desarrollo de aprendizaje adaptativo y accesible en sistemas de código abierto” (AVANZA I+D, TSI-020301- 2008-19), España Virtual (CDTI, Ingenio 2010, CENIT, Deimos Space), SOLITE (CYTED 508AC0341), and “Integración vertical de servicios telemáticos de apoyo al aprendizaje en entornos residenciales” (Programa de creación y consolidación de grupos de investigación de la Universidad Carlos III de Madrid).Publicad

An MPEG-7 scheme for semantic content modelling and filtering of digital video

Abstract Part 5 of the MPEG-7 standard specifies Multimedia Description Schemes (MDS); that is, the format multimedia content models should conform to in order to ensure interoperability across multiple platforms and applications. However, the standard does not specify how the content or the associated model may be filtered. This paper proposes an MPEG-7 scheme which can be deployed for digital video content modelling and filtering. The proposed scheme, COSMOS-7, produces rich and multi-faceted semantic content models and supports a content-based filtering approach that only analyses content relating directly to the preferred content requirements of the user. We present details of the scheme, front-end systems used for content modelling and filtering and experiences with a number of users

Terabyte-scale supervised 3D training and benchmarking dataset of the mouse kidney

The performance of machine learning algorithms, when used for segmenting 3D biomedical images, does not reach the level expected based on results achieved with 2D photos. This may be explained by the comparative lack of high-volume, high-quality training datasets, which require state-of-the-art imaging facilities, domain experts for annotation and large computational and personal resources. The HR-Kidney dataset presented in this work bridges this gap by providing 1.7 TB of artefact-corrected synchrotron radiation-based X-ray phase-contrast microtomography images of whole mouse kidneys and validated segmentations of 33 729 glomeruli, which corresponds to a one to two orders of magnitude increase over currently available biomedical datasets. The image sets also contain the underlying raw data, threshold- and morphology-based semi-automatic segmentations of renal vasculature and uriniferous tubules, as well as true 3D manual annotations. We therewith provide a broad basis for the scientific community to build upon and expand in the fields of image processing, data augmentation and machine learning, in particular unsupervised and semi-supervised learning investigations, as well as transfer learning and generative adversarial networks

A schema-based P2P network to enable publish-subscribe for multimedia content in open hypermedia systems

Open Hypermedia Systems (OHS) aim to provide efficient dissemination, adaptation and integration of hyperlinked multimedia resources. Content available in Peer-to-Peer (P2P) networks could add significant value to OHS provided that challenges for efficient discovery and prompt delivery of rich and up-to-date content are successfully addressed. This paper proposes an architecture that enables the operation of OHS over a P2P overlay network of OHS servers based on semantic annotation of (a) peer OHS servers and of (b) multimedia resources that can be obtained through the link services of the OHS. The architecture provides efficient resource discovery. Semantic query-based subscriptions over this P2P network can enable access to up-to-date content, while caching at certain peers enables prompt delivery of multimedia content. Advanced query resolution techniques are employed to match different parts of subscription queries (subqueries). These subscriptions can be shared among different interested peers, thus increasing the efficiency of multimedia content dissemination

Video summarisation: A conceptual framework and survey of the state of the art

This is the post-print (final draft post-refereeing) version of the article. Copyright @ 2007 Elsevier Inc.Video summaries provide condensed and succinct representations of the content of a video stream through a combination of still images, video segments, graphical representations and textual descriptors. This paper presents a conceptual framework for video summarisation derived from the research literature and used as a means for surveying the research literature. The framework distinguishes between video summarisation techniques (the methods used to process content from a source video stream to achieve a summarisation of that stream) and video summaries (outputs of video summarisation techniques). Video summarisation techniques are considered within three broad categories: internal (analyse information sourced directly from the video stream), external (analyse information not sourced directly from the video stream) and hybrid (analyse a combination of internal and external information). Video summaries are considered as a function of the type of content they are derived from (object, event, perception or feature based) and the functionality offered to the user for their consumption (interactive or static, personalised or generic). It is argued that video summarisation would benefit from greater incorporation of external information, particularly user based information that is unobtrusively sourced, in order to overcome longstanding challenges such as the semantic gap and providing video summaries that have greater relevance to individual users

Promoting and Nurturing Interactions with Open Access Books: Strategies for Publishers and Authors (1.0).:A COPIM WP6 Research and Scoping Report

This report explores how publishers and authors can promote, nurture, and facilitate interaction with openly available books. Open access (obviously) opens up scholarship, but it also offers scope to enhance interactions between books, scholars, publishers, resources, librarians, and of course readers. This might take the form of creating communities and conversations around books, of gathering comments and hyperlinks, or of enabling updating, remixing and reusing, translating, modifying, reviewing, versioning, and forking of existing books. Open access, in short can create additional value and new avenues and formats that go beyond openness, by changing how people interact with books. Research shows that making books available in open access enhances discovery and online consultation (Snijder, 2019), but the short outline above makes clear that there is still a lot to be done to stimulate, explore, and practice the full range of book interactions made possible by open access. The first part of this report provides a literature overview that identifies the opportunities that digital technologies and enhanced interactions with open access books can provide for scholarship; it outlines some of the main types of interactions around scholarship—and around and as part of open access books more in particular—that scholars are involved in; and it showcases some of the experiments within humanities book publishing with reuse and remix; finally it presents some of the main (technological and socio-cultural) inhibitions that have prevented further uptake of these practices. The second part of this report more closely explores the technical dependencies that the introduced interactions and affordances rely upon. Doing so, it outlines and showcases various open source tools, software, technologies, platforms, infrastructures, guidelines and best practices, that lend themselves to being adopted by publishers and authors (or by publishers and authors working in collaboration with each other) to facilitate interaction around their book(s). The third part of this report then summarises the findings of the previous parts and provides recommendations, guidelines, and strategies (again, both socio-cultural and technological) for publishers and authors to further open up their books and collections to community interaction and reuse. Who is this Report for? The main communities we want to reach with this report are publishers and authors/scholars (or communities of scholars), to explore how they, by experimenting and often just making simple adjustments, can start to open up and stimulate interactions around their books. Where larger (commercial) publishers often have the resources to develop tools and workflows for interaction in-house (and often proprietary), scholar-led publishers, for example, although they have been at the vanguard of more experimental forms of publishing, have indicated that they often lack expertise and familiarity with more experimental forms of publishing and with the tools available to support them (Adema and Stone, 2017). We therefore focus in this report on open source tools and openly and freely available resources and guidelines that can help small-scale and not-for-profit book publishers that cannot afford to build their own custom platforms, to stimulate engagement around books. We also show various examples throughout this report of how publishers, publishing collectives and platforms, authors, and scholarly communities already are stimulating interaction around books in interesting ways and the tools and practices they have adopted to do so. This report focuses on interactions with books and on books within the humanities and social sciences in particular. Many of the types of interaction and interactive practices we describe within this report (such as for example open peer review and data mining), are being used and adopted more commonly within the STEM fields (where their uptake is also more widely researched). The humanities (and to a lesser extent the social sciences) in general have lower adoption rates where it concerns these types of practices and also have field specific preferences (as well as prejudices) towards many of these practices, which will be taken into account and further discussed in this report. Types of Interaction As part of our research we have identified several types of scholarly interaction taking place around books. The first part of this report is structured around some of the more common kinds of interaction that open access books afford: annotations, open peer review, remix and reuse, social scholarship and networked books, and emergent practices (including versioning, forking, and human computer interactions). This report doesn’t aim to cover all forms of interaction around books but has chosen to focus on the kinds of interactions that publishers and scholars would be able to promote and recreate with relatively simple adaptations to their workflows, systems, practices, and licensing. Each of the above identified types of interaction around books will be discussed in the next section, including how we can stimulate them and what obstacles currently exist towards their more general implementation. Throughout the next part of this report we will also be providing examples from within humanities book publishing to illustrate the different kinds of interaction. --- --- --- --- --- --- The report has itself been published in an experimental way. Making use of the advanced versioning functionalities offered by PubPub, we will iteratively update this document over the remainder of the project, thus allowing us to incorporate user feedback and new technological developments. Hence, we would be really grateful for constructive feedback from the communities out there who are already experimenting with new forms of interaction. Please don’t hesitate to leave comments either on the PubPub version (account and login required), or get in touch via email at [email protected] The report is published as a PDF here on Zenodo, while a more interactive book version that is available as a PubPub book.Community-led Open Publishing Infrastructures for Monographs (COPIM) is supported by the Research England Development (RED) Fund, and Arcadia—a charitable fund of Lisbet Rausing and Peter Baldwin