CHORUS Deliverable 2.1: State of the Art on Multimedia Search Engines

Based on the information provided by European projects and national initiatives related to multimedia search as well as domains experts that participated in the CHORUS Think-thanks and workshops, this document reports on the state of the art related to multimedia content search from, a technical, and socio-economic perspective. The technical perspective includes an up to date view on content based indexing and retrieval technologies, multimedia search in the context of mobile devices and peer-to-peer networks, and an overview of current evaluation and benchmark inititiatives to measure the performance of multimedia search engines. From a socio-economic perspective we inventorize the impact and legal consequences of these technical advances and point out future directions of research

Ranking of Wikipedia articles in search engines revisited: Fair ranking for reasonable quality?

This paper aims to review the fiercely discussed question of whether the ranking of Wikipedia articles in search engines is justified by the quality of the articles. After an overview of current research on information quality in Wikipedia, a summary of the extended discussion on the quality of encyclopedic entries in general is given. On this basis, a heuristic method for evaluating Wikipedia entries is developed and applied to Wikipedia articles that scored highly in a search engine retrieval effectiveness test and compared with the relevance judgment of jurors. In all search engines tested, Wikipedia results are unanimously judged better by the jurors than other results on the corresponding results position. Relevance judgments often roughly correspond with the results from the heuristic evaluation. Cases in which high relevance judgments are not in accordance with the comparatively low score from the heuristic evaluation are interpreted as an indicator of a high degree of trust in Wikipedia. One of the systemic shortcomings of Wikipedia lies in its necessarily incoherent user model. A further tuning of the suggested criteria catalogue, for instance the different weighing of the supplied criteria, could serve as a starting point for a user model differentiated evaluation of Wikipedia articles. Approved methods of quality evaluation of reference works are applied to Wikipedia articles and integrated with the question of search engine evaluation

On the Impact of Information Technologies on Society: an Historical Perspective through the Game of Chess

The game of chess as always been viewed as an iconic representation of intellectual prowess. Since the very beginning of computer science, the challenge of being able to program a computer capable of playing chess and beating humans has been alive and used both as a mark to measure hardware/software progresses and as an ongoing programming challenge leading to numerous discoveries. In the early days of computer science it was a topic for specialists. But as computers were democratized, and the strength of chess engines began to increase, chess players started to appropriate to themselves these new tools. We show how these interactions between the world of chess and information technologies have been herald of broader social impacts of information technologies. The game of chess, and more broadly the world of chess (chess players, literature, computer softwares and websites dedicated to chess, etc.), turns out to be a surprisingly and particularly sharp indicator of the changes induced in our everyday life by the information technologies. Moreover, in the same way that chess is a modelization of war that captures the raw features of strategic thinking, chess world can be seen as small society making the study of the information technologies impact easier to analyze and to grasp

Youth and Digital Media: From Credibility to Information Quality

Building upon a process-and context-oriented information quality framework, this paper seeks to map and explore what we know about the ways in which young users of age 18 and under search for information online, how they evaluate information, and how their related practices of content creation, levels of new literacies, general digital media usage, and social patterns affect these activities. A review of selected literature at the intersection of digital media, youth, and information quality -- primarily works from library and information science, sociology, education, and selected ethnographic studies -- reveals patterns in youth's information-seeking behavior, but also highlights the importance of contextual and demographic factors both for search and evaluation. Looking at the phenomenon from an information-learning and educational perspective, the literature shows that youth develop competencies for personal goals that sometimes do not transfer to school, and are sometimes not appropriate for school. Thus far, educational initiatives to educate youth about search, evaluation, or creation have depended greatly on the local circumstances for their success or failure

Design Research and Domain Representation

While diverse theories about the nature of design research have been proposed, they are rarely considered in relation to one another across the broader disciplinary field. Discussions of design research paradigms have tended to use overarching binary models for understanding differing knowledge frameworks. This paper focuses on an analysis of theories of design research and the use of Web 3 and open content systems to explore the potential of building more relational modes of conceptual representation. The nature of this project is synthetic, building upon the work of other design theorists and researchers. A number of theoretical frameworks will be discussed and examples of the analysis and modelling of key concepts and information relationships, using concept mapping software, collaborative ontology building systems and semantic wiki technologies will be presented. The potential of building information structures from content relationships that are identified by domain specialists rather than the imposition of formal, top-down, information hierarchies developed by information scientists, will be considered. In particular the opportunity for users to engage with resources through their own knowledge frameworks, rather than through logically rigorous but largely incomprehensible ontological systems, will be explored in relation to building resources for emerging design researchers. The motivation behind this endeavour is not to create a totalising meta-theory or impose order on the ‘ill structured’ and ‘undisciplined’, domain of design. Nor is it to use machine intelligence to ‘solve design problems’. It seeks to create dynamic systems that might help researchers explore design research theories and their various relationships with one another. It is hoped such tools could help novice researchers to better locate their own projects, find reference material, identify knowledge gaps and make new linkages between bodies of knowledge by enabling forms of data-poesis - the freeing of data for different trajectories. Keywords: Design research; Design theory; Methodology; Knowledge systems; Semantic web technologies.</p

Pushing Your Point of View: Behavioral Measures of Manipulation in Wikipedia

As a major source for information on virtually any topic, Wikipedia serves an important role in public dissemination and consumption of knowledge. As a result, it presents tremendous potential for people to promulgate their own points of view; such efforts may be more subtle than typical vandalism. In this paper, we introduce new behavioral metrics to quantify the level of controversy associated with a particular user: a Controversy Score (C-Score) based on the amount of attention the user focuses on controversial pages, and a Clustered Controversy Score (CC-Score) that also takes into account topical clustering. We show that both these measures are useful for identifying people who try to "push" their points of view, by showing that they are good predictors of which editors get blocked. The metrics can be used to triage potential POV pushers. We apply this idea to a dataset of users who requested promotion to administrator status and easily identify some editors who significantly changed their behavior upon becoming administrators. At the same time, such behavior is not rampant. Those who are promoted to administrator status tend to have more stable behavior than comparable groups of prolific editors. This suggests that the Adminship process works well, and that the Wikipedia community is not overwhelmed by users who become administrators to promote their own points of view

Download It While It\u27s Hot: Open Access and Legal Scholarship

This article analyzes the shift of legal scholarship from the old world of law reviews to today\u27s world of peer reviews to tomorrow\u27s world of open access legal blogs. This shift is occurring in three dimensions. First, legal scholarship is moving from the long form (treatises and law review articles) to the short form (very short articles, blog posts, and online collaborations). Second, a regime of exclusive rights is giving way to a regime of open access. Third, intermediaries (law school editorial boards, peer-reviewed journals) are being supplemented by disintermediated forms (papers on the Internet, blogs). Blogs and internet conversations between academics are expanding interdisciplinary legal scholarship and increasing the avenues of communication among legal scholars, practitioners and a wide array of interested laypersons worldwide