SemQuaRE - An extension of the SQuaRE quality model for the evaluation of semantic technologies

To correctly evaluate semantic technologies and to obtain results that can be easily integrated, we need to put evaluations under the scope of a unique software quality model. This paper presents SemQuaRE, a quality model for semantic technologies. SemQuaRE is based on the SQuaRE standard and describes a set of quality characteristics specific to semantic technologies and the quality measures that can be used for their measurement. It also provides detailed formulas for the calculation of such measures. The paper shows that SemQuaRE is complete with respect to current evaluation trends and that it has been successfully applied in practice

Socializing the Semantic Gap: A Comparative Survey on Image Tag Assignment, Refinement and Retrieval

Where previous reviews on content-based image retrieval emphasize on what can be seen in an image to bridge the semantic gap, this survey considers what people tag about an image. A comprehensive treatise of three closely linked problems, i.e., image tag assignment, refinement, and tag-based image retrieval is presented. While existing works vary in terms of their targeted tasks and methodology, they rely on the key functionality of tag relevance, i.e. estimating the relevance of a specific tag with respect to the visual content of a given image and its social context. By analyzing what information a specific method exploits to construct its tag relevance function and how such information is exploited, this paper introduces a taxonomy to structure the growing literature, understand the ingredients of the main works, clarify their connections and difference, and recognize their merits and limitations. For a head-to-head comparison between the state-of-the-art, a new experimental protocol is presented, with training sets containing 10k, 100k and 1m images and an evaluation on three test sets, contributed by various research groups. Eleven representative works are implemented and evaluated. Putting all this together, the survey aims to provide an overview of the past and foster progress for the near future.Comment: to appear in ACM Computing Survey

Dialectic Tensions in the Context of Inter-organizational Integration

This study compares the perspectives on inter-organizational integration of information between stakeholders of the architecture, engineering, construction, and facilities management (AEC/FM) industry in Finland. Our findings are grounded on semi-structured interviews with practitioners that participated in a project of the Finnish government. Applying the theoretical framework of dialectical analysis, we identified six dimensions where conflicting points of view may arise regarding shared information: Ontology, standards, storage, openness, monetization and the involvement of the public sector. We argue that stakeholders will have stronger motivation to integrate with new actors if they share the same vision about one or more of such challenge areas. Awareness of these tensions helps to understand and guide the development of inter-organizational information systems in networked industries

CHORUS Deliverable 2.2: Second report - identification of multi-disciplinary key issues for gap analysis toward EU multimedia search engines roadmap

After addressing the state-of-the-art during the first year of Chorus and establishing the existing landscape in multimedia search engines, we have identified and analyzed gaps within European research effort during our second year. In this period we focused on three directions, notably technological issues, user-centred issues and use-cases and socio- economic and legal aspects. These were assessed by two central studies: firstly, a concerted vision of functional breakdown of generic multimedia search engine, and secondly, a representative use-cases descriptions with the related discussion on requirement for technological challenges. Both studies have been carried out in cooperation and consultation with the community at large through EC concertation meetings (multimedia search engines cluster), several meetings with our Think-Tank, presentations in international conferences, and surveys addressed to EU projects coordinators as well as National initiatives coordinators. Based on the obtained feedback we identified two types of gaps, namely core technological gaps that involve research challenges, and “enablers”, which are not necessarily technical research challenges, but have impact on innovation progress. New socio-economic trends are presented as well as emerging legal challenges

Automatic extraction of gene ontology annotation and its correlation with clusters in protein networks

<p>Abstract</p> <p>Background</p> <p>Uncovering cellular roles of a protein is a task of tremendous importance and complexity that requires dedicated experimental work as well as often sophisticated data mining and processing tools. Protein functions, often referred to as its annotations, are believed to manifest themselves through topology of the networks of inter-proteins interactions. In particular, there is a growing body of evidence that proteins performing the same function are more likely to interact with each other than with proteins with other functions. However, since functional annotation and protein network topology are often studied separately, the direct relationship between them has not been comprehensively demonstrated. In addition to having the general biological significance, such demonstration would further validate the data extraction and processing methods used to compose protein annotation and protein-protein interactions datasets.</p> <p>Results</p> <p>We developed a method for automatic extraction of protein functional annotation from scientific text based on the Natural Language Processing (NLP) technology. For the protein annotation extracted from the entire PubMed, we evaluated the precision and recall rates, and compared the performance of the automatic extraction technology to that of manual curation used in public Gene Ontology (GO) annotation. In the second part of our presentation, we reported a large-scale investigation into the correspondence between communities in the literature-based protein networks and GO annotation groups of functionally related proteins. We found a comprehensive two-way match: proteins within biological annotation groups form significantly denser linked network clusters than expected by chance and, conversely, densely linked network communities exhibit a pronounced non-random overlap with GO groups. We also expanded the publicly available GO biological process annotation using the relations extracted by our NLP technology. An increase in the number and size of GO groups without any noticeable decrease of the link density within the groups indicated that this expansion significantly broadens the public GO annotation without diluting its quality. We revealed that functional GO annotation correlates mostly with clustering in a physical interaction protein network, while its overlap with indirect regulatory network communities is two to three times smaller.</p> <p>Conclusion</p> <p>Protein functional annotations extracted by the NLP technology expand and enrich the existing GO annotation system. The GO functional modularity correlates mostly with the clustering in the physical interaction network, suggesting that the essential role of structural organization maintained by these interactions. Reciprocally, clustering of proteins in physical interaction networks can serve as an evidence for their functional similarity.</p

How does an imaginary persona's attractiveness affect designers' perceptions and IT solutions? An experimental study on users' remote working needs

Purpose The “what is beautiful is good” (WIBIG) effect implies that observers tend to perceive physically attractive people in a positive light. The authors investigate how the WIBIG effect applies to user personas, measuring designers' perceptions and task performance when employing user personas for the design of information technology (IT) solutions. Design/methodology/approach In a user experiment, the authors tested six different personas with 235 participants that were asked to develop remote work solutions based on their interaction with a fictitious user persona. Findings The findings showed that a user persona's perceived attractiveness was positively correlated with other perceptions of the persona. The personas' completeness, credibility, empathy, likability and usefulness increased with attractiveness. More attractive personas were also perceived as more agreeable, emotionally stable, extraverted and open, and the participants spent more time engaging with personas they perceived attractive. A linguistic analysis indicated that the IT solutions created for more attractive user personas demonstrated a higher degree of affect, but for the most part, task outputs did not vary by the personas' perceived attractiveness. Research limitations/implications The WIBIG effect applies when designing IT solutions with user personas, but its effect on task outputs appears limited. The perceived attractiveness of a user persona can impact how designers interact with and engage with the persona, which can influence the quality or the type of the IT solutions created based on the persona. Also, the findings point to the need to incorporate hedonic qualities into the persona creation process. For example, there may be contexts where it is helpful that the personas be attractive; there may be contexts where the attractiveness of the personas is unimportant or even a distraction. Practical implications The findings point to the need to incorporate hedonic qualities into the persona creation process. For example, there may be contexts where it is helpful that the personas be attractive; there may be contexts where the attractiveness of the personas is unimportant or even a distraction. Originality/value Because personas are created to closely resemble real people, the authors might expect the WIBIG effect to apply. The WIBIG effect might lead decision makers to favor more attractive personas when designing IT solutions. However, despite its potential relevance for decision making with personas, as far as the authors know, no prior study has investigated whether the WIBIG effect extends to the context of personas. Overall, it is important to understand how human factors apply to IT system design with personas, so that the personas can be created to minimize potentially detrimental effects as much as possible.© Joni Salminen, Jo~ao M. Santos, Soon-gyo Jung and Bernard J. Jansen. Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcodefi=vertaisarvioitu|en=peerReviewed