Benchmarking Central Ohio 2008

On April 2, 2008 Benchmarking Central Ohio 2008 was released at a forum at the Columbus Metropolitan Club. The report assesses how the 8-county Columbus metropolitan area is doing, in comparison to 15 other metro areas, using a panel of 60 diverse indicators. The indicators focus on four broad areas -- population vitality, economic strength, personal prosperity, and community well-being -- each of which describes a facet of the community that contributes to economic competitiveness. The research was commissioned by The Columbus Partnership, a CEO organization of 30 top business and community leaders in central Ohio whose mission is to improve the economy of central Ohio and be a catalyst for growth in the region

TRECVID: evaluating the effectiveness of information retrieval tasks on digital video

TRECVID is an annual exercise which encourages research in information retrieval from digital video by providing a large video test collection, uniform scoring procedures, and a forum for organizations interested in comparing their results. TRECVID benchmarking covers both interactive and manual searching by end users, as well as the benchmarking of some supporting technologies including shot boundary detection, extraction of some semantic features, and the automatic segmentation of TV news broadcasts into non-overlapping news stories. TRECVID has a broad range of over 40 participating groups from across the world and as it is now (2004) in its 4th annual cycle it is opportune to stand back and look at the lessons we have learned from the cumulative activity. In this paper we shall present a brief and high-level overview of the TRECVID activity covering the data, the benchmarked tasks, the overall results obtained by groups to date and an overview of the approaches taken by selective groups in some tasks. While progress from one year to the next cannot be measured directly because of the changing nature of the video data we have been using, we shall present a summary of the lessons we have learned from TRECVID and include some pointers on what we feel are the most important of these lessons

Evaluation campaigns and TRECVid

The TREC Video Retrieval Evaluation (TRECVid) is an international benchmarking activity to encourage research in video information retrieval by providing a large test collection, uniform scoring procedures, and a forum for organizations interested in comparing their results. TRECVid completed its fifth annual cycle at the end of 2005 and in 2006 TRECVid will involve almost 70 research organizations, universities and other consortia. Throughout its existence, TRECVid has benchmarked both interactive and automatic/manual searching for shots from within a video corpus, automatic detection of a variety of semantic and low-level video features, shot boundary detection and the detection of story boundaries in broadcast TV news. This paper will give an introduction to information retrieval (IR) evaluation from both a user and a system perspective, highlighting that system evaluation is by far the most prevalent type of evaluation carried out. We also include a summary of TRECVid as an example of a system evaluation benchmarking campaign and this allows us to discuss whether such campaigns are a good thing or a bad thing. There are arguments for and against these campaigns and we present some of them in the paper concluding that on balance they have had a very positive impact on research progress

FIL Benchmarking Project

Write up of a workshop which took place at Interlend 2015, the annual conference of the Forum for Interlending and Information Delivery, held in Manchester. The workshop followed on from the presentation of the results of the FIL Benchmarking Project Survey in 2014, and was intended to facilitate discussion of the findings, with a view to establishing best practice

LogCLEF: Enabling research on multilingual log files

Interactions between users and information access systems can be analyzed and studied to gather user preferences and to learn what a user likes the most, and to use this information to adapt the search to users and personalize the presentation of results. The LogCLEF lab - ”A benchmarking activity on Multilingual Log File Analysis: Language identification, query classification, success of a query” deals with information contained in query logs of search engines and digital libraries from which knowledge can be mined to understand search behavior in multilingual context. LogCLEF has created the first long-term standard collection for evaluation purposes in the area of log analysis. The LogCLEF 2011 lab is the continuation of the past two editions: as a pilot task in CLEF 2009, and a workshop in CLEF 2010. The Cross-Language Evaluation Forum (CLEF) promotes research and development in multilingual information access and is an activity of the PROMISE Network of Excellence

The print and packaging forum: a report on the print industry’s review of its own performance

This report is presented to the Print and Packaging Forum in fulfilment of the activities envisaged under Research Agreement signed between the Leadership, Innovation and Knowledge Research Centre DCU and the Irish Printing and Packaging Forum dated 15 July 2010. The remainder of this report sets out our research findings and response to the requirements set out in the Research Agreement. Section 3 sets out our approach and research methodology including limitations on this study and subsequent findings. Section 4 details the research findings. A survey was conducted of the industry to provide information on various aspects of its performance. Unfortunately no firms operating in the newspaper or paper sectors responded thus impacting on the representativeness of the survey. The main findings are summarised below. The vast majority of companies surveyed continue to be private Irish-owned firms. Sales performance of surveyed companies is in decline. The Industry faces competition internationally; the overwhelming majority of companies surveyed do not export. The respondents considered themselves relatively capable against Irish competitors however less competitive across nearly all areas against International competition. Particular factors in their lack of competitiveness are seen as raw material costs and access and overall relative cost position. Average employment is 20 persons, inferring a significant decline when compared to the 2005 Report. This confirmed supporting data from Forfas. On average over 55% of employees of respondent companies are operatives or crafts people. Less than 20% of respondent companies had vacancies compared to over half reported in 2005. Both overcapacity and low capacity usage remain features of the industry however expected lead times and time lost due to breakdowns has improved when compared to the 2005 Report. Average capacity utilisation for companies in the survey was 69% with over a third operating at below 60%. Over 80% of companies surveyed indicated that they undertake benchmarking; this is a significant increase on the level reported in the 2005 Report

Benchmarking news recommendations: the CLEF NewsREEL use case

The CLEF NewsREEL challenge is a campaign-style evaluation lab allowing participants to evaluate and optimize news recommender algorithms. The goal is to create an algorithm that is able to generate news items that users would click, respecting a strict time constraint. The lab challenges participants to compete in either a "living lab" (Task 1) or perform an evaluation that replays recorded streams (Task 2). In this report, we discuss the objectives and challenges of the NewsREEL lab, summarize last year's campaign and outline the main research challenges that can be addressed by participating in NewsREEL 2016

Māori farming trusts - A preliminary scoping investigation into the governance and management of large dairy farm businesses.

This preliminary scoping study investigates areas for possible improvement in the governance and management of large Māori dairy farm businesses. Building on the innovative practices of their tūpuna – including Rawiri Taiwhanga, the country’s first commercial dairy farmer – Māori are defining their own aspirations, realities and goals in the dairy farming world (Durie 1998, 2000). This report outlines these, and their accompanying challenges, as expressed by individuals and collectives currently engaged in Māori Dairy farm businesses. The Māori way of doing business is described in this study as having a ‘Quadruple Bottom Line of Profit, People, Environment and Community’ business objectives. More specifically, ‘Māori farms often have an inverted Quadruple Bottom Line. People, Environment and their Community often come before Profit….but without Profit none of it happens.’ Māori strategic plans and business values place emphasis on relationships, responsibilities, reciprocity and respect. These are exemplars of a Māori world-view, which explicitly acknowledges particular historic and cultural contexts (Tapsell and Woods 2010). The strategic management plans of the Māori Farming Trusts illustrate the spiral or matrix of values ‘He korunga o nga tikanga’ envisaged by Nicholson, Hēnare and Woods (2012). They prioritise the development of social capital to create competitive advantage. Such strategic plans reflect Māori vision and aspirations. These are to sustain and grow the land base; to provide leadership and guidance for the whānau; to develop capacity and resources within the Trusts and to perform better as businesses.DairyNZ Ltd, Ministry for Primary Industries (NZ

The scholarly impact of TRECVid (2003-2009)

This paper reports on an investigation into the scholarly impact of the TRECVid (TREC Video Retrieval Evaluation) benchmarking conferences between 2003 and 2009. The contribution of TRECVid to research in video retrieval is assessed by analyzing publication content to show the development of techniques and approaches over time and by analyzing publication impact through publication numbers and citation analysis. Popular conference and journal venues for TRECVid publications are identified in terms of number of citations received. For a selection of participants at different career stages, the relative importance of TRECVid publications in terms of citations vis a vis their other publications is investigated. TRECVid, as an evaluation conference, provides data on which research teams ‘scored’ highly against the evaluation criteria and the relationship between ‘top scoring’ teams at TRECVid and the ‘top scoring’ papers in terms of citations is analysed. A strong relationship was found between ‘success’ at TRECVid and ‘success’ at citations both for high scoring and low scoring teams. The implications of the study in terms of the value of TRECVid as a research activity, and the value of bibliometric analysis as a research evaluation tool, are discussed

Forging partnerships in health care: Process and measuring benefits

Universally, there is concern that much academic learning has dealt mainly in theory, removing knowledge from context with a resultant lack of practical experience. Here, the catalyst for strengthening university-community engagement, emanated from a desire to foster greater propensity within students to make connections between their academic courses and responsibility toward the community and people in need, and thus develop enhanced skills in social interaction, teamwork and effectiveness. This paper explores a variety of models of university-community engagement that aim to achieve and model good practice in policy making and planning around healthcare education and service development. Ways of integrating teaching and learning with community engagement, so there is reciprocal learning with significant benefits to the community, students, the university and industry are described. The communities of engagement for a transdisciplinary approach in healthcare are defined and the types of collaborative partnerships are outlined, including public/private partnerships, service learning approaches and regional campus engagement. The processes for initiating innovation in this field, forging sustainable partnerships, providing cooperative leadership and building shared vision are detailed. Measuring shared and sustained benefits for all participants is examined in the context of effecting changes in working relationships as well as the impact on students in terms of increased personal and social responsibility, confidence and competence. For the health professions, it is considered vital to adopt this approach in order to deliver graduates who feel aware of community needs, believe they can make a difference, and have a greater sense of community responsibility, ethic of service and more sophisticated understandings of social contexts. In the longer term, it is proposed the strategy will deliver a future healthcare workforce that is more likely to have a strengthened sense of community, social and personal responsibility and thus effect positive social change