Components and Functions of Crowdsourcing Systems – A Systematic Literature Review

Many organizations are now starting to introduce crowdsourcing as a new model of business to outsource tasks, which are traditionally performed by a small group of people, to an undefined large workforce. While the utilization of crowdsourcing offers a lot of advantages, the development of the required system carries some risks, which are reduced by establishing a profound theoretical foundation. Thus, this article strives to gain a better understanding of what crowdsourcing systems are and what typical design aspects are considered in the development of such systems. In this paper, the author conducted a systematic literature review in the domain of crowdsourcing systems. As a result, 17 definitions of crowdsourcing systems were found and categorized into four perspectives: the organizational, the technical, the functional, and the human-centric. In the second part of the results, the author derived and presented components and functions that are implemented in a crowdsourcing system

Engineering Crowdsourced Stream Processing Systems

A crowdsourced stream processing system (CSP) is a system that incorporates crowdsourced tasks in the processing of a data stream. This can be seen as enabling crowdsourcing work to be applied on a sample of large-scale data at high speed, or equivalently, enabling stream processing to employ human intelligence. It also leads to a substantial expansion of the capabilities of data processing systems. Engineering a CSP system requires the combination of human and machine computation elements. From a general systems theory perspective, this means taking into account inherited as well as emerging properties from both these elements. In this paper, we position CSP systems within a broader taxonomy, outline a series of design principles and evaluation metrics, present an extensible framework for their design, and describe several design patterns. We showcase the capabilities of CSP systems by performing a case study that applies our proposed framework to the design and analysis of a real system (AIDR) that classifies social media messages during time-critical crisis events. Results show that compared to a pure stream processing system, AIDR can achieve a higher data classification accuracy, while compared to a pure crowdsourcing solution, the system makes better use of human workers by requiring much less manual work effort

Public Participation GIS for sustainable urban mobility planning: methods, applications and challenges

Sustainable mobility planning is a new approach to planning, and as such it requires new methods of public participation, data collection and data aggregation. In the article we present an overview of Public Participation GIS (PPGIS) methods with potential use in sustainable urban mobility planning. We present the methods using examples from two recent case studies conducted in Polish cities of Poznań and Łodź. Sustainable urban mobility planning is a cyclical process, and each stage has different data and participatory requirements. Consequently, we situate the PPGIS methods in appropriate stages of planning, based on potential benefits they may bring into the planning process. We discuss key issues related to participant recruitment and provide guidelines for planners interested in implementing methods presented in the paper. The article outlines future research directions stressing the need for systematic case study evaluation

Developing a Framework towards Design Understanding for Crowdsourcing Research: A Content Analysis

In the Information Systems (IS) discipline, Design Science Research (DSR) is distinctive; creating knowledge through the design of novel or innovative artefacts, and analysing the artefacts’ use or performance. We present an analysis of DSR doctoral theses published in Australia for the period 2006-2017. Our purpose is to understand the extent and diversity of DSR applied by the Australian IS community in particular by doctoral candidates. We selected the theses from the Australian national repository and analysed their content. The findings suggest that 1) DSR is evolving and maturing in this cohort, 2) DSR theses have resulted in various artefacts and scholarly publications, 3) candidates’ ability to theorize about their work remains a challenge, and 4) nomenclature in DSR remains a problem and the whole IS community should strive for consistency. This paper contributes towards our understanding of DSR as a research approach and offers recommendations to the DSR community

Exploring Barriers and Opportunities in Adopting Crowdsourcing Based New Product Development in Manufacturing SMEs

Crowdsourcing is an innovative business practice of obtaining needed services, ideas, or content or even funds by soliciting contributions from a large group of people (the ‘Crowd’). The potential benefits of utilizing crowdsourcing in product design are well-documented, but little research exists on what are the barriers and opportunities in adopting crowdsourcing in new product development (NPD) of manufacturing SMEs. In order to answer the above questions, a Proof of Market study is carried out on crowdsourcing-based product design under an Innovate UK funded Smart project, which aims at identifying the needs, challenges and future development opportunities associated with adopting crowdsourcing strategies for NPD. The research findings from this study are reported here and can be used to guide future development of crowdsourcing-based collaborative design methods and tools and provide some practical references for industry to adopt this new and emerging collaborative design method in their business

Early Learning Innovation Fund Evaluation Final Report

This is a formative evaluation of the Hewlett Foundation's Early Learning Innovation Fund that began in 2011 as part of the Quality Education in Developing Countries (QEDC) initiative.  The Fund has four overarching objectives, which are to: promote promising approaches to improve children's learning; strengthen the capacity of organizations implementing those approaches; strengthen those organizations' networks and ownership; and grow 20 percent of implementing organizations into significant players in the education sector. The Fund's original design was to create a "pipeline" of innovative approaches to improve learning outcomes, with the assumption that donors and partners would adopt the most successful ones. A defining feature of the Fund was that it delivered assistance through two intermediary support organizations (ISOs), rather than providing funds directly to implementing organizations. Through an open solicitation process, the Hewlett Foundation selected Firelight Foundation and TrustAfrica to manage the Fund. Firelight Foundation, based in California, was founded in 1999 with a mission to channel resources to community-based organizations (CBOs) working to improve the lives of vulnerable children and families in Africa. It supports 12 implementing organizations in Tanzania for the Fund. TrustAfrica, based in Dakar, Senegal, is a convener that seeks to strengthen African-led initiatives addressing some of the continent's most difficult challenges. The Fund was its first experience working specifically with early learning and childhood development organizations. Under the Fund, it supported 16 such organizations: one in Mali and five each in Senegal, Uganda and Kenya. At the end of 2014, the Hewlett Foundation commissioned Management Systems International (MSI) to conduct a mid-term evaluation assessing the implementation of the Fund exploring the extent to which it achieved intended outcomes and any factors that had limited or enabled its achievements. It analyzed the support that the ISOs provided to their implementing organizations, with specific focus on monitoring and evaluation (M&E). The evaluation included an audit of the implementing organizations' M&E systems and a review of the feasibility of compiling data collected to support an impact evaluation. Finally, the Foundation and the ISOs hoped that this evaluation would reveal the most promising innovations and inform planning for Phase II of the Fund. The evaluation findings sought to inform the Hewlett Foundation and other donors interested in supporting intermediary grant-makers, early learning innovations and the expansion of innovations. TrustAfrica and Firelight Foundation provided input to the evaluation's scope of work. Mid-term evaluation reports for each ISO provided findings about their management of the Fund's Phase I and recommendations for Phase II. This final evaluation report will inform donors, ISOs and other implementing organizations about the best approaches to support promising early learning innovations and their expansion. The full report outlines findings common across both ISOs' experience and includes recommendations in four key areas: adequate time; appropriate capacity building; advocacy and scaling up; and evaluating and documenting innovations. Overall, both Firelight Foundation and TrustAfrica supported a number of effective innovations working through committed and largely competent implementing organizations. The program's open-ended nature avoided being prescriptive in its approach, but based on the lessons learned in this evaluation and the broader literature, the Hewlett Foundation and other donors could have offered more guidance to ISOs to avoid the need to continually relearn some lessons. For example, over the evaluation period, it became increasingly evident that the current context demands more focused advance planning to measure impact on beneficiaries and other stakeholders and a more concrete approach to promoting and resourcing potential scale-up. The main findings from the evaluation and recommendations are summarized here