A data-driven game theoretic strategy for developers in software crowdsourcing: a case study

Crowdsourcing has the advantages of being cost-effective and saving time, which is a typical embodiment of collective wisdom and community workers’ collaborative development. However, this development paradigm of software crowdsourcing has not been used widely. A very important reason is that requesters have limited knowledge about crowd workers’ professional skills and qualities. Another reason is that the crowd workers in the competition cannot get the appropriate reward, which affects their motivation. To solve this problem, this paper proposes a method of maximizing reward based on the crowdsourcing ability of workers, they can choose tasks according to their own abilities to obtain appropriate bonuses. Our method includes two steps: Firstly, it puts forward a method to evaluate the crowd workers’ ability, then it analyzes the intensity of competition for tasks at Topcoder.com—an open community crowdsourcing platform—on the basis of the workers’ crowdsourcing ability; secondly, it follows dynamic programming ideas and builds game models under complete information in different cases, offering a strategy of reward maximization for workers by solving a mixed-strategy Nash equilibrium. This paper employs crowdsourcing data from Topcoder.com to carry out experiments. The experimental results show that the distribution of workers’ crowdsourcing ability is uneven, and to some extent it can show the activity degree of crowdsourcing tasks. Meanwhile, according to the strategy of reward maximization, a crowd worker can get the theoretically maximum reward

Large-Scale Microtask Programming

To make microtask programming more efficient and reduce the potential for conflicts between contributors, I developed a new behavior-driven approach to microtasking programming. In our approach, each microtask asks developers to identify a behavior behavior from a high-level description of a function, implement a unit test for it, implement the behavior, and debug it. It enables developers to work on functions in isolation through high-level function descriptions and stubs. In addition, I developed the first approach for building microservices through microtasks. Building microservices through microtasks is a good match because our approach requires a client to first specify the functionality the crowd will create through an API. This API can then take the form of a microservice description. A traditional project may ask a crowd to implement a new microservice by simply describing the desired behavior in a API and recruiting a crowd. We implemented our approach in a web-based IDE, \textit{Crowd Microservices}. It includes an editor for clients to describe the system requirements through endpoint descriptions as well as a web-based programming environment where crowd workers can identify, test, implement, and debug behaviors. The system automatically creates, manages, assigns microtasks. After the crowd finishes, the system automatically deploys the microservice to a hosting site.Comment: 2 page, 1 figure, GC VL/HCC 2020, Graduate Consortiu

Crowdsourcing in Software Development: A State-of-the-Art Analysis

As software development cycles become shorter and shorter, while software complexity increases and IT budgets stagnate, many companies are looking for new ways of acquiring and sourcing knowledge outside their boundaries. One promising solution to aggregate know-how and manage large distributed teams in software development is crowdsourcing. This paper analyzes the existing body of knowledge regarding crowdsourcing in software development. As a result, we propose a fundamental framework with five dimensions to structure the existing insights of crowdsourcing in the context of software development and to derive a research agenda to guide further research

Research protocol for a case study of crowdsourcing software development

Crowdsourcing is an emerging topic within software engineering research. This report presents the protocol for our case study of crowdsourcing at a multi-national company. The findings of the case study are presented in a paper in the proceedings of the 36th International Conference on Software Engineering (2014) (see ref. [37]). This protocol presents additional details that provide more insight regarding the background, design and execution of our study. The research design can also be used for replicating the case study so as to be able to more easily compare different case studies

A goal model for crowdsourced software engineering

Crowdsourced Software Engineering (CSE) is the act of undertaking any external software engineering tasks by an undefined, potentially large group of online workers in an open call format. Using an open call, CSE recruits global online labor to work on various types of software engineering tasks, such as requirements extraction, design, coding and testing. The field is rising rapidly and touches various aspects of software engineering. CSE has grown significance in both academy and industry. Despite of the enormous usage and significance of CSE, there are many open challenges reported by various researchers. In order to overcome the challenges and realizing the full potential of CSE, it is highly important to understand the concrete advantages and goals of CSE. In this paper, we present a goal model for CSE, to understand the real environment of CSE, and to explore the aspects that can somehow overcome the aforementioned challenges. The model is designed using RiSD, a method for building Strategic Dependency (SD) models in the i* notation, applied in this work using iStar2.0. This work can be considered useful for CSE stakeholders (Requesters, Workers, Platform owners and CSE organizations).Peer ReviewedPostprint (published version

The power of the crowd: promise and potential of crowdsourcing for education

Crowdsourcing is the term often used for processes of data collation and creation where individuals or groups of users who are not necessarily located centrally generate content that is then shared. While the term originates within the world of business, it has since gained traction within a number of academic and professional disciplines. Drawing upon two examples that have originated within the Republic of Ireland, this paper reflects on the educational potential of crowdsourcing. Firstly, it reports a unique one-year open crowdsourcing initiative which compiled a comprehensive A-Z directory of edtech tools for teaching and learning through collaborative contributions. Secondly, it describes an initiative to develop a crowdsourced repository of study tips and suggestions for adult, part-time, online and flexible learners embarking on further study. These two case studies provide a valuable context for considering the wider potential of crowdsourcing applications for teaching and learning purposes

Crowdsourcing, Open-sourcing, Outsourcing and Insourcing Software Development: A Comparative Analysis

The software development industry invariably embraces different models and techniques to develop the best user-oriented and cost-effective solutions. The selection of an appropriate software-sourcing model is one of the key factors that influences the entire development process. The various software-sourcing models Crowdsourcing, Open-sourcing, Outsourcing and Insourcing have been adopted to achieve the best software products. Every software-sourcing model possesses several strengths and may be effective in certain types of projects; however, its limitations may restrain the use of it in some other projects. It is very essential for an organisation to investigate the pros and cons of a potential sourcing-model before going to adopt it for their project. This paper presents a comparative analysis of Crowdsourcing, Open-sourcing, Outsourcing and Insourcing models in order to find out the best fit environment and suitability of each model