Information Technology (IT) enabled crowdsourcing: A conceptual framework

Published on Mar 1, 2020in Information Processing and Management4.787
· DOI :10.1016/J.IPM.2019.102135
Minoo Modaresnezhad2
Estimated H-index: 2
(UNCW: University of North Carolina at Wilmington),
Lakshmi S. Iyer15
Estimated H-index: 15
(ASU: Appalachian State University)
+ 1 AuthorsVasyl Taras11
Estimated H-index: 11
(UNCG: University of North Carolina at Greensboro)
Abstract IT-enabled crowdsourcing is defined as technology-enabled outsourcing of tasks through an open call to the masses via the internet. Crowdsourcing is an IT artifact that has gone beyond the traditional boundaries of an organization to a much broader context. Over the past decade, research and practice on crowdsourcing have continued to grow, evolve, and revolutionize the way work gets done. Although numerous studies have been conducted in this area, our understanding of the main components involved in crowdsourcing processes remains limited. The goal of the current study is to conduct a structured literature review and synthesize the available crowdsourcing literature and applications in one coherent conceptual framework. The framework identifies the main elements involved in the crowdsourcing process and its characteristics. This framework extends the field of Information Systems (IS) and would help us better understand this phenomenon. Furthermore, the results of this study could potentially fill the knowledge gap in the crowdsourcing literature by identifying the main characteristics of a crowdsourcing process as a legitimate, IT-enabled form of problem-solving. Our results would also help organizations to leverage crowdsourcing more efficiently.
📖 Papers frequently viewed together
3 Citations
2 Citations
1 Citations
12 CitationsSource
#1Fábio Ribeiro de Assis Neto (UFES: Universidade Federal do Espírito Santo)H-Index: 2
#2Celso A. S. Santos (UFES: Universidade Federal do Espírito Santo)H-Index: 10
Abstract Crowdsourcing is a powerful method that leverages human intelligence to solve problems in the medical, linguistics, machine learning, and in a considerable number of other fields of study. This systematic review aims to understand how crowdsourcing projects are designed and executed in the state-of-the-art, considering the following dimensions: Task execution, quality management, and platform usage. Our results summarized trends of the important aspects of a crowdsourcing project, such ...
33 CitationsSource
#1Antonio Ghezzi (Polytechnic University of Milan)H-Index: 24
#2Donata Gabelloni (UniPi: University of Pisa)H-Index: 6
Last. Angelo Natalicchio (IPN: Instituto Politécnico Nacional)H-Index: 12
view all 4 authors...
As academic and practitioner studies on crowdsourcing have been building up since 2006, the subject itself has progressively gained in importance within the broad field of management. No systematic review on the topic has so far appeared in management journals, however; moreover, the field suffers from ambiguity in the topic's definition, which in turn has led to its largely unstructured evolution. The authors therefore investigate the existing body of knowledge on crowdsourcing systematically t...
127 CitationsSource
#1Simone L. Vernez (UCI: University of California, Irvine)H-Index: 7
Last. Ralph V. Clayman (UCI: University of California, Irvine)H-Index: 96
view all 6 authors...
Abstract Background: We hypothesized that surgical skills assessment could aid in the selection process of medical student applicants to a surgical program. Recently, crowdsourcing has been shown to provide an accurate assessment of surgical skills at all levels of training. We compared expert and crowd assessment of surgical tasks performed by resident applicants during their interview day at the urology program at the University of California, Irvine. Materials and Methods: Twenty-five residen...
31 CitationsSource
#1Humayun Irshad (BIDMC: Beth Israel Deaconess Medical Center)H-Index: 15
#2Eun-Yeong Oh (KP: Kaiser Permanente)H-Index: 4
Last. Andrew H. Beck (BIDMC: Beth Israel Deaconess Medical Center)H-Index: 59
view all 7 authors...
Crowdsourcing scoring of immunohistochemistry images: Evaluating Performance of the Crowd and an Automated Computational Method
20 CitationsSource
#1Steve Feng (UCLA: University of California, Los Angeles)H-Index: 14
#2Min-jae Woo (UCLA: University of California, Los Angeles)H-Index: 1
Last. Aydogan Ozcan (UCLA: University of California, Los Angeles)H-Index: 79
view all 7 authors...
We developed an easy-to-use and widely accessible crowd-sourcing tool for rapidly training humans to perform biomedical image diagnostic tasks and demonstrated this platform’s ability on middle and high school students in South Korea to diagnose malaria infected red-blood-cells (RBCs) using Giemsa-stained thin blood smears imaged under light microscopes. We previously used the same platform (i.e., BioGames) to crowd-source diagnostics of individual RBC images, marking them as malaria positive (i...
5 CitationsSource
#1Pavel Kucherbaev (University of Trento)H-Index: 7
#2Florian Daniel (Tomsk Polytechnic University)H-Index: 32
Last. Maurizio Marchese (University of Trento)H-Index: 21
view all 4 authors...
This article makes a case for crowdsourcing approaches that are able to manage crowdsourcing processes -- that is, crowdsourcing scenarios that go beyond the mere outsourcing of multiple instances of a micro-task and instead require the coordination of multiple different crowd and machine tasks. It introduces the necessary background and terminology, identifies a set of analysis dimensions, and surveys state-of-the-art tools, highlighting strong and weak aspects and promising future research and...
36 CitationsSource
Feb 27, 2016 in CSCW (Conference on Computer Supported Cooperative Work)
#1Mary L. Gray (Microsoft)H-Index: 11
#2Siddharth Suri (Microsoft)H-Index: 29
Last. Deepti KulkarniH-Index: 1
view all 4 authors...
The main goal of this paper is to show that crowdworkers collaborate to fulfill technical and social needs left by the platform they work on. That is, crowdworkers are not the independent, autonomous workers they are often assumed to be, but instead work within a social network of other crowdworkers. Crowdworkers collaborate with members of their networks to 1) manage the administrative overhead associated with crowdwork, 2) find lucrative tasks and reputable employers and 3) recreate the social...
117 CitationsSource
Peer production is the most significant organizational innovation that has emerged from Internet-mediated social practice. Organizationally, it combines three core characteristics: (1) decentralization of conception and execution of problems and solutions, (2) harnessing diverse motivations, and (3) separation of governance and management from property and contract. Functionally, these components make peer-production practices highly adept at learning and experimentation, innovation, and adaptat...
28 Citations
#1Jiahua Jin (HIT: Harbin Institute of Technology)H-Index: 4
#2Yijun Li (HIT: Harbin Institute of Technology)H-Index: 14
Last. Li Zhai (HIT: Harbin Institute of Technology)H-Index: 1
view all 4 authors...
An empirical model was proposed to study users' knowledge contribution behavior.Self-presentation is positively associated with knowledge contribution behavior.Peer recognition is positively associated with knowledge contribution behavior.Social learning is positively associated with knowledge contribution behavior. Based on social capital theory, social exchange theory, and social cognitive theory, this study explored why users continuously contribute knowledge to online social Q&A communities....
88 CitationsSource
Cited By10
#1Huiying Zhang (UNLV: University of Nevada, Las Vegas)
#2Xi Y. Leung (UNT: University of North Texas)H-Index: 15
Last. Yunpeng Li (Capital University of Economics and Business)H-Index: 1
view all 4 authors...
Abstract null null Even though crowdsourcing emerges as a new business principle of many successful tourism apps, its underlying mechanism in tourism remains unexplored. This research note explores this topic with a qualitative design through interviews with stakeholders involved in a crowdsourcing tourism app, Gold Medal Tour Guide. Applying the grounded theory, researchers propose a framework of crowdsourcing in tourism apps consisting of six themes and 15 subthemes. The framework identifies t...
#1Kevin Roitero (University of Udine)H-Index: 9
#2Eddy Maddalena ('KCL': King's College London)H-Index: 10
Last. Falk Scholer (RMIT: RMIT University)H-Index: 26
view all 4 authors...
Abstract null null Relevance is a key concept in information retrieval and widely used for the evaluation of search systems using test collections. We present a comprehensive study of the effect of the choice of relevance scales on the evaluation of information retrieval systems. Our work analyzes and compares four crowdsourced scales (2-levels, 4-levels, and 100-levels ordinal scales, and a magnitude estimation scale) and two expert-labeled datasets (on 2- and 4-levels ordinal scales). We compa...
#1Jian Tang (CUFE: Central University of Finance and Economics)H-Index: 63
#2Xinxue Zhou (CUFE: Central University of Finance and Economics)H-Index: 2
Last. Tianmei Wang (CUFE: Central University of Finance and Economics)H-Index: 3
view all 4 authors...
Abstract null null Citizen science involves non-expert volunteers collaborating to investigate scientific problems. Volunteers’ knowledge contribution is a key premise to the success of citizen science projects. Despite previous research on the type and valence of feedback information, little is known about the main and interactive effects of these two facets of feedback information on volunteers’ knowledge contribution. This study draws on achievement goal theory and hypothesizes how the type a...
#1Rui Shang (United States Department of Energy Office of Science)
#2Yongmei Ma (Chaohu University)
Last. Abdullah KhanH-Index: 10
view all 7 authors...
Crowdsourcing is a task-solving model in which human crowd is hired to solve a particular task. During the crowdsourcing process, the crowd selection is performed in order to select appropriate crowd workers for a specific task; without appropriate selection of crowd workers, the process of crowdsourcing is aimless. The main goal of this paper was to identify the features of crowd in crowdsourcing activity, reasons behind crowd participation in the activity of crowdsourcing, and the existing tec...
Crowdsourcing is a complex task-solving model that utilizes humans for solving organizational specific problems. For assigning a crowdsourced task to an online crowd, crowd selection is carried out to select appropriate crowd for achieving the task. The efficiency and effectiveness of crowdsourcing may fail if irrelevant crowd is selected for performing a task. Early decisions regarding selection of a crowd can ultimately lead to successful completion of tasks. To select most appropriate crowd f...
#1Ying Zhang (UCI: University of California, Irvine)
#2Susan Xue (University of California, Berkeley)
Last. Zhaohui Xue (Stanford University)
view all 3 authors...
Abstract We present a case study of a collaborative digital humanities project that was led by academic librarians and participated by IT specialists and international scholars. Through the project, we produced and published two open-access products – a bilingual dictionary of historical government official titles, and an online system for crowdsourcing translations. We also contributed metadata, from the dictionary, to an existing large digital humanities project. Whereas the dictionary fills a...
1 CitationsSource
#1Guan Wang (Graduate School USA)
#2Farhad AliH-Index: 25
view all 7 authors...
Internet-enabled technologies have provided a way for people to communicate and collaborate with each other. The collaboration and communication made crowdsourcing an efficient and effective activity. Crowdsourcing is a modern paradigm that employs cheap labors (crowd) for accomplishing different types of tasks. The task is usually posted online as an open call, and members of the crowd self-select a task to be carried out. Crowdsourcing involves initiators or crowdsourcers (an entity usually a ...
#1Maimoona Salam (UNIMAS: Universiti Malaysia Sarawak)H-Index: 8
#2Muhammad Shoaib Farooq (University of Engineering and Technology, Lahore)H-Index: 1
The use of collaborative learning technologies is a stimulating element of collaborative learning process, where social interaction and collaboration are key factors. This research examines the impact of sociability quality on the usage of web-based collaborative learning information system (WBCLIS) and user satisfaction. We propose a theoretical model by integrating the construct of ‘sociability quality’ in the DeLone and McLean’s (Journal of Management Information Systems 19:9–30, 2003) update...
12 CitationsSource
#2Raúl MonroyH-Index: 16
Last. Huaxing ZhuH-Index: 2
view all 6 authors...
1 CitationsSource
#1Zhichao Ba (Nanjing University of Science and Technology)H-Index: 2
#2Yuxiang Chris Zhao (Nanjing University of Science and Technology)H-Index: 5
Last. Shijie Song (NU: Nanjing University)H-Index: 4
view all 4 authors...
Abstract Online charitable crowdfunding has become an increasingly popular approach for online fundraising and has attracted widespread concern in society. However, little is known about donation allocation in the implementation of online charitable crowdfunding, especially the purposes involved and the specific flows of these donations. To this end, this study aims to explore project initiators’ fundraising allocation by identifying latent intentions from a large sample of project descriptions ...
4 CitationsSource