![Crowdtesting](https://upload.wikimedia.org/wikipedia/commons/5/58/Crowdtesting.jpg)
Crowdsourcing involves a large group of dispersed participants contributing or producing
goods or services
Goods are items that are usually (but not always) tangible, such as pens, physical books, salt, apples, and hats. Services are activities provided by other people, who include architects, suppliers, contractors, technologists, teachers, docto ...
—including ideas,
votes,
micro-tasks, and finances—for payment or as volunteers. Contemporary crowdsourcing often involves
digital platforms
Digital usually refers to something using discrete digits, often binary digits.
Technology and computing Hardware
*Digital electronics, electronic circuits which operate using digital signals
**Digital camera, which captures and stores digital i ...
to attract and divide work between participants to achieve a cumulative result. Crowdsourcing is not limited to online activity, however, and there are various historical examples of crowdsourcing. The word crowdsourcing is a
portmanteau
A portmanteau word, or portmanteau (, ) is a blend of words[crowd
Generally speaking, a crowd is defined as a group of people that have gathered for a common purpose or intent such as at a Demonstration (people), demonstration, a Sport, sports event, or during looting (this is known as an acting crowd), or ...](_blank)
" and "
outsourcing
Outsourcing is an agreement in which one company hires another company to be responsible for a planned or existing activity which otherwise is or could be carried out internally, i.e. in-house, and sometimes involves transferring employees and ...
".
In contrast to outsourcing, crowdsourcing usually involves less specific and more public groups of participants.
Advantages of using crowdsourcing include lowered costs, improved speed, improved quality, increased flexibility, and/or increased
scalability
Scalability is the property of a system to handle a growing amount of work by adding resources to the system.
In an economic context, a scalable business model implies that a company can increase sales given increased resources. For example, a ...
of the work, as well as promoting
diversity
Diversity, diversify, or diverse may refer to:
Business
*Diversity (business), the inclusion of people of different identities (ethnicity, gender, age) in the workforce
*Diversity marketing, marketing communication targeting diverse customers
* ...
.
Crowdsourcing methods include
competitions
Competition is a rivalry where two or more parties strive for a common goal which cannot be shared: where one's gain is the other's loss (an example of which is a zero-sum game). Competition can arise between entities such as organisms, indivi ...
, virtual labor markets, open online collaboration and data donation.
Some forms of crowdsourcing, such as in "idea competitions" or "innovation contests" provide ways for organizations to learn beyond the "base of minds" provided by their employees (e.g.
LEGO Ideas).
Commercial platforms, such as
Amazon Mechanical Turk
Amazon Mechanical Turk (MTurk) is a crowdsourcing website for businesses to hire remotely located "crowdworkers" to perform discrete on-demand tasks that computers are currently unable to do. It is operated under Amazon Web Services, and is owned ...
, match
microtask
Microtask is a Finnish technology company founded by Ville Miettinen, Harri Holopainen, Otto Chrons and Panu Wilska in 2009 s submitted by requesters to workers who perform them. Crowdsourcing is also used by
nonprofit organizations
A nonprofit organization (NPO) or non-profit organisation, also known as a non-business entity, not-for-profit organization, or nonprofit institution, is a legal entity organized and operated for a collective, public or social benefit, in co ...
to develop
common goods
Common goods (also called common-pool resources) are defined in economics as goods that are rivalrous and non-excludable. Thus, they constitute one of the four main types based on the criteria:
* whether the consumption of a good by one pers ...
, such as
Wikipedia
Wikipedia is a multilingual free online encyclopedia written and maintained by a community of volunteers, known as Wikipedians, through open collaboration and using a wiki-based editing system. Wikipedia is the largest and most-read refer ...
.
Definitions
The term ''crowdsourcing'' was coined in 2006 by two editors at
''Wired'', Jeff Howe and Mark Robinson, to describe how businesses were using the Internet to "
outsource
Outsourcing is an agreement in which one company hires another company to be responsible for a planned or existing activity which otherwise is or could be carried out internally, i.e. in-house, and sometimes involves transferring employees and ...
work to the crowd," which quickly led to the portmanteau "crowdsourcing".
Howe published a definition for the term in a blog post in June 2006:
Simply defined, crowdsourcing represents the act of a company or institution taking a function once performed by employees and outsourcing it to an undefined (and generally large) network of people in the form of an open call. This can take the form of peer-production (when the job is performed collaboratively), but is also often undertaken by sole individuals. The crucial prerequisite is the use of the open call format and the large network of potential laborers.
Daren C. Brabham defined crowdsourcing as an "online, distributed problem-solving and production model."
Kristen L. Guth and Brabham found that the performance of ideas offered in crowdsourcing platforms are affected not only by their quality, but also by the communication among users about the ideas, and presentation in the platform itself.
[
] After studying more than 40 definitions of crowdsourcing in the scientific and popular literature, Enrique Estellés-Arolas and Fernando González Ladrón-de-Guevara, researchers at the
Technical University of Valencia
The Technical University of Valencia ( ca-valencia, Universitat Politècnica de València, UPV; , es, Universidad Politécnica de Valencia) is a Spanish university located in Valencia, with a focus on science, technology, and arts. It was founded ...
, developed a new integrating definition:
Crowdsourcing can either take an explicit or an implicit route. Explicit crowdsourcing lets users work together to evaluate, share, and build different specific tasks, while implicit crowdsourcing means that users solve a problem as a side effect of something else they are doing. With explicit crowdsourcing, users can evaluate particular items like books or webpages, or share by posting products or items. Users can also build artifacts by providing information and editing other people's work. Implicit crowdsourcing can take two forms: standalone and piggyback. Standalone allows people to solve problems as a side effect of the task they are doing, whereas piggyback takes users' information from a third-party website to gather information.
Despite the multiplicity of definitions for crowdsourcing, one constant has been the broadcasting of problems to the public, and an open call for contributions to help solve the problem. Members of the public submit solutions that are then owned by the entity who originally broadcast the problem. In some cases, the contributor of the solution is compensated monetarily with prizes or public recognition. In other cases, the only rewards may be
praise
Praise as a form of social interaction expresses recognition, reassurance or admiration.
Praise is expressed verbally as well as by body language (facial expression and gestures).
Verbal praise consists of a positive evaluations of another's a ...
or intellectual satisfaction. Crowdsourcing may produce solutions from
amateur
An amateur () is generally considered a person who pursues an avocation independent from their source of income. Amateurs and their pursuits are also described as popular, informal, autodidacticism, self-taught, user-generated, do it yourself, DI ...
s or
volunteers
Volunteering is a voluntary act of an individual or group freely giving time and labor for community service. Many volunteers are specifically trained in the areas they work, such as medicine, education, or emergency rescue. Others serve ...
working in their spare time, from experts, or from small businesses.
Historical examples
While the term "crowdsourcing" was popularized online to describe Internet-based activities,
some examples of projects, in retrospect, can be described as crowdsourcing.
Timeline of crowdsourcing examples
* 618–907 –
Tang dynasty
The Tang dynasty (, ; zh, t= ), or Tang Empire, was an Dynasties in Chinese history, imperial dynasty of China that ruled from 618 to 907 AD, with an Zhou dynasty (690–705), interregnum between 690 and 705. It was preceded by the Sui dyn ...
introduced the
Joint-Stock Company
A joint-stock company is a business entity in which shares of the company's capital stock, stock can be bought and sold by shareholders. Each shareholder owns company stock in proportion, evidenced by their share (finance), shares (certificates ...
, the earliest form of crowdfunding.
* 1567 –
King Philip II of Spain
Philip II) in Spain, while in Kingdom of Portugal, Portugal and his Italian kingdoms he ruled as Philip I ( pt, Filipe I). (21 May 152713 September 1598), also known as Philip the Prudent ( es, Felipe el Prudente), was King of Spain from 1556, K ...
offered a cash prize for calculating the longitude of a vessel whilst at sea.
* 1714 – The
longitude rewards
The longitude rewards were the system of inducement prizes offered by the British government for a simple and practical method for the precise determination of a ship's longitude at sea. The rewards, established through an Act of Parliament (t ...
: When the British government was trying to find a way to measure a ship's longitudinal position, they offered the public a monetary prize to whomever came up with the best solution.
* 1783 –
King Louis XVI
Louis XVI (''Louis-Auguste''; ; 23 August 175421 January 1793) was the last King of France before the fall of the monarchy during the French Revolution. He was referred to as ''Citizen Louis Capet'' during the four months just before he was e ...
offered an award to the person who could "make the alkali" by decomposing sea salt by the "simplest and most economic method".
* 1848 –
Matthew Fontaine Maury
Matthew Fontaine Maury (January 14, 1806February 1, 1873) was an American oceanographer and naval officer, serving the United States and then joining the Confederacy during the American Civil War.
He was nicknamed "Pathfinder of the Seas" and i ...
distributed 5000 copies of his ''Wind and Current Charts'' free of charge on the condition that sailors returned a standardized log of their voyage to the U.S. Naval Observatory. By 1861, he had distributed 200,000 copies free of charge, on the same conditions.
* 1849 – A network of some 150 volunteer weather observers all over the USA was set up as a part of the
Smithsonian Institution
The Smithsonian Institution ( ), or simply the Smithsonian, is a group of museums and education and research centers, the largest such complex in the world, created by the U.S. government "for the increase and diffusion of knowledge". Founded ...
's Meteorological Project started by the Smithsonian's first Secretary,
Joseph Henry
Joseph Henry (December 17, 1797– May 13, 1878) was an American scientist who served as the first Secretary of the Smithsonian Institution. He was the secretary for the National Institute for the Promotion of Science, a precursor of the Smith ...
, who used the
telegraph
Telegraphy is the long-distance transmission of messages where the sender uses symbolic codes, known to the recipient, rather than a physical exchange of an object bearing the message. Thus flag semaphore is a method of telegraphy, whereas p ...
to gather volunteers' data and create a large weather map, making new information available to the public daily. For instance, volunteers tracked a tornado passing through Wisconsin and sent the findings via telegraph to the Smithsonian. Henry's project is considered the origin of what later became the
National Weather Service
The National Weather Service (NWS) is an Government agency, agency of the Federal government of the United States, United States federal government that is tasked with providing weather forecasts, warnings of hazardous weather, and other weathe ...
. Within a decade, the project had more than 600 volunteer observers and had spread to Canada, Mexico, Latin America, and the Caribbean.
* 1884 – Publication of the ''
Oxford English Dictionary
The ''Oxford English Dictionary'' (''OED'') is the first and foundational historical dictionary of the English language, published by Oxford University Press (OUP). It traces the historical development of the English language, providing a com ...
'': 800 volunteers catalogued words to create the first fascicle of the OED.
* 1916 –
Planters
Planters Nut & Chocolate Company is an American snack food company now owned by Hormel Foods. Planters is best known for its processed nuts and for the Mr. Peanut icon that symbolizes them. Mr. Peanut was created by grade schooler Antonio Gentil ...
Peanuts contest: The
Mr. Peanut
Mr. Peanut is the advertising logo and mascot of Planters, an American snack-food company owned by Hormel. He is depicted as an anthropomorphic peanut in its shell, wearing the formal clothing of an old-fashioned gentleman, with a top hat, mono ...
logo was designed by a 14-year-old boy who won the Planter Peanuts logo contest.
* 1957 –
Jørn Utzon
Jørn Oberg Utzon, , Hon. FAIA (; 9 April 191829 November 2008) was a Danish architect. He was most notable for designing the Sydney Opera House in Australia, completed in 1973. When it was declared a World Heritage Site on 28 June 2007, Utzo ...
was selected as winner of the design competition for the
Sydney Opera House
The Sydney Opera House is a multi-venue performing arts centre in Sydney. Located on the foreshore of Sydney Harbour, it is widely regarded as one of the world's most famous and distinctive buildings and a masterpiece of 20th-century architec ...
.
* 1970 – French amateur photo contest ''C'était Paris en 1970'' ("This Was Paris in 1970") was sponsored by the city of
Paris
Paris () is the capital and most populous city of France, with an estimated population of 2,165,423 residents in 2019 in an area of more than 105 km² (41 sq mi), making it the 30th most densely populated city in the world in 2020. S ...
,
France-Inter
France Inter () is a major French public radio channel and part of Radio France. It is a "generalist" station, aiming to provide a wide national audience with a full service of news and spoken-word programming, both serious and entertaining, li ...
radio, and the
Fnac
Fnac () is a large French retail chain selling cultural and electronic products, founded by André Essel and Max Théret in 1954. Its head office is in ''Le Flavia'' in Ivry-sur-Seine near Paris. It is an abbreviation of Fédération Nationale d ...
: 14,000 photographers produced 70,000 black-and-white prints and 30,000 color slides of the French capital to document the architectural changes of Paris. Photographs were donated to the
Bibliothèque historique de la ville de Paris
The Bibliothèque Historique de la Ville de Paris, commonly abbreviated with the acronym BHVP, is a public library specializing in the history of the city of Paris, France. Formerly in the Hôtel Saint-Fargeau (now part of the Musée Carnavale ...
.
* 1979 –
Robert Axelrod
Robert Marshall Axelrod (born May 27, 1943) is an American political scientist. He is Professor of Political Science and Public Policy at the University of Michigan where he has been since 1974. He is best known for his interdisciplinary work o ...
invited academics on-line to submit
FORTRAN algorithms to play the repeated
Prisoner's Dilemma
The Prisoner's Dilemma is an example of a game analyzed in game theory. It is also a thought experiment that challenges two completely rational agents to a dilemma: cooperate with their partner for mutual reward, or betray their partner ("defe ...
; A
tit for tat
Tit for tat is an English saying meaning "equivalent retaliation". It developed from "tip for tap", first recorded in 1558.
It is also a highly effective strategy in game theory. An agent using this strategy will first cooperate, then subseque ...
algorithm ended up in first place.
* 1991 –
Linus Torvalds
Linus Benedict Torvalds ( , ; born 28 December 1969) is a Finnish software engineer who is the creator and, historically, the lead developer of the Linux kernel, used by Linux distributions and other operating systems such as Android. He also c ...
began work on the
Linux
Linux ( or ) is a family of open-source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991, by Linus Torvalds. Linux is typically packaged as a Linux distribution, which ...
operating system, and
* 1996 – The
Hollywood Stock Exchange
The Hollywood Stock Exchange, or HSX, is a web-based, multiplayer game in which players use simulated money to buy and sell "shares" of actors, directors, upcoming films, and film-related options. The game uses Virtual Specialist technology invente ...
was founded: It allowed buying and selling of shares.
* 1997 – British rock band
Marillion
Marillion are a British rock music, rock band, formed in Aylesbury, Buckinghamshire, in 1979. They emerged from the post-punk music scene in Britain and existed as a bridge between the styles of punk rock and classic progressive rock, becomin ...
raised $60,000 from their fans to help finance their U.S. tour.
* 1999 –
SETI@home was launched by the
University of California, Berkeley
The University of California, Berkeley (UC Berkeley, Berkeley, Cal, or California) is a public land-grant research university in Berkeley, California. Established in 1868 as the University of California, it is the state's first land-grant u ...
. Volunteers can contribute to searching for signals that might come from extraterrestrial intelligence by installing a program that uses idle computer time for analyzing chunks of data recorded by
radio telescopes
A radio telescope is a specialized antenna and radio receiver used to detect radio waves from astronomical radio sources in the sky. Radio telescopes are the main observing instrument used in radio astronomy, which studies the radio frequency po ...
involved in the
SERENDIP SERENDIP (Search for Extraterrestrial Radio Emissions from Nearby Developed Intelligent Populations) is a Search for Extra-Terrestrial Intelligence (SETI) program originated by the Berkeley SETI Research Center at the University of California, Berke ...
program.
* 2000 –
JustGiving
JustGiving is a global online social platform for giving. The firm's headquarters are located in Bankside, London.
History
In 2000, Zarine Kharas and Anne-Marie Huby founded JustGiving, (initially clickforaction.com) a company to provide on ...
was established: This online platform allows the public to help raise money for charities.
* 2000 – UNV Online Volunteering service launched: Connecting people who commit their time and skills over the Internet to help organizations address development challenges.
* 2000 –
iStockPhoto
iStock is an online royalty free, international micro stock photography provider based in Calgary, Alberta, Canada. The firm offers millions of photos, illustrations, clip art, videos and audio tracks. Artists, designers and photographers world ...
was founded: The free stock imagery website allows the public to contribute to and receive commission for their contributions.
* 2001 – Launch of
Wikipedia
Wikipedia is a multilingual free online encyclopedia written and maintained by a community of volunteers, known as Wikipedians, through open collaboration and using a wiki-based editing system. Wikipedia is the largest and most-read refer ...
: "Free-access, free content Internet encyclopedia".
* 2001 – Foundation of
Topcoder
Topcoder (formerly TopCoder) is a crowdsourcing company with an open global community of designers, developers, data scientists, and competitive programmers. Topcoder pays community members for their work on the projects and sells community ser ...
– crowdsourcing software development company.
* 2004 –
OpenStreetMap
OpenStreetMap (OSM) is a free, open geographic database updated and maintained by a community of volunteers via open collaboration. Contributors collect data from surveys, trace from aerial imagery and also import from other freely licensed g ...
, a
collaborative project to create a
free
Free may refer to:
Concept
* Freedom, having the ability to do something, without having to obey anyone/anything
* Freethought, a position that beliefs should be formed only on the basis of logic, reason, and empiricism
* Emancipate, to procur ...
editable
map
A map is a symbolic depiction emphasizing relationships between elements of some space, such as objects, regions, or themes.
Many maps are static, fixed to paper or some other durable medium, while others are dynamic or interactive. Although ...
of the world, was launched.
* 2004 –
Toyota
is a Japanese multinational automotive manufacturer headquartered in Toyota City, Aichi, Japan. It was founded by Kiichiro Toyoda and incorporated on . Toyota is one of the largest automobile manufacturers in the world, producing about 10 ...
's first "Dream car art" contest: Children were asked globally to draw their "dream car of the future".
* 2005 –
Kodak
The Eastman Kodak Company (referred to simply as Kodak ) is an American public company that produces various products related to its historic basis in analogue photography. The company is headquartered in Rochester, New York, and is incorpor ...
's "Go for the Gold" contest: Kodak asked anyone to submit a picture of a personal victory.
* 2005 –
Amazon Mechanical Turk (MTurk) was launched publicly on November 2, 2005. It enables businesses to hire remotely located "crowdworkers" to perform discrete on-demand tasks that computers are currently unable to do.
* 2006 –
Waze
Waze (; he, ווייז, label=Hebrew), formerly FreeMap Israel, is a subsidiary company of Google that provides satellite navigation software on smartphones and other computers that support the Global Positioning System (GPS). In addition to ...
(then named FreeMap Israel), a community-oriented
GPS
The Global Positioning System (GPS), originally Navstar GPS, is a Radionavigation-satellite service, satellite-based radionavigation system owned by the United States government and operated by the United States Space Force. It is one of t ...
app, was created. It allows users to submit road information and route data based on location, such as reports of
car accidents or
traffic
Traffic comprises pedestrians, vehicles, ridden or herded animals, trains, and other conveyances that use public ways (roads) for travel and transportation.
Traffic laws govern and regulate traffic, while rules of the road include traffic ...
, and integrates that data into its routing algorithms for all users of the app.
* 2010 –
The 1947 Partition Archive The 1947 Partition Archive is a 501(c)(3) nonprofit oral history organization in Berkeley, California and a registered trust in Delhi, India, that collects, preserves and shares firsthand accounts of the Partition of India in 1947. The organization ...
, an
oral history
Oral history is the collection and study of historical information about individuals, families, important events, or everyday life using audiotapes, videotapes, or transcriptions of planned interviews. These interviews are conducted with people wh ...
project that asked community members around the world to document oral histories from aging witnessed of a significant but under-documented historical event, the 1947
Partition of India
The Partition of British India in 1947 was the Partition (politics), change of political borders and the division of other assets that accompanied the dissolution of the British Raj in South Asia and the creation of two independent dominions: ...
, was founded.
* 2011 – ''Casting of Flavours'' (''Do us a flavor'' in the USA) – a campaign launched by PepsiCo's Lay's in Spain. The campaign was to create a new flavor for the snack where the consumers where directly involved in its formation.
Early competitions
Crowdsourcing has often been used in the past as a competition to discover a solution. The French government proposed several of these competitions, often rewarded with
Montyon Prizes
The Montyon Prize (french: Prix Montyon) is a series of prizes awarded annually by the French Academy of Sciences and the Académie française. They are endowed by the French benefactor Baron de Montyon.
History
Prior to the start of the French R ...
. These included the
Leblanc process
The Leblanc process (pronounced leh-blaank) was an early industrial process for making ''soda ash'' (sodium carbonate) used throughout the 19th century, named after its inventor, Nicolas Leblanc. It involved two stages: making sodium sulfate from ...
, or the Alkali prize, where a reward was provided for separating the salt from the alkali, and the
Fourneyron's turbine, when the first hydraulic commercial turbine was developed.
In response to a challenge from the French government,
Nicolas Appert
Nicolas Appert (17 November 1749 – 1 June 1841) was the French inventor of airtight food preservation. Appert, known as the " father of Food Science", was a confectioner. Appert described his invention as a way "of conserving all kinds of food ...
won a prize for inventing a new way of
food preservation
Food preservation includes processes that make food more resistant to microorganism growth and slow the oxidation of fats. This slows down the decomposition and rancidification process. Food preservation may also include processes that inhibit ...
that involved sealing food in air-tight jars. The British government provided a similar reward to find an easy way to determine a ship's
longitude
Longitude (, ) is a geographic coordinate that specifies the east–west position of a point on the surface of the Earth, or another celestial body. It is an angular measurement, usually expressed in degrees and denoted by the Greek letter l ...
in
the Longitude Prize. During the Great Depression, out-of-work clerks tabulated higher mathematical functions in the
Mathematical Tables Project The Mathematical Tables Project was one of the largest and most sophisticated computing organizations that operated prior to the invention of the digital electronic computer. Begun in the United States in 1938 as a project of the Works Progress Admi ...
as an outreach project. One of the largest crowdsourcing campaigns was a public design contest in 2010 hosted by the Indian government's finance ministry to create a symbol for the
Indian rupee
The Indian rupee ( symbol: ₹; code: INR) is the official currency in the republic of India. The rupee is subdivided into 100 ''paise'' (singular: ''paisa''), though as of 2022, coins of denomination of 1 rupee are the lowest value in use wh ...
. Thousands of people sent in entries before the government zeroed in on the final symbol based on the
Devanagari
Devanagari ( ; , , Sanskrit pronunciation: ), also called Nagari (),Kathleen Kuiper (2010), The Culture of India, New York: The Rosen Publishing Group, , page 83 is a left-to-right abugida (a type of segmental Writing systems#Segmental syste ...
script using the letter Ra.
Applications
A number of motivations exist for businesses to use crowdsourcing to accomplish their tasks. These include the ability to offload peak demand, access cheap labor and information, generate better results, access a wider array of talent than what is present in one organization, and undertake problems that would have been too difficult to solve internally. Crowdsourcing allows businesses to submit problems on which contributors can work—on topics such as science, manufacturing, biotech, and medicine—optionally with monetary rewards for successful solutions. Although crowdsourcing complicated tasks can be difficult, simple work tasks can be crowdsourced cheaply and effectively.
Crowdsourcing also has the potential to be a problem-solving mechanism for government and nonprofit use.
Urban and transit planning are prime areas for crowdsourcing. For example, from 2008 to 2009, a crowdsourcing project for transit planning in Salt Lake City was created to test the public participation process. Another notable application of crowdsourcing for government
problem-solving
Problem solving is the process of achieving a goal by overcoming obstacles, a frequent part of most activities. Problems in need of solutions range from simple personal tasks (e.g. how to turn on an appliance) to complex issues in business an ...
is
Peer-to-Patent
The Peer To Patent project is an initiative that seeks to assist patent offices in improving patent quality by gathering public input in a structured, productive manner. Peer To Patent is the first social-software project directly linked to decisio ...
, which was an initiative to improve patent quality in the United States through gathering public input in a structured, productive manner.
Researchers have used crowdsourcing systems such as the Mechanical Turk to aid their research projects by crowdsourcing some aspects of the research process, such as data collection, parsing, and evaluation to the public. Notable examples include using the crowd to create speech and language databases and to conduct user studies.
Crowdsourcing systems provided researchers with the ability to gather large amounts of data, and helped researchers to collect data from populations and demographics they may not have access to locally.
Artists have also used crowdsourcing systems. In a project called the Sheep Market,
Aaron Koblin
Aaron Koblin (born January 14, 1982) is an American digital media artist and entrepreneur best known for his innovative use of data visualization and his pioneering work in crowdsourcing, virtual reality, and interactive film. He is co-founder an ...
used Mechanical Turk to collect 10,000 drawings of sheep from contributors around the world. Artist
Sam Brown leveraged the crowd by asking visitors of his website
explodingdog
explodingdog is the name of a website run by Sam Brown (artist), Sam Brown, pseudonym of Adam Culbert. From 2000 to 2015, viewers e-mailed Brown short phrases for inspiration and he illustrated certain ones. The drawings are usually rendered digi ...
to send him sentences to use as inspirations for his paintings. Art curator Andrea Grover argues that individuals tend to be more open in crowdsourced projects because they are not being physically judged or scrutinized.
[
] As with other types of uses, artists use crowdsourcing systems to generate and collect data. The crowd also can be used to provide inspiration and to collect financial support for an artist's work.
In
navigation systems, crowdsourcing from 100 million drivers were used by
INRIX
INRIX is a private company headquartered in Kirkland, Washington, US. It provides location-based data and software-as-a-service analytics — such as real-time and historical traffic conditions, road safety, and parking availability — to automak ...
to collect users' driving times to provide better GPS routing and real-time traffic updates.
In science
Astronomy
Crowdsourcing in astronomy was used in the early 19th century by astronomer
Denison Olmsted
Denison Olmsted (June 18, 1791May 13, 1859) was an American physicist and astronomer. Professor Olmsted is credited with giving birth to meteor science after the 1833 Leonid meteor shower over North America spurred him to study this phenomenon.
...
. After being awakened in a late November night due to a
meteor shower
A meteor shower is a celestial event in which a number of meteors are observed to radiate, or originate, from one point in the night sky. These meteors are caused by streams of cosmic debris called meteoroids entering Earth's atmosphere at extre ...
taking place, Olmsted noticed a pattern in the shooting stars. Olmsted wrote a brief report of this meteor shower in the local newspaper. "As the cause of 'Falling Stars' is not understood by meteorologists, it is desirable to collect all the facts attending this phenomenon, stated with as much precision as possible," Olmsted wrote to readers, in a report subsequently picked up and pooled to newspapers nationwide. Responses came pouring in from many states, along with scientists' observations sent to the ''American Journal of Science and Arts''. These responses helped him to make a series of scientific breakthroughs including observing the fact that meteor showers are seen nationwide and fall from space under the influence of gravity. The responses also allowed him to approximate a velocity for the meteors.
A more recent version of crowdsourcing in astronomy is NASA's photo organizing project, which asked internet users to browse photos taken from space and try to identify the location the picture is documenting.
Energy system research
Energy system models require large and diverse
dataset A data set (or dataset) is a collection of data. In the case of tabular data, a data set corresponds to one or more database tables, where every column of a table represents a particular variable, and each row corresponds to a given record of the ...
s, increasingly so given the trend towards greater temporal and spatial resolution.
[
] In response, there have been several initiatives to crowdsource this data. Launched in December 2009,
OpenEI
Open Energy Information (OpenEI) is a website for policy makers, researchers, technology investors, venture capitalists, and market professionals with energy data, information, analyses, tools, images, maps, and other resources. It was establ ...
is a
collaborative
Collaboration (from Latin ''com-'' "with" + ''laborare'' "to labor", "to work") is the process of two or more people, entities or organizations working together to complete a task or achieve a goal. Collaboration is similar to cooperation. Most ...
website
A website (also written as a web site) is a collection of web pages and related content that is identified by a common domain name and published on at least one web server. Examples of notable websites are Google Search, Google, Facebook, Amaz ...
run by the US government that provides
open
Open or OPEN may refer to:
Music
* Open (band), Australian pop/rock band
* The Open (band), English indie rock band
* ''Open'' (Blues Image album), 1969
* ''Open'' (Gotthard album), 1999
* ''Open'' (Cowboy Junkies album), 2001
* ''Open'' (YF ...
energy data.
[
] While much of its information is from US government sources, the platform also seeks crowdsourced input from around the world.
The
semantic
Semantics (from grc, σημαντικός ''sēmantikós'', "significant") is the study of reference, meaning, or truth. The term can be used to refer to subfields of several distinct disciplines, including philosophy, linguistics and comput ...
wiki
A wiki ( ) is an online hypertext publication collaboratively edited and managed by its own audience, using a web browser. A typical wiki contains multiple pages for the subjects or scope of the project, and could be either open to the pu ...
and
database
In computing, a database is an organized collection of data stored and accessed electronically. Small databases can be stored on a file system, while large databases are hosted on computer clusters or cloud storage. The design of databases sp ...
Enipedia also publishes energy systems data using the concept of crowdsourced open information. Enipedia went live in March 2011.
[Chapter9 discusses in depth the initial development of Enipedia.]
Genealogy research
Genealogical
Genealogy () is the study of families, family history, and the tracing of their lineages. Genealogists use oral interviews, historical records, genetic analysis, and other records to obtain information about a family and to demonstrate kinsh ...
research used crowdsourcing techniques long before personal computers were common. Beginning in 1942, members of
the Church of Jesus Christ of Latter-day Saints
The Church of Jesus Christ of Latter-day Saints, informally known as the LDS Church or Mormon Church, is a Nontrinitarianism, nontrinitarian Christianity, Christian church that considers itself to be the Restorationism, restoration of the ...
encouraged members to submit information about their ancestors. The submitted information was gathered together into a single collection. In 1969, to encourage more participation, the church started the three-generation program. In this program, church members were asked to prepare documented family group record forms for the first three generations. The program was later expanded to encourage members to research at least four generations and became known as the four-generation program.
Institutes that have records of interest to genealogical research have used crowds of volunteers to create catalogs and indices to records.
Genetic genealogy research
Genetic genealogy
Genetic genealogy is the use of genealogical DNA tests, i.e., DNA profiling and DNA testing, in combination with traditional genealogical methods, to infer genetic relationships between individuals. This application of genetics came to be used b ...
is a combination of traditional genealogy with
genetics
Genetics is the study of genes, genetic variation, and heredity in organisms.Hartl D, Jones E (2005) It is an important branch in biology because heredity is vital to organisms' evolution. Gregor Mendel, a Moravian Augustinian friar wor ...
. The rise of personal DNA testing, after the turn of the century, by companies such as
Gene by Gene
Gene by Gene is a commercial genetic testing company based in Houston, Texas. The company was owned by Bennett Greenspan and Max Blankfeld, and was the parent company of Family Tree DNA. In January of 2021, Gene by Gene was acquired by US based ...
,
FTDNA,
GeneTree
GeneTree was a family history website focused on using DNA testing to trace ancestry. A website account was free, and within their account users could order DNA tests, enter results from other testing companies, search the DNA database, create an o ...
,
23andMe
23andMe Holding Co. is a publicly held personal genomics and biotechnology company based in South San Francisco, California. It is best known for providing a direct-to-consumer genetic testing service in which customers provide a saliva sample t ...
, and
Ancestry.com
Ancestry.com LLC is an American genealogy company based in Lehi, Utah. The largest for-profit genealogy company in the world, it operates a network of genealogical, historical records, and related genetic genealogy websites.
In November 2018, ...
, has led to public and semi public databases of DNA testing using crowdsourcing techniques.
Citizen science
Citizen science (CS) (similar to community science, crowd science, crowd-sourced science, civic science, participatory monitoring, or volunteer monitoring) is scientific research conducted with participation from the public (who are sometimes re ...
projects have included support, organization, and dissemination of
personal DNA (genetic) testing. Similar to
amateur astronomy
Amateur astronomy is a hobby where participants enjoy observing or imaging celestial objects in the sky using the unaided eye, binoculars, or telescopes. Even though scientific research may not be their primary goal, some amateur astronomers m ...
, citizen scientists encouraged by volunteer organizations like the
International Society of Genetic Genealogy
The International Society of Genetic Genealogy (ISOGG) is an independent non-commercial nonprofit organization of genetic genealogy, genetic genealogists run by Volunteering, volunteers. It was founded by a group of surname DNA project administrat ...
have provided valuable information and research to the professional scientific community.
The
Genographic Project
The Genographic Project, launched on 13 April 2005 by the National Geographic Society and IBM, was a genetic anthropological study (sales discontinued on 31 May 2019) that aimed to map historical human migrations patterns by collecting and ...
, which began in 2005, is a research project carried out by the
National Geographic Society
The National Geographic Society (NGS), headquartered in Washington, D.C., United States, is one of the largest non-profit scientific and educational organizations in the world.
Founded in 1888, its interests include geography, archaeology, and ...
's scientific team to reveal patterns of human migration using crowdsourced
DNA testing and reporting of results.
Ornithology
Another early example of crowdsourcing occurred in the field of
ornithology
Ornithology is a branch of zoology that concerns the "methodological study and consequent knowledge of birds with all that relates to them." Several aspects of ornithology differ from related disciplines, due partly to the high visibility and th ...
. On 25 December 1900, Frank Chapman, an early officer of the
National Audubon Society
The National Audubon Society (Audubon; ) is an American non-profit environmental organization dedicated to conservation of birds and their habitats. Located in the United States and incorporated in 1905, Audubon is one of the oldest of such organ ...
, initiated a tradition dubbed the
"Christmas Day Bird Census". The project called birders from across North America to count and record the number of birds in each species they witnessed on Christmas Day. The project was successful, and the records from 27 different contributors were compiled into one bird census, which tallied around 90 species of birds. This large-scale collection of data constituted an early form of citizen science, the premise upon which crowdsourcing is based. In the 2012 census, more than 70,000 individuals participated across 2,369 bird count circles. Christmas 2014 marked the National Audubon Society's 115th annual
Christmas Bird Count
The Christmas Bird Count (CBC) is a census of birds in the Western Hemisphere, performed annually in the early Northern-hemisphere winter by volunteer birdwatchers and administered by the National Audubon Society. The purpose is to provide popu ...
.
Seismology
Seismology (; from Ancient Greek σεισμός (''seismós'') meaning "earthquake" and -λογία (''-logía'') meaning "study of") is the scientific study of earthquakes and the propagation of elastic waves through the Earth or through other ...
The
European-Mediterranean Seismological Centre (EMSC) has developed a seismic detection system by monitoring the traffic peaks on its website and analyzing keywords used on Twitter.
In journalism
Crowdsourcing is increasingly used in professional journalism. Journalists are able to organize crowdsourced information by fact checking the information, and then using the information they have gathered in their articles as they see fit. A daily newspaper in Sweden has successfully used crowdsourcing in investigating the home loan interest rates in the country in 2013–2014, which resulted in over 50,000 submissions. A daily newspaper in Finland crowdsourced an investigation into stock short-selling in 2011–2012, and the crowdsourced information led to revelations of a
tax evasion
Tax evasion is an illegal attempt to defeat the imposition of taxes by individuals, corporations, trusts, and others. Tax evasion often entails the deliberate misrepresentation of the taxpayer's affairs to the tax authorities to reduce the taxp ...
system by a Finnish bank. The bank executive was fired and policy changes followed.
TalkingPointsMemo in the United States asked its readers to examine 3,000 emails concerning the firing of federal prosecutors in 2008. The British newspaper ''
The Guardian
''The Guardian'' is a British daily newspaper. It was founded in 1821 as ''The Manchester Guardian'', and changed its name in 1959. Along with its sister papers ''The Observer'' and ''The Guardian Weekly'', ''The Guardian'' is part of the Gu ...
'' crowdsourced the examination of hundreds of thousands of documents in 2009.
Data donation
Data donation is a crowdsourcing approach to gather digital data. It is used by researchers and organizations to gain access to data from online platforms, websites, search engines and apps and devices. Data donation projects usually rely on participants volunteering their authentic digital profile information. Examples include:
* DataSkop developed by Algorithm Watch, a non-profit research organization in Germany, which accessed data on social media algorithms and
automated decision-making
Automated decision-making (ADM) involves the use of data, machines and algorithms to make decisions in a range of contexts, including public administration, business, health, education, law, employment, transport, media and entertainment, with var ...
systems.
* Mozilla Rally, from the
Mozilla Foundation
The Mozilla Foundation (stylized as moz://a) is an American non-profit organization that exists to support and collectively lead the open source Mozilla project. Founded in July 2003, the organization sets the policies that govern development, ...
, was a browser extension for participants in the US to provide access to their data for research projects.
* The Australian Search Experience and Ad Observatory projects set up in 2021 by researchers at the
(ADM+S) in Australia was using data donations to analyze how Google personalized search results, and examine how Facebook's algorithmic advertising model worked.
* The Citizen Browser Project, developed by
The Markup
''The Markup'' is an American nonprofit news publication focused on the impact of technology on society. Founded in 2018 with the goal of advancing data-driven journalism, the publication is headquartered in New York City.
History
''The Marku ...
, was designed to measure how disinformation traveled across social media platforms over time.
In public policy
Crowdsourcing public policy and the production of public services is also referred to as
citizen sourcing. While some scholars argue crowdsourcing for this purpose as a policy tool or a definite means of co-production, others question that and argue that crowdsourcing should be considered just as a technological enabler that simply increases speed and ease of participation. Crowdsourcing can also play a role in
democratization
Democratization, or democratisation, is the transition to a more democratic political regime, including substantive political changes moving in a democratic direction. It may be a hybrid regime in transition from an authoritarian regime to a ful ...
.
The first conference focusing on Crowdsourcing for Politics and Policy took place at
Oxford University
Oxford () is a city in England. It is the county town and only city of Oxfordshire. In 2020, its population was estimated at 151,584. It is north-west of London, south-east of Birmingham and north-east of Bristol. The city is home to the ...
, under the auspices of the Oxford Internet Institute in 2014. Research has emerged since 2012 which focused on the use of crowdsourcing for policy purposes. These include experimentally investigating the use of Virtual Labor Markets for policy assessment, and assessing the potential for citizen involvement in process innovation for public administration.
Governments across the world are increasingly using crowdsourcing for knowledge discovery and civic engagement. Iceland crowdsourced their constitution reform process in 2011, and Finland has crowdsourced several law reform processes to address their off-road traffic laws. The Finnish government allowed citizens to go on an online forum to discuss problems and possible resolutions regarding some off-road traffic laws. The crowdsourced information and resolutions would then be passed on to legislators to refer to when making a decision, allowing citizens to contribute to public policy in a more direct manner.
Palo Alto
Palo Alto (; Spanish for "tall stick") is a charter city in the northwestern corner of Santa Clara County, California, United States, in the San Francisco Bay Area, named after a coastal redwood tree known as El Palo Alto.
The city was estab ...
crowdsources feedback for its Comprehensive City Plan update in a process started in 2015. The House of Representatives in Brazil has used crowdsourcing in policy-reforms.
NASA
The National Aeronautics and Space Administration (NASA ) is an independent agency of the US federal government responsible for the civil space program, aeronautics research, and space research.
NASA was established in 1958, succeeding t ...
used crowdsourcing to analyze large sets of images. As part of the
Open Government Initiative
The Open Government Initiative is an effort by the administration of President of the United States Barack Obama to "reatean unprecedented level of openness in Government.". The directive starting this initiative was issued on January 20, 2009, Ob ...
of the
Obama Administration
Barack Obama's tenure as the 44th president of the United States began with his first inauguration on January 20, 2009, and ended on January 20, 2017. A Democrat from Illinois, Obama took office following a decisive victory over Republican ...
, the
General Services Administration
The General Services Administration (GSA) is an independent agency of the United States government established in 1949 to help manage and support the basic functioning of federal agencies. GSA supplies products and communications for U.S. gover ...
collected and amalgamated suggestions for improving federal websites.
For part of the Obama and
Trump Administrations, the
We the People
The Preamble to the United States Constitution, beginning with the words We the People, is a brief introductory statement of the Constitution's fundamental purposes and guiding principles. Courts have referred to it as reliable evidence o ...
system collected signatures on petitions, which were entitled to an official response from the
White House
The White House is the official residence and workplace of the president of the United States. It is located at 1600 Pennsylvania Avenue NW in Washington, D.C., and has been the residence of every U.S. president since John Adams in 1800. ...
once a certain number had been reached. Several U.S. federal agencies ran
inducement prize contest
An inducement prize contest (IPC) is a competition that awards a cash prize for the accomplishment of a feat, usually of engineering. IPCs are typically designed to extend the limits of human ability. Some of the most famous IPCs include the Longit ...
s, including NASA and the
Environmental Protection Agency
A biophysical environment is a biotic and abiotic surrounding of an organism or population, and consequently includes the factors that have an influence in their survival, development, and evolution. A biophysical environment can vary in scale f ...
.
Language-related data
Crowdsourcing has been used extensively for gathering language-related data.
For dictionary work, crowdsourcing was applied over a hundred years ago by the ''
Oxford English Dictionary
The ''Oxford English Dictionary'' (''OED'') is the first and foundational historical dictionary of the English language, published by Oxford University Press (OUP). It traces the historical development of the English language, providing a com ...
'' editors using paper and postage. It has also been used for collecting examples of
proverbs
A proverb (from la, proverbium) is a simple and insightful, traditional saying that expresses a perceived truth based on common sense or experience. Proverbs are often metaphorical and use formulaic speech, formulaic language. A proverbial phra ...
on a specific topic (e.g.
religious pluralism
Religious pluralism is an attitude or policy regarding the diversity of religious belief systems co-existing in society. It can indicate one or more of the following:
* Recognizing and tolerating the religious diversity of a society or countr ...
) for a printed journal. Crowdsourcing language-related data online has proven very effective and many dictionary compilation projects used crowdsourcing. It is used particularly for specialist topics and languages that are not well documented, such as for the
Oromo language
Oromo ( or ; Oromo: ''Afaan Oromoo''), in the linguistic literature of the early 20th century also called Galla (a name with a pejorative meaning and therefore rejected by the Oromo people), is an Afroasiatic language that belongs to the Cushiti ...
. Software programs have been developed for crowdsourced dictionaries, such as ''WeSay''. A slightly different form of crowdsourcing for language data was the online creation of scientific and mathematical terminology for
American Sign Language
American Sign Language (ASL) is a natural language that serves as the predominant sign language of Deaf communities in the United States of America and most of Anglophone Canadians, Anglophone Canada. ASL is a complete and organized visual lang ...
.
In linguistics, crowdsourcing strategies have been applied to estimate word knowledge, vocabulary size, and word origin. Implicit crowdsourcing on social media has also approximating sociolinguistic data efficiently.
Reddit
Reddit (; stylized in all lowercase as reddit) is an American social news aggregation, content rating, and discussion website. Registered users (commonly referred to as "Redditors") submit content to the site such as links, text posts, images ...
conversations in various location-based subreddits were analyzed for the presence of grammatical forms unique to a regional dialect. These were then used to map the extent of the speaker population. The results could roughly approximate large-scale surveys on the subject without engaging in field interviews.
Mining publicly available social media conversations can be used as a form of implicit crowdsourcing to approximate the geographic extent of speaker dialects.
Proverb collection is also being done via crowdsourcing on the Web, most notably for the
Pashto language
Pashto (,; , ) is an Eastern Iranian language in the Indo-European language family. It is known in historical Persian literature as Afghani ().
Spoken as a native language mostly by ethnic Pashtuns, it is one of the two official languages ...
of Afghanistan and Pakistan. Crowdsourcing has been extensively used to collect high-quality gold standards for creating automatic systems in natural language processing (e.g.
named entity recognition
Named-entity recognition (NER) (also known as (named) entity identification, entity chunking, and entity extraction) is a subtask of information extraction that seeks to locate and classify named entities mentioned in unstructured text into pre ...
,
entity linking In natural language processing, entity linking, also referred to as named-entity linking (NEL), named-entity disambiguation (NED), named-entity recognition and disambiguation (NERD) or named-entity normalization (NEN) is the task of assigning a uni ...
).
In product design
LEGO allows users to work on new product designs while conducting requirements testing. Any user can provide a design for a product, and other users can vote on the product. Once the submitted product has received 10,000 votes, it will be formally reviewed in stages and go into production with no impediments such as legal flaws identified. The creator receives royalties from the net income.
In business
Homeowners can use
Airbnb
Airbnb, Inc. ( ), based in San Francisco, California, operates an online marketplace focused on short-term homestays and experiences. The company acts as a broker and charges a commission from each booking. The company was founded in 2008 b ...
to list their accommodation or unused rooms. Owners set their own nightly, weekly and monthly rates and accommodations. The business, in turn, charges guests and hosts a fee. Guests usually end up spending between $9 and $15. They have to pay a booking fee every time they book a room. The landlord, in turn, pays a service fee for the amount due. The company has 1,500 properties in 34,000 cities in more than 190 countries.
Other examples
* Geography —
Volunteered geographic information (VGI) is
geographic information
Geographic data and information is defined in the ISO/TC 211 series of standards as data and information having an implicit or explicit association with a location relative to Earth (a geographic location or geographic position).
It is also call ...
generated through crowdsourcing, as opposed to traditional methods of Professional Geographic Information (PGI). In describing the
built environment
The term built environment refers to human-made conditions and is often used in architecture, landscape architecture, urban planning, public health, sociology, and anthropology, among others. These curated spaces provide the setting for human ac ...
, VGI has many advantages over PGI, primarily perceived currency, accuracy and authority.
OpenStreetMap
OpenStreetMap (OSM) is a free, open geographic database updated and maintained by a community of volunteers via open collaboration. Contributors collect data from surveys, trace from aerial imagery and also import from other freely licensed g ...
is an example of crowdsourced mapping project.
* Engineering — Many companies are introducing crowdsourcing to grow their engineering capabilities and find solutions to unsolved technical challenges and the need to adopt newest technologies such as
3D printing
3D printing or additive manufacturing is the Manufacturing, construction of a three-dimensional object from a computer-aided design, CAD model or a digital 3D modeling, 3D model. It can be done in a variety of processes in which material is ...
and the
IOT
The Internet of things (IoT) describes physical objects (or groups of such objects) with sensors, processing ability, software and other technologies that connect and exchange data with other devices and systems over the Internet or other com ...
.
* Libraries, museums and archives — Newspaper text correction at the
National Library of Australia
The National Library of Australia (NLA), formerly the Commonwealth National Library and Commonwealth Parliament Library, is the largest reference library in Australia, responsible under the terms of the ''National Library Act 1960'' for "mainta ...
was an early, influential example of work with text transcriptions for crowdsourcing in cultural heritage institutions. The Steve Museum project provided a prototype for
categorizing
Categorization is the ability and activity of recognizing shared features or similarities between the elements of the experience of the world (such as objects, events, or ideas), organizing and classifying experience by associating them to a ...
artworks. Crowdsourcing is used in libraries for
OCR corrections on
digitized
DigitizationTech Target. (2011, April). Definition: digitization. ''WhatIs.com''. Retrieved December 15, 2021, from https://whatis.techtarget.com/definition/digitization is the process of converting information into a digital (i.e. computer- ...
texts, for
tagging and for funding, especially in the absence of financial and human means. Volunteers can contribute explicitly with conscious effort or implicitly without being known by turning the text on the raw newspaper image into human corrected digital form.
[Andro, M. (2018). ''Digital libraries and crowdsourcing'', Wiley / ISTE. .]
* Agriculture — Crowdsource research also applies to the field of agriculture. Crowdsourcing can be used to help farmers and experts to dentify different types of weeds from the fields and also to provide assistance in removing the weeds.
*
Cheating in bridge
Cheating in bridge refers to a deliberate violation of the rules of the game of bridge or other unethical behaviour that is intended to give an unfair advantage to a player or team. Cheating can occur in many forms and can take place before, durin ...
—
Boye Brogeland
Boye Brogeland (born 1973) is a Norwegian professional bridge player. After a successful junior career, he won three Bermuda Bowl medals with the Norwegian team, including the gold in Shanghai 2007, and several North American Bridge Championships. ...
initiated a crowdsourcing investigation of cheating by top-level
bridge
A bridge is a structure built to span a physical obstacle (such as a body of water, valley, road, or rail) without blocking the way underneath. It is constructed for the purpose of providing passage over the obstacle, which is usually somethi ...
players that showed several players as guilty, which led to their suspension.
*
Open Source Software and
Crowdsourcing software development
Crowdsourcing software development or software crowdsourcing is an emerging area of software engineering. It is an open call for participation in any task of software development, including documentation, design, coding and testing. These tasks a ...
have been used extensively in the domain of software development.
* Healthcare — Research has emerged that outlined the use of crowdsourcing techniques in the public health domain.
The collective intelligence outcomes from crowdsourcing are being generated in three broad categories of public health care: health promotion,
health research, and health maintenance. Crowdsourcing also enables researchers to move from small homogeneous groups of participants to large heterogenous groups
beyond convenience samples such as students or higher educated people. The
SESH group focuses on using crowdsourcing to improve health.
Methods
Internet and digital technologies have massively expanded the opportunities for crowdsourcing. However, the effect of user communication and platform presentation can have a major bearing on the success of an online crowdsourcing project.
The crowdsourced problem can range from huge tasks (such as finding alien life or mapping earthquake zones) or very small (identifying images). Some examples of successful crowdsourcing themes are problems that bug people, things that make people feel good about themselves, projects that tap into niche knowledge of proud experts, and subjects that people find sympathetic.
Crowdsourcing can either take an explicit or an implicit route:
* Explicit crowdsourcing lets users work together to evaluate, share, and build different specific tasks, while implicit crowdsourcing means that users solve a problem as a side effect of something else they are doing. With explicit crowdsourcing, users can evaluate particular items like books or webpages, or share by posting products or items. Users can also build artifacts by providing information and editing other people's work.
* Implicit crowdsourcing can take two forms: standalone and piggyback. Standalone allows people to solve problems as a side effect of the task they are actually doing, whereas piggyback takes users' information from a third-party website to gather information.
This is also known as data donation.
In his 2013 book, ''Crowdsourcing'', Daren C. Brabham puts forth a problem-based typology of crowdsourcing approaches:
* Knowledge discovery and management is used for information management problems where an organization mobilizes a crowd to find and assemble information. It is ideal for creating collective resources.
* Distributed human intelligence tasking (HIT) is used for information management problems where an organization has a set of information in hand and mobilizes a crowd to process or analyze the information. It is ideal for processing large data sets that computers cannot easily do. Amazon Mechanical Turk uses this approach.
* Broadcast search is used for
ideation problems where an organization mobilizes a crowd to come up with a solution to a problem that has an objective, provable right answer. It is ideal for scientific problem-solving.
* Peer-vetted creative production is used for ideation problems, where an organization mobilizes a crowd to come up with a solution to a problem which has an answer that is subjective or dependent on public support. It is ideal for design, aesthetic, or policy problems.
Ivo Blohm identifies four types of Crowdsourcing Platforms: Microtasking, Information Pooling, Broadcast Search, and Open Collaboration. They differ in the diversity and aggregation of contributions that are created. The diversity of information collected can either be homogenous or heterogenous. The aggregation of information can either be selective or integrative. Some common categories of crowdsourcing have been used effectively in the commercial world include crowdvoting, crowdsolving,
crowdfunding
Crowdfunding is the practice of funding a project or venture by raising money from a large number of people, typically via the internet. Crowdfunding is a form of crowdsourcing and alternative finance. In 2015, over was raised worldwide by crow ...
,
microwork
Microwork is a series of many small tasks which together comprise a large unified project, and it is completed by many people over the Internet. Microwork is considered the smallest unit of work in a virtual assembly line. It is most often used to ...
,
creative crowdsourcing,
crowdsource workforce management, and
inducement prize contests.
Crowdvoting
Crowdvoting occurs when a website gathers a large group's opinions and judgments on a certain topic. Some crowdsourcing tools and platforms allow participants to rank each other's contributions, e.g. in answer to the question "What is one thing we can do to make Acme a great company?" One common method for ranking is "like" counting, where the contribution with the most "like" votes ranks first. This method is simple and easy to understand, but it privileges early contributions, which have more time to accumulate votes. In recent years, several crowdsourcing companies have begun to use pairwise comparisons backed by ranking algorithms. Ranking algorithms do not penalize late contributions. They also produce results quicker. Ranking algorithms have proven to be at least 10 times faster than manual stack ranking. One drawback, however, is that ranking algorithms are more difficult to understand than vote counting.
The
Iowa Electronic Market is a prediction market that gathers crowds' views on politics and tries to ensure accuracy by having participants pay money to buy and sell contracts based on political outcomes. Some of the most famous examples have made use of social media channels: Domino's Pizza, Coca-Cola, Heineken, and Sam Adams have crowdsourced a new pizza, bottle design, beer, and song respectively. A website called
Threadless
Threadless (stylized as threadless) is an online community of artists and an e-commerce website based in Chicago, Illinois, founded in 2000 by Jake Nickell and Jacob DeHart.
Threadless designs are created by and chosen by an online community. E ...
selected the T-shirts it sold by having users provide designs and vote on the ones they like, which are then printed and available for purchase.
[
]
The
California Report Card
The California Report Card (CRC) is a mobile-optimized web application designed to promote public involvement in the California government. Developed by Prof. Ken Goldberg and the CITRIS Data and Democracy Initiative at UC Berkeley with Californ ...
(CRC), a program jointly launched in January 2014 by the
and Lt. Governor
Gavin Newsom
Gavin Christopher Newsom (born October 10, 1967) is an American politician and businessman who has been the 40th governor of California since 2019. A member of the Democratic Party, he served as the 49th lieutenant governor of California fr ...
, is an example of modern-day crowd voting. Participants access the CRC online and vote on six timely issues. Through
principal component analysis
Principal component analysis (PCA) is a popular technique for analyzing large datasets containing a high number of dimensions/features per observation, increasing the interpretability of data while preserving the maximum amount of information, and ...
, the users are then placed into an online "café" in which they can present their own political opinions and grade the suggestions of other participants. This system aims to effectively involve the greater public in relevant political discussions and highlight the specific topics with which people are most concerned.
Crowdvoting's value in the movie industry was shown when in 2009 a crowd accurately predicted the success or failure of a movie based on its trailer, a feat that was replicated in 2013 by Google.
On Reddit, users collectively rate web content, discussions and comments as well as questions posed to persons of interest in "
AMA" and AskScience
online interview An online interview is an online research method conducted using computer-mediated communication (CMC), such as instant messaging, email, or video. Online interviews require different ethical considerations, sampling and rapport than practices found ...
s.
In 2017,
Project Fanchise
Fan Controlled Football (FCF) is a professional 7-on-7 Indoor football league created in 2017 as the first sports league controlled by fans. All games are played at the Pullman Yards in Atlanta, Georgia and broadcast on Twitch, NBCLX, DAZN, Fu ...
purchased a team in the
Indoor Football League
The Indoor Football League (IFL) is a professional indoor American football league created in 2008 out of the merger between the Intense Football League and United Indoor Football. It has one of the largest number of currently active teams amon ...
and created the
Salt Lake Screaming Eagles
The Salt Lake Screaming Eagles were a professional indoor football team based in West Valley City, Utah, near Salt Lake City. The Screaming Eagles started as an expansion team in the Indoor Football League (IFL) and began play in 2017 with home ...
, a fan run team. Using a mobile app, the fans voted on the day-to-day operations of the team, the mascot name, signing of players and even
offensive
Offensive may refer to:
* Offensive, the former name of the Dutch political party Socialist Alternative
* Offensive (military), an attack
* Offensive language
** Fighting words or insulting language, words that by their very utterance inflict inj ...
play calling
A play calling system in American football is the specific language and methods used to call offensive plays.
It is distinct from the play calling philosophy, which is concerned with overall strategy: whether a team favors passing or running, whet ...
during games.
Crowdfunding
Crowdfunding is the process of funding projects by a multitude of people contributing a small amount to attain a certain monetary goal, typically via the Internet. Crowdfunding has been used for both commercial and charitable purposes.
The crowdfuding model that has been around the longest is rewards-based crowdfunding. This model is where people can prepurchase products, buy experiences, or simply donate. While this funding may in some cases go towards helping a business, funders are not allowed to invest and become shareholders via rewards-based crowdfunding.
Individuals, businesses, and entrepreneurs can showcase their businesses and projects by creating a profile, which typically includes a short video introducing their project, a list of rewards per donation, and illustrations through images. Funders make monetary contribution for numerous reasons:
# They connect to the greater purpose of the campaign, such as being a part of an entrepreneurial community and supporting an innovative idea or product.
[Agrawal, Ajay, Christian Catalini, and Avi Goldfarb. "Some Simple Economics of Crowdfunding." ''National Bureau of Economic Research'' (2014): 63-97.]
# They connect to a physical aspect of the campaign like rewards and gains from investment.
# They connect to the creative display of the campaign's presentation.
# They want to see new products before the public.
The dilemma for equity crowdfunding in the US as of 2012 was during a refinement process for the regulations of the
Securities and Exchange Commission
The U.S. Securities and Exchange Commission (SEC) is an independent agency of the United States federal government, created in the aftermath of the Wall Street Crash of 1929. The primary purpose of the SEC is to enforce the law against market ...
, which had until 1 January 2013 to tweak the fundraising methods. The regulators were overwhelmed trying to regulate Dodd-Frank and all the other rules and regulations involving public companies and the way they traded. Advocates of regulation claimed that crowdfunding would open up the flood gates for fraud, called it the "wild west" of fundraising, and compared it to the 1980s days of penny stock "cold-call cowboys". The process allowed for up to $1 million to be raised without some of the regulations being involved. Companies under the then-current proposal would have exemptions available and be able to raise capital from a larger pool of persons, which can include lower thresholds for investor criteria, whereas the old rules required that the person be an "accredited" investor. These people are often recruited from social networks, where the funds can be acquired from an equity purchase, loan, donation, or ordering. The amounts collected have become quite high, with requests that are over a million dollars for software such as Trampoline Systems, which used it to finance the commercialization of their new software.
Inducement prize contests
Web-based idea competitions or inducement prize contests often consist of generic ideas, cash prizes, and an Internet-based platform to facilitate easy idea generation and discussion. An example of these competitions includes an event like IBM's 2006 "Innovation Jam", attended by over 140,000 international participants and yielded around 46,000 ideas.
[
] Another example is the
Netflix Prize
The Netflix Prize was an open competition for the best collaborative filtering algorithm to predict user ratings for films, based on previous ratings without any other information about the users or films, i.e. without the users being identified e ...
in 2009. People were asked to come up with a
recommendation algorithm
A recommender system, or a recommendation system (sometimes replacing 'system' with a synonym such as platform or engine), is a subclass of information filtering system that provide suggestions for items that are most pertinent to a particular u ...
that is more accurate than Netflix's current algorithm. It had a grand prize of US$1,000,000, and it was given to a team which designed an algorithm that beat Netflix's own algorithm for predicting ratings by 10.06%.
Another example of competition-based crowdsourcing is the 2009
DARPA balloon The 2009 DARPA Network Challenge was a prize competition for exploring the roles the Internet and social networking play in the real-time communications, wide-area collaborations, and practical actions required to solve broad-scope, time-critical pr ...
experiment, where
DARPA
The Defense Advanced Research Projects Agency (DARPA) is a research and development agency of the United States Department of Defense responsible for the development of emerging technologies for use by the military.
Originally known as the Adv ...
placed 10 balloon markers across the United States and challenged teams to compete to be the first to report the location of all the balloons. A collaboration of efforts was required to complete the challenge quickly and in addition to the competitive motivation of the contest as a whole, the winning team (
MIT
The Massachusetts Institute of Technology (MIT) is a private land-grant research university in Cambridge, Massachusetts. Established in 1861, MIT has played a key role in the development of modern technology and science, and is one of the mo ...
, in less than nine hours) established its own "collaborapetitive" environment to generate participation in their team. A similar challenge was the
Tag Challenge The Tag Challenge is a social gaming competition, with a US$5,000 reward, in which participants were invited to find five "suspects" in a simulated law enforcement search in five different cities throughout North America and Europe on March 31, 201 ...
, funded by the US State Department, which required locating and photographing individuals in five cities in the US and Europe within 12 hours based only on a single photograph. The winning team managed to locate three suspects by mobilizing volunteers worldwide using a similar incentive scheme to the one used in the balloon challenge.
Using
open innovation
Open innovation is a term used to promote an information age mindset toward innovation that runs counter to the secrecy and silo mentality of traditional corporate research labs. The benefits and driving forces behind increased openness have bee ...
platforms is an effective way to crowdsource people's thoughts and ideas for research and development. The company
InnoCentive is a crowdsourcing platform for corporate research and development where difficult scientific problems are posted for crowds of solvers to discover the answer and win a cash prize that ranges from $10,000 to $100,000 per challenge.
InnoCentive, of
Waltham, Massachusetts
Waltham ( ) is a city in Middlesex County, Massachusetts, United States, and was an early center for the labor movement as well as a major contributor to the American Industrial Revolution. The original home of the Boston Manufacturing Company, th ...
, and
London, England
London is the capital and largest city of England and the United Kingdom, with a population of just under 9 million. It stands on the River Thames in south-east England at the head of a estuary down to the North Sea, and has been a major s ...
, provides access to millions of scientific and technical experts from around the world. The company claims a success rate of 50% in providing successful solutions to previously unsolved scientific and technical problems. The
X Prize Foundation creates and runs incentive competitions offering between $1 million and $30 million for solving challenges.
Local Motors
Local Motors was an American motor vehicle manufacturing company focused on low-volume manufacturing of open-source motor vehicle designs using multiple microfactories. It was founded in 2007 by John B. Rogers Jr and had headquarters in Phoenix ...
is another example of crowdsourcing, and it is a community of 20,000 automotive engineers, designers, and enthusiasts that compete to build off-road rally trucks.
Implicit crowdsourcing
Implicit crowdsourcing is less obvious because users do not necessarily know they are contributing, yet can still be very effective in completing certain tasks. Rather than users actively participating in solving a problem or providing information, implicit crowdsourcing involves users doing another task entirely where a third party gains information for another topic based on the user's actions.
A good example of implicit crowdsourcing is the
ESP game The ESP game is a human-based computation game developed to address the problem of creating difficult metadata. The idea behind the game is to use the computational power of humans to perform a task that computers cannot (originally, image recog ...
, where users find words to describe Google images, which are then used as
metadata
Metadata is "data that provides information about other data", but not the content of the data, such as the text of a message or the image itself. There are many distinct types of metadata, including:
* Descriptive metadata – the descriptive ...
for the images. Another popular use of implicit crowdsourcing is through
reCAPTCHA
reCAPTCHA is a CAPTCHA system that enables web hosts to distinguish between human and automated access to websites. The original version asked users to decipher hard to read text or match images. Version 2 also asked users to decipher text or ...
, which asks people to solve
CAPTCHA
A CAPTCHA ( , a contrived acronym for "Completely Automated Public Turing test to tell Computers and Humans Apart") is a type of challenge–response test used in computing to determine whether the user is human.
The term was coined in 2003 ...
s to prove they are human, and then provides CAPTCHAs from old books that cannot be deciphered by computers, to digitize them for the web. Like many tasks solved using the Mechanical Turk, CAPTCHAs are simple for humans, but often very difficult for computers.
Piggyback crowdsourcing can be seen most frequently by websites such as Google that data-mine a user's search history and websites to discover keywords for ads, spelling corrections, and finding synonyms. In this way, users are unintentionally helping to modify existing systems, such as
Google Ads
Google Ads (formerly Google AdWords) is an online advertising platform developed by Google, where advertisers bid to display brief advertisements, service offerings, product listings, or videos to web users. It can place ads both in the result ...
.
[
]
Other types
* Creative crowdsourcing involves sourcing people for creative projects such as
graphic design
Graphic design is a profession, academic discipline and applied art whose activity consists in projecting visual communications intended to transmit specific messages to social groups, with specific objectives. Graphic design is an interdiscipli ...
,
crowdsourcing architecture
Throughout history, architects have often been chosen by setting up an architectural competition and awarding the commission on the basis of the most favoured design. With the advent of the internet, a similar process has been set up by a number of ...
, product design,
apparel design, movies, writing, company naming, illustration, etc. While crowdsourcing competitions have been used for decades in some creative fields such as architecture, creative crowdsourcing has proliferated with the recent development of web-based platforms where clients can solicit a wide variety of creative work at lower cost than by traditional means.
*
Crowdshipping Crowdshipping, sometimes referred to as crowd logistics, applies the concept of crowdsourcing to the personalized delivery of freight. Crowdshipping can be conceived as an example of people using social networking to behave collaboratively and sha ...
(crowd-shipping) is a peer-to-peer shipping service, usually conducted via an online platform or marketplace. There are several methods that have been categorized as crowd-shipping:
** Travelers heading in the direction of the buyer, and are willing to bring the package as part of their luggage for a reward.
** Truck drivers whose route lies along the buyer's location and who are willing to take extra items in their truck.
** Community-based platforms that connect international buyers and local forwarders, by allowing buyers to use forwarder's address as purchase destination, after which forwarders ship items further to the buyer.
* Crowdsolving is a collaborative and holistic way of solving a problem through many people, communities, groups, or resources. It is a type of crowdsourcing with focus on complex and intellectually demanding problems requiring considerable effort, and the quality or uniqueness of contribution.
** Problem–idea chains are a form of idea crowdsourcing and crowdsolving, where individuals are asked to submit ideas to solve problems and then problems that can be solved with those ideas. The aim is to find encourage individuals to find practical solutions to problems that are well thought through.
*
Macrowork tasks typically have these characteristics: they can be done independently, they take a fixed amount of time, and they require special skills. Macro-tasks could be part of specialized projects or could be part of a large, visible project where workers pitch in wherever they have the required skills. The key distinguishing factors are that macro-work requires specialized skills and typically takes longer, while microwork requires no specialized skills.
*
Microwork
Microwork is a series of many small tasks which together comprise a large unified project, and it is completed by many people over the Internet. Microwork is considered the smallest unit of work in a virtual assembly line. It is most often used to ...
is a crowdsourcing platform that allows users to do small tasks for which computers lack aptitude in for low amounts of money. Amazon's
Mechanical Turk
The Turk, also known as the Mechanical Turk or Automaton Chess Player (german: Schachtürke, ; hu, A Török), was a fraudulent chess-playing machine constructed in the late 18th century. From 1770 until its destruction by fire in 1854 it was ...
has created many different projects for users to participate in, where each task requires very little time and offers a very small amount in payment.
When choosing tasks, since only certain users "win", users learn to submit later and pick less popular tasks to increase the likelihood of getting their work chosen. An example of a Mechanical Turk project is when users searched satellite images for a boat to find
Jim Gray, a missing computer scientist.
* Mobile crowdsourcing involves activities that take place on smartphones or mobile platforms that are frequently characterized by GPS technology. This allows for real-time data gathering and gives projects greater reach and accessibility. However, mobile crowdsourcing can lead to an urban bias, and can have safety and privacy concerns.
* Simple projects are those that require a large amount of time and skills compared to micro and macro-work. While an example of macro-work would be writing survey feedback, simple projects rather include activities like writing a basic line of code or programming a database, which both require a larger time commitment and skill level. These projects are usually not found on sites like
Amazon Mechanical Turk
Amazon Mechanical Turk (MTurk) is a crowdsourcing website for businesses to hire remotely located "crowdworkers" to perform discrete on-demand tasks that computers are currently unable to do. It is operated under Amazon Web Services, and is owned ...
, and are rather posted on platforms like
Upwork
Upwork Global Inc., formerly Elance-oDesk, is an American freelancing platform headquartered in Santa Clara and San Francisco, California. The company was formed in 2013 as Elance-oDesk, after the merger of Elance Inc. and oDesk Corp. The merg ...
that call for a specific expertise.
* Complex projects generally take the most time, have higher stakes, and call for people with very specific skills. These are generally "one-off" projects that are difficult to accomplish and can include projects such as
designing
A design is a plan or specification for the construction of an object or system or for the implementation of an activity or process or the result of that plan or specification in the form of a prototype, product, or process. The verb ''to design'' ...
a new product that a company hopes to patent. Such projects are considered to be complex because design is a meticulous process that requires a large amount of time to perfect, and people completing the project must have specialized training in design to effectively complete the project. These projects usually pay the highest, yet are rarely offered.
Demographics of the crowd
The
crowd
Generally speaking, a crowd is defined as a group of people that have gathered for a common purpose or intent such as at a Demonstration (people), demonstration, a Sport, sports event, or during looting (this is known as an acting crowd), or ...
is an umbrella term for the people who contribute to crowdsourcing efforts. Though it is sometimes difficult to gather data about the
demographics
Demography () is the statistical study of populations, especially human beings.
Demographic analysis examines and measures the dimensions and dynamics of populations; it can cover whole societies or groups defined by criteria such as edu ...
of the crowd, a study by Ross ''et al.'' surveyed the demographics of a sample of the more than 400,000 registered crowdworkers using Amazon Mechanical Turk to complete tasks for pay. A previous study in 2008 by
Ipeirotis found that users at that time were primarily American, young, female, and well-educated, with 40% earning more than $40,000 per year. In November 2009, Ross found a very different Mechanical Turk population where 36% of which was Indian. Two-thirds of Indian workers were male, and 66% had at least a bachelor's degree. Two-thirds had annual incomes less than $10,000, with 27% sometimes or always depending on income from Mechanical Turk to make ends meet.
The average US user of Mechanical Turk earned $2.30 per hour for tasks in 2009, versus $1.58 for the average Indian worker. While the majority of users worked less than five hours per week, 18% worked 15 hours per week or more. This is less than
minimum wage
A minimum wage is the lowest remuneration that employers can legally pay their employees—the price floor below which employees may not sell their labor. Most countries had introduced minimum wage legislation by the end of the 20th century. Bec ...
in the United States (but not in India), which Ross suggests raises ethical questions for researchers who use crowdsourcing.
The demographics of Microworkers.com differ from Mechanical Turk in that the US and India together accounting for only 25% of workers; 197 countries are represented among users, with Indonesia (18%) and Bangladesh (17%) contributing the largest share. However, 28% of employers are from the US.
Another study of the demographics of the crowd at
iStockphoto
iStock is an online royalty free, international micro stock photography provider based in Calgary, Alberta, Canada. The firm offers millions of photos, illustrations, clip art, videos and audio tracks. Artists, designers and photographers world ...
found a crowd that was largely white, middle- to upper-class, higher educated, worked in a so-called "white-collar job" and had a high-speed Internet connection at home.
In a crowd-sourcing diary study of 30 days in Europe, the participants were predominantly higher educated women.
Studies have also found that crowds are not simply collections of amateurs or hobbyists. Rather, crowds are often professionally trained in a discipline relevant to a given crowdsourcing task and sometimes hold advanced degrees and many years of experience in the profession.
Claiming that crowds are amateurs, rather than professionals, is both factually untrue and may lead to marginalization of crowd labor rights.
Gregory Saxton et al. studied the role of community users, among other elements, during his content analysis of 103 crowdsourcing organizations. They developed a taxonomy of nine crowdsourcing models (intermediary model, citizen media production, collaborative software development, digital goods sales, product design, peer-to-peer social financing, consumer report model, knowledge base building model, and collaborative science project model) in which to categorize the roles of community users, such as researcher, engineer, programmer, journalist, graphic designer, etc., and the products and services developed.
Motivations
Contributors
Many researchers suggest that both
intrinsic
In science and engineering, an intrinsic property is a property of a specified subject that exists itself or within the subject. An extrinsic property is not essential or inherent to the subject that is being characterized. For example, mass ...
and
extrinsic
In science and engineering, an intrinsic property is a property of a specified subject that exists itself or within the subject. An extrinsic property is not essential or inherent to the subject that is being characterized. For example, mass ...
motivations cause people to contribute to crowdsourced tasks and these factors influence different types of contributors.
For example, people employed in a full-time position rate human capital advancement as less important than part-time workers do, while women rate social contact as more important than men do.
Intrinsic motivations are broken down into two categories: enjoyment-based and community-based motivations. Enjoyment-based motivations refer to motivations related to the fun and enjoyment contributors experience through their participation. These motivations include: skill variety, task identity, task
autonomy
In developmental psychology and moral, political, and bioethical philosophy, autonomy, from , ''autonomos'', from αὐτο- ''auto-'' "self" and νόμος ''nomos'', "law", hence when combined understood to mean "one who gives oneself one's ...
, direct feedback from the job, and taking the job as a
pastime
A hobby is considered to be a regular activity that is done for enjoyment, typically during one's leisure time. Hobbies include collecting themed items and objects, engaging in creative and artistic pursuits, playing sports, or pursuing oth ...
. Community-based motivations refer to motivations related to community participation, and include community identification and social contact. In crowdsourced journalism, the motivation factors are intrinsic: the crowd is driven by a possibility to make social impact, contribute to social change, and help their peers.
Extrinsic motivations are broken down into three categories: immediate payoffs, delayed payoffs, and social motivations. Immediate payoffs, through monetary payment, are the immediately received compensations given to those who complete tasks. Delayed payoffs are benefits that can be used to generate future advantages, such as training skills and being noticed by potential employers. Social motivations are the rewards of behaving pro-socially, such as the
altruistic
Altruism is the principle and moral practice of concern for the welfare and/or happiness of other human beings or animals, resulting in a quality of life both material and spiritual. It is a traditional virtue in many cultures and a core asp ...
motivations of
online volunteers. Chandler and Kapelner found that US users of the Amazon Mechanical Turk were more likely to complete a task when told they were going to help researchers identify tumor cells, than when they were not told the purpose of their task. However, of those who completed the task, quality of output did not depend on the framing.
Motivation factors in crowdsourcing are often a mix of intrinsic and extrinsic factors. In a crowdsourced law-making project, the crowd was motivated by both intrinsic and extrinsic factors. Intrinsic motivations included fulfilling civic duty, affecting the law for sociotropic reasons, to deliberate with and learn from peers. Extrinsic motivations included changing the law for financial gain or other benefits. Participation in crowdsourced policy-making was an act of grassroots advocacy, whether to pursue one's own interest or more altruistic goals, such as protecting nature.
Another form of social motivation is prestige or status. The
International Children's Digital Library The International Children's Digital Library Foundation (ICDL) is a free online library of digitized children's books in 59 languages from many countries. It is housed by the International Children's Digital Library Foundation and was originally dev ...
recruited volunteers to translate and review books. Because all translators receive public acknowledgment for their contributions, Kaufman and Schulz cite this as a reputation-based strategy to motivate individuals who want to be associated with institutions that have prestige. The Mechanical Turk uses reputation as a motivator in a different sense, as a form of quality control. Crowdworkers who frequently complete tasks in ways judged to be inadequate can be denied access to future tasks, providing motivation to produce high-quality work.
Despite the potential global reach of IT applications online, recent research illustrates that differences in location affect participation outcomes in IT-mediated crowds.
Limitations and controversies
At least six major topics cover the limitations and controversies about crowdsourcing:
# Impact of crowdsourcing on product quality
# Entrepreneurs contribute less capital themselves
# Increased number of funded ideas
# The value and impact of the work received from the crowd
# The ethical implications of low wages paid to workers
# Trustworthiness and informed decision making
Impact of crowdsourcing on product quality
Crowdsourcing allows anyone to participate, allowing for many unqualified participants and resulting in large quantities of unusable contributions. Companies, or additional crowdworkers, then have to sort through the low-quality contributions. The task of sorting through crowdworkers' contributions, along with the necessary job of managing the crowd, requires companies to hire actual employees, thereby increasing management overhead.
For example, susceptibility to faulty results can be caused by targeted, malicious work efforts. Since crowdworkers completing microtasks are paid per task, a financial incentive often causes workers to complete tasks quickly rather than well. Verifying responses is time-consuming, so employers often depend on having multiple workers complete the same task to correct errors. However, having each task completed multiple times increases time and monetary costs.
Crowdsourcing quality is also impacted by task design. Lukyanenko ''et al.'' argue that, the prevailing practice of modeling crowdsourcing data collection tasks in terms of fixed classes (options), unnecessarily restricts quality. Results demonstrate that information accuracy depends on the classes used to model domains, with participants providing more accurate information when classifying phenomena at a more general level (which is typically less useful to sponsor organizations, hence less common). Further, greater overall accuracy is expected when participants could provide free-form data compared to tasks in which they select from constrained choices.
Just as limiting, oftentimes there is not enough skills or expertise in the crowd to successfully accomplish the desired task. While this scenario does not affect "simple" tasks such as image labeling, it is particularly problematic for more complex tasks, such as engineering design or product validation. A comparison between the evaluation of business models from experts and an anonymous online crowd showed that an anonymous online crowd cannot evaluate business models to the same level as experts. In these cases, it may be difficult or even impossible to find qualified people in the crowd, as their responses represent only a small fraction of the workers compared to consistent, but incorrect crowd members. However, if the task is "intermediate" in its difficulty, estimating crowdworkers' skills and intentions and leveraging them for inferring true responses works well, albeit with an additional computation cost.
Crowdworkers are a nonrandom sample of the population. Many researchers use crowdsourcing to quickly and cheaply conduct studies with larger sample sizes than would be otherwise achievable. However, due to limited access to the Internet, participation in low developed countries is relatively low. Participation in highly developed countries is similarly low, largely because the low amount of pay is not a strong motivation for most users in these countries. These factors lead to a bias in the population pool towards users in medium developed countries, as deemed by the
human development index
The Human Development Index (HDI) is a statistic composite index of life expectancy, education (mean years of schooling completed and expected years of schooling upon entering the education system), and per capita income indicators, whi ...
.
The likelihood that a crowdsourced project will fail due to lack of monetary motivation or too few participants increases over the course of the project. Tasks that are not completed quickly may be forgotten, buried by filters and search procedures. This results in a long-tail power law distribution of completion times. Additionally, low-paying research studies online have higher rates of attrition, with participants not completing the study once started.
Even when tasks are completed, crowdsourcing does not always produce quality results. When
Facebook
Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dustin M ...
began its localization program in 2008, it encountered some criticism for the low quality of its crowdsourced translations.
One of the problems of crowdsourcing products is the lack of interaction between the crowd and the client. Usually little information is known about the final product, and workers rarely interacts with the final client in the process. This can decrease the quality of product as client interaction is considered to be a vital part of the design process.
An additional cause of the decrease in product quality that can result from crowdsourcing is the lack of collaboration tools. In a typical workplace, coworkers are organized in such a way that they can work together and build upon each other's knowledge and ideas. Furthermore, the company often provides employees with the necessary information, procedures, and tools to fulfill their responsibilities. However, in crowdsourcing, crowd-workers are left to depend on their own knowledge and means to complete tasks.
A crowdsourced project is usually expected to be unbiased by incorporating a large population of participants with a diverse background. However, most of the crowdsourcing works are done by people who are paid or directly benefit from the outcome (e.g. most of
open source
Open source is source code that is made freely available for possible modification and redistribution. Products include permission to use the source code, design documents, or content of the product. The open-source model is a decentralized sof ...
projects working on
Linux
Linux ( or ) is a family of open-source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991, by Linus Torvalds. Linux is typically packaged as a Linux distribution, which ...
). In many other cases, the end product is the outcome of a single person's endeavor, who creates the majority of the product, while the crowd only participates in minor details.
Entrepreneurs contribute less capital themselves
To make an idea turn into a reality, the first component needed is capital. Depending on the scope and complexity of the crowdsourced project, the amount of necessary capital can range from a few thousand dollars to hundreds of thousands, if not more. The capital-raising process can take from days to months depending on different variables, including the entrepreneur's network and the amount of initial self-generated capital.
The crowdsourcing process allows entrepreneurs to access a wide range of investors who can take different stakes in the project.
As an effect, crowdsourcing simplifies the capital-raising process and allows entrepreneurs to spend more time on the project itself and reaching milestones rather than dedicating time to get it started. Overall, the simplified access to capital can save time to start projects and potentially increase the efficiency of projects.
Others argue that easier access to capital through a large number of smaller investors can hurt the project and its creators. With a simplified capital-raising process involving more investors with smaller stakes, investors are more risk-seeking because they can take on an investment size with which they are comfortable.
This leads to entrepreneurs losing possible experience convincing investors who are wary of potential risks in investing because they do not depend on one single investor for the survival of their project. Instead of being forced to assess risks and convince large institutional investors on why their project can be successful, wary investors can be replaced by others who are willing to take on the risk.
Some translation companies and translation tool consumers pretend to use crowdsourcing as a means for drastically cutting costs, instead of hiring
professional translators. This situation has been systematically denounced by
IAPTI
The International Association of Professional Translators and Interpreters (IAPTI) is an international professional association of translators and interpreters based in Argentina.
History
Based in Buenos Aires, Argentina, IAPTI was established ...
and other translator organizations.
Increased number of funded ideas
The raw number of ideas that get funded and the quality of the ideas is a large controversy over the issue of crowdsourcing.
Proponents argue that crowdsourcing is beneficial because it allows the formation of startups with niche ideas that would not survive
venture capitalist
Venture capital (often abbreviated as VC) is a form of private equity financing that is provided by venture capital firms or funds to startups, early-stage, and emerging companies that have been deemed to have high growth potential or which hav ...
or
angel
In various theistic religious traditions an angel is a supernatural spiritual being who serves God.
Abrahamic religions often depict angels as benevolent celestial intermediaries between God (or Heaven) and humanity. Other roles include ...
funding, which areoftentimes the primary investors in startups. Many ideas are scrapped in their infancy due to insufficient support and lack of capital, but crowdsourcing allows these ideas to be started if an entrepreneur can find a community to take interest in the project.
Crowdsourcing allows those who would benefit from the project to fund and become a part of it, which is one way for small niche ideas get started. However, when the number of projects grows, the number of failures also increases. Crowdsourcing assists the development of niche and high-risk projects due to a perceived need from a select few who seek the product. With high risk and small target markets, the pool of crowdsourced projects faces a greater possible loss of capital, lower return, and lower levels of success.
Concerns
Because crowdworkers are considered independent contractors rather than employees, they are not guaranteed
minimum wage
A minimum wage is the lowest remuneration that employers can legally pay their employees—the price floor below which employees may not sell their labor. Most countries had introduced minimum wage legislation by the end of the 20th century. Bec ...
. In practice, workers using the Amazon Mechanical Turk generally earn less than the minimum wage. In 2009, it was reported that United States Turk users earned an average of $2.30 per hour for tasks, while users in India earned an average of $1.58 per hour, which is below minimum wage in the United States (but not in India).
In 2018, a survey of 2,676 Amazon Mechanical Turk workers doing 3.8 million tasks found that the median hourly wage was approximately $2 per hour, and only 4% of workers earned more than the federal minimum wage of $7.25 per hour. Some researchers who have considered using Mechanical Turk to get participants for research studies have argued that the wage conditions might be unethical.
[Greg Norcie, 2011, "Ethical and practical considerations for compensation of crowdsourced research participants," ''CHI WS on Ethics Logs and VideoTape: Ethics in Large Scale Trials & User Generated Content,']
, accessed 30 June 2015. However, according to other research, workers on Amazon Mechanical Turk do not feel they are exploited and are ready to participate in crowdsourcing activities in the future. When Facebook began its localization program in 2008, it received criticism for using free labor in crowdsourcing the translation of site guidelines.
Typically, no written contracts, nondisclosure agreements, or employee agreements are made with crowdworkers. For users of the Amazon Mechanical Turk, this means that employers decide whether users' work is acceptable and reserve the right to withhold pay if it does not meet their standards.
Critics say that crowdsourcing arrangements exploit individuals in the crowd, and a call has been made for crowds to organize for their labor rights.
Collaboration between crowd members can also be difficult or even discouraged, especially in the context of competitive crowd sourcing. Crowdsourcing site InnoCentive allows organizations to solicit solutions to scientific and technological problems; only 10.6% of respondents reported working in a team on their submission.
Amazon Mechanical Turk workers collaborated with academics to create a platform, WeAreDynamo.org, that allows them to organize and create campaigns to better their work situation, but unfortunately the site is no longer running. Another platform run by Amazon Mechanical Turk workers and academics, Turkopticon, continues to operate and provides worker reviews on Amazon Mechanical Turk employers.
America Online
AOL (stylized as Aol., formerly a company known as AOL Inc. and originally known as America Online) is an American web portal and online service provider based in New York City. It is a brand marketed by the current incarnation of Yahoo! Inc. ...
settled the case ''Hallissey et al v. America Online, Inc.'' for $15 million in 2009, after unpaid moderators sued to be paid the
minimum wage
A minimum wage is the lowest remuneration that employers can legally pay their employees—the price floor below which employees may not sell their labor. Most countries had introduced minimum wage legislation by the end of the 20th century. Bec ...
as employees under the U.S.
Fair Labor Standards Act
The Fair Labor Standards Act of 1938 (FLSA) is a United States labor law that creates the right to a minimum wage, and "time-and-a-half" overtime pay when people work over forty hours a week. It also prohibits employment of minors in "oppres ...
.
See also
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
Folksonomy
Folksonomy is a classification system in which end users apply public tags to online items, typically to make those items easier for themselves or others to find later. Over time, this can give rise to a classification system based on those tags ...
*
*
*
*
Models of collaborative tagging
A model is an informative representation of an object, person or system. The term originally denoted the plans of a building in late 16th-century English, and derived via French and Italian ultimately from Latin ''modulus'', a measure.
Models c ...
*
*
*
*
*
*
*
*
*
*
*
References
* Reinhold, S., & Dolnicar, S. (2018). How Airbnb creates value. ''Peer-to-Peer Accommodation Networks; Dolnicar, S., Ed'', 39-53.
External links
*
*
{{Authority control
Collaboration