Crowdsourcing
Crowdsourcing is the practice of obtaining work, information, ideas, or judgments from a large group of contributors, often distributed and coordinated through an online platform.
AI-Powered Search
Crowdsourcing is obtaining information, judgments, or work from a large and distributed group of people, often through an online system.
- How it is used
- Improves search relevance by turning distributed human input and behavior into signals about query intent and document quality.
- How deep it goes
- Defines explicit and implicit input, then distinguishes signals boosting, collaborative filtering, and learning to rank.
- Examples
- Uses Mechanical Turk labeling, click logs, customer reviews, sentiment, abuse reports, and web links as crowdsourced evidence.
- What you can do after
- Apply it via search logs and user content to derive relevance signals, boost or penalize documents, and learn recommendations.
The Cloud at Your Service: The when, how, and why of enterprise cloud computing
The practice of obtaining work, information, or judgments from a large group of people, often through an open call.
- How it is used
- Augments software QA with short-burst human testing when automation cannot provide subjective results or perform a check.
- How deep it goes
- Explains practical uses and worker limitations through examples, without technical implementation detail.
- Examples
- Uses a Japan-based site-accessibility check and visual defect checks across website pages and major browsers.
- What you can do after
- Apply it via Amazon Mechanical Turk to obtain human checks of regional accessibility or visual defects.
Also covered in
- Architecture Modernization: Socio-technical alignment of software, strategy, and structure
- Evaluating AI SystemsIn early access (MEAP)
Related concepts
- crowdsourced workeruses · A person who completes tasks obtained through a crowd-based labor arrangement, often through an online platform.
- internal crowdsourcingincludes · Internal crowdsourcing is the collection of ideas or contributions from a broad group of people within an organization.
- ImageNetused by · ImageNet is a large-scale labeled image dataset organized into semantic categories and widely used for visual-recognition research and benchmarking.
Questions about crowdsourcing
What is crowdsourcing?
Crowdsourcing is the practice of obtaining work, information, ideas, or judgments from a large group of contributors, often distributed and coordinated through an online platform.
Which Manning books explain crowdsourcing?
AI-Powered Search and The Cloud at Your Service: The when, how, and why of enterprise cloud computing.
What kinds of crowdsourcing are there?
Kinds of crowdsourcing include internal crowdsourcing and volunteer crowdsourcing.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

