Click-through rate
Click-through rate is the proportion of impressions or opportunities to display an item that result in a click on that item.
Experimentation for Engineers
Click-through rate is the proportion of opportunities in which users click a presented item, such as an advertisement or article.
- How it is used
- Measures ad-serving quality and revenue-relevant performance while comparing click models.
- How deep it goes
- Defines CTR from binary outcomes, works through standard error and bootstrap uncertainty, and applies it to bandit selection.
- Examples
- Uses simulated click models at CTRs 0.0050 and 0.0070, ten binary click observations, and bootstrap resamples.
- What you can do after
- Evaluate/understand CTR comparisons, uncertainty, and live selection trade-offs among competing click models.
Read how Experimentation for Engineers explains click-through rate →
Machine Learning System Design
The proportion of users who click a displayed search result or other presented link.
- How it is used
- Uses clicks as a live behavioral signal for search ranking and as a proxy for slower purchase outcomes.
- How deep it goes
- Explains definition, online measurement, proxy reasoning, metric hierarchy, and experimentation benefits without detailing CTR calculation.
- Examples
- Uses search-result clicks, image purchases, and comparisons with mean reciprocal rank and normalized discounted cumulative gain.
- What you can do after
- Evaluate live search behavior and apply CTR as a faster proxy when purchase labels are sparse.
Read how Machine Learning System Design explains click-through rate →
The Art of AI Product Development
Click-through rate is the proportion of users or impressions that result in a click on a presented link, recommendation, or control.
- How it is used
- Evaluates whether recommendations or search results attract enough clicks to support ongoing product optimization.
- How deep it goes
- Explains CTR as a monitoring signal and connects it to testing, relevance diagnosis, conversions, and engagement, but does not derive its calculation.
- Examples
- Uses product recommendations, ranked search results, repeated feature-comparison queries, and comparisons of filtering strategies as examples.
- What you can do after
- Evaluate recommendation and search performance, diagnose relevance problems, and compare changes using clicks alongside stronger outcome and engagement measures.
Read how The Art of AI Product Development explains click-through rate →
AI-Powered Search
Click-through rate is the number of clicks received by a displayed result divided by the number of times that result was displayed.
- How it is used
- Uses observed search clicks to create initial relevance judgments for learning to rank.
- How deep it goes
- Defines the ratio, works through document aggregation, and diagnoses position bias before deferring to a corrective click model.
- Examples
- Uses session records, the query “transformers dark of the moon,” document-level CTRs, and CTR values grouped by rank.
- What you can do after
- Apply it via Python to calculate document CTRs and identify why raw click rates can misrepresent relevance.
AI Model Evaluation
Click-through rate is the proportion of users or impressions that result in a click on a presented item or recommendation.
- How it is used
- Uses CTR as a user-engagement metric in A/B tests that evaluate recommendation latency and product behavior.
- How deep it goes
- Defines CTR and applies it in a segmented latency experiment, but stops short of formal estimation or statistical testing.
- Examples
- Uses a movie recommendation page, device-segmented latency variants, and mobile results ranging from 23.5% to 8.7% CTR.
- What you can do after
- Evaluate recommendation engagement through CTR while checking latency, downstream consumption, and longer-term satisfaction.
Also covered in
- Applied Reinforcement LearningIn early access (MEAP)
- Hidden InfluencesIn early access (MEAP)
- First-Party Data Activation
- Financial AI in Practice
What to know first
- metricA metric is a quantitative measure that assigns values to a property or outcome so it can be assessed, compared, or monitored.
- relevanceRelevance is the degree to which information, a result, or a response pertains to a query, task, purpose, or information need.
- conversionConversion rate is the proportion of eligible users, interactions, or opportunities that complete a specified desired action or transition.
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
Related concepts
- aggregate metrickind of · An aggregate metric is a numerical summary that combines measurements collected across multiple events, requests, components, or operations.
- click modelused by · A click model is a predictive model of the likelihood that a user clicks a particular result, advertisement, or other presented item.
- study designmeasured by · Study design is the planned arrangement of procedures, conditions, measurements, and comparisons for investigating a question and supporting valid conclusions.
- metrickind of · A metric is a quantitative measure that assigns values to a property or outcome so it can be assessed, compared, or monitored.
- diversitycontrasts with · Diversity is the degree of variation among members of a set or population in characteristics relevant to that set or population.
Questions about click-through rate
What is click-through rate?
Click-through rate is the proportion of impressions or opportunities to display an item that result in a click on that item.
Which Manning books explain click-through rate?
Experimentation for Engineers, Machine Learning System Design, The Art of AI Product Development, AI-Powered Search and AI Model Evaluation.
What should I know before learning click-through rate?
Manning books that teach click-through rate usually introduce metric, relevance, conversion and language model first.
What is the difference between click-through rate and diversity?
Click-through rate is the proportion of impressions or opportunities to display an item that result in a click on that item. Diversity is the degree of variation among members of a set or population in characteristics relevant to that set or population.
What is click-through rate a kind of?
Click-through rate is a kind of aggregate metric. An aggregate metric is a numerical summary that combines measurements collected across multiple events, requests, components, or operations.
What is click-through rate also called?
Click-through rate is also called CTR.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.




