liveBook · Manning

Evidence

As explained in Effective Data Analysis

Evidence is information that supports or challenges a hypothesis, theory, or conclusion without making it irrevocable.

Evidence is information that supports a hypothesis or theory without making the conclusion irrevocable. Sound analysis remains open to future information that may contradict earlier findings. section 3.2.3

Experiments and quasi-experimental studies generate evidence by comparing participant groups, documenting subgroup trends, and sometimes examining interaction effects. More granular comparisons can reveal useful patterns but increase the risk of Type 1 errors. section 3.2.3

Use evidence responsibly by:

  • Distinguishing support for a claim from proof treated as an unchangeable rule. section 3.2.3
  • Choosing collection and analysis methods that allow conclusions to be revised when new information appears. section 3.2.3
  • Communicating uncertainty carefully because workplace language reflects and shapes data-informed culture. section 3.2.3
Figure 3.9 Quasi-experiments have a similar design to controlled experiments without random group assignment.
figure

Compare quasi-experimental designs with controlled experiments to see how evidence can be gathered without random group assignment. section 3.2.3

How Effective Data Analysis covers it

How deep it goes
Defines evidence against proof and discusses subgroup comparisons, interaction effects, and Type 1 error risk without detailing analysis procedures.
Examples
Uses subscription renewal, tutoring outcomes, website engagement, subgroup trends, and quasi-experimental group assignment as examples.
What it assumes
Assumes familiarity with hypotheses and participant groups while clarifying the evidence–proof distinction from first principles.
What you can do after
Evaluate/understand claims without treating supporting data as irrevocable proof.
How it connects
Connects evidence with hypotheses, theories, experiments, quasi-experiments, randomized controlled trials, subgroup analysis, and Type 1 errors.

Also explained in

Compare how 4 books explain evidence →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Effective Data Analysis. The section links point to the parts of the book it draws on.