liveBook · Manning

Data collection

As explained in Effective Data Analysis

Data collection is the systematic process of gathering, capturing, and recording observations, measurements, or other information for storage or analysis.

Data collection systematically gathers information for analysis. It begins by operationalizing concepts into clear, observable, measurable indicators, then selecting a suitable collection method. section 6.2

Methods may use direct measures, recorded firsthand by a researcher, or indirect measures drawn from existing information such as historical archives. Available organizational data often combines primary systems and third-party applications. section 6.2 section 6.2.3

Evaluate whether collected or available data can measure the behavior of interest by checking:

  • The data source and whether it is primary, third-party, or a curated combination. section 6.2.3
  • The refresh rate and whether stakeholders can rely on hourly, daily, or less frequent updates. section 6.2.3
  • Whether each record represents an object or an action, since objects may provide limited behavioral insight. section 6.2.3
  • Whether changes are tracked, rather than silently editing records in place. section 6.2.3

From records to behavior

A sales transaction, software-use record, support ticket, or user click can represent different levels of activity. A database row recording a doctor’s visit captures a visit record, while a page-view row may combine visitor and page information at a particular aggregation level. section 6.2.3

Figure 6.11 A few simple queries can help determine if there are problems with the quality of your data.
figure

Use simple queries to inspect data quality before treating a dataset as evidence for behavior. section 6.2.3

How Effective Data Analysis covers it

How deep it goes
Defines direct and indirect methods, then gives practical checks for source, refresh, record meaning, change tracking, and quality.
Examples
Uses height, historical archives, sales transactions, software clicks, doctor visits, and page-view records to distinguish measures and record meanings.
What it assumes
Assumes a defined concept and stakeholder-aligned indicators, while teaching how to translate concepts into measurable observations.
What you can do after
Evaluate data sources for behavioral measurement and choose collection methods aligned with measurable indicators.
How it connects
Connects operationalization, measurable indicators, behavioral data, analytics, data quality, and privacy.

Also explained in

Compare how 10 books explain data collection →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Effective Data Analysis. The section links point to the parts of the book it draws on.