liveBook · Manning

Double-barreled question

As explained in Effective Data Analysis

A double-barreled question or statement combines two distinct issues in a single survey item, making a single response ambiguous.

A double-barreled question combines two distinct concepts in one survey item, making a single response ambiguous and difficult to interpret accurately. section 6.2.2

In analytics, this wording weakens self-report measures because respondents may agree with one part but not the other. Separate questions produce interpretable answers for each concept. section 6.2.2 section 6.4

Identify and revise the pattern by:

  • Checking whether the item asks about more than one distinct concept. section 6.2.2
  • Splitting the item so respondents can rate each concept separately. section 6.2.2
  • Using clear, neutral wording so ambiguity or leading language does not add further response bias. section 6.2.2 section 6.4

Software feedback item

“Do you agree that the software’s user interface is intuitive and the customer support team is helpful?” combines interface usability with support quality. Replace it with separate questions about how intuitive the software is and how helpful the support team is. section 6.2.2

Figure 6.7 How do you think the wording of these questions might affect the responses you receive?
figure

Use the figure to examine how question wording can affect the responses collected. section 6.2.2

How Effective Data Analysis covers it

How deep it goes
Defines the pattern, explains its ambiguity, and demonstrates revision through a software-feedback example.
Examples
Uses a software item combining interface intuitiveness with customer-support helpfulness, then separates the two ratings.
What it assumes
Assumes basic familiarity with questionnaires or surveys and teaches the ambiguity problem through examples.
What you can do after
Evaluate survey items and rewrite combined questions as separate, interpretable measures.
How it connects
Connects to self-report measures, survey design, response bias, reliability, and validity.

This explainer was generated by Manning's knowledge graph from the text of Effective Data Analysis. The section links point to the parts of the book it draws on.