Dichotomous Survey Questions: 32 Examples That Measure Well

Key Takeaways

• A yes/no question can recover data a checklist loses. Pew Research Center ran the same items two ways and found endorsement roughly 8 percentage points higher when each option was asked as its own forced-choice question instead of as a select-all-that-apply list.
• The format is not the problem, the framing is. Agree/disagree items are the version of the two-option question that measures badly, because they invite agreement regardless of content. Item-specific wording fixes most of it.
• Two options are only honest when there are genuinely two. Most bad yes/no questions are questions with a hidden third answer, and the respondents who needed that third answer are the ones who abandon the survey.
• Your consent checkbox is a dichotomous question with legal weight. Under GDPR it has to be an unticked, affirmative, separate yes. That single item is the one where getting the format wrong costs more than bad data.

Ask ten survey guides about yes/no questions and nine will tell you they flatten nuance and you should use a scale. The measurement research says something more specific and more useful: it depends entirely on what job the question is doing. When the job is establishing a fact, a forced yes/no beats a checklist by a measurable margin. When the job is capturing an attitude, a two-option question is usually the wrong instrument. The examples below are sorted by job, so you can tell which one you have.

What makes a question dichotomous

A dichotomous question offers exactly two mutually exclusive answers. Yes/no, true/false, agree/disagree, male/female, did/did not.

The dividing line matters more than the definition. Add "not sure" or "prefer not to say" and the question stops being dichotomous in the statistical sense, because you now have a three-category variable and any analysis assuming a binary breaks. That is not a reason to leave the option out, it is a reason to decide deliberately, because the third option changes your data structure and your response rate together.

Three formats get lumped together as dichotomous and behave very differently:

• Factual binaries ("Did you receive a confirmation email?") measure something that happened. These are the strongest use of the format.
• Behavioural binaries ("Have you used the client portal in the last 30 days?") measure recall, so accuracy decays with the length of the recall window.
• Attitudinal binaries ("Do you agree the onboarding was clear?") ask someone to compress a position into a switch. These are the weakest, and the next section explains why.

32 dichotomous survey question examples

Each group below is a different job. Copy the wording, not the format, because the wording is doing the work.

Screening and eligibility

Screeners are the clearest case for a binary. You are not measuring an attitude, you are deciding which branch of the survey someone sees, and a scale would give you nothing to branch on.

• Are you currently employed full-time?
• Have you purchased from us in the past 12 months?
• Do you have decision-making authority over software purchases at your company?
• Are you responsible for scheduling appointments for other people?
• Do you live in the European Union?
• Have you completed onboarding with your account manager?

Keep screeners at the top and keep them short. The same qualification logic drives the binaries in our discovery call script and questions template. In an 80-comment thread in r/SampleSize on what makes people quit a survey mid-way, the pattern respondents describe most is being screened out after investing several minutes. If a binary can disqualify someone, ask it first.

Facts and behaviour

This is where the Pew finding applies directly. Ask each item as its own yes/no and you get more accurate reporting than folding them into a checklist.

• Did you receive a booking confirmation email?
• Did your appointment start within five minutes of the scheduled time?
• Have you rescheduled an appointment with us in the last three months?
• Did you use a mobile device to book?
• Did anyone follow up with you after the meeting?
• Have you contacted support about this issue before?
• Did you attend the meeting you booked?

Every one of these has a verifiable answer, which is the test. If answering requires forming an opinion, the item belongs elsewhere in your survey.

Consent and permission

These carry legal consequences rather than just methodological ones, which is why they get their own section further down.

• May we contact you by email about your booking?
• Do you consent to this session being recorded?
• Would you like to receive our monthly newsletter?
• May we share your feedback publicly with your first name attached?
• Do you consent to your responses being processed for research purposes?

Post-appointment and client feedback

Two options work here when you are checking whether something happened, and stop working when you are asking how good it was. Split those apart rather than blending them. The same discipline shapes the questions in our guide to running client feedback surveys after a project closes.

• Was the meeting link easy to find?
• Did the agenda match what was discussed?
• Were your questions answered during the call?
• Would you book with this consultant again?
• Did you have to enter the same information twice?
• Was the appointment reminder useful?

"Would you book again?" is the only attitudinal item in that list, and it earns its place because the underlying decision genuinely is binary. You either rebook or you do not.

Employee and internal surveys

Internal surveys are where binaries do the most damage, because a workforce that answers yes to everything is the workforce that has learned not to answer honestly. Use these for facts, and open questions for reasons.

• Have you had a one-to-one with your manager in the past month?
• Do you know who to contact when a client escalates?
• Have you completed the required security training?
• Do you have the equipment you need to do your job remotely?

Product and pricing research

• Have you evaluated any alternative to this tool in the last six months?
• Would you pay for this feature as a separate add-on?
• Did anything block you from completing setup?
• Have you recommended this product to a colleague?

Pair these with an open follow-up. A yes/no tells you the size of a problem, never its shape, which is why we treat binaries and open-ended survey questions as a pair rather than a choice. The same logic runs through our guide to customer research surveys, where binaries size a segment and open text explains it.

When a yes/no question beats a rating scale

Pew Research Center tested this directly. In a randomised experiment with 4,581 US adults fielded 30 July to 12 August 2018, respondents reported whether they or a family member had experienced a set of undesirable events. Half saw a select-all-that-apply checklist. Half saw each item as its own forced-choice yes/no question.

The forced-choice version produced consistently higher reporting, averaging around 8 percentage points. Being denied health insurance came back at 19% asked individually against 13% on the checklist. Being overcharged by a mechanic came back at 52% against 36%. Pew's archival analysis across 21 surveys also found the checklist carried a 3-point primacy effect, where items near the top were picked more often simply for sitting there, while the forced-choice format showed none.

Pew now uses forced choice instead of select-all in its online surveys as a matter of policy.

The mechanism is unglamorous. A checklist lets a respondent stop reading once they have ticked enough boxes to feel done, while a yes/no per item makes them consider each one. It costs screens and scrolling, and buys real data.

So the rule is not "avoid binaries." It is closer to: replace your checklists with binaries, and your attitudinal binaries with scales.

Three ways dichotomous questions go wrong

Acquiescence

People agree. Presented with a statement and an agree/disagree switch, a measurable share will pick agree regardless of what the statement says, and Pew notes the tendency is stronger among less educated and less informed respondents and stronger again when an interviewer is present.

Saris, Revilla, Krosnick and Shaeffer tested this against the alternative in Survey Research Methods in 2010, combining random assignment with a multitrait-multimethod design. Agree/disagree items showed substantially lower data quality than comparable questions offering item-specific response options.

The fix is mechanical. Stop asking whether people agree with a statement and ask them the thing directly.

The hidden third answer

"Did the appointment start on time?" has a third answer for anyone whose appointment was cancelled. "Would you pay for this feature?" has a third answer for anyone who has not understood what the feature does yet. Forcing those respondents into yes or no does not produce a decisive answer, it produces a wrong one, and the confident-looking percentage you report afterwards is built on it.

Either add the escape option and accept a three-category variable, or add a screener that stops the question from reaching people it does not apply to.

Double-barrelled binaries

"Was the booking process fast and easy?" is two questions wearing one coat. A respondent for whom it was fast but confusing has no valid answer. Any question containing "and" or "or" between two attributes needs splitting before it ships.

How to rewrite a bad yes/no question

The rewrite is usually the same three moves: name the specific thing, remove the agreement frame, and check what a "no" would actually mean.

Then run one check on every rewrite: read the "no" out loud and ask what you would do differently if 30% of respondents chose it. If the answer is nothing, cut the question.

Consent: the dichotomous question with legal consequences

Every form ends with a checkbox, and that checkbox is a dichotomous question carrying a compliance requirement rather than a methodological one.

GDPR Recital 32 is explicit that silence, pre-ticked boxes and inactivity do not constitute consent. The Court of Justice of the European Union confirmed the point in Case C-673/17, the Planet49 judgment, and the EDPB's Guidelines 05/2020 on consent restate it: consent requires a clear affirmative act, unbundled from your general terms.

Three practical consequences for the way you build the item:

• The box ships unticked. Default-yes is not a shortcut, it is an invalid record.
• Separate purposes get separate boxes. One consent covering the appointment, the newsletter and a research panel is not specific enough to be valid for any of them.
• Store the answer with a timestamp and the exact wording shown, because consent you cannot evidence is consent you do not have.

If you are working out where consent sits against the rest of your obligations, our overview of GDPR compliance strategies covers the wider ground.

What respondents complain about

The methodology literature and the people filling in your forms flag different things, and both are worth reading.

In a 30-comment r/UXResearch thread on badly written survey questions, the recurring complaint is questions that assume the respondent's situation, which is the hidden-third-answer problem showing up in the wild rather than in a journal.

A 40-comment r/ProlificAc thread started by a professor asking what to tell students who field surveys collects advice from people who fill in surveys for a living, and it skews toward wording clarity and respecting the respondent's time over anything statistical.

There is also an analysis cost nobody warns you about. A thread in r/research about untangling one question with eight yes/no parts in SPSS is the standard outcome of shipping a check-all-that-apply grid and discovering each tick has become its own variable. Ask them as separate binaries and the data arrives in the shape you needed.

Two more mistakes worth naming, because they are common and quiet:

• Binaries that cannot change a decision. If neither answer leads to a different action, the question is costing you completion rate for nothing.
• No segmentation data. A 62% yes is not actionable until you know which segment it came from. Threads on survey mistakes in r/smallbusiness put this alongside biased wording as the failure small teams repeat most.

Where these questions live in your form

A yes/no question is the cleanest branch condition you can build, which is why the format survives despite everything above. One binary answer can decide which of two paths the respondent takes next, and a scale cannot do that without you inventing a threshold.

meetergo treats forms and scheduling as one flow rather than two products, which matters here because the answer to a screening binary usually needs to do something. Its routing forms carry 25+ field types including a native yes/no field, and conditional logic with EQUALS, CONTAINS, BLANK and GREATER THAN operators that shows or hides later fields based on earlier answers. A qualified lead can be routed straight to the right team member's calendar, so the screening question ends in a booked meeting instead of a spreadsheet row.

Two caveats before you plan around it. Smart routing through Funnels sits on the Premium tier at €49.90/month rather than the €29.90 Suite plan, so a solo consultant running a simple feedback form will not need it. And this is a scheduling and pipeline tool with survey capability attached, not a research platform, so weighting, quota management and significance testing on a panel study belong somewhere else. For simpler builds the survey tool and the forms app cover most feedback work, and invitee questions attach a binary screener directly to a booking page.

Data stays under EU law throughout, with servers in Europe and no US corporate parent, which matters when your form collects consent as well as opinions.

Build a form with yes/no routing on meetergo's free plan

Frequently asked questions

What is a dichotomous question in simple terms?

A question with exactly two possible answers that cannot both be true. Yes/no is the most common form, followed by true/false and did/did not. Adding "not sure" makes it a three-option question, which changes how you analyse it.

Are dichotomous questions qualitative or quantitative?

Quantitative. Each answer becomes a binary variable, usually coded 1 and 0, and the result is reported as a proportion. That is also why they are cheap to analyse compared with free text.

How many yes/no questions should a survey have?

Fewer than you are tempted to write. Use them for screening, facts and consent, then switch to scales for attitudes and open questions for reasons. A survey made entirely of binaries tends to produce agreeable, unusable data.

Is a dichotomous question the same as a closed-ended question?

No. Every dichotomous question is closed-ended, but closed-ended also covers multiple choice, rating scales and ranking. Dichotomous is the narrowest case, with the option count fixed at two.

Why do surveys still use agree/disagree if it measures badly?

Because it is fast to write and looks consistent down a page. The 2010 Survey Research Methods study found item-specific options produce better data, but rewriting a battery of agree/disagree items takes work a template does not.

Can I turn a rating scale into a dichotomous variable afterwards?

You can, and people do it constantly by collapsing a 1 to 10 scale into promoters and everyone else. Collect the full scale and collapse at analysis time rather than the reverse, because you cannot recover detail you never asked for.

What is the best question type for measuring satisfaction?

A scale, not a binary. Satisfaction sits on a continuum, and forcing it into two options discards the difference between mild irritation and genuine anger. Our comparison of market survey methods covers where each instrument fits.