Implementation Guide
Designing the Perfect Binary Prompt
Garbage in, garbage out. The syntax of a good A/B poll.
Rule 1: Mutual Exclusivity
The options presented must not overlap in any logical capacity. If a user can conceptually desire both simultaneously without trade-off, the poll is flawed.
Flawed
What should we improve?
A. Speed
B. Reliability
Correct
If forced to choose, which is worse?
A. A 3-second page load
B. One minute of downtime per week
Rule 2: Symmetry of Effort
Both options should require roughly the same amount of reading comprehension. If Option A is three words and Option B is three sentences, you will introduce a bias toward the shorter option simply due to cognitive laziness.
Rule 3: Avoid Leading Questions
Do not embed the desired outcome within the prompt. "Do you prefer our new, modern interface, or the old, clunky one?" is not a poll; it is marketing copy disguised as research.