Preference Test

A preference test shows people two to six designs, asks which they prefer, and records why.

Showing examplePre-filled with two booking-page designs and a question, so you can try everything first.

Set up your test

Study title

Your designs2

Two to six images. People see them in a random order.

Design A

PNG, JPG or WebP, or drag it here

Design B

PNG, JPG or WebP, or drag it here

Main question

Options

Participant journey

Optional. Empty boxes use the wording shown.

Shown first, on the start screen.

Shown under the welcome message, before the first step.

Questions before the study

Up to 3. Asked before the task. Don't ask for names or emails unless you need them; participants are told what's collected.

Ready to share2 designs

Questions

Frequently asked questions

What's a preference test?

A preference test shows people two to six versions of a design and asks which one they prefer for a specific reason, such as which makes it clearer how to book. It is a quick way to settle a design argument with evidence from the people who will use the thing.

How many responses do I need?

The tool will not call a winner under 20 responses, because a handful of votes can swing either way by chance. With 20 or more it shows a p-value hint: an exact binomial test for two designs and a chi-square test for three. Treat it as a hint, not proof, because your participants are self-selected.

Does the order of the designs bias the result?

Each participant sees the designs in a random order, and the tool records the order they saw, so position bias (people favouring the first or left-hand option) is spread across the designs instead of favouring one. Results are always counted against the original A, B and C.

What should I ask?

One specific, answerable question beats "which do you prefer?". Try "which makes it clearer how to book?" or "which would you trust with your payment details?". The optional follow-up (why did you choose it?) is where the useful detail comes from, so read the reasons, not just the percentages.

What images work best?

Screenshots or mockups of the same screen at the same size, so the only difference is the thing you are testing. Upload PNG, JPG or WebP (they are resized for you), or paste a link to an image that is already hosted. Participants can tap any design to see it full size.

When is a preference test the wrong tool?

It tells you which design people pick and what they say about it, not whether the design works. Pair it with a first-click or task-based test before you ship, and remember there is no participant panel here, so you recruit your own.