# Quick comparison

> Ask testers to pick one of 2 to 4 mockups with a one-line reason, then read the split by option, language and country.

Use a quick comparison for small decisions: a color, a button label, an icon. Each tester picks one of 2 to 4 images and writes a one-line reason, in about 30 seconds. No install needed.

## Create and publish

1. `create_comparison` with the question, the images as base64 (PNG, JPEG or WebP, up to 5 MB and 4096 px a side), how many `responses` you want and when it ends. Labels are yours; testers never see them.
2. `publish_test` with the returned `mission_id` and `draft_revision`. Each response costs 2 credits.
3. `get_test` later: `comparison` holds the split per option, per language and per country, and every reason.

## How answers stay fair

- Each tester sees the options in their own random order, labelled only by position.
- Nobody sees results before answering.
- A reason is required. Empty, unrelated or copied reasons earn no reward.

## Too close to call

`indeterminate` is true when there are fewer than 20 responses, the top options tie, or the leader is not significantly ahead of the runner-up (two-sided exact binomial test on the top two options' answers, p > 0.05). Then don't treat the leader as a decision: ask more people or change the options.

> **Unreleased designs**
>
> Images are stored privately, metadata is stripped and only your app and its testers can open them, but outside people do see them. Don't upload anything that must stay secret.