本文へスキップ
Pumati開発者ドキュメント
Language / 言語: 日本語
ログイン

このページはまだ日本語に対応していないため、英語で表示しています。

Guides

quick-comparison.md

Quick comparison

Use a quick comparison for small decisions: a color, a button label, an icon. Each tester picks one of 2 to 4 images and writes a one-line reason, in about 30 seconds. No install needed.

Create and publish

  1. create_comparison with the question, the images as base64 (PNG, JPEG or WebP, up to 5 MB and 4096 px a side), how many responses you want and when it ends. Labels are yours; testers never see them.
  2. publish_test with the returned mission_id and draft_revision. Each response costs 2 credits.
  3. get_test later: comparison holds the split per option, per language and per country, and every reason.

How answers stay fair

  • Each tester sees the options in their own random order, labelled only by position.
  • Nobody sees results before answering.
  • A reason is required. Empty, unrelated or copied reasons earn no reward.

Too close to call

indeterminate is true when there are fewer than 20 responses, the top options tie, or the leader is not significantly ahead of the runner-up (two-sided exact binomial test on the top two options' answers, p > 0.05). Then don't treat the leader as a decision: ask more people or change the options.