Round-robin image comparison
Respondents see pairs of your images side-by-side and pick a favorite. Membrane generates every unique pair — a clean way to surface a clear winner from a small set.
When to use it
Round-robin is the right format when you have a small set of options and want a decisive outcome. It's especially good when every option is “pretty good” — forcing a pairwise pick surfaces preferences that a yes/no vote would miss.
Pick a winner
Reveal subtle preferences
Small, focused comparisons
Images go from your browser, not the AI
The AI generates a private upload link, you drop your images on the page, then come back and tell it you're done.
- Step 1AI sends you an upload linkDescribe the campaign and the AI generates a private upload page for you.
- Step 2You upload your imagesOpen the link, drag files onto the page, and click “Done — Return to chat” when it's all up.
- Step 3You tell the AI you're doneBack in chat, say “uploaded”. The AI verifies and creates the campaign.
What you'll need
- At least 2 images — PNG, JPEG, or WebP, up to 10 MB each. Most comparisons use 3–6.
- A campaign title and description, plus a short tagline and category label.
- The comparison questionrespondents will see above each pair (e.g., “Which feels more premium?”).
- A reward amount — positive number.
- A landing-page link.
The pair count grows fast
With N images, respondents see N × (N − 1) ÷ 2 unique pairs. A set of 5 is still quick; a set of 10 is a longer ask.
| Images | Unique pairs | Feels like |
|---|---|---|
| 3 | 3 pairs | Quick — under a minute for most respondents |
| 4 | 6 pairs | Comfortable — the sweet spot for most tests |
| 5 | 10 pairs | Still fast — about 2 minutes |
| 6 | 15 pairs | Noticeably longer; consider higher reward |
| 8 | 28 pairs | Getting tiring — use only when decisive data is worth it |
| 10 | 45 pairs | Long. Split into two round-robins if possible |
Rule of thumb: keep it to 6 or fewer images. If you have more, split the set into two rounds or switch to a binary (Yes/No) survey.
Describe the comparison. Upload. Go live.
- I want to run a pairwise comparison on our four new packaging designs. Call it “Spring packaging — head to head”. Question: “Which feels more premium?” Category: packaging. Reward: 75.
- Got it. Here's your upload link — drop your four images there and name them if you want (e.g., Matte Black, Glossy White). Let me know once you're done.https://mcp.nfthing.com/upload?session=…
- Done — uploaded all four.
- Confirmed. With 4 images, respondents will see 6 unique pairs. Creating the campaign now. Start it live, or hold for review?
- Start it live.
- Spring packaging — head to head is live. Ask me for a winner summary anytime.
Give each image a readable name on the upload page.
On the upload page, type a short name into the field next to each image (e.g., 'Matte black', 'Glossy white'). These names appear in your results report, so you can see exactly which option won.
Copy, paste, and tweak
“Set up a round-robin comparison called 'New video thumbnail'. Question: 'Which one makes you want to click?'. Category: content. Reward: 30. Give me the upload link — I have four options to upload.”
“Run a round-robin on our five candidate packaging designs. Call it 'Packaging finalists'. Ask: 'Which feels more premium?'. Category: packaging. Reward: 75. After I upload, turn it on.”
“Compare three ad creatives for our app launch. Question: 'Which would you tap?'. Category: mobile apps. Reward: 40. Campaign name: 'App launch — creative test'. Send me the upload link.”
“My 'Packaging finalists' round-robin has been live for two days. Which design is winning, and what's the margin between the top two?”
A few things worth knowing
Pair count scales quadratically
Live instantly after creation
Name your images
Pairs are randomized per respondent
- Only one image uploaded — round-robin needs at least two. Upload at least one more and retry.
- Upload link expired — ask the AI for a fresh link (one-hour window).
- File type not supported — PNG, JPEG, or WebP only. Convert and retry.
