Skip to main content

Testing more than two options

What's the difference between a Ranked poll and a Head-to-head (H2H) poll? Which is right for me?

Updated over 3 weeks ago

Choose the right poll format when comparing 3-8 options to get actionable insights.

Summary

PickFu offers four poll types for testing 3-8 options: Single Select, Multi Select, Ranked, and Round Robin.

When to use / prerequisites

  • Use when you have 3-8 options to test

  • Available on all PickFu plans

  • Consider your research goal before choosing poll type

Poll types for multiple options

Single Select (For factual/binary choices)

Best for: Questions with only one logical answer (e.g., "How many kids do you have?")

How it works: Respondents choose only their top choice and explain why

Sample size: 50+ respondents recommended

  1. Select Single Select as your poll type

  2. Upload 3-8 options (images, text, or combinations)

  3. Write a clear question (e.g., "Which book cover would make you most likely to buy?")

  4. Set your audience and launch

Single Select is designed for questions with only one logical answer. For creative decisions across multiple appealing options, use Ranked polls instead—Single Select may not surface a clear winner when testing subjective preferences.

Multi Select (For understanding broad appeal)

Best for: Understanding which options have appeal (respondents can select multiple)

How it works: Respondents select all options that appeal to them

Sample size: 50+ respondents recommended

  1. Select Multi Select as your poll type

  2. Upload 3-8 options

  3. Write a question encouraging multiple selections (e.g., "Which features would you use?")

  4. Review results to see appeal percentages

Sort Multi Select results by selection count and scan comments for recurring pairings. If many respondents select the same options together, that reveals natural bundle opportunities for packaging or messaging.

Ranked (Recommended for finding a winner)

Best for: Finding the most preferred option using instant runoff tallying

How it works: Respondents rank all options from best to worst; PickFu determines the winner through instant runoff voting

Sample size: 100+ respondents recommended for reliable ranking

  1. Select Ranked as your poll type

  2. Upload 3-8 options

  3. Ask respondents to rank by preference

  4. Get weighted ranking results

Ranked polls deliver a majority-backed winner through instant runoff voting, even when no option receives 50%+ first-place votes initially. This makes it the most reliable format for identifying a true champion across multiple options.

Round Robin (For comprehensive comparison)

Best for: Understanding how each option performs against every other option in direct comparisons

How it works: Creates all possible pairwise comparisons (A vs B, B vs C, A vs C, etc.) and determines winners through head-to-head matchups

Sample size: 50+ respondents recommended per matchup

  1. Select Round Robin as your poll type

  2. Upload 3-8 options

  3. PickFu automatically creates all pairwise combinations

  4. Review head-to-head results and overall winner

With 5 options, a Round Robin poll creates 10 unique matchups (A vs. B, A vs. C, A vs. D, A vs. E, B vs. C, B vs. D, B vs. E, C vs. D, C vs. E, D vs. E). Each matchup generates detailed feedback, making this the most comprehensive—but also most expensive and time-intensive—format available.

Using Image Sets

For complex visual testing

If your options require multiple images each (like product photo sets), use our Image Sets feature:

  1. Select Single Select, Multi Select, Ranked, or Round Robin poll type

  2. Choose "Image Set" when adding options

  3. Upload up to 9 images per option (1 main + up to 8 supporting images)

  4. Respondents can navigate through each image set

Image Sets work with Single Select, Multi Select, Ranked, and Round Robin poll types. They're included in standard poll pricing with no additional fees.

Avoid creating collages by combining multiple images in Photoshop or Canva. Use Image Sets instead for cleaner, more professional presentation with zoom functionality and better mobile experience.

For complete details, see Testing image sets with PickFu.

Using Mockups

For listing and search result testing

For testing how products appear in marketplaces, use our Mockups feature:

SERP View (Search Results):

  • Products shown in grid format replicating Amazon search results

  • Test how your listing performs in competitive search context

  • Ideal for Amazon search result optimization and CTR testing

Listing View (Individual Products):

  • Products shown as individual cards with listing details

  • Test standalone listing appeal and conversion optimization

  • Perfect for individual product page testing

Choose SERP view when testing click-through appeal in search results. Choose Listing view when optimizing individual product page conversion without position bias.

For complete mockup workflows, see:

Choosing the right approach

Your goal

Recommended poll type

Sample size

Find the most preferred winner

Ranked (instant runoff tallying)

100+

Factual/binary questions

Single Select

50+

See which have broad appeal

Multi Select

50+

Comprehensive pairwise comparison

Round Robin

50+ per matchup

Test complex visual products

Single Select/Multi Select/Ranked/Round Robin + Image Sets

50-100+

Test marketplace listings

Any type + Mockups (SERP or Listing view)

50-100+

Troubleshooting / FAQs

Should I use Single Select or Ranked?

Use Single Select only for factual questions where only one logical answer exists—like age brackets, household size, or subscription status. When testing subjective preferences (book covers, designs, headlines), Single Select votes often split evenly across options without revealing a true winner.

Use Ranked for creative decisions where you need a clear winner. Ranked polls use instant runoff voting to ensure the winning option would beat all others in head-to-head comparisons, even when votes are split across many appealing choices.

What happened to Head-to-Head for multiple options?

Head-to-Head polls are designed for exactly 2 options only. For 3+ options with comprehensive pairwise comparisons, use Round Robin, which runs every possible head-to-head matchup (A vs. B, A vs. C, B vs. C, etc.) to deliver exhaustive competitive analysis.

For most use cases testing 3-8 options, Ranked polls deliver comparable winner identification at lower cost and faster turnaround than Round Robin.

Can I test more than 8 options?

Current poll types support up to 8 options. For more options, consider:

  • Narrow down first: Run an internal review to eliminate obvious weak candidates before testing the top 8

  • Run multiple polls: Split options into groups, identify winners from each group, then run a final poll comparing the finalists

  • Test in phases: Start with a Multi Select poll to identify broad appeal, then run a Ranked poll on the top performers

When should I use Image Sets vs. single images?

Use Image Sets when each option requires multiple angles, contexts, or variations to properly evaluate—like product photography with lifestyle shots, detail views, and infographics, or app interface flows showing multiple screens.

Use single images when testing a single visual element—like a main product image, logo variation, book cover, or hero banner.

You can mix both formats in one poll if some options need image stacks while others only need single images.

How do I avoid the collage workaround?

Don't create collages in design tools! Use the Image Sets feature instead, which:

  • Presents multiple images cleanly and professionally

  • Provides navigation arrows and zoom controls for respondents

  • Saves you design time

  • Delivers a better mobile experience

  • Keeps images high-resolution and independently viewable

Only create collages when you need feedback on a single composed layout—like a magazine spread or packaging flat where the unified composition itself is what you're testing.

For detailed guidance, see How to test sets of images using collages.

Related resources

Did this answer your question?