Skip to main content

Asking testers for their top picks with ranking and selection limits

Limit a ranking question to a top N, switch it to tap to rank instead of dragging, and cap how many answers a multiple choice question accepts.

Sometimes you do not need testers to rank every option, only their top few. A ranking question can be limited to a top N, so "rank your top 3 of these 10 features" is one question rather than a long drag exercise. Ranking questions can also switch from dragging to a tap to rank mode, and multiple choice questions can cap how many answers a tester may select.

These settings exist because long lists produce weak data. Asked to order ten features, most testers place the first three or four deliberately and then guess. A top 3 limit collects only the choices they actually thought about. Tap to rank is worth turning on for tests where people answer on a phone, since tapping in order is far easier than dragging on a small screen. A selection cap on multiple choice does the same job for "pick your three most important" style questions, where an uncapped list invites people to tick everything.

How to limit a ranking question to a top N

  1. Open your test and go to the survey builder for the survey you want to edit.

  2. Add a Ranking question, or find an existing one, and enter your answer options.

  3. Click the gear icon at the top right of the question.

  4. Check Rank top N only. An N dropdown appears on the same row, set to 3 by default.

  5. Pick your N. You can choose any number from 1 up to one less than the number of answer options.

Testers see the full list with a line after position N reading "Only answers above this line count", and helper text asking them to drag their top N to the top of the list. Only the answers above the line are saved.

How to switch a ranking question to tap to rank

  1. Click the gear icon at the top right of the ranking question.

  2. Check Tap to rank (no dragging).

Instead of dragging, testers tap their picks in order of importance. Each tap adds a numbered badge and a counter shows their progress, for example "2 of 3". Tapping a selected answer removes it and renumbers the rest.

Tap to rank works with or without Rank top N only. Without a limit, testers tap through the whole list to rank every option.

How to limit selections on a multiple choice question

  1. On a Multiple Choice question, check Use checkboxes to allow multiple answers at the bottom of the question. The limit only applies to questions that allow multiple answers.

  2. Click the gear icon at the top right of the question.

  3. Check Limit selections. A Max dropdown appears on the same row, set to 3 by default.

  4. Pick the maximum.

Testers see "Select up to 3" above the options, and once they reach the limit the remaining options gray out until they deselect something.

Things to know

All three settings are off by default, so existing questions keep behaving exactly as before. Ranking questions ask testers to rank everything, and multiple choice questions allow unlimited selections.

Require answer is available for ranking questions. Combined with Rank top N only, testers must assign all N ranks before they can continue. With tap to rank and no limit, they must rank every option.

Randomize order still shuffles the starting order for each tester in both ranking modes. It is worth turning on for top N questions, because the options a tester sees first otherwise have an advantage.

A limit is always between 1 and one less than the number of answer options. If you delete answer options later, an existing limit is automatically reduced to fit.

Avoid adding or removing answer options on a ranking question after testers have answered it. Earlier rankings were scored against the old option list, so mixing them with new answers can skew the reported ranks. Changing the limit itself is safe.

An "Other" answer counts toward the multiple choice selection limit like any other selection.

Your results, exports, and charts work the same as before. With a top N limit, options a tester did not rank simply have no rank, and multiple choice results count selections exactly as they do today.

You can turn these settings on or off after collecting responses. Earlier answers are kept and reported alongside new ones.

Duplicating a test or a survey copies these settings.

Related articles

Did this answer your question?