We provide testers with the ability to opt out of a test shortly after they join. This ensures that only testers that are interested and engaged will participate and helps our clients get high quality participation.
Reasons we allow testers to opt out:
Only after being accepted to a test do testers have access to the test instructions provided by our clients. At this point, they may see that they aren't a good fit, or perhaps the time expectations or the rewards being offered don't seem to match their expectations.
A participant may have had something unexpected and important come up and don't think they'll be able to participate.
By allowing testers to opt out early, we ensure that only testers that are truly interested will participate.
What happens after a tester opts out?
We remove the tester from the test, along with any feedback they provided
In most cases our system will be able to replace the tester automatically. If a test is using Manual Review of participants during screening, as a customer you can select a replacement tester from your Pending pool at any time.
If a tester isn't replaced, and you end up with fewer participants than you desired, please keep in mind that you are only charged for participants that actually finish the test process.
Will I be charged for this tester?
No, at the end of the test process you are only charged for participants that actually finish the test, and you have the opportunity to review and approve everyone.
Why are testers opting out?
If you see a high opt out rate, normally this would indicate one or more of the following:
Your targeting requirements or screening survey may not have mentioned all the requirements. For example, if your test instructions require users to link their Gmail account with your software, you need to confirm that testers actually have a gmail account through your screening survey. If you don't, they won't be able to complete your test.
Testers may be having trouble getting access to your app. If it's a lot of trouble getting started, a tester may just opt out rather than waste their time.
The instructions may complicated, wordy, or confusing. If the test is a 30 minute test and you've given people a 10 page PDF of instructions to read, they may just decide to opt out as they expect it will take longer than communicated or the reward isn't sufficient.
The test may not have been what people expected.
The reward and time expectations may not seem worth it after reviewing your instructions. We suggest increasing your reward or time expectations in your next test.
The Test Overview may not have accurately described what is expected. We would suggest updating your test details to provide a better description about what is expected during the test:
As a tester, does opting out hurt my tester rating?
If done sparingly, no. It will only impact your tester rating if you make it a frequent habit.