BetaTesting makes it easy to manage and re-engage a community of test participants for ongoing iterative testing and research.
See this article for a broad overview:
Searching, Filtering, and Re-Engaing Your Community of Testers
To filter and target your community for specific tests, there are two primary options:
Option 1: You can start from Your Community page, select the testers, and then create a test targeting those testers OR
Option 2: You can create/duplicate a test directly, and then update the targeting settings in the Tester Recruiting section of that specific test.
Both of these options support the same targeting/filtering options, it's just a question of starting with the testers first (option 1) or starting with the test first (option 2).
Option 1: Starting from Your Community
The Your Community page is accessible from the primary menu bar when logged into BetaTesting:
See this article for an overview of filtering and selecting testers to invite into a new test.
Searching, Filtering, and Re-Engaing Your Community of Testers
Option 2: Create/Duplicate a Test, Update Tester Recruiting Settings
The Tester Recruiting page is the 2nd step when designing most tests on BetaTesting. To target your existing community, select Your Community.
If you want to recruit from your entire audience, select "All past applicants". If you want to filter/target specific users, select "Choose specific testers".
When you Choose Specific Testers, you can then define who becomes part of the Invite Queue:
Click on Not Selected to apply the filters and choose participants.
Choose the testers you want, and select Add to Invite Queue.
Then select how many testers you want to recruit.
Important: If you want everyone in your invite queue to get an invite and be able to participate, the number you enter for "How many testers would you like to recruit" must exceed the size of your invite queue. Otherwise, we’ll invite testers from your invite queue in batches only until we have fulfilled this quota. Once we have fulfilled the quote, we'll stop inviting more.
Common Questions:
When do invites go out?
Invites get sent via email in batches once the test is formally launched.
Do you invite all the participants in the Invite Queue
No - We only invite as many as are needed in order to fulfill the number of participants you want.
The number you enter for "How many testers would you like to recruit" defines the Participant count for the test. i.e. if you enter 50, we'll aim to accept 50 testers into the test.
If the Invite Queue count is > Participants, then we invite in batches, measure results, and continue to invite until we get enough applicants.
Will everyone get a chance to join the test?
Only if the number you enter for "How many testers would you like to recruit" (the Participant count) is > the Invite Queue count.
If someone was invited, are they guaranteed a spot?
Same answer as above, with some more context. They are only guaranteed a spot (even if they receive an invite) if the number of participants in the Invite Queue is less than the number you enter for "How many testers would you like to recruit" (the Participant count).
Otherwise, our system will continue to send invites in batches until enough participants are selected. In general, if a potential tester receives an email and acts quickly to apply, they will have a very good chance to participate. However, if they don't see the email or act on it for minutes or hours, there is a good chance that another participant may take the last spot before they do.
Why does it work like this?
The system works this way so you can fulfill tests quickly. We strive to be fair to participants, so most people that act quickly on an invite are able to join, but also meet the researchers goals of quickly executing research. We find the system works well and creates the appropriate desire to act quickly and is fair to everyone.
Will some people be upset they can't join?
Occasionally someone might be frustrated because tests are fulfilled more quickly than they can act. If you have projects that are in high-demand (e.g. hardware tests, new releases, or tests with great incentives) this is more likely to happen. However, normally if someone gets an invite, they can apply to the test if they act relatively quickly.
How does the system decide who to invite?
From the invite queue, our system will first invite the testers that have the best quality history in your community. This is determined by past participation, automated quality scoring, and any feedback ratings that your team applied.
Do any other targeting criteria apply?
Yes, any other targeting criteria that you apply will act on top of the Invite Queue. So if you put people with iOS and Android phones in the invite queue, but choose to only target iPhones in the tester recruiting settings, then we will only invite people in the Invite Queue that have iPhones.
