Test-wide AI insights are currently available to all plans. Note: AI credits will likely be limited by plan in the future.
About BetaIQ
BetaIQ is a product quality score. It is meant as an estimation for the overall product quality based on feedback provided during the test. The score takes into account the amount of positive / negative feedback along with sentiment weight, and any NPS or high-level rating questions (like star ratings) that are part of your surveys.
The BetaIQ Score (shown on the test dashboard) is calculated at the end of the test, or once per week for multi-week tests.
Key Signals: Defines the top positive / negative insights, backed by evidence
Issues: A grade based on the amount and severity of submitted bugs/issues
NPS: NPS score from any questions in the test
Test Health: A grade of the overall test engagement quality. If the test is going well and participants are completing activities on time, this will be high.
Some notes:
This rating is not based on any comparison to other products
The score is a useful guide and normally directionally accurate, but keep in mind that it's influenced by the way you ask questions. If you ask questions looking for praise (or problems) you're more likely to get that type of feedback. In bug tests or QA tests, you're more likely to find issues.
Example for a test that uses an NPS rating:
Test Overview:
Engagement Score is a score that each participant receives to measure the quality of their engagement. It takes into account automated ratings for each piece of feedback, manual ratings for each piece of feedback (e.g. admins can rate a survey answer as Helpful or Excellent), completion rate, penalties (e.g. lateness or expected AI usage), number and quality of bug/issue reports, messages, etc.
The Test Overview section shows some high level stats for the test. The Avg Engagement Score shows the average engagement score for all participants.
AI Insights Summary:
The AI Insights section on the test dashboard shows the most Positive and Negative insights from your test feedback. Each insight is derived from evidence provided through the surveys in your test. If you click into "View Full Report" or click the AI Insights section in the left nav menu, you can see the full insights report.
AI Insights Report:
The AI insights report shows the Positive and Negative insights from your test feedback.
Each section shows the key insights, and the number of testers that were associated with that insight. Clicking "View X Testers" will show you the exact feedback that is linked to this insight.
