Leveraging Question Insights in Alooba to Analyze Participant Performance

TL;DR: Dive into Alooba's Question Insights feature, which provides an intuitive histogram for in-depth analysis of participant performance on multiple-choice questions. This tool helps streamline the evaluation process, ensuring you select top talent.

Are you looking to understand how your participants fare on Alooba assessments? The Question Insights feature provides a visual representation, enabling you to compare individual performances and make informed decisions. With this feature, you can analyze response times, evaluate question difficulty, and more, all presented in an easy-to-understand format.

What are Question Insights?

Question Insights are available for all Multiple Choice questions like those in the Concepts & Knowledge and Data Analysis tests). It provides a histogram view, allowing you to understand a participant's answer in comparison to others. This visualization helps in gauging how long most people who answered the question correctly took and offers insight into a question's difficulty based on overall participant performance.

Note: Newly added questions or those with limited responses won't have Question Insights available initially.

Accessing Question Insights

Question insights are available on the Candidate's page (for Alooba Assess & Alooba Junior) and the Employee's page (for Alooba Growth) for anyone who has completed a Concepts & Knowledge or Data Analysis test.

When you select a question, insights appear on the right, showing response accuracy and comparison.

The green bar corresponds to the count of accurate responses, while the red bar represents the tally of incorrect responses. The blue bar denotes the participant's answer falling within this specific section.

If there are insufficient responses to a question, the insights will not be available. Once enough people have answered the question, it will become available.

Interpreting the Histogram

The histogram presents various metrics that provide insights into both question difficulty and participant performance. Here's how to read and understand the information presented:

1. Time to Answer: The histogram divides participants' response times into 30-second intervals, allowing you to see how quickly participants answered the question. The horizontal axis indicates the distribution of participants' response times.
2. Correctness Rate: The histogram illustrates how many participants answered the question correctly (vertical axis) against the 30-second time ranges (horizontal axis). Each bar represents a specific time range, showing the number of correct and incorrect answers.
3. Performance Comparison: By analyzing the histogram, you can compare a participant's response to others who answered the same question. A question is considered difficult if many participants answered it incorrectly. If a participant answered a challenging question correctly, their performance stands out. Similarly, a question is deemed easy if most participants answered it correctly, and a participant's incorrect response might raise concerns about their skills.
4. Confidence and Efficiency: The histogram's time-to-answer distribution reflects participant confidence and efficiency. Quick and accurate responses indicate a high level of confidence and proficiency. Slower response times might raise concerns about a participant's efficiency or familiarity with the topic.

Utilizing Insights for Efficient Evaluation

• Participants who correctly answer challenging questions demonstrate a higher level of proficiency.
• Incorrect responses to easy questions indicate potential areas of improvement.
• Swift and accurate responses reflect strong confidence and competence.
• Longer response times might indicate a lack of efficiency or slower problem-solving skills.

Conclusion

Incorporating Question Insights into your evaluation process empowers you with a valuable tool to make more informed decisions and streamline the participant selection/evaluation process. You can effortlessly gain deeper insights into participants' performance, enabling you to identify top talent.

Want to explore more features or need a personalized demo? Contact your Alooba account manager for further assistance.