Game based assessment design

We work with HireVue on their game based assessment design and new gamified assessment research. HireVue is the world leader in video assessment.

GAME BASED ASSESSMENT INTRO

Game Based Assessment design (GBA), or gamified assessment, involves a blend of psychometric design expertise, game design and machine learning.

Rob Williams Assessment also design gamified personality assessments for Hire Vue. Increasingly, these form a highly engaging component of HireVue’s video-based assessments. HireVue use AI increasingly to build mobile-first assessments combining both video interview, cognitive test and personality assessment components.

Some of the most popular HireVue assessments we’ve helped to design have assessed the cognitive aspects of personality traits. For example, the identification of emotions in other people. OR of spotting the use of empathy can be used to influence and to lead others. Meanwhile, Hire Vue this year exceeded over ten million video interviews.

Using video interviews

Video interviews are completed virtually. Even via any candidate’s mobile. A video interview does then allow employers to drill down on a candidate’s employment value. Just as they would do in a face-to-face interview!

So, you fill your recruiting pipeline with worthy candidates. Then, your next stage in the recruiting lifecycle is to evaluate each candidate’s skills and qualifications. To move only the right ones through the pipeline.

There are other pitfalls in the conventional interviewing process that recruiters and hiring managers rely on. First, in spite of an evaluator’s best intentions, bias can creep into their process, both in content and manner, that can put a candidate at a disadvantage.

Second, an unstructured interviewing process can also unintentionally gloss over the most important skills that lead to on-the-job success.

Finally, it’s not always easy to build a scalable, repeatable process that can evaluate a large pool of good candidates without letting some slip through the cracks.

Personality testing using games

Personality assessment research demonstrates that misleading and careless responses typically stem from lack of internal motivation or interest in the task. To address the underlying motivation issue, we created a text-based fantasy game where participants can select a variety of choices to reflect corresponding personality characteristics.

Results have shown consistent moderate-to-strong correlations between choices in the game and scores on a traditional Five-Factor Model personality inventory, indicating that game-like personality assessments can be developed with acceptable construct validity in a mentally stimulating way.

How gamification facilitates creative thinking

Playing games, literally, is a powerful way of facilitating creative thinking. It lowers the barriers of established behavioural routines. Still many companies are still sceptical about the concept of gamification or unsure how to make it.

Traditional techniques known to foster creativity, include mind-mapping and brainstorming. Many big companies (such as design agencies) embrace these practices in the way they work. Research has now shown how gamification creates a ‘creative space’ where people can share their ideas with each other.

Engaging people’s ideas

‘Ideas management’ engages people’s ideas and then accelerates them through the “innovation funnel”.  Traditionally, a company would have an ideas box, then later an Intranet to share ideas.

Game based learning

The popularity of video games has drawn researchers’ attention in the exploration of the possibility of  using video games to enhance knowledge, skills, and other personal attributes.

The idea of using games for serious purposes other than entertainment is called game-based learning. Advocates of game-based learning argue that well-designed video games represent solid learning principles. A fair amount of research shows that game-based learning is at least as effective as nongame conditions, such as class- room contexts.

In addition, when game-based assessment is designed following a principled design framework such as evidence-centered design or cognitive design system, the assessment is likely to have high validity and reliability.

Game-based assessment is essentially performance-based assessment. Tasks that require students to demonstrate their knowledge and skills by working through a task. Rather than a simple test of one’s ability to recall or recognize information, or supply self-reported information, performance-based assessment provides students with the opportunity to show their understanding and apply knowledge in meaningful settings.

Part II

Scholars generally support the use of performance-based assessment to measure and support twenty-first-century skills over conventional types of assessment such as multiple-choice questions or filling in the blanks.

Good games can provide an engaging and authentic environment designed to keep practice meaningful and personally relevant. With simulated visualization, authentic problem solving, and instant feedback, computer games can afford a realistic framework for experimentation.

Part III

Another key feature of well-designed games that can enhance learning and motivation is adaptivity related to providing appropriate and adaptive levels of challenge. Gee has argued that the secret of a good game is not its D graphics and other bells and whistles, but its underlying architecture in which each level dances around the outer limits of the player’s abilities, seeking at every point to be hard enough to be just doable.

Similarly, psychologists (e.g., Vygotsky) have long argued that the best instruction hovers at the boundary of a student’s competence. Flow is another name for this phenomenon. It is a construct first proposed by Csikszentmihalyi to describe an optimal experiential state that involves complete immersion in an activity and a deep sense of enjoyment. Flow represents full engagement, which is crucial for deep learning.

Hire Vue game based assessments

Digital assessments / gamified assessments

Pymetrics has a history of designing digital assessments / gamified assessments for Unilever. Pymetrics develops neuroscience games and leverages bias-free AI for.

  • Digitalised job matching.
  • Recruiting high performers (HiPOs).

Twenty minutes of gameplay behaviour with Pymetrics or MindX games will assess high performer potential in specific job roles/industries. MindX focuses on the candidate’s cognitive potential, whilst Pymetrics also offers a range of emotional potential metrics.

Aptitude test practice books

Rob Williams’s five practice aptitude tests books are all available on Amazon:

Firstly, in our opinion this is the best aptitude test practice book for Passing Verbal Reasoning Tests.

Secondly, in our opinion this is the best aptitude test practice book for Passing Numerical Reasoning Tests.

Passing Numerical Reasoning Tests gif

Other game based assessment resources

– – –Game Based Assessment Design – – –

Leave a Reply

Your email address will not be published. Required fields are marked *