Situational Judgement Test Designs. Man in box creating situational judgement scenario.

Situational

Situational judgement test, or SJT design is aone of our many specialities.

Situational judgement test designs

Rob Williams Assessment Ltd have considerable experience in situational judgement test designs. Our approach to situational judgement test designs is to always design bespoke situational judgement tests based upon a highly detailed role analysis.

SJT Design Project Examples

  • Lazard Brothers and AECOM graduate engineers. Situational judgement test validations
  • Citibank. Designing blended assessments for retail and call centre operations in American and Mexico. Managing item writing team for SJTs, ability tests, biodata questions etc.
  • Citibank telephony customer service agents (Mexico, Malaysia, India) and retail banking roles (North America): manager, assistant manager, bank teller, personal banker.
  • European Union. Development of project management and IT skills-based aptitude tests for the European Union.
  • British Airways cabin crew, British Airways customer service and call centre operatives.

Situational Values Test Design

We are specialists in values test design and motivation test design. Please contact us to discuss how Rob Williams Assessment Ltd can help your company in assessment exercise design.

  •  3-4 scenarios to assess each value.
  • Totalling approx. 15-16 questions.
  • Provides accurate and meaningful feedback to each respondent.

Situational Judgement Test Designs. Person at laptop with notepad.

Values based situational judgement tests 

Typically a situational judgement test uses problem-solving and judgment skills to measure role-specific competencies. In particular those role characteristics which are difficult to assess at interview or in an assessment centre. For example, empathy and resilience in customer-facing customer service roles.

At a higher level than the role, bespoke SJTs can also be designed to assess organisational “fit”. How well an individual’s values and attitudes match those of the organisation. The rationale is that this is an assessment of whether or not the individual “fits” into the organisational culture.

Values-Based Interview

Structured interview(s) comprising firstly values questions. Secondly, comprising of competency questions, and finally, including technical questions.

Values-Based Simulation Exercises

  • Scenarios from the job analysis can be used to design simulation exercises.
  • Parallel version developed to maximise exercise integrity.
  • Minimise risk of applicants sharing details of tools.
  • Compromising the validity of the assessment process.

Values Test Design – Assessment Exercises

We can design values assessment exercises design to focus on any values framework.

Values based recruitment may involve values based structured interviews, values based selection centres, values based situational judgement tests and/or values based personality tests.

Values based personality tests

Personality tests can be designed to measure values – as well as job specific constructs or competencies. As with a situational judgement based design, values based personality tests can serve as a highly effective realistic job preview, or self-selection tool.

Personality traits and values are often grouped together with other factors, such as motivation, competencies and skills; all of which impact upon job performance. Thus, skills such as judgement/decision-making and interpersonal effectiveness can be defined of values and/or personality traits.

Part II

If it is important to differentiate personality traits from values, then values can be seen as enduring goals, whilst personality better describes enduring dispositions.

Whenever a values based personality test is being used as part of a values based recruitment process, its vital to remember that personality influences motivational processes differently to how values drive motivational behaviour. Values impact goal content whereas personality traits impact the efforts that individuals make towards their goals.

Values Fit Designs

Rob Williams Assessment Ltd has experience of designing values tests that are generic in nature.

Alternatively specific values test which assess a company’s values. Hence, an individual’s fit between their personal values and their work’s organisational values. Situational judgement tests (SJTs) are often used to measure values. Also, the fit with a company’s values.

BUPA Care Assistants SJT Design

  • Design of realistic job preview.
  • Design of Situational judgment test.
Beneficial SJT Design Project Outcomes
  • Best practice was followed throughout the design process in SJT design.
  • An SJT was produced which successfully incorporated a range of care home-specific scenarios.
  • The most suitable set of scenarios could be hand-picked at the SME panel meeting, as well as gaining buy-in and discussing implementation.
  • Providing some scenarios for telephone interview sifts.
  • Setting a suitable cut-off and validating the tool.

Lazard Brothers and AECOM graduate engineers

    • Situational judgement test validations

Situational judgement test usage

Increasingly online situational judgment tests are being used as a recruitment sift in place of a more traditional verbal reasoning test and/or personality questionnaire. Here are some of the advantages that situational judgement tests offer compared to more traditional psychometric tests:

– More efficient to use one psychometric combining elements of both reasoning and personality assessments

– Once a bespoke situational judgment test is developed, it is more cost effective

– Situational judgment tests excel at sifting out high volumes of poorer quality candidates whilst selecting in the high calibre candidates who have scored highly across the range of role competencies

– Fairer assessment in terms of diversity issues since there is minimal adverse impact due to gender or ethnic origin

– Situational judgment tests are particularly good at assessing cultural fit. A well designed situational judgment test can therefore assess organisational values – as well as an organisation’s competencies per role.

– Situational judgment tests (SJTs) can act as a realistic job preview since SJTs and RJPs (RJPs)  have the same test format. Candidates can sift themselves out of a recruitment process at an early stage – often even before applying if the realistic job preview sits freely available on the company website.

– You can purchase generic situational judgment tests from most UK psychometric test publishers. A bespoke SJT is a more effective sift even though it will be more expensive initially.

Situational Judgement Test Designs. Woman at interview

SJTs can assess difficult skills

Judgment is one of the most difficult skills to assess online. This is one of the reasons why situational judgement tests have become more and more prevalent in recent years since the first SJTs appeared on the market about fifty years ago. The two other main reasons are that situational judgment assessments offer a fairer assessment than aptitude tests and personality questionnaires.

Our situational judgement test design process

The SJTs we design focus on identifying candidates who think and behave in the right way for our client organisations. We will take you through the following stages:

– Review existing role descriptions and competency framework literature
– Conduct job analysis sessions (face-to-face or telephone-based) with a selection of subject matter experts (SME’s)
– Create draft scenarios encompassing positive and negative behavioural responses
– Write realistic responses to each draft scenario
– Run a small trial of the draft SJT scenarios with a set of subject matter experts. This is primarily to agree the scoring key
– Analyse descriptive statistics for the first trial
– Run a full trial of the draft SJT scenarios
– Apply and check the scoring key against the trial SJT test results
– Analyse descriptive statistics for this trial (mean, SD etc)

Army situational judgement tests

Numerical Reasoning practice test book

Passing Numerical Reasoning Tests gif
Secondly, Passing Numerical Reasoning Tests book by Rob Williams

Additional assessment practice

Our psychometric test designs

Strengths Design  ~ Realistic Job Preview Design ~ Personality Test Design ~ Situational Judgment Test Design ~ Psychometric Test Design.