Psychometric Test Design. People having colour fight.

SPECIALISMS

Rob Williams Assessment Ltd specialises in custom psychometric test design services for SME’s and scale-ups.

Psychometric test design specialists

We are bespoke psychometric test specialists in both work and education settings. For more insights into meaningful assessments contact Rob Williams Assessment for a comprehensive appraisal.

Our Practice Aptitude Test Books (listings on Amazon)

  • FREE Brilliant Passing Verbal Reasoning Tests ebook

  • Passing Numerical Reasoning Tests book

We’ve helped SHL, SOVA and CAPP with numerous bespoke psychometric design projects; designed video assessments (HireVue, Arctic Shores); and been commissioned by leading psychometric consultancies, such as TPI and We are Amberjack.

Psychometric test design specialists

Contact us Today

Our Bespoke Psychometric Designs

Many of the UK’s and US’s leading test publishers have used Rob Williams Assessment’s to calculate and prove the reliability of their Personality Test designs and Situational Judgement test designs.

In addition to situational judgement test design, we also specialise in Assessment design and Aptitude test design.

Personality Tests

Psychological and personality tests analyze your personal qualities, strengths and weaknesses. The answers you provide to these types of questions can help you assess your ideal working style.

Based on your personality, preferences and patterns, you’ll discover the types of professions you’re best suited for. You will find plenty of aptitude test practice and aptitude test tips on this website.

– – – Career guidance service – – –

Aptitude Tests

Aptitude tests give one a sense of how good of a fit you are to perform certain tasks – or how likely you are to learn a skill. You will find plenty of aptitude test practice and aptitude test tips on this website.

Workplace diversity and inclusion

  • Inclusion is ‘making the mix work’ by
    • Valuing people as individuals.
    • Respecting their differences.
    • Applying that individual knowledge and skillset.
    • Having an open and trusting working environment

This is what unlocks diversity’s power.

Workplace equality?

  • Ensuring that no single employee is given favorable treatment because of who they are.
  • Do all members of staff have qual access to what’s needed for effective work performance, career opportunities and rewards.

What are the risks of making the wrong recruitment decision?
Costs

  • Time
  • Effort
  • Recruiting costs
  • Business results

Risks

  • Reputation
  • Customer service quality of care

Benefits

  • Positive experience for customers and staff
  • Efficiency
  • Quality

Our Bespoke Psychometric Design Principles

For training consultancies, Rob Williams Assessment Ltd has built coaching and employability profiling tools.

With recruitment agencies we’ve designed culture and role fit personality-based assessments to improve the efficiency of matching clients to the best-fitting jobs.

Our psychometric test design solutions

  • Our consultancy work focuses on aptitude test practice and bespoke psychometric test design.
  • We believe in the benefits of practice and ensuring fairness in testing. We, therefore, offer some practice aptitude tests and some practice psychometric tests. The intention is to promote as ‘level a playing-field’ as possible.

Psychometric Test Design. Man at desk working at laptop, picture taken from the top

Our SJT designs

As psychometric tests have become more commonplace, the bigger users have commissioned their own bespoke situational judgement tests.

Rob Williams Assessment has worked on several such projects for High Street banks and for the European Union. Another recent innovation of test developers has been online adaptive tests. With these tests, if you are doing well, you will find that the questions get progressively harder.

The innovative design of shorter and more efficient tests was driven by an increasingly aware of the immediacy of the Internet and our increasing use of emails and social media, in short, sharp bursts.

This discourages test takers from spending 30-40 minutes online doing the same questionnaire. It’s better for everyone to keep test takers engaged when being tested – not bored!

Knowledge-based situational judgement test design

Some or all of the scenarios presented in an SJT can test specific job knowledge. For example, a retail marketing SJT may ask questions about the 3Ps (price, position, promotion) of product marketing. Alternatively, both an SJT measuring generic decision-making skills may be used alongside a knowledge-based test.

Our video-based situational judgment test designs

Simulated situational judgement tests are increasingly common as recruitment sifts. Adding 2D or 3D workplace scenario graphics brings the situational judgment test scenarios to life. This can only promote the company brand and make employers using simulated situational judgment tests more desirable employers.

psychometric test design

UK and US psychometric test publishers have produced both video-based and animated SJT scenarios. Animated SJTs are easier – and therefore cheaper – for global companies to develop.

Our consultancy work focuses on aptitude test practice and bespoke psychometric test design. We believe in the benefits of practice and ensuring fairness in testing. We, therefore, offer some practice aptitude tests and some practice psychometric tests. The intention is to promote as ‘level a playing-field’ as possible.

Values based recruitment

Example values-based recruitment Question – Describe an example of when you have made a decision which had a positive effect on a customer?
Probes: What actions did you take? Who was involved? What was the outcome of your actions?

Positive behavioural indicators

  • Uses their initiative.
  • Takes personal responsibility.
  • Describes the example’s context, their actions and the outcome(s).

Negative behavioural indicators

  • Applies limited effort.
  • Only describes own actions.
  • Omits  the outcome.
  • Doesn’t describe their individual contribution.

We always follow BPS Standards in Psychometric Test Design

To be psychometrically sound a test must be:

  • Objective – the results obtained are not influenced by the administrator’s personal characteristics or irrelevant factors such as the colour of a test taker’s socks.
  • Standardised – the test is administered and scored according to standard procedures and people’s scores are compared to known standards.
  • Reliable – the test measures in a consistent way. The potential error is small and is quantifiable.
  • Valid. Our psychometric test design measures the characteristic(s) that it set(s) out to measure. So, if we design a sift psychometric test to select a job applicant should predict job performance. Whereas, if we design a psychometric test of verbal ability then it will predict verbal reasoning abilities.
  • Discriminating. Any of our bespoke psychometric tests designs should show clear differences between individuals on the behaviour being tested. But should not be discriminatory. In other words our psychometric test design does not unfairly discriminate against a minority group.

Our bespoke psychometric test designs

Example Psychometric Test Projects 

Rob Williams has over twenty years of experience of bespoke psychometric test design. Plus ten years prior to this spent working for several of the UK’s leading test publishers. These include IBM, OPP, SHL and HireVue.

British Airways blended assessment project:

  • Firstly our BA Situational judgment test design;
  • Secondly,  our Numerical reasoning test design;
  • Thirdly our Verbal reasoning test design
  • Finally our Personality questionnaire design.

BUPA SJT Design

  • Best practice was followed throughout the design process in SJT design.
  • An SJT was produced which successfully incorporated a range of care home-specific scenarios.
  • The most suitable set of scenarios could be hand-picked at the SME panel meeting, as well as gaining buy-in and discussing implementation.
  • Providing some scenarios for telephone interview sifts.
  • Setting a suitable cut-off and validating the tool.

EPSO Test Design

  • Development of project management test.
  • Design of IT skills-based aptitude tests.

Psychometric test design

Our Work Styles assessment designs

We will work with you to design the most suitable work styles tool to suit your needs. Our Bespoke Personality Questionnaire design process aims to:

  • Firstly, include key role dimensions.
  • Secondly, reflect the personality, attitudinal and motivational aspects of the role-specific dimensions.
  • Thirdly, have face valid questions.
  • Also, to be capable of completion in 20 minutes approx.
  • And to adopt a single-stimulus question format (Likert scale)
  • Plus, adopting a normative format of scoring utilising a sten look-up table (for each personality scale)
  • And finally, using a Social Desirability scale to deal with the issue of faking or extreme scoring patterns

Psychometric test design

Recent situational judgement test trends

Situational judgement tests (SJTs) have also become prevalent in graduate recruitment. These tests present scenarios to applicants and ask them to select the best and the worst thing to do next. SJT’s are very popular in the United States due to their excellent record of fairness across different ethnic groups.

Recent personality test trends

Candidates may also have to take a personality test as part of the recruitment process. There is a vast array of personality tests, which pose questions about a candidate’s behaviour and personal preferences. A typical question may ask whether you prefer attending parties or staying home with a good book. These personality tests help employers to determine whether a candidate has the right profile for the role.

How companies use aptitude tests

Aptitude tests are used by many companies as a standard part of the recruitment process. If you’re currently aplying for jobs, you’re likely to face one or more psychometric tests, measuring everything from verbal reasoning and numeracy to emotional intelligence. I would say that 90 per cent of big companies use skills and/or aptitude tests, though the kind used will depends on the role and industry you’re aplying for,’ says Rob Williams.

How you perform matters. ‘Even if you wow a potential employer with a great first or second interview, the results can make or break your chances of getting hired,’ says Rob. Research backs up the claim. Nearly 90 percent of companies said they would reject candidates if the test showed them to be deficient in basic skills, according to a survey by the American Management Association.

What are the most commonly used aptitude tests? The most commonly used aptitude tests measure numerical, verbal and logical reasoning,

Graduate Aptitude test designs

  • Our first point is that a well-designed selection procedure focuses on predicting a graduate’s competence within a particular work context.
  • Secondly, that psychometric assessments only form one part of the selection procedure.
  • Our third point is that personality assessments can give an indication of how well an individual applicant will fit into the existing workplace or team.
  • Finally, psychometric assessments can assess which applicants are most suited to the demands of the vacant job in terms of both ability and personality factors.

Our assessment designs – graduate psychometric test design example

Graduate recruiters who want to minimise recruitment costs see online ability tests as an efficient and effective means of sifting the initial applicant pool.

A bespoke verbal reasoning test design and numerical reasoning test design offer a reliable and standardised solution. This should ensure that an optimal number of good candidates are seen by the business at the much more expensive ‘face-to-face’ stage.

Using standardised tests to improve your diversity of hires

Using standardised tests in the recruitment process helps to ensure that applicants from different countries and from different ethnic groups are treated fairly.

Aptitude test design – Employability example

All of our psychometric test practice resources are free. So, we hope you enjoy using them!   In our opinion, there is plenty of the right type of aptitude test practice, aptitude test tips and test-taking strategies.

We certainly hope you get maximum value from our free psychometric test practice resources!  Psychometric test practise works best when it’s specific to the test type and the level of difficulty of the psychometric test you will be taking.

Best practice in assessment design

  • Our first point is that a well-designed selection procedure focuses on predicting a graduate’s competence within a particular work context.
  • Secondly, that psychometric assessments only form one part of the selection procedure.
  • Our third point is that personality assessments can give an indication of how well an individual applicant will fit into the existing workplace or team.
  • Finally, psychometric assessments can assess which applicants are most suited to the demands of the vacant job in terms of both ability and personality factors.

Best practice uses of aptitude test data

  • Firstly, it’s fundamental to the use of any psychometric test is that users are aware of a test’s effectiveness and its known limitations.  This information is calculable through knowledge of a measure’s reliability and validity.
  • Secondly, importance is attached to test results and decisions are made using test data.
  • Thirdly, you must be sure that the tests you are using have sound credentials and have been properly developed.
  •  

Bespoke psychometric test design 

validation 

The key benefit is the production of a report that highlights those personality factors that are important for success leading to improvements in future recruitment. Other possible benefits include the following:

  • Development of clear decision rules to make recruitment both more efficient and more effective;
  • Information on the areas in which staff are seen as working more effectively or less effectively;
  • How the client’s staff differ in terms of personality from other groups; and
  • Depending on what data is collected, analysis of information relating to fairness and diversity

Incentives, such as discounts on materials, are something that need to be negotiated on a case by case basis – depending on the quality of the data that might be given to us. It is likely that the analysis would be conducted free of charge.

Premium Personality Test Practice

What is validity?

“Convergent” or “construct” validity scientifically checks whether we’re really measuring what we’ve set out to measure.

  • In the case of pre-hire assessments, are we really measuring personality?
  • Are we identifying something else about our test-takers — their reading ability, English fluency, memory, or ability to stick with a task?
  • Are we left with actual personality data, or just a dataset of people who could finish a lengthy questionnaire?

Validation Stages

Personality Test Validation Stage 1

Identify the following:

  • Who should complete the personality. Each participant should be doing a similar role. A sample in excess of 40-50 is required.
  • What job performance measures should be used and are available from HR. Examples of suitable job performance criteria:
  • sales figures
  • appraisal ratings
  • development or assessment center competency ratings or pass/fail criteria
  • length of service

Personality Test Validation

Stage 2 – Personality Test Validation

An excellent way of obtaining job performance data is to use a managerial Performance Rating form. Managers rate behavioural criteria that are important in their particular role.  Some of the benefits include getting better quality data, getting around the “political” problems of appraisal ratings and covering all aspects of job performance focusing on those which would be more likely to correlate to the 16PF.

At the same time it is worthwhile asking people to rate themselves on the same criteria using a Performance Rating form.

Stage 3 – Personality Test Data Collection

Arrange for identified employees to complete the personality test. Also for their respective managers to complete individual Performance Rating forms.

Final Stage of Personality Test Validation

ROB WILLIAMS ASSESSMENT will conduct all the statistics – requiring a couple of days work – and share the results with the client in the form of a short report – also requiring a couple of days work.

Psychometric test design pillars

An IQ test compares each respondent’s IQ score with a group of previous test-takers. There needs to be a standardization phase when developing any aptitude test.

This standardization sample provides the norm group against which the individual scores of all later psychometric test respondents are compared. Otherwise, an ‘IQ score’ would be meaningless!

The second psychometric test property is…

Reliability

There are two key types of psychometric reliability. In each case, ‘psychometric test reliability’ means that if I take the same test next week, my results will be similar.

Internal Reliability, or Internal Consistency

This is the first type of psychometric test design reliability.

Whether all the test items measure the same concept. It can be assessed in two ways. The first method is known as the split-half reliabilitywhich require correlating the score based on half of the test items with the score based on the other half (e.g., scores on odd and even items).

An alternative method is item-total reliabilitywhich requires correlating each item score with the total score of the rest of the items.

Cronbach alpha then summarises all the psychometric test reliability correlations into one figure. A test should have an alpha of at least a = .80.

Our Bespoke psychometric test designs

Secondly, Test-retest Reliability relates to psychometric score consistency over time. In other words, how reliably a psychometric test measures. A time gap of at least two weeks between the two measurements is key. Since some psychological characteristics change considerably over time.

Then, the test re-test reliability is assessed by correlating the tests scores measured first time with the test scores measured the second time. Ability tests are expected to have a reliability of at least r = .75, yet personality tests might have somewhat lower reliability.

Validity

Psychometric test design validity means the test measures what it says it measures. MindX knows which personality traits are measured because we have compared our results to well-established personality tests. HireVue validates its video assessments using high performer data and job analysis results.

Aptitude Test Design Reliability – is it a reliable measure?

  • Most commonly the internal consistency index coefficient alpha or its dichotomous formulation, KR-20.
  • Under most conditions, these range from 0.0 to 1.0.
  • 1.0 is a perfectly reliable measurement.
  • Although, a reliable test may still not be a valid

Aptitude Test Design Validity – Secondly, is the test valid?

A measure of what it ‘says on the tin’? In our opinion, both the initial content validation and later criterion validation analysis are vital for any bespoke psychometric test.

Final Validity Recommendations

We recommend collecting additional recruitment data over time so that additional validation studies can be conducted. Such as assessment centre data.

There are many other types of psychometric test validation evidence, and one-off studies investigating a psychometric test’s criterion validity are common.

Assessment Reliability

The reliability of any exercise depends upon many factors:

  • Quality of the competency framework.
  • Use of experienced and well-briefed / well-trained assessors.

Biodata approach to psychometric test design

  • Such biodata test designs were popular in the 1970’s/80’s in the UK., but fell out of fashion due to concerns about face validity.
  • Face validity is how job-relevant a test’s questions appear to be.
  • Assessing this is difficult because of the way that the biodata approach to psychometric tezst design fits questions to job performance.

Biodata example questions

  • Asking about previous working and life history facts.
  • Biodata questions can include personal attitudes, values, beliefs.
  • There are therefore both autographical and biographical perspectives.
  • For example, how effective previous working relationships were with managers and/or colleagues.

psychometric test design

Personality Values Test Design

    •  

We also design values based  assessments. Values impact goal content whereas personality traits impact the efforts that individuals make towards their goals.

Ability Tests Introduction

  • Often employers are interested in your aptitude or potential to do a task.
  • In this case, they may use assessment methods that aim to simulate aspects of that task.

Personality Questionnaire Introduction

  • These measure behavioural preferences of how you prefer to work.
  • There’s no right or wrong answer.
  • That said, of course, certain behaviours are more suited to particular jobs.

Situational Judgement Test Introduction

  • These psychometric tests assess your ability to choose the most appropriate action in workplace situations.
  • Respondents read a scenario / view an animation;
  • Then select the Best and Worst responses to that aspecific work situation.

But what does my psychometric score mean ?

If used as a sift at an early stage of the recruitment process then there will be a specific mark that you have to pass in order to proceed further with your application.

When used as part of an assessment centre, a psychometric test is unlikely to be used a sift that excludes a % of applicants. In other words, your test score will be used to provide additional information but would not be the only reason why you succeed or fail at this particular stage.

Top 70 psychometric consultancies

–  – in alphabetical order  – –

  1. ACER
  2. Alva
  3. AON
  4. Assess First
  5. Assessio
  6. Assessments 24×7
  7. Berke
  8. Biddle
  9. Biodata Online
  10. Birkman
  11. Caliper (PSI)
  12. CCI
  13. CCM
  14. Central Test
  15. Criteria Corp
  16. Cubics
  17. Cut-e HR Assessments
  18. DeGarmo
  19. Easi-Consult
  20. e-Skill
  21. Fifth Theory
  22. FPSI
  23. Genos
  24. Get Feedback
  25. GL Assessment
  26. gNeil
  27. Harver
  28. HFI
  29. Hogan
  30. Hogrefe
  31. Holst
  32. HR Avatar
  33. Hudson
  34. IntegriView
  35. IO solutions
  36. IPAT
  37. Isograd
  38. Kattis
  39. Kingwood
  40. Knight chapman
  41. Korn Ferry/TalentQ
  42. Master Intl
  43. McQuaig
  44. MEttl
  45. Mindmill
  46. ModernHire
  47. My Future Choice
  48. My Skills Profile
  49. OnPoint
  50. OPP/Myers Briggs
  51. Outmatch
  52. Pan
  53. Pearson
  54. PELLETB
  55. Pfaff
  56. Predictive Index
  57. PROPHET
  58. PSI
  59. PsyCorp
  60. Psycruit
  61. Psymetrics
  62. Pymetrics
  63. Quest
  64. Ramsay
  65. ReviewNet
  66. Revellian
  67. Saville Assessment
  68. Select
  69. SHL
  70. SOVA

Admissions tests practice

  1. Our aptitude test design projects

Our other psychometric test design specialities

We are assessment specialists in both work and education settings. For more insights into meaningful assessments contact Rob Williams Assessment for a comprehensive appraisal.

 

What is involved in clerical aptitude test, spelling, grammar and accuracy on paper.

Registered Office: Rob Williams, 31 Bruton Way, Ealing, London, W13 0BY

Companies House Registration No: 6572976