A shortlist can look strong on paper and still produce a poor hire. One candidate has a familiar background, another interviewed confidently, and a third has the skills but less polish. Without a consistent method for how to compare job applicants, decisions can quickly default to instinct, availability or the opinions of the loudest person in the room.
The better approach is to compare candidates against the genuine requirements of the role, using the same evidence for every person. This makes selection faster, more defensible and more likely to identify the person who can perform well once they are on the job.
How to compare job applicants using job-relevant criteria
Start before reviewing CVs. Define what successful performance looks like in the role over the first six to 12 months, then separate essential requirements from desirable ones. A job description often lists broad responsibilities, but it may not specify the capabilities that distinguish an average performer from a strong one.
For a customer service role, that might mean listening accuracy, written communication, judgement and the ability to remain composed under pressure. For a finance analyst, it may be numerical reasoning, attention to detail, technical knowledge and stakeholder communication. For a leadership appointment, strategic judgement, people leadership and adaptability may matter more than tenure in a particular industry.
Keep the criteria focused. A scorecard with six to eight job-relevant factors is usually more useful than a long checklist that nobody applies consistently. Each factor should have a clear definition and an agreed standard for what good evidence looks like.
For example, rather than scoring someone on a vague quality such as “culture fit”, assess observable behaviours that matter in your organisation: collaborates across teams, follows through on commitments, responds constructively to feedback or manages change effectively. This reduces the risk of preference being mistaken for performance potential.
Set weightings before candidates are assessed
Not every criterion should carry equal weight. If accuracy is central to a payroll role, it should have more influence on the final decision than presentation style. If a role involves managing complex stakeholders, communication and judgement may deserve greater weighting than a marginal difference in years of experience.
Agreeing on weightings early prevents the team from changing the rules after meeting a particularly likeable candidate. It also helps hiring managers explain why one candidate ranked ahead of another, even where both had credible experience.
Compare evidence, not impressions
CVs are useful for checking experience, qualifications and career progression. They are less reliable as a standalone measure of capability. Candidates receive different levels of support when writing applications, and a well-presented CV cannot show how someone reasons, applies skills or responds in a work-related situation.
A fair comparison brings together several sources of evidence. The mix will depend on the role, hiring volume and risk level, but may include application screening, skills testing, cognitive ability assessment, structured interviews, work samples, reference checking and pre-employment screening.
The principle is straightforward: assess the same job-relevant areas for each shortlisted candidate, then compare results on a common scale. If one applicant completes a detailed skills test while another is assessed through an informal conversation, the evidence is not equivalent.
Use a simple scoring guide for each selection activity. A one-to-five rating scale can work well when anchors are defined. A rating of one might indicate limited evidence or an inability to meet the requirement. A three may show competent performance, while a five demonstrates strong, repeatable evidence that exceeds the role standard. Written notes should support every rating.
Structure interviews so they add useful evidence
Unstructured interviews can feel natural, but they often reward confidence, rapport and similarity to the interviewer. They also make candidate comparison difficult because each person is asked different questions and given different opportunities to demonstrate capability.
A structured interview does not need to be stiff. It means asking every candidate the same core questions, using consistent follow-up prompts and rating responses against pre-agreed criteria. Interviewers can still explore relevant details, but the foundation remains comparable.
Behavioural questions are useful when past experience is relevant: “Tell us about a time you had to resolve a conflict between competing priorities.” Situational questions can be stronger where candidates have limited direct experience: “How would you respond if a key stakeholder challenged your recommendation late in a project?”
For each question, identify what a high-quality answer should include. In the stakeholder example, stronger evidence may involve clarifying concerns, checking facts, considering business impact and communicating a practical path forward. This gives interview panels a standard beyond whether they personally liked the response.
Asynchronous video interviews can also improve consistency in early-stage recruitment, particularly for high-volume roles. Candidates receive the same questions and can complete their responses within an agreed timeframe, while recruiters review answers when it suits the selection process. This is most effective when questions are targeted, time expectations are reasonable and assessors use a defined rating guide.
Use validated assessments for capabilities that are hard to see
Some of the most important predictors of job performance are difficult to establish from a CV or one interview. Cognitive ability, work style, role-specific skills and job fit can all be assessed more consistently through validated tools.
The right assessment depends on the decision you need to make. Skills tests can verify practical capability in areas such as data entry, software use, written communication or job knowledge. Cognitive ability assessments can provide evidence of reasoning and learning capacity, which may be particularly valuable for complex roles, graduate recruitment or positions where candidates will need to adapt quickly.
Personality and job-fit assessments can add insight into likely work preferences and behavioural tendencies. They should not be used as a pass-or-fail shortcut or interpreted in isolation. Their value lies in showing how a candidate’s profile relates to the demands of a specific role, team and work environment.
Tools should be scientifically validated, relevant to the job and administered consistently. Employers also need a clear process for interpreting results. RightPeople combines assessment technology with psychologist input so organisations can use results as decision-quality evidence rather than a collection of scores with no practical meaning.
Bring the evidence together with a decision matrix
Once each assessment stage is complete, consolidate results in a candidate comparison matrix. Place the agreed criteria down one side and each candidate across the top. Record the score, evidence source and any important notes for every criterion.
A weighted total can help rank candidates, especially where there are several assessors or a large shortlist. But do not treat the highest mathematical score as an automatic appointment. Review the pattern behind the result. A candidate may rank strongly overall but fall below the minimum standard in a non-negotiable requirement, such as a required licence, safety-critical skill or ability to perform an essential task.
Equally, a lower-scoring candidate may warrant discussion if they have an uncommon capability that is genuinely valuable to the role. The point of the matrix is not to remove professional judgement. It is to ensure judgement is applied transparently and to the same evidence.
Hold a calibration discussion before deciding
Before making an offer, bring the panel together to review scores and evidence. Ask where ratings differ and why. A large difference between interviewers can signal that the criterion was unclear, the evidence was interpreted differently or one assessor was influenced by an unrelated factor.
The panel should be able to answer three questions: Does this candidate meet the essential requirements? What evidence supports their likely performance? What risks remain, and can they be managed through onboarding, development or supervision?
This conversation is particularly valuable for senior, specialist and leadership roles, where a small number of candidates may each bring different strengths. The best choice is not always the person with the most familiar background. It is the person whose evidence best matches the work ahead.
Protect fairness, candidate experience and compliance
Consistent selection processes support fairness, but only when the criteria themselves are relevant. Avoid scoring factors that do not relate directly to performance, such as personal interests, accent, family circumstances or assumptions about cultural similarity. Ensure assessment methods are accessible and offer reasonable adjustments where needed.
Keep clear records of selection criteria, interview notes, assessment outcomes and the rationale for the final decision. This supports internal accountability and gives your organisation a stronger basis for responding to questions about the process. It also creates useful data over time: you can test whether candidates who scored well at selection are succeeding in the role.
Candidate experience matters here too. Explain the stages, expected timing and purpose of assessments. Most applicants accept a rigorous process when it is relevant, respectful and proportionate to the role. They are less likely to accept repetition, unclear requests or tests that appear disconnected from the job.
A sound comparison process will not remove every hiring risk. People and roles change, and no single measure can predict performance perfectly. It will, however, replace unsupported impressions with a clear view of each candidate’s capability, potential and fit for the work that actually needs to be done.
