A CV can show where someone has worked. It cannot reliably show whether they can do the work your vacancy requires. To create skills based shortlist decisions that hold up under pressure, employers need to define capability before reviewing candidates, then apply the same evidence standards to every applicant.
This is especially relevant when applicant volume is high, hiring managers hold different views on what “good” looks like, or a role carries material operational, customer or compliance risk. A skills-based shortlist replaces impression-led selection with a clear question: which candidates have demonstrated the capabilities most likely to predict performance in this role?
Start with the work, not the applicant
The quality of a shortlist is set well before the first application arrives. Begin with a practical job analysis: identify the activities the person will perform, the decisions they will make, the people they will work with and the conditions in which they will operate.
For a customer service role, this may include understanding written information, resolving issues calmly, using multiple systems accurately and communicating with empathy. For a project manager, it may involve prioritising competing work, interpreting data, influencing stakeholders and maintaining delivery discipline. The title alone is not enough. Two roles with the same title can demand very different capability profiles.
Separate requirements into essential and desirable criteria. Essential criteria are the capabilities a person needs on day one, or can develop quickly without creating an unacceptable business risk. Desirable criteria may strengthen performance, but should not automatically remove an otherwise capable applicant.
Be disciplined here. A requirement such as “five years’ industry experience” is not a skill in itself. It may be a reasonable proxy in some specialist positions, but it can also exclude candidates who have gained the relevant capability elsewhere. Where possible, express the requirement as an observable skill: for example, “can interpret technical drawings accurately” or “can prepare clear, evidence-based written advice”.
Build a scorecard before applications are reviewed
A structured scorecard is the operating system of a skills-based shortlist. It gives recruiters and hiring managers a common standard, records why decisions were made and makes calibration much easier.
For each essential criterion, define what evidence should look like and how it will be scored. A simple four-point scale often works well: no relevant evidence, limited evidence, sufficient evidence and strong evidence. The labels matter less than clear behavioural anchors.
For example, “stakeholder communication” is too broad to score consistently. A stronger definition might distinguish between a candidate who has attended meetings, one who has explained routine information to stakeholders, and one who has adapted a difficult message, managed competing interests and achieved an agreed outcome.
Weight criteria according to their impact on the role. A payroll officer’s accuracy and numerical reasoning should carry more weight than presentation skills. A frontline supervisor may need a stronger weighting for judgement, communication and people leadership. Weighting prevents easy-to-observe but less relevant factors, such as a polished CV, from dominating the decision.
Keep minimum thresholds visible
Weighted scores are useful, but they should not allow a high score in one area to mask a critical gap in another. Set minimum thresholds for non-negotiable skills, licences, work rights or safety-related requirements. A candidate who does not meet a genuine threshold should not progress simply because they excel elsewhere.
The reverse also applies. Do not introduce thresholds for preferences disguised as necessities. Every hard screen should be defensible as job-relevant and proportionate to the role.
Use evidence that matches the skill
The best assessment method depends on what you are trying to measure. Application forms and CVs can provide early evidence of experience and qualifications, but they are self-reported and uneven in detail. They are a starting point, not a complete measure of capability.
A work sample or skills test is often the strongest option when the role requires a practical, teachable task. A data analyst could interpret a short dataset; an administrator could prioritise a realistic inbox; a technical candidate could diagnose a scenario. The task should reflect meaningful aspects of the job without asking applicants to complete unpaid production work.
Cognitive ability assessments can help predict learning speed, problem-solving and capacity to handle complex information, particularly where roles involve change or a steep learning curve. Personality and job-fit assessments can add useful context around work style and likely behavioural preferences. They should inform a broader decision, not become a shortcut for labelling people as suitable or unsuitable.
Structured interviews remain valuable because they allow candidates to explain their decisions and experiences. The difference is structure: every candidate should be asked substantially the same job-relevant questions, assessed against defined criteria and rated independently before the panel discusses its view. Asynchronous video interviews can be useful at early stages when they are designed around a small number of relevant questions and are accessible to candidates.
RightPeople combines skills, cognitive and behavioural assessment options with structured reporting, helping employers compare candidate evidence on a consistent basis rather than relying on intuition alone.
Create a skills based shortlist with consistent scoring
Once assessment data is available, combine it in the scorecard rather than treating each stage as an isolated hurdle. The aim is not to find the person with the highest score on every measure. It is to identify candidates who meet essential requirements and present the best overall evidence for the role.
This is where a calibration discussion adds value. Recruiters and hiring managers should review the leading candidates against the same evidence, check whether scoring has been applied consistently and challenge unsupported conclusions. If someone says a candidate is a “great cultural fit”, ask which role-relevant behaviour supports that view. If a candidate is rejected for seeming less confident, ask whether confidence is required for the work and whether the assessment method gave them a fair opportunity to demonstrate it.
Document exceptions. There will be legitimate cases where a candidate progresses despite a lower score in one area, such as an internal applicant with verified performance evidence or a person with a rare technical skill. Record the reason and ensure it is related to job performance. This protects decision quality while allowing appropriate judgement.
Avoid the common shortcuts that weaken shortlists
Skills-based hiring is not simply a longer list of criteria. It requires removing signals that are convenient but weakly related to performance. The most common problems are over-reliance on previous employer prestige, vague culture-fit judgements, unstructured interviews and inconsistent screening by different recruiters.
Automation can also create false confidence. An applicant tracking system can rank candidates quickly, but its output is only as sound as the criteria and data behind it. Keywords may identify relevant terminology, yet they cannot reliably establish how well a person applies a skill. Use automation to manage volume and workflow, then apply validated assessments and structured human judgement to establish capability.
Fairness should be designed into the process, not checked at the end. Use plain-language instructions, offer reasonable adjustments, set realistic time expectations and ensure assessors understand the scoring standards. Review outcomes for patterns that may indicate an unnecessary barrier. A selection process can be demanding while still being relevant, consistent and equitable.
Make the shortlist useful to the final decision-maker
A shortlist should do more than name the candidates who progress. Give decision-makers a concise evidence profile for each person: their performance against essential skills, notable strengths, development considerations and questions to explore at interview or reference checking.
This reduces repeated assessment and makes final interviews more purposeful. Instead of asking every candidate to walk through their CV, interviewers can test the areas that matter most. A candidate with strong analytical test results but limited stakeholder evidence might be asked to explain how they have influenced a difficult decision. A candidate with excellent experience but weaker task accuracy might complete a further work sample before appointment.
The process should also be proportionate. A high-volume entry-level campaign may require an efficient online assessment and brief structured interview. A senior leadership appointment warrants deeper assessment, multiple evidence sources and careful interpretation. More assessment is not automatically better. The right amount is determined by the role’s complexity, risk, hiring volume and cost of a poor appointment.
A well-built shortlist changes the recruitment conversation. Instead of debating who made the best first impression, your team can discuss the evidence of who is most likely to perform. That gives hiring managers a clearer basis for action, candidates a fairer process and the organisation stronger grounds for every appointment.
