Interview design
How to build a screening scorecard.
A scorecard lists the skills you’re screening for, the level you expect and how much each counts, with a short description of what answers sound like in each score range.
7 min read · Updated September 24, 2026 · The LessRounds team
A screening scorecard is the list of things you’re judging a candidate on, written down before the first interview. Without one, every interviewer judges something slightly different, and the most confident candidate tends to win. With one, you can compare candidates on the same terms, explain why someone moved forward, and notice when your own judgment starts to shift over time. Building a good one takes about an hour. This guide walks through the four parts and ends with a complete example.
What goes on a screening scorecard
A useful scorecard has four parts for each skill:
- The skill. Something you can hear in a conversation, named plainly.
- The expected level. How good the person needs to be on day one.
- The weight. How much this skill counts compared with the others.
- Anchors. Short descriptions of what an answer sounds like in each score range.
Keep it to three to five skills. A first interview is short. Ten skills means each gets a sentence of evidence, and the scores turn into guesses.
Step 1: Choose three to five skills
Start from the work, not the job description. Ask what a new hire will spend most of their first few months doing, and what separates the people who do it well.
Good skill names are specific, and describe something you can hear in an answer:
- “Calming upset customers” rather than “people skills”
- “Explaining data to non-analysts” rather than “communication”
- “Prioritizing a full week” rather than “organized”
Avoid personality labels like “passionate” or “driven”. You can’t score them fairly from an answer, and they encourage scoring on gut feeling. Also avoid overlap. If two skills would always get the same score, merge them.
Step 2: Set the expected level
The same answer can be excellent for a graduate and weak for a team lead. Setting an expected level stops you from judging a junior candidate against what you’d expect from someone senior. A common four-level scale:
- Beginner: understands the basics, needs guidance, can learn quickly.
- Intermediate: does the work independently in normal situations.
- Advanced: handles unusual or difficult cases and can guide others.
- Expert: sets the approach, and others learn from them.
For most roles, intermediate is the right level for most skills. Be wary of setting everything to advanced. It usually reflects a wish list, and it pushes every score down.
Step 3: Weight what matters most
Weights say how much each skill counts toward the overall score. They’re relative, so 3, 3 and 4 works the same as 30, 30 and 40. Give the most weight to the skill that’s hardest to teach and most important to the job.
A worked example, with weights of 35, 25, 20 and 20, and a candidate scoring 80, 60, 70 and 50 on the four skills:
(0.35 × 80) + (0.25 × 60) + (0.20 × 70) + (0.20 × 50) = 28 + 15 + 14 + 10 = 67
Two cautions. First, a single skill weighted above about half the total makes the others barely matter. That’s fine only if it’s true of the job. Second, equal weights are a choice too. Use them only if the skills really matter equally.
Step 4: Write anchors for each score range
Anchors are the part most scorecards skip, and the part that makes scoring consistent. For each skill, describe what an answer sounds like in each score range. On a 0 to 100 scale, four ranges work well:
- 80–100: clearly above the expected level, with specific evidence.
- 60–79: meets the expected level.
- 40–59: partly there, with gaps or thin evidence.
- 0–39: little or no evidence of the skill.
General anchors like these are a start. Anchors written for each skill are much better, because they tell the scorer what to listen for.
An example scorecard
Here’s a scorecard for a customer support representative, a role where most of the job is spoken and most hires are expected to work independently from the start.
| Skill | Expected level | Weight | What to listen for |
|---|---|---|---|
| Calming upset customers | Intermediate | 35 | Acknowledges feelings before fixing, stays calm, specific examples |
| Clear explanation | Intermediate | 25 | Short steps, no jargon, checks understanding |
| Following through | Intermediate | 20 | Takes responsibility until the problem is solved, and tells the customer when it is |
| Judgment about policy | Beginner | 20 | Knows when to follow the rule and when to pass the problem to a manager |
And the anchors for the two most heavily weighted skills:
| Score range | Calming upset customers | Clear explanation |
|---|---|---|
| 80–100 | Gives a specific, difficult example. Describes what they said, how the customer responded and how it ended. Names habits that keep them steady. | Explains in a few short steps with no jargon, checks the listener is following, and ends with what to do next. |
| 60–79 | Gives a real example and a sensible approach, with less detail about what they said or how it ended. | Clear and accurate, with a little jargon or one step out of order. |
| 40–59 | Speaks in general terms (“I always stay calm”), or the example focuses on why the customer was wrong. | Understands the topic but explains it in a way a beginner would struggle to follow. |
| 0–39 | No example, or describes arguing with or ignoring the customer. | Can’t explain it, or the explanation is inaccurate. |
The overall score comes from the weighted skills, as in the worked example above. The anchors are what make two people give the same score to the same answer.
Using the scorecard well
- Score each skill on its own. Don’t decide an overall impression first and fill in skills to match.
- Write down the evidence. Next to each score, note the line from the interview that justifies it. If you can’t find one, the score is a guess.
- Score straight after the interview. Memory fades fast, and it fades toward whatever impression you already had.
- Don’t let one answer affect every score. A great story about one skill doesn’t mean the other skills are strong too.
- Check that your team scores alike. Have two people score the same three interviews independently, then compare. Where you disagree, rewrite the anchor.
- Revisit after the first batch. If everyone scores the same on a skill, it isn’t telling candidates apart. Rewrite the question or the anchor.
In LessRounds, the scorecard is built into the interview: you set each skill’s expected level and weight, and every skill gets a score from 0 to 100 with the reasoning and a quote from the transcript, so you can check the evidence yourself. See how scoring works.