Interview design
Decide what good looks like first.
A scorecard lists the skills you’re screening for, the level you expect and how much each counts, with plain descriptions of each score band.
7 min read · Updated September 24, 2026 · The LessRounds team
A screening scorecard is the list of things you’re judging a candidate on, written down before the first interview. Without one, every interviewer judges something slightly different, and the most confident candidate tends to win. With one, you can compare candidates on the same terms, explain why someone moved forward, and spot when your own judgment has drifted. Building a good one takes about an hour. This guide walks through the four parts and ends with a complete example.
What goes on a screening scorecard
A useful scorecard has four parts for each skill:
- The skill. Something observable in a conversation, named plainly.
- The expected level. How good the person needs to be on day one.
- The weight. How much this skill counts compared with the others.
- Anchors. Short descriptions of what an answer sounds like at each score band.
Keep it to three to five skills. A first round is short. Ten skills means each gets a sentence of evidence, and the scores turn into guesses.
Step 1: Choose three to five skills
Start from the work, not the job description. Ask what a new hire will spend most of their first few months doing, and what separates the people who do it well.
Good skill names are specific and observable:
- “Calming upset customers” rather than “people skills”
- “Explaining data to non-analysts” rather than “communication”
- “Prioritizing a full week” rather than “organized”
Avoid personality labels like “passionate” or “driven”. You can’t score them fairly from an answer, and they invite gut feel. Also avoid overlap. If two skills would always get the same score, merge them.
Step 2: Set the expected level
The same answer can be excellent for a graduate and weak for a team lead. Setting an expected level keeps you from marking a junior candidate against a senior bar. A common four-level scale:
- Beginner: understands the basics, needs guidance, can learn quickly.
- Intermediate: does the work independently in normal situations.
- Advanced: handles unusual or difficult cases and can guide others.
- Expert: sets the approach, and others learn from them.
Most first-round roles need intermediate on most skills. Be wary of setting everything to advanced. It usually reflects a wish list, and it pushes every score down.
Step 3: Weight what matters most
Weights say how much each skill counts toward the overall score. They’re relative, so 3, 3 and 4 works the same as 30, 30 and 40. Give the most weight to the skill that’s hardest to teach and most important to the job.
A worked example, with weights of 35, 25, 20 and 20, and a candidate scoring 80, 60, 70 and 50 on the four skills:
(0.35 × 80) + (0.25 × 60) + (0.20 × 70) + (0.20 × 50) = 28 + 15 + 14 + 10 = 67
Two cautions. First, a single skill weighted above about half the total makes the others barely matter. That’s fine only if it’s true of the job. Second, equal weights are a choice too. Use them only if the skills really matter equally.
Step 4: Write anchors for each score band
Anchors are the part most scorecards skip, and the part that makes scoring consistent. For each skill, describe what an answer sounds like in each band. On a 0 to 100 scale, four bands work well:
- 80–100: clearly above the expected level, with specific evidence.
- 60–79: meets the expected level.
- 40–59: partly there, with gaps or thin evidence.
- 0–39: little or no evidence of the skill.
Generic anchors are a start. Skill-specific ones are much better, because they tell the scorer what to listen for.
An example scorecard
Here’s a scorecard for a customer support representative, a role where most of the job is spoken and most hires are expected to work independently from the start.
| Skill | Expected level | Weight | What to listen for |
|---|---|---|---|
| Calming upset customers | Intermediate | 35 | Acknowledges feelings before fixing, stays level, specific examples |
| Clear explanation | Intermediate | 25 | Short steps, no jargon, checks understanding |
| Following through | Intermediate | 20 | Owns the problem until it’s solved, closes the loop |
| Judgment about policy | Beginner | 20 | Knows when to follow the rule and when to escalate |
And the anchors for the two most heavily weighted skills:
| Band | Calming upset customers | Clear explanation |
|---|---|---|
| 80–100 | Gives a specific, difficult example. Describes what they said, how the customer responded and how it ended. Names habits that keep them steady. | Explains in a few short steps with no jargon, checks the listener is following, and ends with what to do next. |
| 60–79 | Gives a real example and a sensible approach, with less detail about what they said or how it ended. | Clear and accurate, with a little jargon or one step out of order. |
| 40–59 | Speaks in general terms (“I always stay calm”), or the example focuses on why the customer was wrong. | Understands the topic but explains it in a way a beginner would struggle to follow. |
| 0–39 | No example, or describes arguing with or ignoring the customer. | Can’t explain it, or the explanation is inaccurate. |
The overall score comes from the weighted skills, as in the worked example above. The anchors are what make two people give the same score to the same answer.
Using the scorecard well
- Score each skill on its own. Don’t decide an overall impression first and fill in skills to match.
- Write down the evidence. Next to each score, note the line from the interview that justifies it. If you can’t find one, the score is a guess.
- Score straight after the interview. Memory fades fast, and it fades toward whatever impression you already had.
- Watch for one answer coloring everything. A great story about one skill doesn’t mean the other skills are strong too.
- Calibrate as a team. Have two people score the same three interviews independently, then compare. Where you disagree, rewrite the anchor.
- Revisit after the first batch. If everyone scores the same on a skill, it isn’t separating candidates. Rewrite the question or the anchor.
In LessRounds, the scorecard is built into the interview: you set each skill’s expected level and weight, and every skill gets a score from 0 to 100 with the reasoning and a quote from the transcript, so you can check the evidence yourself. See how scoring works.