Nebo · tutorial 15 · run operations
Screen applicants on the job, not the person
Strong fits advanced, clear misses declined with a recorded reason, every borderline call escalated, and every decision auditable.
Screening decisions about people carry legal obligations that vary by jurisdiction, and an automated decision may need to be explainable and appealable. Check your obligations before you run this on real applicants, and keep a human in the loop on every rejection.
The honest case for this recipe is consistency. Human screening drifts: the tenth CV of the evening is judged differently from the first. A scorecard applied identically every time, with the reason recorded, is fairer than most manual processes and considerably easier to review.
Steps
Write the scorecard before you see a single CV
Requirements must be observable from an application. "Strong communicator" is not screenable; "has written for a technical audience, with a sample" is.
Rule out protected characteristics explicitly
Without an explicit instruction, a model will happily reason about a graduation year as a proxy for age. Naming the prohibition is what stops the inference appearing in your written record.
Require a reason for every decision
Bias the ambiguous cases toward escalation. The cost of a human reading one more CV is small; the cost of a wrongly rejected good candidate is invisible and permanent.
Watch the applicant inbox
Set the gate
Every message to a candidate, every rejection, and every offer. Keep candidate
contact at approval permanently rather than growing into trusting
it, because a rejection sent in error cannot be recalled and the candidate will
remember your company for it.
Verify
- Run it against a past round where you know the outcomes, and compare
- Check that the person you eventually hired would have been advanced
- Submit two identical applications differing only in name and confirm identical outcomes
- Confirm no assessment mentions anything on the prohibited list
- Confirm no candidate was contacted
When it goes wrong
It declines candidates you would have interviewed
The scorecard encodes a proxy rather than the requirement, typically years of experience standing in for capability. Loosen the proxy and raise escalation.
It escalates nearly everyone
Your must-haves are not observable from an application. Rewrite them as things visible on a CV.
Reasons are vague
Require a quote from the application for every decision. A decision that cannot cite evidence is not a decision you could defend.