Interview Panel Calibration Audit

Audit interview scoring consistency across panelists to identify inter-rater variance, calibration gaps, and training needs so candidate evaluations remain fair, reliable, and defensible.

Audit Scope and Interview Set

• Interview role, requisition, and audit period are documented
• Sample includes a representative set of interviews across all panelists
  Enter the number of interviews reviewed in the sample.
• All interviewers included in the sample were active panel members for the period reviewed
• Interview rubric or scorecard version is current and approved
• Interview questions and scoring anchors were consistent across candidates in the sample

Scoring Consistency and Inter-Rater Reliability

• Average score variance across panelists is within acceptable tolerance
  Enter the average absolute score variance between panelists for the reviewed sample.
• No interviewer is a clear outlier in scoring severity or leniency
• Score distributions are reasonably aligned across interviewers for each competency
• Inter-rater agreement was calculated using a documented method
• Material disagreements were reviewed and explained with evidence

Rubric Use and Behavioral Evidence

• Score justifications reference observable candidate responses or examples
• Interviewers used the same competency definitions and rating anchors
• Notes support the assigned score for each competency reviewed
• Any deviations from the interview guide were documented and justified
• Potential bias indicators were reviewed and addressed

Calibration Training and Corrective Actions

• Interviewers with scoring drift were identified
• Calibration coaching or refresher training is scheduled for identified interviewers
• Training topics were assigned based on observed gaps
• A follow-up calibration review date is set
• Corrective actions were assigned to an owner with a due date

Audit Summary and Fairness Controls

• Overall audit result
• Evaluation process appears fair and consistently applied across interviewers
• Audit findings were summarized for HR and hiring leadership