Loading...

Run: CSAT and QA Score Correlation Review

Review how QA scorecard results line up with post-call CSAT for a specific period, team, or queue. Use it to spot scorecard gaps, evaluator drift, and the fe...

Fill this out, get a PDF emailed to you. No account required. Want to run it with your team and track results? Sign up free →

Review Context & Attribution

Select the cadence period this review covers (e.g., monthly, quarterly).
Specify the team, skill group, or product line (e.g., 'Tier 1 Support – EMEA').
Enter the sample size of QA-evaluated interactions that also have a matched CSAT response.
Enter as a percentage (e.g., 18%). Low response rates (<10%) reduce correlation reliability.
Name and role of the QA analyst or program manager completing this review.

Aggregate Score Alignment

Rate alignment: 1 = Strongly disagree (large gap between QA avg and CSAT avg) → 5 = Strongly agree (scores closely mirror each other).
1 = Strongly disagree → 5 = Strongly agree.
Provide directional detail: which metric is inflated or deflated relative to the other, and by how much.
1 = Strongly disagree → 5 = Strongly agree. This tests whether top QA scores predict promoter-level satisfaction.
1 = Strongly disagree → 5 = Strongly agree. This tests whether low QA scores predict detractor-level satisfaction.

Scorecard Criteria Validity

Name the specific criterion (e.g., 'Empathy & Tone', 'First Contact Resolution', 'Accurate Information Provided').
Identify criteria where high QA scores do not translate to high customer satisfaction — these are calibration candidates.
1 = Strongly disagree → 5 = Strongly agree. Misaligned weighting is a leading cause of QA-CSAT divergence.
Include the criterion name, current weight, and your recommended adjustment with rationale.
Select Yes or No. If Yes, detail the missing drivers in the follow-up field.
Examples: 'Customers frequently cite hold time as a dissatisfier — not currently scored' or 'Customers value proactive follow-up, which has no scorecard item'.

Evaluator Calibration & Consistency

1 = Strongly disagree → 5 = Strongly agree. Inconsistent calibration inflates or deflates QA scores independently of actual performance.
Select Yes, No, or Partially. Lack of calibration sessions is a common root cause of QA-CSAT divergence.
1 = Strongly disagree (no bias detected) → 5 = Strongly agree (clear bias pattern observed).
Be specific: e.g., 'Evaluator A scores Agent X 8-10 points higher than the team average on soft-skills criteria with no CSAT support'.

Detractor & Outlier Analysis

Enter the count. These 'false positive' interactions are the most valuable for scorecard recalibration.
Enter the count. These 'false negative' interactions may indicate over-penalization of criteria customers don't value.
1 = Strongly disagree → 5 = Strongly agree.
Examples: 'Resolution was technically correct but agent tone was perceived as dismissive', 'Policy constraints frustrated customers despite agent compliance'.
Examples: 'Agent deviated from script but customer appreciated the personalized approach', 'Scored down for hold time but customer was satisfied with outcome'.

Action Planning & Program Recommendations

1 = Strongly disagree (scorecard is well-calibrated) → 5 = Strongly agree (significant revision needed).
Include: criteria to add, remove, or reweight; suggested new point values; and the CSAT evidence supporting each change.
Examples: 'Schedule IRR session for all evaluators in Q3', 'Coach Agent cohort on empathy language linked to detractor verbatims'.
Select Yes or No. Continuous loop reviews are essential to validate that scorecard changes improve predictive accuracy.
Include any contextual factors (e.g., product outages, policy changes, seasonal volume spikes) that may have distorted the correlation this period.

Get your results

Enter your email — we'll send you a PDF of your filled-out template, plus the occasional MangoScoop newsletter (templates, workflow tips, product updates). Unsubscribe anytime — link is in every email.

Generated with MangoApps Templates — browse 250+ free
Ask AI Product Advisor

Hi! I'm the MangoApps Product Advisor. I can help you with:

  • Understanding our 40+ workplace apps
  • Finding the right solution for your needs
  • Answering questions about pricing and features
  • Pointing you to free tools you can try right now

What would you like to know?