QA Analyst III- #26-10721
This job is in your area. Enjoy a short commute and work close to home.
Job Description
Remote
Role Summary
The Ground Truth Quality Analyst is responsible for maintaining the accuracy and integrity of Meta's AI-powered sales quality governance system. This system uses LLM-as-Judge technology to assess and evaluate Small Medium Business sales calls daily across 17 quality skills. As part of a 3-person ground truth team, you will conduct independent human reviews of AI-scored call transcripts, verify scoring accuracy, and feed findings back into the system to drive continuous improvement. Your work directly underpins the credibility of automated quality measurement at scale.
Key Responsibilities
- Conduct ground truth reviews - independently evaluate a representative sample of AI-scored Mid-Market sales call transcripts against defined quality skill rubrics.
- Support diagnostic deep-dives - participate in targeted investigations on ca...