Verification & Validation Data Scientist

SHRM is a member-driven catalyst for creating better workplaces where people and businesses thrive together. As the trusted authority on all things work, SHRM is the foremost expert, researcher, advocate, and thought leader on issues and innovations impacting today’s evolving workplaces. With nearly 340,000 members in 180 countries, SHRM touches the lives of more than 362 million workers and their families globally.

Summary

This role exists to answer one question independently

do the synthetic-audience and automated systems actually perform as claimed? It is a verification-and-validation function drawn from data science, closer to model validation, ML evaluation, and the independent V&V discipline used in regulated and safety-critical software than to market research. The V&V Data Scientist will design and run the evaluation that benchmarks system output against ground-truth data, owns the accuracy metrics and error bounds, and certifies fitness for use, working independently of the engineer who builds the models. The separation of duties is the point: the builder does not grade their own work.

Responsibilities

• Design and run the independent validation methodology: benchmark synthetic-audience and automated output against real panel holdout and other ground-truth data.
• Own the evaluation metrics, test harness design, and reported accuracy bounds; quantify where each system is and is not reliable.
• Certify fitness for use, translate results into clear “validated for this use / not validated for that use” determinations.
• Operate independently of the AI/Synthetic Engineer: verify the models and pipelines AI/Synthetic Engineer builds without having built them.
• Monitor for model and data drift over time; re-validate as models, prompts, and source data change.
• Maintain the audit trail and evidence base that supports the function’s credibility with stakeholders and any external auditor.

Education & Experience Requirements

Ed...