AI QA Engineer

DEPARTMENT

Data Insights and Innovation

JOB TITLE

AI QA Engineer

JOB CODE

AIQAE

REPORTS TO

Manager, AI and Intelligent Decisioning

FLSA STATUS

Exempt

EMPLOYMENT TYPE

Full-Time

JOB PURPOSE

This role at Arbitration Forums is as unique as it is rewarding because of the AF IPAAL Values (Integrity, Passion, Accountability, Achievement, Leadership) and TRI Model (Trust, Respect, Inclusion).

The AI Quality Assurance Engineer is responsible for safeguarding the integrity of AI systems by meticulously overseeing the testing process to identify bugs and inconsistencies. This role serves as the last line of defense, ensuring that only the most reliable AI solutions are deployed.

This role is responsible for designing, developing, and optimizing test cases for AI solutions, ensuring that models and prompts for generative AI are producing the expected outputs prior to full integration into business processes and applications. The incumbent will partner with stakeholders to drive business value to Arbitration Forums and our members through fully tested AI solutions for deployment through a myriad of implementation methods.

DEPARTMENTAL EXPECTATION OF EMPLOYEE

• Adheres to AF Policy and Procedures and the AF IPAAL Values and TRI Model
• Acts as a role model within and outside AF.
• Performs duties as workload necessitates.
• Maintains a positive and respectful attitude.
• Communicates regularly with the departmental leader about department issues.
• Demonstrates flexible and efficient time management and ability to prioritize workload.
• Consistently reports to work on time, prepared to perform duties of the position.
• Meets Department productivity standards

ESSENTIAL DUTIES AND RESPONSIBILITIES

Test Design, Creation, and Optimization

• Design, develop, and implement comprehensive test plans to ensure AI system functionality aligns with specifications.
• Design automated test cases and monitor re...