Oversee quality assurance (QA) through the actions of design, development, documentation, and implementation, while helping to maintain development, testing, evaluation, and validation processes for AI model development. Certify that AI models being introduced into the AI platform have met all QA criteria. Perform QA testing on AI Models, including software testing, such as unit and validation testing as well as metric testing on AI models for performance comparisons against state of the art. Identify and submit reports to the appropriate leads against deficiencies identified through the QA process. Work with 3rd party partners to certify that their AI models are ready for deployment on the AI platform. Contribute to the completion of routine technical tasks.
4+ years of experience within QA process development, software testing, and machine learning development
Experience with developing QA processes and procedures and experience running a QA program
Experience with test planning and execution, including test case writing, test case executing, test report writing, and test automation
Experience with unit testing and unit test execution
Experience with JIRA, including defect reporting or trouble tickets
Experience with programming in common languages, including Python, C, C++, C#, Java, or Scala and platform tools, including Git or Docker
Experience with machine learning concepts, techniques, and frameworks, including PyTorch, Tensorflow, Keras, or Caffe
Knowledge of QA processes and methods
Ability to obtain a security clearance
BA or BS degree in CS, EE, ME, Computer Engineering, Physics, Mathematics, Economics, or Statistics
7 years of experience with QA process development, software testing, and machine learning development
Experience with Cloud computing and Cloud tools
Experience with remote development
Experience with deep learning techniques and methods
Experience with applied statistics
Possession of excellent oral and written communication skills, including technical writing on topics, such as software development, engineering, or advanced data science
MA or MS degree or PhD degree in quantitative discipline, including Engineering, CS, Physics, Mathematics, and Statistics
Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information.
We’re an EOE that empowers our people—no matter their race, color, religion, sex, gender identity, sexual orientation, national origin, disability, veteran status, or other protected characteristic—to fearlessly drive change.