Job Description:
About ETS:
ETS is a global education and talent solutions organization enabling lifelong learners worldwide to be future-ready. For more than 75 years, we've been advancing the science of measurement to build benchmarks for fair and valid skill assessment across cultures and borders. Our worldwide impact extends through our renowned assessments including TOEFL®, TOEIC®, GRE® and Praxis® tests, serving millions of learners in more than 200 countries and territories. Through strategic acquisitions, we've expanded our global capabilities: PSI strengthens our workforce assessment solutions, while Edusoft, Kira Talent, Pipplet, Vericant, and Wheebox enhance our educational technology and assessment platforms across critical markets worldwide.
Through ETS Research Institute and ETS Solutions, we're partnering with educational institutions, governments, and organizations globally to promote skill proficiency, empower upward mobility, and unlock opportunities for everyone, everywhere. With offices and partners across Asia, Europe, the Middle East, Africa, and the Americas, we deliver nearly 50 million tests annually. Join us in our journey of measuring progress to power human progress worldwide.
Position Summary
The Psychometrician supports large-scale language assessment programs by contributing to psychometric design, statistical analysis, score reporting, and ongoing program improvement, while integrating advanced AI and data science capabilities into assessment development and delivery. The role works across the full assessment lifecycle, partnering with psychometricians, AI engineers, data scientists, and product teams to develop, evaluate, and operationalize AI-enabled solutions such as automated scoring, adaptive testing, and item generation. Responsibilities include leading or supporting operational assessment cycles, ensuring technical quality and compliance with measurement standards, conducting research to support reliability and validity, developing technical documentation and score interpretation materials, and translating complex analyses into clear insights for internal and external stakeholders. The role also contributes to innovation, process improvement, and scholarly dissemination, supporting the evolution of assessment practices through the responsible use of emerging technologies.
Open to US & Canada candidates
Primary Responsibilities
- Operational Program Support: Lead and participate in the operational aspects of large-scale language testing programs, including planning, coordination, and execution of assessment cycles.
-
AI-Driven Test Development: Collaborate with AI engineers and data scientists to design, implement, and evaluate AI-powered solutions for test item generation, automated scoring, and adaptive testing.
-
Project Leadership: Coordinate and manage projects or segments of complex testing programs, including scheduling, resource allocation, and progress monitoring.
-
Score Reporting & Statistical Analysis: Independently conduct statistical analyses required for score reporting and data interpretation. Contribute to planning and coordination of score reporting and associated statistical work.
-
Quality Control: Review results for accuracy and reasonableness; ensure compliance with technical and operational standards.
-
Program Design: Contribute to psychometric design and analysis decisions for innovative assessment solutions, including the integration of AI and machine learning models.
-
Program Improvement: Identify opportunities for process improvement, propose and implement solutions, and evaluate their impact.
-
Procedure Development: Assist in the design, development, and documentation of technical and operational procedures and statistical guidelines.
-
Documentation: Develop score interpretation materials, technical reports, and publications related to testing programs.
-
Client Interaction: Respond to internal and external client requests, develop analysis plans, oversee data analysis, and prepare and present findings.
-
Psychometric Research: Conduct research to support the reliability and validity of testing programs, including the development of new methods for test security, irregularity detection, and AI-based item parameter prediction.
-
Scholarly Activity: Publish scientific papers and represent the company at professional conferences.
#LI-MM1
Experience and Skills:
-
Ph.D. in Psychometrics, Educational Measurement, Statistics, Computer Science, Data Science, Quantitative Psychology, or a closely related field.
-
5+ years of demonstrated experience in educational measurement, quantitative psychology, or statistical research (all levels considered; senior roles require progressively responsible experience).
-
Strong analytical, communication, and project management skills.
ETS is mission driven and action oriented
-
We are passionate about hiring innovative thinkers who believe in the promise of education and lifelong learning.
-
We are energized by cultivating growth, innovation, and continuous transformation for the next generation of rising professionals as leaders. Â In support of this ETS offers multiple Business Resource Groups (BRG) for you to learn and advance your career growth!
-
As a not-for-profit organization we will encourage you to lean in to your passion for volunteering. Â At ETS you may qualify for up to an additional 8 hours of PTO for volunteer work on causes that are important to you!
-
The base salary range advertised represents the low and high end of the anticipated salary range for this position. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. The base pay is only one aspect of the Total Rewards Package that will be offered to the successful candidate.
ETS is an Equal Opportunity Employer. We are committed to providing equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, marital status, veteran status, sexual orientation, gender identity, or any other characteristic protected by law. We believe in creating a work environment where all individuals are treated with respect and dignity.
From: Educational Testing Service
