AI Operations Specialist - STEM

1840 & Company -
Austin, TX

Apply Now

Job Details

Full-time
$46.00 - $57.50 an hour
11 hours ago

Qualifications

English

Full Job Description

AI Operations Specialist - STEM

1840

Remote, Austin, Texas, United States

Apply Now

Non-Negotiable

About the Company

1840 & Company is a global organization focused on delivering innovative business solutions that help companies grow, scale, and succeed. Operating in over 150 countries, we support organizations through a range of workforce, operational, and business services designed to drive efficiency and long-term success.

About the Job

We are seeking an exceptional AI Operations Specialist to apply advanced STEM expertise to evaluate and improve AI-generated content. Specialists assess technical accuracy, reasoning, relevance, and quality within structured AI operations workflows.

Job Overview

Employment Type:
Full-Time Independent Contractor
Department:
Administration
Job Level:
Senior

Education & Experience

Years Of Experience:
10 Years
Business Model:
PaaS (Platform As A Service)
SaaP (Service-As-A-Product)
SaaS (Software As A Service)
Minimum Education Level:
Doctorate
Qualification:
- 10+ Years Of Directly Relevant Professional Experience OR Doctorate In A Relevant STEM Discipline.
- Specialties: Biology, Chemistry, Mathematics, Physics, Statistics, Computer Science, Engineering, And Related Fields.
- Advanced Expertise In The Applicable STEM Field.
- Strong Analytical, Critical-Thinking, And Problem-Solving Skills.
- Ability To Independently Evaluate Complex Technical Reasoning And Identify Substantive Errors.
- Strong Written Communication And Attention To Detail.
- Ability To Work Effectively Within Structured, Technology-Enabled Workflows.
Preferred Qualifications
- Experience Reviewing, Teaching, Publishing, Or Developing Advanced Technical Content.
- Experience With AI Evaluation, Annotation, Preference Ranking, Red Teaming, Or Similar Work.
- Familiarity With Generative AI And Large Language Models.

Skills

Tools/Platforms:
Data Annotation Platforms
Generative AI / LLM Platforms
AI Evaluation Platforms
Preference Ranking Tools
AI Model Validation Tools
Red Teaming Tools / Environments
Additional Skills:
Advanced STEM Expertise In Biology, Chemistry, Mathematics, Physics, Statistics, Computer Science, Engineering, Or Related Disciplines, Complex Problem-Solving And Error Identification, AI And Machine Learning Familiarity, Generative AI And Large Language Model Understanding, Multimodal Content Evaluation (Text, Code, Images, Equations, Charts), Red Teaming And Adversarial Testing, Independent Judgment And Decision-Making
Common Methodologies/Frameworks:
Customer Support Workflow Management
AI Model Evaluation
Human-In-The-Loop (HITL) AI Evaluation
AI Response Ranking & Preference Evaluation
Data Annotation & Classification
Technical Accuracy Validation
AI Reasoning Evaluation
Additional Skills:
Advanced STEM Expertise In Biology, Chemistry, Mathematics, Physics, Statistics, Computer Science, Engineering, Or Related Disciplines, Complex Problem-Solving And Error Identification, AI And Machine Learning Familiarity, Generative AI And Large Language Model Understanding, Multimodal Content Evaluation (Text, Code, Images, Equations, Charts), Red Teaming And Adversarial Testing, Independent Judgment And Decision-Making
General Skills:
Cross-Functional Collaboration
Research Methodologies
Quality Assurance
Additional Skills:
Advanced STEM Expertise In Biology, Chemistry, Mathematics, Physics, Statistics, Computer Science, Engineering, Or Related Disciplines, Complex Problem-Solving And Error Identification, AI And Machine Learning Familiarity, Generative AI And Large Language Model Understanding, Multimodal Content Evaluation (Text, Code, Images, Equations, Charts), Red Teaming And Adversarial Testing, Independent Judgment And Decision-Making
Soft Skills:
Attention To Detail
Time Management
Critical Thinking
Additional Skills:
Advanced STEM Expertise In Biology, Chemistry, Mathematics, Physics, Statistics, Computer Science, Engineering, Or Related Disciplines, Complex Problem-Solving And Error Identification, AI And Machine Learning Familiarity, Generative AI And Large Language Model Understanding, Multimodal Content Evaluation (Text, Code, Images, Equations, Charts), Red Teaming And Adversarial Testing, Independent Judgment And Decision-Making

Requirements

Technological Requirements:

Language:
English
Location:
United States

Responsibilities

Evaluate AI-generated content for technical accuracy, reasoning, completeness, and relevance.
Create or review expert responses, explanations, and reasoning examples.
Compare, rank, annotate, classify, and validate model outputs using defined criteria.
Identify scientific, mathematical, technical, logical, or methodological errors.
Evaluate multimodal content such as text, images, charts, equations, and code.
Support model safety, red-teaming, and validation activities as required.
Apply project guidelines consistently and document evaluation rationale when needed.
Meet established quality, productivity, attendance, and scheduled-hour requirements.

Working Hours

Flexible working hours

Apply Now

Job Seeker Tools

Employer Tools

Browse

Stay Connected