Top 21 Data evaluator Jobs in Austin, Tx

AI QA Trainer - LLM Evaluation - Freelance Project
Meridial —Austin, TX
- $6 - $65 an hour
- Remote
- Computer Science
- Master's degree
- SQL
Senior Research Analyst
Health & Human Services Comm —Austin, TX
- $6,377.50 - $8,581.66 a month
- Online Application
- Microsoft Excel
- Microsoft Outlook
- Office
- Health insurance
- Opportunities for advancement
Quick Apply
Language Fluency Instructors - Freelance AI Trainer Project
Meridial —Austin, TX
- $6 - $65 an hour
- Remote
- English
- Mid-level
- Analysis skills
- Health insurance
13d
Vaccine Preventable Disease Epidemiologist I
Dept of State Health Services —Austin, TX
- $4,020.33 - $5,178.00 a month
- Online Application
- Public speaking
- Mid-level
- Office
Quick Apply
Field Associate - Property Showings & Evaluations
Doorstead —Austin, TX
- Contract
- Office
- Real Estate License
- Driver's License
Quick Apply
Product Marketing Specialist - Lead
Sprinklr —Austin, TX
- $121,000 - $201,000 a year
- Full-time
- 5 years
- In-person
- Senior level
- Paid holidays
- Disability insurance
Account Executive
AppDirect —Austin, TX
- $58,225 - $71,925 a year
- Bachelor of Science
- Mid-level
- 3 years
Quick Apply
13d
Microbiologist III
Dept of State Health Services —Austin, TX
- $5,110.03 - $5,876.53 a month
- Weekends as needed
- Word processing
- Bachelor's degree
- Travel
Quick Apply
3d
Academic Records Administrative Associate, Education Abroad, Texas Global
University of Texas at Austin —Austin, TX
- $47,000 a year
- Urgently hiring
- Microsoft Word
- High school
- Writing skills
- Retirement plan
6d
Academic Program Coordinator - Admissions and Recruitment
University of Texas at Austin —Austin, TX
- $48,000 - $56,234 a year
- Urgently hiring
- Writing skills
- Mid-level
- Office
- Retirement plan
UT GEAR UP for Industry Development and Educational Success (GUIDES 2025) Site Coordinator – Coldspring-Oakhurst Consolidated ISD
University of Texas at Austin —Austin, TX
- From $55,000 a year
- Urgently hiring
- Classroom
- Spanish
- High school
- Health insurance
- Retirement plan
Mission Development Manager
Gallatin —Austin, TX
- Full-time
- Military
- Contracts
- Senior level
- Health insurance
- 401(k)
Foundations Manager, Austin Texas or Portland Oregon
Children's Cancer Association (CCA) —Austin, TX
- From $65,000 a year
- Full-time
- 5 years
- Basic math
- English
- Free parking
- Paid holidays
Acute Flaccid Myelitis Epidemiologist III
Dept of State Health Services —Austin, TX
- $5,098.66 - $6,701.75 a month
- Online Application
- Medicine
- Office
- Travel
Quick Apply
Multi-Medical Assistant
Texas Children's Hospital —Austin, TX
- Full-time
- Vital signs
- PALS Certification
- BLS Certification
8d
Energy Engineer II
CLEAResult Consulting Inc. —Austin, TX
- $69,300 - $103,900 a year
- Full-time
- Salesforce
- Engineering
- Mid-level
- Health insurance
- Dental insurance
Quick Apply
Test Team Deputy Director
Allen Control Systems —Austin, TX
- Full-time
- Bachelor of Science
- Engineering
- Travel
- Health insurance
- Dental insurance
Quick Apply

More jobs to discover

Find similar jobs that you might be interested in.

Senior Research Analyst
Health & Human Services Comm —Austin, TX
The Senior Research Analyst designs and conducts research and evaluation studies requiring data collection, analysis, and reporting; applies advanced research…
$6,377.50 - $8,581.66 a month
Quick Apply
Board Certified Behavior Analyst (BCBA)
Action Behavior Centers —Austin, TX
Certification Bonuses: Get rewarded for each therapist who becomes certified under your supervision. Mentorship Bonuses: Provide supervision hours to an RBT…
$84,500 - $119,000 a year
Quick Apply

Show more similar jobs

Explore jobs in cities nearby

Check out jobs in cities near your current location, Columbus

Seasonal Credentials Evaluator
The Ohio State University —Columbus, OH
Application Evaluation includes data entry and administrative tasks to ensure accurate and comprehensive data is gathered in Ohio State admissions systems.
$17.50 - $20.04 an hour
5d
Full-Time Occupancy Evaluator
FAR Inspections —Dublin, OH
As an independent contractor, you are responsible for providing your own equipment, including: Based in Reno, NV, we have a 12-year track record of excellence…
$25 - $35 an hour

Show more jobs in cities nearby

I want to receive the latest job alert for data evaluator in austin, tx

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

data evaluator jobs near austin, tx

AI QA Trainer - LLM Evaluation - Freelance Project

Meridial
Austin, TX

Apply Now

Job Details

Freelance
$6 - $65 an hour

Qualifications

AI models
Software issue identification
Data integrity assurance
Regression testing implementation
Data quality checks
Defect resolution root cause analysis
Statistics
Computer Science
Bug Tracking (Quality assurance practices)
Automation
Bachelor's degree in statistics
Multilingual
Tooling
Testing and evaluation
AI tools proficiency
Bug Reporting (Quality assurance practices)
Metrics Reporting
Reporting and dashboarding tools
Prompt engineering
Master's degree
SQL
Quality control data reporting
Doctoral degree in Computer Science
Linguistics
Bachelor's degree
Ph.D. in statistics
Doctor of Philosophy
System validation
Issue tracking
Master's degree in statistics

Full Job Description

Are you an AI QA expert eager to shape the future of AI? Large-scale language models are evolving from clever chatbots into enterprise-grade platforms. With rigorous evaluation data, tomorrow's AI can democratize world-class education, keep pace with cutting-edge research, and streamline workflows for teams everywhere. That quality begins with you—we need your expertise to harden model reasoning and reliability.

We're looking for AI QA trainers who live and breathe model evaluation, LLM safety, prompt robustness, data quality assurance, multilingual and domain-specific testing, grounding verification, and compliance/readiness checks. You'll challenge advanced language models on tasks like hallucination detection, factual consistency, prompt-injection and jailbreak resistance, bias/fairness audits, chain-of-reasoning reliability, tool-use correctness, retrieval-augmentation fidelity, and end-to-end workflow validation—documenting every failure mode so we can raise the bar.

On a typical day, you will converse with the model on real-world scenarios and evaluation prompts, verify factual accuracy and logical soundness, design and run test plans and regression suites, build clear rubrics and pass/fail criteria, capture reproducible error traces with root-cause hypotheses, and suggest improvements to prompt engineering, guardrails, and evaluation metrics (e.g., precision/recall, faithfulness, toxicity, and latency SLOs). You'll also partner on adversarial red-teaming, automation (Python/SQL), and dashboarding to track quality deltas over time.

A bachelor's, master's, or PhD in computer science, data science, computational linguistics, statistics, or a related field is ideal; shipped QA for ML/AI systems, safety/red-team experience, test automation frameworks (e.g., PyTest), and hands-on work with LLM eval tooling (e.g., OpenAI Evals, RAG evaluators, W&B) signal fit. Skills that stand out include: evaluation rubric design, adversarial testing/red-teaming, regression testing at scale, bias/fairness auditing, grounding verification, prompt and system-prompt engineering, test automation (Python/SQL), and high-signal bug reporting. Clear, metacognitive communication—"showing your work"—is essential.

Ready to turn your QA expertise into the quality backbone for tomorrow's AI? Apply today and start teaching the model that will teach the world.

We offer a pay range of $6-to- $65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you'll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.

Employment type: Contract
Workplace type: Remote
Seniority level: Mid-Senior Level

Apply Now

Refine Your Search

data evaluator jobs in austin, tx

AI QA Trainer - LLM Evaluation - Freelance Project

Senior Research Analyst

Language Fluency Instructors - Freelance AI Trainer Project

Vaccine Preventable Disease Epidemiologist I

Field Associate - Property Showings & Evaluations

Product Marketing Specialist - Lead

Account Executive

Microbiologist III

Academic Records Administrative Associate, Education Abroad, Texas Global

Academic Program Coordinator - Admissions and Recruitment

UT GEAR UP for Industry Development and Educational Success (GUIDES 2025) Site Coordinator – Coldspring-Oakhurst Consolidated ISD

Mission Development Manager

Foundations Manager, Austin Texas or Portland Oregon

Acute Flaccid Myelitis Epidemiologist III

Multi-Medical Assistant

Energy Engineer II

Test Team Deputy Director

More jobs to discover

Explore jobs in cities nearby

I want to receive the latest job alert for data evaluator in austin, tx

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected