Top 15 Data evaluator Jobs in Austin, Tx

AI QA Trainer - LLM Evaluation - Freelance Project
Meridial —Austin, TX
- $6 - $65 an hour
- Remote
- Computer Science
- Master's degree
- SQL
Research Analyst
Health & Human Services Comm —Austin, TX
- $5,425.33 - $7,155.75 a month
- Online Application
- Microsoft Excel
- Microsoft Outlook
- Office
- Health insurance
- Opportunities for advancement
Quick Apply
2d
Laboratory Technician III
Dept of State Health Services —Austin, TX
- $3,907.90 - $4,494.09 a month
- Weekends as needed
- Clean driving record
- Maintenance
- Mid-level
Quick Apply
14d
Head of Insights & Impact - Austin, TX
Michael & Susan Dell Foundation —Austin, TX
- Office
- Analysis skills
- Children
Quick Apply
Language Fluency Instructors - Freelance AI Trainer Project
Meridial —Austin, TX
- $6 - $65 an hour
- Remote
- English
- Mid-level
- Analysis skills
- Health insurance
Field Associate - Property Showings & Evaluations
Doorstead —Austin, TX
- Contract
- Office
- Real Estate License
- Driver's License
Quick Apply
Sign Language Interpreter
US Internal Revenue Service —Austin, TX
- $76,777 - $99,816 a year
- Online Application
- Background check
- 18 years or older
- High school
8d
Account Executive
AppDirect —Austin, TX
- $116,450 - $143,850 a year
- Bachelor of Science
- Mid-level
- 3 years
Quick Apply
Lab Procurement Group Manager
Dept of State Health Services —Austin, TX
- $7,000 - $7,500 a month
- Online Application
- Hybrid work
- Microsoft Outlook
- Word processing
- Writing skills
Quick Apply
Senior Product Manager, Identity Security
Trend Micro —Austin, TX
- Full-time
- Computer Science
- Product management
- US work authorization
- Wellness program
- Paid holidays
Test Team Deputy Director
Allen Control Systems —Austin, TX
- Full-time
- Bachelor of Science
- Engineering
- Travel
- Health insurance
- Dental insurance
Quick Apply
Mission Development Manager
Gallatin —Austin, TX
- Full-time
- Military
- Contracts
- Senior level
- Health insurance
- 401(k)
Board Certified Behavior Analyst (BCBA)
Assessment Intervention Management —Austin, TX
- Full-time
- Background check
- Clean driving record
- Mid-level
- Disability insurance
- Dental insurance
Quick Apply
10d
Psychologist III-Forensic Evaluator
Health & Human Services Comm —Austin, TX
- $8,184.00 - $11,864.50 a month
- Extended hours
- 18 years or older
- Doctoral degree
- Psychiatry
- Health insurance
- Opportunities for advancement
Quick Apply
9d
Principal Accountant
CesiumAstro —Austin, TX
- Full-time
- Microsoft Word
- CPA
- 11+ years
- Health savings account
- Health insurance
7d

More jobs to discover

Find similar jobs that you might be interested in.

Market Research Analyst
Intellibright —Austin, TX
You will own real research projects that directly shape the strategy and content our team uses every day. Research demographic makeup, average budgets, income…
Up to $30 an hour
Quick Apply
Research Analyst
Health & Human Services Comm —Austin, TX
The Research Analyst designs and conducts research and evaluation studies requiring data collection, analysis, and reporting; applies advanced research designs…
$5,425.33 - $7,155.75 a month
Quick Apply
2d

Show more similar jobs

Explore jobs in cities nearby

Check out jobs in cities near your current location, Columbus

Registered Nurse (RN), Operating Room, Full-time, Varies, ONA
UC Health, LLC —Ohio
Promotes patient's independence by establishing patient care goals, teaching the patient/ family to understand condition medications, and self-care skills and…
Quick Apply
Full-Time Occupancy Evaluator
FAR Inspections —Dublin, OH
As an independent contractor, you are responsible for providing your own equipment, including: Based in Reno, NV, we have a 12-year track record of excellence…
$25 - $35 an hour

Show more jobs in cities nearby

I want to receive the latest job alert for data evaluator in austin, tx

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

data evaluator jobs near austin, tx

AI QA Trainer - LLM Evaluation - Freelance Project

Meridial
Austin, TX

Apply Now

Job Details

Freelance
$6 - $65 an hour

Qualifications

AI models
Software issue identification
Data integrity assurance
Regression testing implementation
Data quality checks
Defect resolution root cause analysis
Statistics
Computer Science
Bug Tracking (Quality assurance practices)
Automation
Bachelor's degree in statistics
Multilingual
Tooling
Testing and evaluation
AI tools proficiency
Data reporting
Bug Reporting (Quality assurance practices)
Metrics Reporting
Prompt engineering
Master's degree
SQL
Quality control data reporting
Doctoral degree in Computer Science
Linguistics
Bachelor's degree
Ph.D. in statistics
Doctor of Philosophy
System validation
Issue tracking
Master's degree in statistics

Full Job Description

Are you an AI QA expert eager to shape the future of AI? Large-scale language models are evolving from clever chatbots into enterprise-grade platforms. With rigorous evaluation data, tomorrow's AI can democratize world-class education, keep pace with cutting-edge research, and streamline workflows for teams everywhere. That quality begins with you—we need your expertise to harden model reasoning and reliability.

We're looking for AI QA trainers who live and breathe model evaluation, LLM safety, prompt robustness, data quality assurance, multilingual and domain-specific testing, grounding verification, and compliance/readiness checks. You'll challenge advanced language models on tasks like hallucination detection, factual consistency, prompt-injection and jailbreak resistance, bias/fairness audits, chain-of-reasoning reliability, tool-use correctness, retrieval-augmentation fidelity, and end-to-end workflow validation—documenting every failure mode so we can raise the bar.

On a typical day, you will converse with the model on real-world scenarios and evaluation prompts, verify factual accuracy and logical soundness, design and run test plans and regression suites, build clear rubrics and pass/fail criteria, capture reproducible error traces with root-cause hypotheses, and suggest improvements to prompt engineering, guardrails, and evaluation metrics (e.g., precision/recall, faithfulness, toxicity, and latency SLOs). You'll also partner on adversarial red-teaming, automation (Python/SQL), and dashboarding to track quality deltas over time.

A bachelor's, master's, or PhD in computer science, data science, computational linguistics, statistics, or a related field is ideal; shipped QA for ML/AI systems, safety/red-team experience, test automation frameworks (e.g., PyTest), and hands-on work with LLM eval tooling (e.g., OpenAI Evals, RAG evaluators, W&B) signal fit. Skills that stand out include: evaluation rubric design, adversarial testing/red-teaming, regression testing at scale, bias/fairness auditing, grounding verification, prompt and system-prompt engineering, test automation (Python/SQL), and high-signal bug reporting. Clear, metacognitive communication—"showing your work"—is essential.

Ready to turn your QA expertise into the quality backbone for tomorrow's AI? Apply today and start teaching the model that will teach the world.

We offer a pay range of $6-to- $65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you'll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.

Employment type: Contract
Workplace type: Remote
Seniority level: Mid-Senior Level

Apply Now

Refine Your Search

data evaluator jobs in austin, tx

AI QA Trainer - LLM Evaluation - Freelance Project

Research Analyst

Laboratory Technician III

Head of Insights & Impact - Austin, TX

Language Fluency Instructors - Freelance AI Trainer Project

Field Associate - Property Showings & Evaluations

Sign Language Interpreter

Account Executive

Lab Procurement Group Manager

Senior Product Manager, Identity Security

Test Team Deputy Director

Mission Development Manager

Board Certified Behavior Analyst (BCBA)

Psychologist III-Forensic Evaluator

Principal Accountant

More jobs to discover

Explore jobs in cities nearby

I want to receive the latest job alert for data evaluator in austin, tx

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected