Top 2109 Computational linguist, ai evaluation Jobs in San Francisco, Ca

Computational Linguist, AI Evaluation
TwelveLabs —San Francisco, CA
- $140,000 - $160,000 a year
- Full-time
- Hybrid work
- 5 years
- Office
- Organizational skills
- Dental insurance
- Paid time off
Scientific Evals
Edison Scientific —San Francisco, CA
- $160,000 - $300,000 a year
- Full-time
- Psychiatry
- Office
- Analysis skills
- Commuter assistance
- Paid parental leave
Researcher, Education Labs
Anthropic —San Francisco, CA
- $300,000 - $405,000 a year
- Hybrid work
- Office
- Bachelor's degree
- Software development
- Parental leave
- Flexible schedule
Research Scientist, Life Sciences (Computational)
Anthropic —San Francisco, CA
- $300,000 - $320,000 a year
- Hybrid work
- Computer Science
- Office
- Databases
- Parental leave
- Flexible schedule
AI Resident
Ema —San Francisco Bay Area, CA
- $4,000 a month
- Full-time
- System design
- No degree
- Entry level
1d
AI Engineer, Evaluation
Distyl AI —San Francisco, CA
- $150,000 - $250,000 a year
- Full-time
- Hybrid work
- Up to 50% travel
- System design
- Office
- Health savings account
- Health insurance
Risk Assessment Analyst (Youth AI Safety Institute)
COMMON SENSE MEDIA —San Francisco, CA
- $90,000 - $110,000 a year
- Full-time
- Background check
- Management
- Computer Science
- Health insurance
- Dental insurance
Quick Apply
Member of the Technical Staff, Biological Data
Output Biosciences —San Francisco, CA
- $150,000 - $350,000 a year
- Full-time
- Doctor of Philosophy
- Senior level
- 2 years
- Health insurance
- Dental insurance
5d
Risk Assessment Associate (Youth AI Safety Institute)
COMMON SENSE MEDIA —San Francisco, CA
- $30 - $38 an hour
- Full-time
- Background check
- Computer Science
- Mid-level
- Health insurance
- Dental insurance
Quick Apply
AI Analyst
Stanford University —Redwood City, CA
- $156,505 - $183,920 a year
- Full-time
- Hybrid work
- 8 years
- SQL
- Bachelor's degree
10d
Researcher, Trustworthy AI
OpenAI —San Francisco, CA
- $380,000 a year
- Full-time
- Mid-level
- Office
- 3 years
Researcher, Safety & Privacy
OpenAI —San Francisco, CA
- $295,000 - $445,000 a year
- Full-time
- Computer science
- Computer Science
- System design
Threat Intel Manager, CBRN-E & Advanced Weapons
Anthropic —San Francisco, CA
- $375,000 - $455,000 a year
- Weekends as needed
- Hybrid work
- Office
- Analysis skills
- Bachelor's degree
- Parental leave
- Flexible schedule
AI Residency
1X —San Carlos, CA
- $10,000 a month
- Full-time
- Computer Science
- Research
- Mid-level
- Paid holidays
- Dental insurance
Quick Apply
Researcher, Recursive Self-Improvement Safety
OpenAI —San Francisco, CA
- $295,000 - $445,000 a year
- Urgently hiring
- Management
- Machine learning
- Fair chance
Recruiter, AI/ML Research
OpenAI —San Francisco, CA
- $216,000 - $240,000 a year
- Full-time
- Hybrid work
- Office
- Fair chance
- Senior level
- Relocation assistance
- Work from home
Early Career Software Engineer – Applied AI
Wonderschool —San Francisco Bay Area, CA
- $100,000 - $120,000 a year
- Computer Science
- Office
- AWS
- Health insurance
- Paid time off
Quick Apply
Manager, AI Strategy & Partnerships
Visa U.S.A. Inc. —San Francisco, CA
- $146,200 - $233,700 a year
- Full-time
- Office
- Analysis skills
- Bachelor's degree
- Wellness program
- Health savings account
Product Manager, Claude Code Model Performance
Anthropic —San Francisco, CA
- $305,000 - $460,000 a year
- Hybrid work
- Mid-level
- Office
- Bachelor's degree
- Parental leave
- Flexible schedule
Technical AI Policy Researcher, Frontier Risk - Trust and Safety
TikTok —San Francisco, CA
- $93,600 - $220,400 a year
- Computer science
- Computer Science
- System design
- Paid parental leave
- Paid holidays

I want to receive the latest job alert for computational linguist, ai evaluation in san francisco, ca

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

computational linguist, ai evaluation jobs near san francisco, ca

Computational Linguist jobs in San Francisco, CA

Researcher jobs in San Francisco, CA

Partnership Manager jobs in San Francisco, CA

Coding Manager jobs in San Francisco, CA

Research Scientist jobs in San Francisco, CA

Risk Analyst jobs in San Francisco, CA

Risk Associate jobs in San Francisco, CA

Ai Ml Engineer jobs in San Francisco, CA

Ai Developer jobs in San Francisco, CA

Software Engineer jobs in San Francisco Bay Area, CA

Computational Linguist jobs in Philadelphia, PA

Computational Linguist jobs in San Jose, CA

Computational Linguist jobs in Raleigh, NC

Computational Designer jobs in New York, NY

Computational Linguist jobs in South Hadley, MA

Legal Researcher jobs in Dallas Fort Worth, TX

Political Researcher jobs in Washington, DC

Senior Ux Researcher jobs in Remote

User Experience Researcher jobs in San Jose, CA

Security Manager jobs in Dallas, TX

Computational Linguist, AI Evaluation

TwelveLabs -
San Francisco, CA

Apply Now

Job Details

Full-time
$140,000 - $160,000 a year

Benefits

Dental insurance
Paid time off
Parental leave
Vision insurance

Qualifications

Data-driven problem-solving

Full Job Description

Who We Are:

Video is 90% of the world's data. Most of it is invisible to machines.
TwelveLabs builds the intelligence layer to change that. Our multimodal AI models understand video the way humans do — across sight, sound, and motion — and power production-scale AI workloads across media, entertainment, sports, security, and government.

We have raised more than $210 million from NEA, Radical Ventures, Amazon, NVIDIA, Snowflake, Databricks, Index Ventures, NAVER Ventures, Korea Investment Partners, Quadrille Capital, Red Bull Ventures, and AI pioneers including Fei-Fei Li, Silvio Savarese, and Alexandr Wang.

We are a global company, headquartered in San Francisco with offices in Seoul, New York, and London, and employees around the world. We believe the differences in our cultural, educational, and life experiences make our products stronger. Building technology that understands the world in all its complexity requires people who see it from every angle. We are looking for individuals who are driven by hard problems and want their work to matter. Come build it with us!

About the Role:

You will be a vital member of our ML Data Operations Team – which leads the full spectrum of video-language data collection, labeling operations, and model quality measurement. This role comes with high ownership and includes responsibilities such as defining dataset and evaluation requirements in consultation with our research and product teams; designing and building data pipelines; and coordinating with our vendor partners that execute at scale. You will also be responsible for automating as much of the repetitive partnership and annotation-quality-evaluation work as possible. A desire to work cross functionally and to build relationships is critical for success in this position.

Position is hybrid in San Francisco - onsite Tuesdays & Thursdays.

In this role, you will:

Evaluation Strategy & Design: Define and build evaluation protocols for video-language model quality, working with Research and Product teams to translate ambiguous quality questions into measurable, repeatable benchmarks or evaluation flows.
Data-to-Insight Pipelines: Turn raw customer and usage data into structured signal, building pipelines and analyses that surface where our models are underperforming and working with XFN partners to translate these insights into concrete improvement plans.
Labeling Operations: Design and execute video-language data collection and labeling projects, automating repetitive processes so the team can focus on higher-leverage work.
Vendor & Partner Collaboration: Coordinate with vendor and outsourcing partners executing at scale, keeping quality high through clear guidelines and feedback loops.
Cross-Functional Partnership: Work closely with Engineering and Research teams to align on top-priority data and evaluation needs, communicating findings through dashboards and reports that drive decisions.

You may be a good fit if you have:

Direct experience building or running model evaluation pipelines (benchmark design, human eval frameworks, automated scoring systems), and translating ambiguous quality questions into measurable criteria.
5+ years of experience working in an AI focused data operations organization.
A proven track record designing and executing large scale data projects, including gathering, labeling, and post-processing data.
The ability to analyze messy and complex data, identify overarching patterns, and distill your findings into crisp annotation guidelines or other accessible documentation.
Proficiency with Python, agentic coding, or other popular industry tools for automation.
Excellent communication and project management skills, and the ability to support several projects simultaneously.
A foundational understanding of and interest in LLMs/VLMs and multimodal AI.
Conviction that data is the key ingredient for the performance of AI models.

Preferred Qualifications:

Experience in data collection and labeling for multimodal language models.
Experience working with research scientists and engineers.
Experience planning and operating new data tools and labeling systems.
Expertise or interest in video-centric domains, such as sports, advertising, and content creation.

Tech Stack:

Technical: Python, FFMPEG, AWS (S3, EC2)
Project Management: Linear, Notion, Google Suite, Encord

Even if there are a few checkboxes that aren’t ticked through your prior experience, we still encourage you to apply! If you are a 0-1 achiever, a ferocious learner, and a kind and fun team player who motivates others, you will find a home at TwelveLabs.

We are a global company that values the uniqueness of each person’s journey. It is the differences in our cultural, educational, and life experiences that allow us to constantly challenge the status quo. We are looking for individuals who are motivated by our mission and eager to make an impact as we push the bounds of technology to transform the world. Join us as we revolutionize video understanding and multimodal AI.

Benefits and Perks:

An open and inclusive culture and work environment

Work closely with a collaborative, mission-driven team on cutting-edge AI technology

Full health, dental, and vision benefits

Extremely flexible PTO and parental leave policy. Office closed the week of Christmas and New Years

Monthly wellness stipend

Annual Learning & Development stipend to invest in your growth

Global offices in San Francisco and Seoul, and co-working office memberships for remote team members

Transportation stipend (SF onsite/hybrid only)

Daily lunch & dinner provided (SF onsite/hybrid only)

Compensation Range: $140K - $160K

Apply Now

Refine Your Search

computational linguist, ai evaluation jobs in san francisco, ca

Computational Linguist, AI Evaluation

Scientific Evals

Researcher, Education Labs

Research Scientist, Life Sciences (Computational)

AI Resident

AI Engineer, Evaluation

Risk Assessment Analyst (Youth AI Safety Institute)

Member of the Technical Staff, Biological Data

Risk Assessment Associate (Youth AI Safety Institute)

AI Analyst

Researcher, Trustworthy AI

Researcher, Safety & Privacy

Threat Intel Manager, CBRN-E & Advanced Weapons

AI Residency

Researcher, Recursive Self-Improvement Safety

Recruiter, AI/ML Research

Early Career Software Engineer – Applied AI

Manager, AI Strategy & Partnerships

Product Manager, Claude Code Model Performance

Technical AI Policy Researcher, Frontier Risk - Trust and Safety

I want to receive the latest job alert for computational linguist, ai evaluation in san francisco, ca

Related Searches

Explore jobs in more locations

Who We Are:

About the Role:

In this role, you will:

You may be a good fit if you have:

Preferred Qualifications:

Tech Stack:

Benefits and Perks:

Job Seeker Tools

Employer Tools

Browse

Stay Connected