Top 5836 Sr. software development engineer in test, ai/ml Jobs in San Mateo, Ca

Software Development Engineer in Test, ML/AI
PlayStation Global —San Mateo, CA
- $140,500 - $210,700 a year
- Computer science
- Computer Science
- 3 years
- Wellness program
- Health insurance
Principal Data Scientist - AI Trainer
DataAnnotation —San Mateo, CA
- $40 - $60 an hour
- Part-time
- Remote
- Computer Science
- English
- Master's degree
- Flexible schedule
Quick Apply
Decision Scientist - AI Trainer
DataAnnotation —Berkeley, CA
- $40 - $60 an hour
- Part-time
- Remote
- Computer Science
- English
- Mid-level
- Flexible schedule
Quick Apply
Senior Electrical Characterization Engineer
Capgemini —San Francisco, CA
- Full-time
- 5 years
- Master's degree
- In-person
- Paid holidays
- Disability insurance
Senior Fiber Optic Module Packaging Engineer
Coherent Corp. —Sunnyvale, CA
- $88,169 - $163,081 a year
- Full-time
- Microsoft Outlook
- Computer literacy
- Bachelor of Science
Predictive Modeler - AI Trainer
DataAnnotation —Palo Alto, CA
- $40 - $60 an hour
- Part-time
- Remote
- Computer Science
- English
- Mid-level
- Flexible schedule
Quick Apply
Lead Electrical Engineer
Coherent Corp. —Fremont, CA
- $100,625 - $172,250 a year
- Overtime
- Mid-level
- Office
- Doctor of Philosophy
Refrigeration & HVAC Technician (Mid/Senior)
IEC Services —San Francisco Bay Area, CA
- $30 - $45 an hour
- Full-time
- Background check
- Clean driving record
- Ability to walk for extended periods
- Fuel card
- Health savings account
Quick Apply
Pricing Analyst - AI Trainer
DataAnnotation —Fremont, CA
- $40 - $60 an hour
- Part-time
- Remote
- Computer Science
- English
- Mid-level
- Flexible schedule
Quick Apply
Sr. Principal Hardware Architect for Optical Transceivers
Coherent Corp. —Fremont, CA
- $127,875 - $223,813 a year
- Full-time
- Bachelor of Science
- Office
- Analysis skills
Electrical Engineer Signal Integrity and Power Integrity Technical Lead (7400)
Advantest —San Jose, CA
- $129,650 - $200,400 a year
- Full-time
- Background check
- Bachelor of Science
- System design
- Health insurance
- Dental insurance
Quick Apply
System QA Engineer
TMP Worldwide India Private Limited for ERS US —Cupertino, CA
- $83,000 - $110,000 a year
- Email
- Computer science
- Computer Science
- Bachelor of Science
- AD&D insurance
- Paid holidays
Quick Apply
Labview Engineer
TMP Worldwide India Private Limited for ERS US —Milpitas, CA
- $71,000 - $108,000 a year
- Email
- 8 years
- Bachelor's degree
- In-person
- AD&D insurance
- Paid holidays
Quick Apply
Senior Applications Engineer
ASML —San Jose, CA
- $120,750 - $201,250 a year
- Full-time
- Research
- Doctor of Philosophy
- Travel
- Paid holidays
- Dental insurance
VP of Engineering - Optical Circuit Switching
The Hiring Method, LLC —Sunnyvale, CA
- $300,000 - $325,000 a year
- Office
- Doctor of Philosophy
- Product management
- Relocation assistance
- Health insurance
Quick Apply
Sr. Application Developer
University of California San Francisco —San Francisco, CA
- $101,300 - $190,000 a year
- Full-time
- Computer Science
- Mid-level
- Office
- Health savings account
- Health insurance
Quick Apply
Senior Manager AI/ML Engineering - Remote
UnitedHealth Group —San Francisco, CA
- $148,900 - $255,300 a year
- Full-time
- Azure
- Computer Science
- Pass drug screening
Senior Principal Engineer- End-to-End AI Training Framework
Bosch Group —Sunnyvale, CA
- $240,000 - $320,000 a year
- Full-time
- Background check
- Management
- Computer Science
- Health savings account
- Disability insurance
Principal Data Architect
Delta Dental —Oakland, CA
- $123,624 - $267,751 a year
- Full-time
- Hybrid work
- Background check
- Azure
- System design
- Paid holidays
- Health insurance
Senior Manager, Financial Planning & Analysis (FP&A)
Delta Dental —Oakland, CA
- $123,624 - $267,852 a year
- Full-time
- Hybrid work
- Background check
- Oracle
- CPA
- Paid holidays
- Health insurance

I want to receive the latest job alert for sr. software development engineer in test, ai/ml in san mateo, ca

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

sr. software development engineer in test, ai/ml jobs near san mateo, ca

Senior Ai Ml Engineer jobs in San Francisco, CA

Refrigeration Technician jobs in San Francisco Bay Area, CA

Software Test Engineer jobs in San Mateo, CA

Senior Application Developer jobs in San Francisco, CA

Engineer jobs in Milpitas, CA

Principal Software Engineer jobs in Sunnyvale, CA

Electrical Engineer jobs in Fremont, CA

Electrical Engineer jobs in San Jose, CA

Principal Data Architect jobs in Oakland, CA

Vice President Of Engineering jobs in Sunnyvale, CA

Electronics Engineer jobs in San Francisco, CA

Senior Application Engineer jobs in San Jose, CA

Senior Optical Engineer jobs in Billerica, MA

Optical Engineer jobs in Seattle, WA

Senior Optical Engineer jobs in New York, NY

Senior Optical Engineer jobs in Greenwood Village, CO

Senior Optical Engineer jobs in Bothell, WA

Part Time Senior jobs in Portland, OR

Industrial Engineer jobs in New Jersey

Director Of Financial Planning And Analysis jobs in Blue Ash, OH

Software Development Engineer in Test, ML/AI

PlayStation Global -
San Mateo, CA

Apply Now

Job Details

$140,500 - $210,700 a year

Benefits

Wellness program
Health insurance
Dental insurance
Paid time off
Vision insurance
401(k) matching
Employee discount

Qualifications

AI models
Containerization systems
Performance monitoring
Software engineering
RESTful API
Tooling
Public Cloud
Quality assurance experience within IT
Databases
Microservices
IT monitoring tools
Machine learning
Release management
Agile software development
Distributed computing
DevOps automation
Model evaluation
Debugging

Full Job Description

Position Type:

Location(s):

United States, San Mateo, CA

Date Posted:

Job ID:

R-124503

Why Sony Interactive Entertainment?

Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity.

Software Development Engineer In Test, ML/AI

PlayStation offers more than just the Best Place to Play; it is also a top workplace. Today, we are a global entertainment leader. Our portfolio includes PlayStation®5, PlayStation®4, PlayStation®VR, PlayStation®Plus, and well-known software from PlayStation Studios.

PlayStation works to foster an inclusive environment where employees feel supported and diversity is valued. We encourage individuals with passion and curiosity for innovation, technology, and play to apply for our open roles and become part of our growing distributed team.

The PlayStation brand falls under Sony Interactive Entertainment, a wholly-owned subsidiary of Sony Group Corporation.

At SIE, we believe in making play safer for everyone. Within our Information Security team, we protect our people, platforms, and products with smart, scalable, and thoughtful solutions. Our mission is to provide clear, actionable risk and security insights that guide the business and enable amazing player experiences.

We’re building a team that thrives on collaboration, curiosity, and delivering real value. Come help us make a difference!

Overview

We are hiring a Software Engineer in Test specializing in ML/AI quality, including automation for model evaluation, LLM-assisted test generation, and validation of AI-powered workflows. The role includes guiding quality strategy and developing automation frameworks. You will also manage implementation for complex, cross-functional, machine learning-powered products and services. This role involves more than test development. You will lead quality initiatives from start to finish, ensuring teams stay synchronized, dependencies are managed, and releases are delivered confidently. You will work closely with ML, engineering, product, and infrastructure teams. You will shape how quality is built, monitored, and expanded while leading embedded QE efforts within projects.

What you’ll do

Define and complete quality strategies, test plans, and automation coverage for ML-powered services and platform components.
Use LLMs and other AI-assisted techniques to generate, expand, and maintain high-value test cases for ML-powered workflows.
Design scenario-based test suites for AI features, including adversarial prompts, edge cases, ambiguous inputs, and underrepresented user scenarios.
Lead QE efforts for multi-functional projects, driving risk assessment, dependency management, and release readiness.
Design, develop, and maintain scalable automation frameworks for backend services, APIs, and ML inference systems using Python and/or Java.
Build automated validation for ML and LLM outputs, including ranking behavior, score distributions, prompt/response quality, hallucination indicators, and probabilistic model evaluation.
Debug test failures, service anomalies, model inconsistencies, and AI behavior regressions to identify root causes and drive resolution.
Perform functional, integration, regression, API, end-to-end, performance, and reliability testing for distributed systems.
Improve automation reliability, reduce flakiness, and optimize execution efficiency.
Partner with engineering and ML teams to integrate automated testing into CI/CD pipelines and release workflows.
Collaborate across teams to establish scalable quality standards, tooling, and guidelines.

Required qualifications

Bachelor’s degree in Computer Science or equivalent practical experience.
3+ years of experience as an SDET or QE engineer focused on backend and distributed systems.
Experience using LLMs to generate, transform, and prioritize test cases for AI-powered experiences.
Experience with AI evaluation tooling, prompt evaluation frameworks, model monitoring, or human-in-the-loop review workflows.
Strong experience testing RESTful APIs, microservices, and distributed architectures.
Proficiency in Python, Java, JS or similar languages for automation development.
Hands-on experience with automation frameworks such as pytest, JUnit, Selenium, Playwright, Cypress, or Appium.
Experience with CI/CD systems and test pipelines (Jenkins, GitHub Actions, etc.).
Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker).
Familiarity with databases, monitoring, and observability tools.
Strong understanding of SDLC, Agile methodologies, and release processes.
Excellent problem-solving, debugging, and communication skills.

Preferred qualifications

Experience validating ML outputs using statistical analysis or scenario-based testing approaches.
Familiarity with ML infrastructure, data pipelines, or model-serving platforms (Seldon, KServe, Ray Serve, etc.).
Prior work in content moderation ML, security, fraud detection, or adversarial ML.
Experience testing high-scale, low-latency online services.
Experience with Databricks or similar ML platform tooling.
Familiarity with Node.js, React, or modern frontend technologies.
Experience testing mobile, console, or other non-PC platforms.

What sets you apart

Strong combination of automation engineering and delivery ownership.
Ability to drive quality across complex cross-functional initiatives.
Practical understanding of how to test non-deterministic AI systems and separate model variance from quality regressions.
Proven risk management and dependency coordination skills.
Ability to influence engineering teams and promote quality guidelines.
Passion for scalable, reliable, and maintainable automation systems.

At SIE, we consider several factors when setting each role’s base pay range, including the competitive benchmarking data for the market and geographic location.

Please note that the base pay range may vary in line with our hybrid working policy and individual base pay will be determined based on job-related factors which may include knowledge, skills, experience, and location.

In addition, this role is eligible for SIE’s top-tier benefits package that includes medical, dental, vision, matching 401(k), paid time off, wellness program and coveted employee discounts for Sony products. This role also may be eligible for a bonus package.

The estimated base pay range for this role is listed below.

$140,500—$210,700 USD

Please note, Sony Interactive Entertainment conducts background checks at the offer stage for all new employees (which may include criminal background checks for some roles) and will need to process personal information to support these checks.

Please refer to our Candidate Privacy Notice for more information about what personal information we collect, how we use it, who we share it with, and your data protection rights.

Equal Opportunity Statement:

Sony is an Equal Opportunity Employer. All persons will receive consideration for employment without regard to gender (including gender identity, gender expression and gender reassignment), race (including colour, nationality, ethnic or national origin), religion or belief, marital or civil partnership status, disability, age, sexual orientation, pregnancy, maternity or parental status, trade union membership or membership in any other legally protected category.

We strive to create an inclusive environment, empower employees and embrace diversity. We encourage everyone to respond.

Sony Interactive Entertainment is a Fair Chance employer and qualified applicants with arrest and conviction records will be considered for employment.

Apply Now

Refine Your Search

sr. software development engineer in test, ai/ml jobs in san mateo, ca

Software Development Engineer in Test, ML/AI

Principal Data Scientist - AI Trainer

Decision Scientist - AI Trainer

Senior Electrical Characterization Engineer

Senior Fiber Optic Module Packaging Engineer

Predictive Modeler - AI Trainer

Lead Electrical Engineer

Refrigeration & HVAC Technician (Mid/Senior)

Pricing Analyst - AI Trainer

Sr. Principal Hardware Architect for Optical Transceivers

Electrical Engineer Signal Integrity and Power Integrity Technical Lead (7400)

System QA Engineer

Labview Engineer

Senior Applications Engineer

VP of Engineering - Optical Circuit Switching

Sr. Application Developer

Senior Manager AI/ML Engineering - Remote

Senior Principal Engineer- End-to-End AI Training Framework

Principal Data Architect

Senior Manager, Financial Planning & Analysis (FP&A)

I want to receive the latest job alert for sr. software development engineer in test, ai/ml in san mateo, ca

Related Searches

Explore jobs in more locations

Software Development Engineer In Test, ML/AI

Overview

What you’ll do

Required qualifications

Preferred qualifications

What sets you apart

Job Seeker Tools

Employer Tools

Browse

Stay Connected