Top 31 Member of technical staff — model optimization and inference (experienced) Jobs

Member of Technical Staff — Model Optimization and Inference (Experienced)
Nuance Labs —Seattle, WA
- $250,000 - $350,000 a year
- Office
- Senior level
- Commuter assistance
- Health savings account
Member of Technical Staff — RL Research (Experienced)
Nuance Labs —Seattle, WA
- $300,000 - $500,000 a year
- System design
- Office
- Senior level
- Commuter assistance
- Health savings account
Staff Data Scientist - AI Trainer
DataAnnotation —Roanoke, VA
- $50 - $100 an hour
- Part-time
- Remote
- Computer Science
- Writing skills
- English
- Flexible schedule
Quick Apply
5d
Staff Data Scientist - AI Trainer
DataAnnotation —Paramus, NJ
- $50 - $100 an hour
- Part-time
- Remote
- Computer Science
- Writing skills
- English
- Flexible schedule
Quick Apply
5d
Staff Data Scientist - AI Trainer
DataAnnotation —Berkeley Heights, NJ
- $50 - $100 an hour
- Part-time
- Remote
- Computer Science
- Writing skills
- English
- Flexible schedule
Quick Apply
5d
Staff Data Scientist - AI Trainer
DataAnnotation —Overland Park, KS
- $50 - $100 an hour
- Part-time
- Remote
- Computer Science
- Writing skills
- English
- Flexible schedule
Quick Apply
5d
Member of Technical Staff - ML Training Systems
Modal Labs —New York, NY
- $150,000 - $350,000 a year
- Full-time
- 5 years
- Office
- Senior level
12d
Research Staff, LLMs
Deepgram —Remote
- $150,000 - $250,000 a year
- Full-time
- Remote
- 3 years
- Presentation skills
- Senior level
Senior Member of Research Staff, Voleon Securities
The Voleon Group —New York, NY
- $275,000 - $300,000 a year
- Full-time
- Hybrid work
- 5 years
- Office
- Math
- Referral program
Staff Cloud Security Engineer
PlayStation Global —Remote
- $197,600 - $296,400 a year
- Remote
- Computer Science
- Bachelor's degree
- Machine learning
Quick Apply
Data and Analytics Engineer
Digital Strategy LLC —Remote
- $100,000 - $130,000 a year
- Full-time
- Remote
- Background check
- Computer science
- 7 years
- Health insurance
- Dental insurance
Quick Apply
9d
Principal Software Engineer
Amgen —Thousand Oaks, CA
- $157,020.50 - $212,439.50 a year
- Computer science
- Azure
- Doctoral degree
- Disability insurance
- Health insurance
Software Development Engineer, AI/ML, AWS Neuron, Model Inference
Amazon.com Services LLC —Cupertino, CA
- $165,200 - $223,600 a year
- Full-time
- Computer science
- Computer Science
- Software troubleshooting
- AD&D insurance
- Health insurance
Staff Platform Engineer
The University of Chicago —Chicago, IL
- $100,000 - $140,000 a year
- Full-time
- Background check
- Azure
- Computer Science
- Health insurance
- Paid time off
Software Development Engineer, AI/ML, AWS Neuron, Model Inference
Annapurna Labs (U.S.) Inc. —Cupertino, CA
- $165,200 - $223,600 a year
- Full-time
- Computer science
- Computer Science
- Software troubleshooting
- AD&D insurance
- Health insurance
Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference
Annapurna Labs (U.S.) Inc. —Cupertino, CA
- $193,300 - $261,500 a year
- Full-time
- Computer science
- Computer Science
- 5 years
- AD&D insurance
- Health insurance
Staff Data Scientist (Growth & Marketing)
Charlie Health —New York, NY
- $190,000 - $270,000 a year
- Full-time
- Office
- SQL
- Senior level
- Health insurance
Quick Apply
Senior Data Scientist, Audience Analytics for Healthy Communities
Fors Marsh —Remote
- $92,000 - $105,000 a year
- Full-time
- Remote
- 5 years
- SQL
- Doctor of Philosophy
- Disability insurance
- Dental insurance
Quick Apply
Senior Staff AI Engineer
JazzX AI —Los Altos, CA
- Computer science
- Computer Science
- Java
Quick Apply
Sr. Data Science & AI Engineer
NYU Langone Health —New York, NY
- $101,493.51 - $147,000.00 a year
- Online Application
- 5 years
- System design
- HIPAA
- Wellness program

I want to receive the latest job alert for member of technical staff — model optimization and inference (experienced)

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

member of technical staff — model optimization and inference (experienced) jobs near

Member of Technical Staff — Model Optimization and Inference (Experienced)

Nuance Labs
Seattle, WA

Apply Now

Job Details

$250,000 - $350,000 a year

Benefits

Commuter assistance
Health savings account
Visa sponsorship
Health insurance
401(k)
Paid time off

Qualifications

AI models
PyTorch
System performance optimization
AI platforms (beyond public GPTs)
Computational framework
Machine learning libraries
Machine learning frameworks

Full Job Description

About Nuance Labs

Nuance Labs is building photorealistic, real-time AI avatars with emotional intelligence: a full-duplex audiovisual system that can listen, speak, react, interrupt, and respond like a real person.

We're a research company, with PhDs from MIT, UW, Oxford, CMU, and Johns Hopkins, and industry experience from Apple, Meta, Amazon AGI, and Discord. The team is small, the work is real, and the problems are unsolved.

How Nuance Differentiates

Most conversational AI avatars today are hacks — a face slapped on a speech-to-speech pipeline, stuck in the uncanny valley: emotionless, mechanical, one-turn-at-a-time. Current systems take 2–5 seconds to respond; natural conversation requires sub-500ms. That's a 10x improvement, and it demands rethinking the entire stack.

That rethinking starts with full-duplex: an AI that listens and speaks simultaneously, perceives emotion in real time, and responds with a face that actually reflects it. It's an extremely hard problem, and we're developing foundation models designed for it from the ground up.

About the Role

We can train a great model. The next problem is making it fast enough to actually use in a real-time conversation — and that gap is enormous. A model that responds in 3 seconds is a demo. A model that responds in under 500ms is a product.

We’re looking for someone who specializes in taking trained models and squeezing every last millisecond out of them. You understand the full stack from model weights to serving infrastructure — quantization, KV cache optimization, kernel-level acceleration, batching strategies — and you know which lever to pull for which problem. You’ve worked with vLLM, SGLang, or similar frameworks at scale and have strong opinions about where they fall short.

This posting is aimed at experienced engineers and researchers who’ve operated at a senior to senior-staff level at big tech, a leading AI lab, or a high-traffic inference team. Everyone at Nuance is MTS — we don’t run title ladders — but we’re hiring people who have already done this work at scale.

Our stack is more complex than a standard LLM deployment: we’re serving a full-duplex multimodal system that must satisfy strict real-time latency constraints. There’s a lot of unsolved optimization work here, and we need someone who finds that genuinely exciting.

What You’ll Do

Own end-to-end inference optimization across our model stack — LLMs, audio models, and diffusion-based components
Implement and tune KV cache strategies for long-context conversations, including eviction policies, compression, and memory-efficient attention
Evaluate, deploy, and extend inference serving frameworks (vLLM, SGLang, TensorRT-LLM, etc.) for our specific workloads
Profile and benchmark end-to-end latency and throughput; identify and systematically eliminate bottlenecks
Build internal tooling that makes optimization work faster and more rigorous — profiling viewers, end-to-end inference test harnesses, and other infrastructure that helps the team move quickly
Accelerate diffusion model inference — consistency models, step distillation, caching strategies, and custom kernel optimizations
Apply and develop quantization techniques (INT8, INT4, GPTQ, AWQ, and beyond) to reduce memory footprint and increase throughput without meaningfully degrading quality
Work closely with research and infrastructure to ensure new models ship with optimized serving from day one

What We’re Looking For

Significant hands-on experience with LLM inference optimization — you’ve shipped work on KV caching, memory layout, attention kernels, or batching strategies in a production or high-traffic research context
Proven proficiency with inference serving frameworks — vLLM, SGLang, TensorRT-LLM, or similar — including going well beyond default configurations and adapting them to non-standard workloads
Experience optimizing diffusion model inference (latency reduction, step distillation, caching, or kernel-level work)
Strong Python and PyTorch skills; comfort reading and writing CUDA or Triton kernels is a significant plus
A systematic approach to profiling and optimization — you measure first, then optimize
Familiarity with speculative decoding or other inference-time acceleration techniques

Bonus Points

Hands-on experience with post-training quantization (GPTQ, AWQ, or similar) and a clear sense of quality/performance tradeoffs
Familiarity with multimodal or streaming inference architectures
Experience deploying real-time AI systems with hard latency SLAs
Prior work at an AI lab, inference startup, or on a high-traffic model serving platform
Contributions to open-source inference frameworks

Compensation

$250,000 – $350,000 base salary, plus meaningful equity. We think long-term ownership matters and structure equity accordingly.

Logistics

Location: In-person in Seattle, five days a week — we believe in the compounding value of working shoulder-to-shoulder.
Visa sponsorship: We sponsor visas (O-1, H-1B, green card) from day one.
AI-native tooling: Do your best work with the best tools, including unlimited tokens.

Benefits

Health: HSA plan with ~$2,000 in annual company contributions — roughly 2x what most big tech companies put in.
Time off: 15 days of PTO plus public holidays, and we close the office for a full week at year-end.
Food: Lunch, drinks, and snacks on us every workday — the small thing that quietly makes the day better.
Commuter benefits: We help cover the cost of getting to the office.
401(k): In the works.

Nuance Labs is an equal opportunity employer. We believe diverse teams build better AI.

Apply Now

Refine Your Search

member of technical staff — model optimization and inference (experienced) jobs

Member of Technical Staff — Model Optimization and Inference (Experienced)

Member of Technical Staff — RL Research (Experienced)

Staff Data Scientist - AI Trainer

Staff Data Scientist - AI Trainer

Staff Data Scientist - AI Trainer

Staff Data Scientist - AI Trainer

Member of Technical Staff - ML Training Systems

Research Staff, LLMs

Senior Member of Research Staff, Voleon Securities

Staff Cloud Security Engineer

Data and Analytics Engineer

Principal Software Engineer

Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Staff Platform Engineer

Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Staff Data Scientist (Growth & Marketing)

Senior Data Scientist, Audience Analytics for Healthy Communities

Senior Staff AI Engineer

Sr. Data Science & AI Engineer

I want to receive the latest job alert for member of technical staff — model optimization and inference (experienced)

Explore jobs in more locations

About Nuance Labs

How Nuance Differentiates

About the Role

What You’ll Do

What We’re Looking For

Bonus Points

Compensation

Logistics

Benefits

Job Seeker Tools

Employer Tools

Browse

Stay Connected