Top 33 Quantization accelerator transformer architecture Jobs

Software Engineer, Senior
Positron AI —Remote
- $150,000 - $250,000 a year
- Full-time
- Remote
- 7 years
- System design
- C++
Quick Apply
Sr. Staff ML Engineer, Hardware Software Co-Design
Rivian —Palo Alto, CA
- Full-time
- Computer Science
- System design
- Doctor of Philosophy
Quick Apply
2d
AI Inference Engineer
quadric, Inc —Burlingame, CA
- $110,000 - $270,000 a year
- Full-time
- Hybrid work
- Computer Science
- 5 years
- Office
- Health insurance
- Dental insurance
Quick Apply
AI Compiler and Performance Engineer
ElastixAI INC. —Seattle, WA
- Full-time
- Hybrid work
- Computer Science
- Bachelor of Science
- System design
- Commuter assistance
- Paid parental leave
Quick Apply
Staff Compiler Engineer
Neurophos —Austin, TX
- $250,000 - $315,000 a year
- Full-time
- Computer science
- Computer Science
- 5 years
- Health savings account
- Health insurance
Quick Apply
Performance Architect
Sandisk —Milpitas, CA
- Full-time
- Hybrid work
- System design
- Research
- 3 years
- Health savings account
- AD&D insurance
Quick Apply
AI/ML ASIC Architect
Sandisk —Milpitas, CA
- Full-time
- Hybrid work
- Master's degree
- Bachelor's degree
- Machine learning
- Health savings account
- AD&D insurance
Quick Apply
LLM Inference Frameworks and Optimization Engineer
Together AI —San Francisco, CA
- $160,000 - $230,000 a year
- Full-time
- Mid-level
- 3 years
- Analysis skills
- Health insurance
Sr. Staff ML Engineer, Quantization & Compression
Rivian —Palo Alto, CA
- Full-time
- Computer Science
- System design
- Doctor of Philosophy
Quick Apply
2d
Senior Autonomy Engineer
Brain Corp —San Diego, CA
- $151,545 - $183,449 a year
- Computer Science
- 5 years
- Office
Quick Apply
Edge ML Software Engineer (Model Optimization-PICO) - San Jose
ByteDance —San Jose, CA
- $212,800 - $450,000 a year
- Computer Science
- Office
- 3 years
- Paid parental leave
- Paid holidays
Research Staff, Voice AI Foundations
Deepgram —Remote
- $150,000 - $250,000 a year
- Full-time
- Remote
- Mid-level
- Analysis skills
- Math
- Paid holidays
- Disability insurance
Autonomous Driving Multimodal Model Algorithm Engineer
Black Sesame Technologies Inc —San Jose, CA
- $130,000 - $400,000 a year
- Full-time
- Computer Science
- C++
- Doctor of Philosophy
- Health savings account
- Health insurance
Quick Apply
Sr. Machine Learning Engineer
PICTOR LABS INC —California
- $200,000 - $260,000 a year
- Full-time
- Remote
- 7 years
- Azure
- AWS
Senior Deep Learning Software Engineer, TensorRT Performance
NVIDIA —Santa Clara, CA
- $152,000 - $287,500 a year
- Full-time
- Computer science
- Computer Science
- 3 years
Staff Autonomy Engineer
Brain Corp —San Diego, CA
- $169,525 - $205,215 a year
- On call
- 7 years
- Computer Science
- Office
- Health savings account
- Paid holidays
Quick Apply
Embedded AI Tooling Engineer
Analog Devices —Wilmington, MA
- $110,385 - $151,808 a year
- Full-time
- System design
- Travel
- Linux
- Paid holidays
- Health insurance
Senior Machine Learning Engineer, Firefly Foundry
Adobe —San Jose, CA
- $151,800 - $265,350 a year
- Full-time
- Computer science
- Azure
- Computer Science
AI Accuracy Architect
Qualcomm —San Diego, CA
- $158,400 - $237,600 a year
- Computer science
- Computer Science
- Doctor of Philosophy
Senior AI Architect, Foundation Models and SoC Co-Design – Autonomous Vehicles
NVIDIA —Santa Clara, CA
- $208,000 - $327,750 a year
- Full-time
- Computer science
- Computer Science
- System design
11d

I want to receive the latest job alert for quantization accelerator transformer architecture

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

quantization accelerator transformer architecture jobs near

Software Engineer, Senior

Positron AI
Remote

Quick Apply

Job Details

Full-time
$150,000 - $250,000 a year

Qualifications

AI models
Software engineering
C++
Computer hardware
System development
Machine learning (ML) fundamentals
Benchmarking
System performance monitoring

Full Job Description

About Positron AI

Positron AI specializes in developing custom hardware systems to accelerate AI inference. These inference systems offer significant performance and efficiency gains over traditional GPU-based systems, delivering advantages in both performance per dollar and performance per watt. Positron exists to create the world's best AI inference systems.

Role Overview

Senior Software Engineer – Machine Learning Systems & High-Performance LLM Inference

We are seeking a Senior Software Engineer to contribute to the development of high-performance software that powers execution of open-source large language models (LLMs) on our custom appliance. This appliance leverages a combination of FPGAs and x86 CPUs to accelerate transformer-based models. The software stack is written primarily in modern C++ (C++17/20) and heavily relies on templates, SIMD optimizations, and efficient parallel computing techniques.

Key Responsibilities

Design and implement high-performance inference software for LLMs on custom hardware.
Develop and optimize C++-based libraries that efficiently utilize SIMD instructions, threading, and memory hierarchy.
Work closely with FPGA and systems engineers to ensure efficient data movement and computational offloading between x86 CPUs and FPGAs.
Optimize model execution via low-level optimizations, including vectorization, cache efficiency, and hardware-aware scheduling.
Contribute to performance profiling tools and methodologies to analyze execution bottlenecks at the instruction and data flow levels.
Apply NUMA-aware memory management techniques to optimize memory access patterns for large-scale inference workloads.
Implement ML system-level optimizations such as token streaming, KV cache optimizations, and efficient batching for transformer execution.
Collaborate with ML researchers and software engineers to integrate model quantization techniques, sparsity optimizations, and mixed-precision execution.
Ensure all code contributions include unit, performance, acceptance, and regression tests as part of a continuous integration-based development process.

Required Qualifications

7+ years of professional experience in C++ software development, with a focus on performance-critical applications.
Strong understanding of C++ templates and modern memory management.
Hands-on experience with SIMD programming (AVX-512, SSE, or equivalent) and intrinsics-based vectorization.
Experience in high-performance computing (HPC), numerical computing, or ML inference optimization.
Experience with ML model execution optimizations, including efficient tensor computations and memory access patterns.
Knowledge of multi-threading, NUMA architectures, and low-level CPU optimization.
Proficiency with systems-level software development, profiling tools (perfetto, VTune, Valgrind), and benchmarking.
Experience working with hardware accelerators (FPGAs, GPUs, or custom ASICs) and designing efficient software-hardware interfaces.

Preferred Qualifications

Familiarity with LLVM/Clang or GCC compiler optimizations.
Experience in LLM quantization, sparsity optimizations, and mixed-precision computation.
Knowledge of distributed inference techniques and networking optimizations.
Understanding of graph partitioning and execution scheduling for large-scale ML models.

Leveling & Scope

While this role is currently posted at a specific level, we are a growth-oriented organization and are open to hiring at a more senior level for the right candidate. Please note that this job description serves as a focused but generalized overview of the role; specific responsibilities and impact expectations will be tailored to the experience and seniority of the final hire.

Why Join Us?

Work on a cutting-edge ML inference platform that redefines performance and efficiency for LLMs.
Tackle challenging low-level performance engineering problems in AI and HPC.
Collaborate with a team of hardware, software, and ML experts building an industry-first product.
Opportunity to contribute to and shape the future of open-source AI inference software.

Compensation and Benefits

The base salary range for this role is $150,000 – $250,000.

Please note that the figures provided represent the base salary range only and do not include other elements of our total compensation package, equity, or comprehensive benefits.

At Positron AI, we value the unique expertise each candidate brings. While the range above reflects our typical expectation for the position, we reserve the flexibility to exceed this range for candidates whose specialized skills, significant experience, or unique qualifications fall outside the standard scope of the role. Final offers are determined based on a variety of factors, including internal equity, and individual impact.

Equal Opportunity Employer. If you’re excited about the role but don’t meet every bullet, we’d still love to hear from you.

Quick Apply

Refine Your Search

quantization accelerator transformer architecture jobs

Software Engineer, Senior

Sr. Staff ML Engineer, Hardware Software Co-Design

AI Inference Engineer

AI Compiler and Performance Engineer

Staff Compiler Engineer

Performance Architect

AI/ML ASIC Architect

LLM Inference Frameworks and Optimization Engineer

Sr. Staff ML Engineer, Quantization & Compression

Senior Autonomy Engineer

Edge ML Software Engineer (Model Optimization-PICO) - San Jose

Research Staff, Voice AI Foundations

Autonomous Driving Multimodal Model Algorithm Engineer

Sr. Machine Learning Engineer

Senior Deep Learning Software Engineer, TensorRT Performance

Staff Autonomy Engineer

Embedded AI Tooling Engineer

Senior Machine Learning Engineer, Firefly Foundry

AI Accuracy Architect

Senior AI Architect, Foundation Models and SoC Co-Design – Autonomous Vehicles

I want to receive the latest job alert for quantization accelerator transformer architecture

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected