ML Ops Engineer
ML Ops Engineer
Fully REMOTE - working mostly East Coast/Central hours
Compensation up to $180,000 depending on location, experience and skills
We're seeking an experienced ML Ops Engineer to build and scale the infrastructure, automation, and operational processes that support production machine learning and AI systems. This role will partner closely with Data Science, Data Engineering, and Product teams to ensure models are deployed, monitored, governed, and continuously improved in a secure, regulated environment.
Experience in healthcare and/or HIPAA compliance highly desired!
Responsibilities:
- Build and maintain end-to-end ML pipelines for model training, validation, deployment, and monitoring.
- Manage model lifecycle processes including versioning, promotion, deployment, and retirement.
- Design scalable infrastructure for real-time and batch model serving using APIs, containers, and cloud-native technologies.
- Develop feature store, data versioning, and training-serving consistency solutions.
- Support generative AI and LLM applications, including RAG architectures, prompt management, API integrations, guardrails, and usage monitoring.
- Implement monitoring for model drift, performance degradation, latency, and pipeline health.
- Establish CI/CD and continuous training workflows for machine learning systems.
- Automate infrastructure provisioning, security controls, secrets management, and compliance processes.
- Partner with technical teams to improve reliability, scalability, governance, and operational excellence across AI platforms.
- Provide technical leadership and mentor team members on MLOps best practices.
Qualifications:
- Master's degree in Computer Science, Software Engineering, or a related technical discipline.
- 7+ years of experience in DevOps, Data Engineering, ML Engineering, or related disciplines.
- 4+ years supporting production machine learning systems and model operations.
- Experience in healthcare, HIPAA, health technology, or other regulated environments preferred.
- Strong understanding of model deployment, observability, governance, and platform engineering.
- Docker, Kubernetes, EKS
- Terraform and/or AWS CloudFormation
- MLflow
- Databricks (Delta Lake, Spark, Unity Catalog, Workflows, Vector Search)
- AWS: SageMaker, Bedrock, S3, Lambda, API Gateway, DynamoDB, Redshift, Athena, Glue, Step Functions, Kinesis, Secrets Manager
- Kafka and/or Kinesis streaming architectures
- Feature stores and data versioning frameworks
- LLM operations, RAG infrastructure, prompt versioning, and AI governance
- Python, Bash, SQL
- Experience with REST APIs, event-driven architectures, and distributed systems
- Go or Java experience is a plus
- Strong communicator who can collaborate across Data Science, Engineering, and Product teams.
- Detail-oriented with a focus on reliability, scalability, security, and compliance.
- Passionate about modern AI infrastructure, MLOps best practices, and continuous improvement.
- Experienced in building production-grade machine learning platforms that support advanced analytics, NLP, and generative AI applications.
Benefits
Medical/Dental/Vision
401K with 40% match up to first 6% of associated contributions
PTO, Holidays, Personal Days, Community Service Day
- For this position, you must be currently authorized to work in the United States without the need for sponsorship for a non-immigrant visa. This job was first posted by CyberCoders on 08/12/2026 and applications will be accepted on an ongoing basis until the position is filled or closed.Everforth CyberCoders is proud to be an Equal Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity or expression, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, status as a crime victim, disability, protected veteran status, or any other characteristic protected by law. Our hiring process includes AI screening for keywords and minimum qualifications, and a virtual recruiter as part of the application process. A human recruiter reviews all results. Click here for details on our virtual recruiter . Everforth CyberCoders will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable state and local law, including but not limited to the Los Angeles County Fair Chance Ordinance, the San Francisco Fair Chance Ordinance, and the California Fair Chance Act. Everforth CyberCoders is committed to working with and providing reasonable accommodation to individuals with physical and mental disabilities. Individuals needing special assistance or an accommodation while seeking employment can contact a member of our Human Resources team at
[email protected] to make arrangements.
Salary
$120000 - $180000 USD per year
