Job Title: AI/ML Architect/Senior Engineer (OpenAI & Databricks)
Job Type: Full-Time
Location: Remote (U.S. based) with occasional travel to client or partner sites as needed
Clearance Requirement: U.S. Citizenship and Green Card Holder with the ability to obtain a clearance
- Ideally US Citizen OR Green Card Holder - A minimum of 3-5 years of continuous U.S. residency is requires due to Federal Background check requirements
POSITION OVERVIEW
We are seeking a highly skilled AI/Machine Learning Architect and Senior Engineer to design, develop, and deploy advanced AI solutions leveraging OpenAI models, Databricks, and Azure cloud infrastructure. This is a remote position with occasional travel for key project milestones, client workshops, and team alignment sessions.
The ideal candidate will bring deep expertise in machine learning architecture, large language model integration, distributed computing, and container orchestration (Kubernetes). You will work across the full AI/ML lifecycle — from data engineering and model development to deployment, scaling, and optimization — ensuring robust, secure, and high-performance solutions.
KEY RESPONSIBILITIES
AI/ML Architecture & Solution Design
- Lead the design and implementation of scalable AI/ML architectures using OpenAI APIs and Databricks ML workflows.
- Develop strategies for fine-tuning and integrating large language models into business applications.
- Architect and implement MLOps pipelines for continuous integration, testing, deployment, and monitoring.
- Define best practices for data ingestion, feature engineering, and model serving in cloud-native environments.
Cloud & Platform Engineering
- Design and manage deployments on Microsoft Azure, leveraging services such as Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Databricks.
- Orchestrate AI workloads on Kubernetes for scalability, fault tolerance, and cost optimization.
- Implement containerized microservices for AI applications, ensuring secure and efficient execution.
Data Engineering & Processing
- Develop high-performance ETL pipelines on Databricks for structured and unstructured data.
- Optimize data storage, retrieval, and processing for AI training and inference workloads.
- Ensure data quality, lineage, and compliance with applicable standards.
Collaboration & Technical Leadership
- Collaborate with data scientists, software engineers, and business stakeholders to translate requirements into production-ready solutions.
- Provide technical leadership, mentorship, and code reviews for AI/ML engineering teams.
- Stay current with advances in AI/ML frameworks, cloud services, and MLOps practices.
Required Qualifications
- Bachelor’s or Master’s degree in Computer Science, Data Science, or related field.
- 7+ years in software engineering or data engineering, with at least 4 years in AI/ML architecture.
- Expert-level experience with OpenAI API integrations and Databricks ML.
- Strong proficiency in Kubernetes (AKS preferred) and cloud-native architectures.
- Proven experience deploying and scaling AI solutions on Azure.
- Proficiency in Python, SQL, and distributed computing frameworks (e.g., Spark).
- Familiarity with MLOps tools and best practices (e.g., MLflow, CI/CD for ML).
Preferred Qualifications
- Experience fine-tuning large language models (LLMs) for domain-specific applications.
- Knowledge of prompt engineering, embeddings, and retrieval-augmented generation (RAG).
- Azure certifications (e.g., Azure Solutions Architect Expert, Azure AI Engineer Associate).
- Contributions to open-source AI/ML projects or publications in the field.
Work Environment
- Remote-first with flexibility to travel for project kick-offs, customer workshops, and strategic planning sessions.
- Collaboration via cloud-based DevOps, version control, and project management tools.
Thank You
Arnav Acharya
Recruitment Professional
LinkedIn https://www.linkedin.com/in/arnav-nidhi-acharya-ab4220234/ (Messages)
(c) (630)-634-0003
Avilamb, Inc | www.avilamb.com
Pay: $129,414.77 - $170,854.36 per year
Benefits:
Application Question(s):
- Clearance Requirement: U.S. Citizenship and Green card holder with the ability to obtain a clearance
Education:
Work Location: Remote
