Jon Title: Senior Data Engineer
Location: Memphis, TN – Remote
Job Type: Contract
Experience: 15+ Years
Job Summary
We are seeking an experienced Senior Data Engineer with strong expertise in Azure Databricks, Spark, Python, SQL, and Azure data services to design and develop scalable cloud-based data solutions for healthcare analytics.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks, PySpark, Azure Synapse, and Azure Data Factory.
- Process and integrate both structured and unstructured healthcare data, including EHR, claims, and related data sources.
- Build and optimize data solutions using Delta Lake, Azure Data Lake, Azure SQL, Databricks, and Synapse Analytics.
- Implement modern Lakehouse Architecture and data warehousing solutions for enterprise analytics.
- Support machine learning and predictive analytics initiatives by preparing and engineering high-quality datasets.
- Ensure data quality, integrity, governance, security, and compliance with HIPAA and applicable healthcare regulations.
- Work closely with data scientists, analysts, and software engineers to deliver reliable and high-performance data solutions.
- Implement and maintain CI/CD pipelines and automation for data engineering workflows.
- Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and scalability.
- Participate in technical design reviews and contribute to data platform architecture decisions.
- Follow and promote data engineering best practices across development and production environments.
Required Skills & Qualifications
- 8+ years of professional experience in Data Engineering, with strong hands-on experience in Azure cloud environments.
- Strong expertise in developing data pipelines using Python, SQL, Spark/PySpark, and Azure Databricks.
- Solid understanding of Delta Lake, Lakehouse Architecture, data warehousing, and modern data platforms.
- Hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, and Azure SQL.
- Experience working with healthcare datasets such as EHR and claims data.
- Strong understanding of healthcare data standards including FHIR and HL7.
- Experience supporting machine learning, predictive analytics, or data science initiatives.
- Practical experience implementing DevOps and CI/CD practices for data engineering workflows.
- Strong understanding of data security, governance, quality, and HIPAA compliance.
- Excellent problem-solving, communication, and collaboration skills in an Agile environment.
- Azure Data Engineer or Databricks certification is preferred.
Pay: $60.00 - $70.00 per hour
Application Question(s):
- How many years of experience you have?
Work Location: Remote
