Data Platform & Pipeline Development
- Design, develop, and maintain cloud-native data pipelines using Databricks, Microsoft Azure Data Factory, and Microsoft Fabric to support data integration and analytics solutions.
- Implement incremental and real-time data ingestion strategies using a medallion architecture for data lake storage.
- Write, optimize, and maintain complex SQL queries to transform, integrate, and analyze data across enterprise systems.
- Develop solutions with a focus on scalability, maintainability, testability, and long-term operability within a continuous delivery mindset.
Data Operations & Reliability
- Support and troubleshoot legacy data platforms built on SSIS and SQL Server, ensuring high availability and performance of critical data processes.
- Identify, troubleshoot, and resolve data integration and data quality issues to ensure reliable production data delivery.
- Contribute to observability, automated validation, and CI/CD pipelines to support fast feedback and safe releases.
Agile Collaboration & Engineering Practices
- Collaborate daily with product owners, QA, and engineers through Scrum ceremonies including standups, backlog refinement, sprint planning, sprint reviews, and retrospectives.
- Participate in proof-of-concept efforts, technical spikes, and design discussions, providing thoughtful technical analysis and pragmatic recommendations.
- Apply XP engineering practices such as pairing, incremental delivery, continuous refactoring, and shared code ownership to maintain high-quality, evolvable systems.
- Clearly communicate technical concepts, risks, tradeoffs, and progress to both technical and non-technical stakeholders.
