Overview
We are seeking a highly skilled GDF (Google Dataflow) Expert to join our innovative data engineering team. In this role, you will be responsible for designing, developing, and optimizing data processing pipelines using Google Dataflow, a fully managed stream and batch processing service that enables scalable and efficient data workflows. Your expertise in quantum engineering will be instrumental in advancing our data infrastructure, ensuring high performance, reliability, and security. The ideal candidate will possess a strong background in cloud-based data processing technologies and demonstrate a passion for leveraging cutting-edge solutions to solve complex data challenges.
Duties
- Develop, deploy, and maintain robust data pipelines utilizing Google Dataflow to support large-scale data analytics and machine learning initiatives.
- Collaborate with cross-functional teams to understand data requirements and translate them into efficient Dataflow workflows.
- Optimize existing data processing architectures for scalability, speed, and cost-efficiency while ensuring adherence to best practices.
- Implement monitoring, logging, and alerting mechanisms to ensure pipeline reliability and troubleshoot issues proactively.
- Integrate Dataflow pipelines with other cloud services such as BigQuery, Cloud Storage, and Pub/Sub for seamless data ingestion and output.
- Apply principles of quantum engineering where applicable to enhance processing capabilities or develop innovative solutions.
- Document architecture designs, workflows, and technical procedures to facilitate knowledge sharing and future enhancements.
Qualifications
- Proven experience in designing and implementing data pipelines using Google Dataflow or similar cloud-based stream/batch processing frameworks.
- Strong understanding of distributed computing concepts and experience with Apache Beam SDK (the open-source framework underlying Dataflow).
- Knowledge of cloud infrastructure services within the Google Cloud Platform (GCP).
- Familiarity with quantum engineering principles is highly desirable to support advanced computational techniques.
- Proficiency in programming languages such as Java, Python, or Scala relevant to Dataflow development.
- Excellent problem-solving skills with an analytical mindset focused on performance optimization.
- Effective communication skills to collaborate with multidisciplinary teams across different regions. If you are passionate about harnessing the power of cloud computing and quantum engineering to transform data processing capabilities, we encourage you to apply today. Join us in pioneering innovative solutions that drive impactful insights across our organization.
Pay: $45.59 - $54.91 per hour
Benefits:
- 401(k)
- Dental insurance
- Health insurance
Work Location: Remote
