The Industrial Era, the Information Era, the Digital Era, the Globalization Era, the Sustainability Era, the Post-Truth Era, the Biotech Era—you name it, we’ve heard it, witnessed it, and we now want more!!
Dictated mandates never made history. VRIZE hollers all tech rebels, disruptors, creators, innovators, problem solvers, and whatever verb you bring for the creation of a ‘frictionless tech’ era.
The buck is 'YOU.' Are you ready to code your legacy?
Technology: AWS, Python, PySpark, Airflow
Sub-technology: Snowflake, Redshift, SQL/Hive, Jenkins, Docker, Kubernetes, GitLab, Bitbucket, Azure, Google Cloud Platform
-
Bachelor’s degree in Technology
-
5+ years of experience in Data Engineering
- Experience working in Agile/Scrum environments
We are looking for a candidate with 5+ years of experience in a Data Engineer role who has obtained a bachelor’s degree in technology and has experience with Agile/Scrum development processes and methodologies. The ideal candidate should have a proven track record in designing and implementing data solutions using modern data technologies and cloud platforms.
-
5+ years as a Data Engineer with a strong track record of designing and implementing data solutions
-
Proficient in Python and PySpark, with hands-on exposure to Airflow
-
Skilled in cloud data warehousing technologies such as Snowflake and Redshift
-
Well-versed in cloud platforms, including AWS, Azure, and Google Cloud Platform
-
Strong working knowledge of AWS services — S3, EC2, EMR, Glue, CloudWatch, Athena, and Lambda
-
Familiar with containerization and orchestration using Docker and Kubernetes
-
Adept at building CI/CD pipelines using tools like GitLab and Bitbucket
-
Experienced in data pipeline orchestration with Airflow and Jenkins
-
Solid understanding of database concepts, data modeling, schemas, and query languages such as SQL and Hive
-
Good to have: knowledge of Informatica
-
Retail domain exposure is a plus
-
Programming Languages: Python, PySpark, SQL
-
Cloud Platforms: AWS (S3, EC2, EMR, Glue, CloudWatch, Athena, Lambda); Azure; Google Cloud Platform
-
Data Warehouses: Snowflake, Redshift
-
Orchestration Tools: Airflow, Jenkins
-
Version Control & CI/CD: GitLab, Bitbucket
-
Containerization: Docker, Kubernetes
-
Design, develop, and maintain scalable data pipelines and architectures
-
Manage and monitor workflows using Airflow and other orchestration tools
-
Develop automation frameworks for the continuous integration and deployment of data processes
-
Ensure data accuracy, quality, and availability across all stages of the pipeline
-
Collaborate with cross-functional teams to define and document data engineering best practices
-
Troubleshoot data-related issues and optimize performance
-
Contribute to the continuous improvement of data engineering standards and practices