Job Overview
We are seeking a dynamic and highly skilled AWS Data Engineer to join our innovative data team. In this role, you will be at the forefront of designing, developing, and maintaining scalable data pipelines and architectures leveraging Amazon Web Services (AWS) cloud platform. Your expertise will enable the organization to harness the power of big data, facilitate advanced analytics, and support strategic decision-making. This position offers an exciting opportunity to work with cutting-edge technologies, collaborate across teams, and contribute to transformative data solutions that drive business growth.
Responsibilities
- Design, develop, and optimize scalable ETL (Extract, Transform, Load) pipelines using AWS services such as Glue, S3, Redshift, and Lambda to facilitate efficient data ingestion and processing.
- Build and maintain robust data models and schemas aligned with best practices in dimensional modeling for data warehousing environments.
- Develop and implement data management strategies integrating diverse sources including SQL databases (Microsoft SQL Server, Oracle), cloud databases (Azure Data Lake), and big data platforms like Hadoop, Spark, and Apache Hive.
- Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions using Python, Java, Bash scripting, Shell scripting, and Talend.
- Ensure high-quality data through rigorous validation, query management, and adherence to security standards within cloud environments.
- Support model training and analysis activities by providing clean, well-structured datasets; utilize Looker for visualization and reporting purposes.
- Participate in Agile development processes to continuously improve data workflows and ensure timely delivery of projects.
Experience
- Proven experience designing and implementing large-scale data pipelines in cloud environments using AWS services such as S3, Glue, Redshift, Lambda, and related tools.
- Strong proficiency in SQL programming across multiple database platforms including Microsoft SQL Server, Oracle, and cloud-based systems like Azure Data Lake or similar.
- Hands-on experience with big data technologies such as Hadoop ecosystem components (HDFS, Hive), Spark (PySpark or Scala), and Apache Hive for distributed data processing.
- Demonstrated ability to develop ETL workflows using Informatica or Talend; familiarity with RESTful API integration is a plus.
- Expertise in database design principles including dimensional modeling for data warehousing solutions; experience with query optimization techniques is preferred.
- Knowledge of scripting languages such as Python, Bash (Unix shell), VBA for automation tasks; experience with analysis skills for deriving insights from complex datasets.
- Familiarity with Agile methodologies for project management; ability to adapt quickly in a fast-paced environment while maintaining attention to detail.
Join us if you’re passionate about leveraging cloud technology to transform raw data into actionable insights! Bring your expertise in AWS cloud platforms combined with your skills in big data processing, database design, and analytics to make a meaningful impact on our organization’s success.
Work Location: In person
