Job Summary
We are seeking a dynamic and innovative Data Engineer to join our team and drive the development of scalable data solutions. In this role, you will design, build, and maintain robust data pipelines and architectures that enable insightful analytics and strategic decision-making. Your expertise will empower our organization to harness the full potential of big data, cloud platforms, and advanced data processing tools to deliver actionable insights. If you thrive in a fast-paced environment where your technical skills can make a tangible impact, this is the opportunity for you!
Responsibilities
- Develop, implement, and optimize data pipelines using ETL (Extract, Transform, Load) processes to ensure efficient data flow across systems.
- Design and maintain scalable data warehouses and data lakes utilizing platforms such as Azure Data Lake and Hadoop.
- Collaborate with cross-functional teams to gather requirements and translate them into technical solutions leveraging SQL, Python, Java, and Shell Scripting.
- Integrate diverse data sources including Oracle, Microsoft SQL Server, Looker, Linked Data, and RESTful APIs for comprehensive analytics.
- Utilize big data tools like Apache Hive, Spark, and Informatica to process large datasets with speed and accuracy.
- Support model training and analysis by preparing datasets, performing database design, and ensuring data quality.
- Implement security best practices for data access and management while adhering to Agile development methodologies.
Experience
- Proven experience working with cloud platforms such as AWS or Azure for data storage and processing.
- Strong proficiency in SQL programming along with experience in database design for data warehouses or operational databases.
- Hands-on experience with big data technologies including Hadoop ecosystem components (Hive, Spark) and related tools like Talend or Informatica.
- Familiarity with scripting languages such as Python, Bash (Unix shell), VBA or Shell Scripting for automation tasks.
- Knowledge of analytics tools like Looker for creating dashboards and visualizations that communicate insights effectively.
- Experience in developing RESTful APIs for seamless system integration.
- Understanding of Agile project management practices to facilitate iterative development cycles. Join us to be part of an energetic team dedicated to transforming raw data into powerful insights! Your expertise will help shape innovative solutions that drive strategic growth while working in a collaborative environment that values continuous learning and professional development.
Pay: $60,000.00 - $80,000.00 per year
Work Location: In person
