Job Overview
We are seeking an energetic and highly skilled Senior Data Engineer to join our dynamic data team. In this pivotal role, you will lead the design, development, and management of robust data pipelines and systems that empower data-driven decision-making across the organization. Your expertise will help unlock the full potential of our big data systems, ensuring seamless integration, high performance, and scalability. This is an exciting opportunity for a motivated professional eager to innovate within a fast-paced environment, leveraging cutting-edge cloud technologies and advanced data engineering techniques to deliver impactful business insights.
Responsibilities
- Design, develop, and optimize scalable ETL (Extract, Transform, Load) pipelines using tools like Informatica, Talend, or custom Python scripts to facilitate efficient data ingestion and processing from diverse sources.
- Build and maintain large-scale data warehouses and data lakes utilizing cloud platforms such as AWS, Azure Data Lake, or Public Cloud environments to support business intelligence and analytics initiatives.
- Develop and implement data models employing dimensional modeling principles for effective data warehousing and query management.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications for data architecture solutions.
- Manage and enhance big data systems using Hadoop, Spark, Apache Hive, and related technologies to process vast amounts of structured and unstructured data efficiently.
- Ensure data quality, security, and compliance by implementing best practices in data management integration and governance.
- Support business intelligence tools like Looker by creating optimized queries and dashboards that enable insightful analysis.
- Automate workflows through shell scripting (Bash/Unix), RESTful APIs, and other scripting languages to streamline operations.
- Participate actively in Agile development cycles to deliver iterative improvements while maintaining high standards of software development practices.
- Assist in model training and analysis activities by providing reliable datasets that support machine learning initiatives.
Experience
- Proven experience as a Data Engineer or similar role with a strong focus on big data systems, cloud databases, and enterprise data architecture.
- Extensive hands-on expertise with AWS services such as S3, Redshift, Glue; Azure Data Lake; or other Public Cloud platforms for scalable storage and computing solutions.
- Proficiency in programming languages including Java, Python, SQL (Microsoft SQL Server, Oracle), along with shell scripting for automation tasks.
- Deep understanding of ETL pipeline development, SQL database design (including SQL databases like Microsoft SQL Server), and Data warehousing design principles such as dimensional modeling.
- Familiarity with Hadoop ecosystem components—Hadoop Distributed File System (HDFS), Spark for distributed processing—and query engines like Apache Hive.
- Experience working with Business Intelligence tools such as Looker or equivalent platforms to create insightful dashboards and reports.
- Knowledge of data modeling techniques including linked data concepts for integrating diverse datasets effectively.
- Strong analytical skills combined with excellent problem-solving abilities to troubleshoot complex data issues efficiently.
- Ability to work within Agile teams while managing multiple priorities in a fast-paced environment.
Join us in shaping the future of enterprise data solutions! We are committed to fostering an inclusive environment where innovation thrives through passionate collaboration. If you’re ready to elevate your career as a Senior Data Engineer—driving impactful projects with cutting-edge technology—apply now!
Pay: $118,750.28 - $143,011.09 per year
Work Location: In person
