Position Summary
TSPi is seeking a Data Engineer III to support the design, development, and maintenance of enterprise data integration solutions and cloud-based analytics infrastructure for federal government clients. This role serves as the technical lead for data engineering activities, including data pipeline development, data integration, metadata management, and analytics environment support.
The Data Engineer III will work closely with systems managers, data scientists, reporting teams, and business stakeholders to build scalable data solutions that enable advanced analytics, reporting, and data-driven decision-making. The successful candidate will be responsible for developing and maintaining cloud-native data pipelines, integrating data from multiple internal and external sources, and ensuring data quality, governance, and security throughout the data lifecycle.
The ideal candidate is an experienced data engineering professional with strong expertise in AWS cloud services, API-based integrations, data transformation, and Agile software development practices. This role is contingent upon award of the project to Abt Global and TSPi.
Responsibilities
-
Design, develop, implement, and maintain enterprise data integration pipelines supporting analytics and reporting initiatives
-
Develop and optimize cloud-native data solutions using AWS services including AWS Glue, AWS Lambda, Amazon S3, and related technologies
-
Build and maintain automated data ingestion processes from system exports, APIs, external data providers, and other structured and semi-structured data sources
-
Develop data transformation workflows using Python, R, SQL, and related technologies
-
Manage metadata cataloging, schema management, and data governance processes to ensure data quality, integrity, and accessibility
-
Support and maintain AWS-hosted analytics environments and associated data infrastructure
-
Design, implement, and support API-based integrations, including RESTful services and automated data exchange processes
-
Monitor, troubleshoot, and optimize data pipelines and integration processes to ensure reliability and performance
-
Track development activities, enhancements, bug fixes, and optimization efforts using Jira or comparable issue-tracking tools
-
Collaborate with systems managers, data scientists, quality and reporting teams, and other stakeholders to support data-driven business objectives
-
Participate in Agile development activities, including sprint planning, backlog refinement, daily standups, reviews, and retrospectives
-
Develop and maintain technical documentation related to data pipelines, integrations, data models, and operational procedures
-
Ensure compliance with federal data security, privacy, and governance requirements