Job Title: Lead ETL Engineer
Job Location: Los Angeles, CA | Hybrid
IT01
Description:
AgreeYa is a global Systems Integrator and is seeking an experienced Lead ETL Engineer to join our growing team.
Client is seeking for a Lead ETL Engineer of large-scale data solutions. You will join a team delivering a transformative next-gen cloud hosted data platform.
The ideal candidate will have a proven track record in implementing next-gen cloud data solutions and transformation pipelines for large scale organizations. We are seeking someone with deep technical skills in a variety of data warehouse related technologies to play an important role in developing and delivering early proofs of concept and production implementation. The successful candidate will have hands-on experience in a multitude of data domains; including building data warehouse models, ETL development, automated testing framework, performance tuning, service delivery, incident resolution tracking, and change management.
Key Responsibilities
- Architecting and maintaining Operational data stores (ODS), Enterprise Data Warehouse (EDW) and associated data intelligence environments including data lakes, data marts, and metadata repositories.
- Designing and implementing high performance data movement pipelines using multiple ETL tools (Informatica, Azure Data Factory, SQL Packages, etc) with batch and real-time event data streams.
- Developing scalable and re-usable frameworks for ingestion of structured and semi-structured data; and implementing various large-scale settlement and reconciliation frameworks.
- Designing and creating data architecture and data flow diagrams and collaborating with peers to translate requirements into logical and physical data models.
- Ensures data warehouse features and capabilities are incorporated into data model designs to optimize performance, resiliency, and scalability.
- Delivering and presenting proofs of concept to of key technology components to project stakeholders and internal technology leaders.
- Leading and coordinating the design and operationalization of Data Governance capabilities like data lineage, data catalog, data quality, etc.
- Problem-solving of Data warehouse and ODS application issues and production errors, including high level critical production issues that require immediate attention.
- Write, test and produce production grade ETL data pipeline code in financial services without relying on testing by other groups.
- Implement intelligent testing frameworks that auto-generate test cases, predict bugs, and enable self-healing.
- Leads the creation of test strategy, test planning, and test execution related to all aspects of testing like functional, integration, systems, end-to-end testing, accessibility, database validations, and automation.
- Integrate test suites into CI/CD pipelines (Jenkins, Github).
Required Qualifications
- Bachelors and/or masters degree in computer science, Computer Engineering or related field preferred.
- 8+ years of overall software development experience is required primarily with Data warehouse applications, with 3+ years in a technical leadership role.
- 3+ years of hands-on development experience in Cloud-based data warehouse platform (AWS Redshift preferred) and experience with ETL tools (Informatica Cloud preferred).
- 3+ years of development experience with Python scripting experience.
- Strong knowledge and experience in OLAP data modeling & design.
- Knowledge of data governance, security, and compliance standards (e.g., SOC 2, PCI DSS).
- Demonstrated expertise in performance tuning in various DB environments with large volumes of data.
- Familiarity with CI/CD pipelines (e.g., Jenkins, GitHub Actions) and infrastructure-as-code tools.
- Expertise in understanding complex business needs, analyzing, designing, and developing solutions.
- Communication and professional skills and the ability to navigate relationships across business units.
Preferred Qualifications
- Experience in fintech or enterprise data warehouse platforms.
- Familiarity with data warehouse operational domains such as partner reporting, compliance analytics, and business intelligence.
- Contributions to open-source QA frameworks or technical publications.
- Demonstrated leadership in building scalable QA practices, as outlined in internal QA leadership guidance.
AgreeYa is a global systems integrator delivering competitive advantage for its customers through software, solutions, and services. Established in 1999, AgreeYa is headquartered in Folsom, California, with a global footprint and a team of more than 2,200 staff across offices. AgreeYa works with 500+ organizations ranging from Fortune 100 firms to small and large businesses across industries such as Telecom, Banking, Financial Services & Insurance, Healthcare, Utility & Energy, Technology, Public sector, Pharma & Biotech, and others. Please visit us at www.agreeya.com for more information.
AgreeYa is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, gender identity, sexual orientation, national origin, disability, veteran status or other protected characteristics. Visit our website to learn about our Career & Culture.
Pay: Up to $68.00 per hour
Benefits:
- Dental insurance
- Health insurance
- Vision insurance
Experience:
- ETL: 10 years (Required)
- INFORMATICA: 5 years (Required)
- DATAWAREHOUSE: 5 years (Required)
- Python: 3 years (Required)
Work Location: Hybrid remote in Los Angeles, CA
