Azure Data Engineer is needed to perform the following duties:
Build Data Ingestion Pipelines for Data Migration. Use Azure Data Factory or Synapse Pipelines to build pipelines which orchestrate Data Migration from various sources to specific target location. Perform ETL or ELT based on the requirements on Data. Sources could include Relational Databases like Oracle, MS SQL Server, Postgre SQL, or CSV, JSON, XML files, or REST API’s or JSON Objects. Build Data Warehouse Solution on Microsoft Fabric Platform. Migrate all the objects (tables) and Data. Choose Synapse Distribution Strategy based on the tables categorized (Facts or Dimensions tables). Build Processes to support both Batch and Streaming Data using Synapse Real Time Analytics for Stream data and ADF for Batch load. Build Data Processing Flows (Adhoc processes) to ensure the following: Data Validation across Systems. Data Quality as per Organization’s ethics and Standards. Data Governance and Management for proper access based on groups or roles across teams, security, and lineage. Build Reports and Dashboards to help Business get insights of Data and help in decision making. KPIs for high level Metrics and Performance of the Organization. Dashboards to show Year to Year or Month to Month Reports. Overall reports to show Sales, Units, growth parameters, performance etc. to Business Stakeholders. Work with cross platform teams, Data Architects, Technical Manager, and Stakeholders. Support cross platform or downstream applications and teams. Resolve Production Issues. Gather updated requirements, design, develop, deploy recursively under the supervision of Architects or Technical Managers.
Qualifications
Bachelor's Degree is required in Computer Science or Computer Engineering or Information Technology or Information Technology and Computing.
