Azure Data Engineer

Project description

We are seeking an experienced Azure Data Engineer to support a large-scale Mainframe to Azure Cloud PaaS migration program. The ideal candidate will have strong expertise in Azure data services, cloud-native architectures, data integration, and modernization initiatives. This role will work closely with architects, business stakeholders, application teams, and data migration specialists to design, build, and optimize scalable data solutions on the Azure platform.

The engineer will be responsible for migrating legacy data assets from Mainframe environments to Azure-based PaaS services while ensuring data quality, performance, security, and operational excellence.

Responsibilities

• Cloud Data Engineering & Migration -Design and implement scalable Azure-based data solutions supporting enterprise modernization initiatives. -Analyze legacy Mainframe data structures, files, and processing workflows. -Develop and execute data migration strategies from Mainframe platforms to Azure Cloud. -Build and optimize ETL/ELT pipelines for data ingestion, transformation, and loading. -Support batch modernization and data integration requirements. -Ensure successful migration of historical and operational data with minimal business disruption.

  Azure Platform Engineering -Develop solutions using Azure PaaS services, including: -Azure Data Factory (ADF) -Azure Databricks -Azure Synapse Analytics -Azure Data Lake Storage Gen2 -Azure SQL Database -Azure Functions -Azure Logic Apps -Implement cloud-native data architectures aligned with Azure best practices. -Optimize performance, scalability, and cost efficiency of Azure data -platforms.

  Data Management & Governance -Ensure data quality, integrity, lineage, and governance standards. -Implement security controls following enterprise and regulatory requirements. -Establish monitoring, logging, and operational support processes. -Support data validation, reconciliation, and testing activities during -migration phases.

  Collaboration & Delivery -Collaborate with enterprise architects, application teams, business analysts, and infrastructure teams. -Participate in solution design reviews and technical workshops. -Document technical designs, migration approaches, and deployment procedures. -Support Agile delivery methodologies and project milestones.

SKILLS

Must have

• Bachelor's degree in Computer Science, Information Technology, Engineering, or equivalent experience. 5+ years of experience in Data Engineering. 3+ years of hands-on Azure Cloud experience. Experience with large-scale data migration or modernization projects. Strong knowledge of Azure Data Factory, Databricks, Synapse Analytics, and Data Lake. Strong SQL development and performance tuning skills. Experience developing ETL/ELT data pipelines. Understanding of cloud security and governance principles. Experience with CI/CD and DevOps practices. Excellent problem-solving and communication skills.

Nice to have

Experience in Mainframe modernization programs. Knowledge of Mainframe technologies such as: COBOL JCL VSAM DB2 IMS CICS Experience with modernization tools and migration frameworks. Familiarity with event-driven and serverless architectures. Experience working in enterprise-scale Azure environments. Azure certifications are highly desirable: Microsoft Certified: Azure Data Engineer Associate (DP-203) Microsoft Certified: Azure Solutions Architect Expert Microsoft Certified: Azure Administrator Associate