Data Engineer (Azure, Spark, Python)

We are seeking a Data Engineer (Azure) to build and run scalable data pipelines and platforms on Microsoft Azure. You will work hands-on with Azure Data Factory, Azure Databricks and Azure SQL, plus streaming, automation and governance, to deliver reliable data products teams can trust.

Responsibilities

• Design and build batch and streaming data pipelines using Azure Data Factory and Azure Databricks
• Develop and optimize data models and workloads in Azure SQL and cloud data stores
• Implement event-driven data processing with Azure Event Hubs and Kafka
• Automate deployments using Azure DevOps pipelines and Infrastructure as Code
• Containerize services with Docker and run workloads on Azure Kubernetes Service (AKS)
• Implement data governance and lineage with Microsoft Purview
• Monitor platform health, costs and performance using Azure Monitor and logging
• Partner with engineering and product teams to deliver end-to-end data solutions

Requirements

• Proven experience building data pipelines with Azure Data Factory
• Hands-on experience with Azure Databricks for data processing and orchestration
• Strong skills in Azure SQL plus Python and SQL for transformation and automation
• Knowledge of streaming patterns using Azure Event Hubs and/or Kafka
• Experience with Azure Data Lake Storage and Azure Cosmos DB in modern data platforms
• Familiarity with Azure DevOps and Infrastructure as Code (Bicep, Terraform or Azure Resource Manager templates)
• Ability to apply governance and monitoring using Microsoft Purview and Azure Monitor
• Clear communication and collaborative problem-solving in cross-functional teams

Nice to have

• Azure certifications related to data engineering or solution architecture
• Experience with big data architectures and advanced analytics
• Comfort working in agile delivery models and enterprise environments

Benefits

• By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us