Senior AI Infrastructure Engineer

We are looking for a highly skilled Senior AI Infrastructure Engineer to design, build, operate, and optimize scalable infrastructure that supports enterprise AI/ML platforms and workloads. The ideal candidate will have deep expertise in cloud-native technologies, Kubernetes, observability, automation, and platform reliability, with a strong focus on enabling AI/ML teams through robust and efficient infrastructure.

Responsibilities

• Design, build, and operate scalable infrastructure supporting enterprise AI/ML platforms and workloads
• Manage and maintain Kubernetes and Docker environments for containerized applications
• Operate and optimize infrastructure on cloud platforms to support AI/ML workloads
• Develop automation scripts and tools to streamline platform operations
• Implement and maintain monitoring, logging, and observability solutions across infrastructure
• Administer Linux systems and ensure reliable platform operations
• Apply system design principles to improve scalability, performance, and reliability
• Troubleshoot infrastructure, platform, application, and container orchestration issues
• Conduct log analysis, root cause analysis, and incident management for production issues
• Configure and maintain networking components, including DNS, load balancing, ingress, and security controls
• Provide operational support for mission-critical production environments

Requirements

• Bachelor's degree in Engineering (B.Tech/B.E.) with 5+ years of relevant experience
• Expertise in Kubernetes and Docker for container orchestration and management
• Experience managing infrastructure on at least one major cloud platform (Azure, AWS, or GCP)
• Proficiency in scripting and automation using Python, Shell, or Bash
• Familiarity with monitoring, logging, and observability tools such as Prometheus, Grafana, and ELK/OpenSearch or Datadog
• Understanding of Linux systems administration and platform operations
• Knowledge of system design, scalability, performance optimization, and reliability engineering
• Skills in troubleshooting infrastructure, platform, application, and container orchestration issues
• Capability to perform log analysis, root cause analysis, and incident management
• Understanding of networking fundamentals, including DNS, load balancing, ingress, and security concepts
• Background in providing operational support for mission-critical production environments

Nice to have

• Background in supporting AI/ML platforms or GPU-based workloads
• Knowledge of advanced networking concepts such as service mesh (Istio/Linkerd), network policies, API gateways, and traffic management
• Familiarity with cloud-native architecture patterns and platform engineering best practices
• Familiarity with SRE practices, including SLIs, SLOs, error budgets, and disaster recovery
• Hands-on experience with Infrastructure as Code tools such as Terraform and Helm Charts
• Experience in cloud cost monitoring and optimization for high-compute AI workloads

Benefits

With us you can:

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Relocation opportunities may be available for eligible candidates, depending on the role and openings at other EPAM locations
• Participate in volunteer, charity programs and communities (both technical and interest-based)

We focus on your professional growth:

• You can plan your individual career path together with your manager
• Receive regular feedback from colleagues
• Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
• Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
• Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
• Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
• Study at EPAM Solution Architecture School with the instructors who are practicing architects
• Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
• Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)

What we offer:

• Vacation and sick leave (including a sick leave without a medical certificate)
• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children