Senior Software Engineer - MCP Server

We are seeking a Senior Software Engineer to lead the design and evolution of a next-generation AI Gateway platform that enables secure, scalable, and governed access to Large Language Models (LLMs) and agentic workflows across the enterprise in a SAAS environment.

Responsibilities

• Develop the AI Gateway platform, including MCP, agents, LLM routing, governance, and observability
• Translate business and product requirements into clear problem statements, architectural designs, and scalable technical solutions
• Design extensible frameworks for MCP server capabilities and integrations, as well as agent orchestration and reusable agent skills
• Architect gateway capabilities such as semantic caching for LLM responses, rate limiting, quotas, traffic governance, and guardrails and validation layers for safe LLM/MCP usage
• Design and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM traffic
• Build prototypes and reference implementations to validate architectural decisions and guide engineering teams
• Partner with multiple product teams integrating with the AI Gateway, providing architecture guidance, best practices, and integration patterns
• Review designs and code, providing actionable feedback to ensure quality, performance, scalability, and security
• Define and review CI/CD best practices using modern GitHub-based pipelines
• Architect and review Kubernetes-based deployment models, ensure scalability, resiliency, and production readiness

Requirements

• 3+ years of software engineering experience, including significant responsibility in a principal engineer role
• Proven experience designing and delivering large-scale distributed systems or platform products
• Proficiency in Golang and Python
• Familiarity with AI centric development with strong emphasis on quality gates and architecture patterns to enforce agentic behavior in producing quality code
• Deep understanding of AI gateways, AI/LLM platforms, or middleware systems, including routing, governance, and scalability
• Experience with microservices and service-oriented architectures for multi-tenant SAAS environments
• Skills in PostgreSQL for transactional data and Redis for caching and distributed coordination
• Strong background in authentication and authorization systems, particularly OAuth-based approaches
• Demonstrated ability to independently drive problem definition, architecture, prototype, and execution guidance
• Experience designing platforms and frameworks used by multiple product teams

Nice to have

• Experience with MCP (Model Context Protocol), agentic platforms, or AI orchestration frameworks
• Knowledge of working with EDA software
• Prior work on LLM gateways, API gateways, or AI middleware platforms
• Experience building generic developer frameworks or SDKs adopted across teams
• Familiarity with guardrails, semantic caching, prompt/response optimization, and LLM cost control techniques
• Experience operating high-throughput, low-latency systems in Kubernetes environments
• Strong written and verbal communication skills for cross-team architectural alignment

Benefits

• International projects with top brands
• Work with global teams of highly skilled, diverse peers
• Healthcare benefits
• Employee financial programs
• Paid time off and sick leave
• Upskilling, reskilling and certification courses
• Unlimited access to the LinkedIn Learning library and 22,000+ courses
• Global career opportunities
• Volunteer and community involvement opportunities
• EPAM Employee Groups
• Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn