Senior Software Engineer, AI Foundry, Core Bulk Inference
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.
With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.
With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.
The Core team builds the technical foundation behind Google’s flagship products. We are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for our users and drive the pace of innovation for every developer. We look across Google’s products to build central solutions, break down technical barriers and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.
- Design and implement robust, scalable, and testable C++ code for bulk data processing operators and service backends.
- Build and maintain high-throughput data pipelines using Conduit, optimizing for Google-scale throughput (capable of millions of QPS).
- Connect and optimize native integrations with Google storage systems (Spanner, Woodshed, Colossus) and ML serving platforms (Uniserve, SUP, Ares).
- Take ownership of code quality by writing comprehensive unit/integration tests, contributing to documentation, and proactive debugging/refactoring.
- Collaborate with senior engineers and cross-functional partners to clarify ambiguous requirements, suggest architectural improvements, and participate in design reviews.
Minimum qualifications:
- Bachelor’s degree or equivalent practical experience.
- 5 years of experience with software development in one or more programming languages.
- 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
- Experience in low-level systems programming languages (e.g., C++ or C).
- Experience in software performance analysis and improvement, and High-Performance computer architectures (e.g., CPU, memory subsystem, multiprocessing).
- Experience designing, building, and operating large-scale distributed systems, with a focus on scalability, fault tolerance, and reliability.
Preferred qualifications:
- Master's degree or PhD in Computer Science or related technical field.
- Experience with performance analysis and tuning.
- Experience with inference performance concepts.
- Experience with C++, distributed systems, and technical infrastructure.
- Experience using AI tools and building developer solutions.
- Track record of individual contribution to engineering projects.
About the Company
Google is a technology company that specializes in Internet-related services and products, which include online advertising technologies, a search engine, cloud computing, software, and hardware. It is considered one of the Big Five American information technology companies, alongside Amazon, Apple, Meta, and Microsoft.
More jobs at Google
-
Software Engineering Manager, Payments Risk Management, Google Pay
Hyderabad, Telangana, India · · Nov 17, 2026
-
Technical Solutions Engineering Manager, Google Cloud
Bengaluru, Karnataka, India; Hyderabad, Telangana, India; Pune, Maharashtra, India · Hybrid · Nov 17, 2026
-
Staff Software Engineer, Machine Repairs, AI/ML
Sunnyvale, CA, USA · · Nov 17, 2026
-
SOC Quality and Reliability Test Engineer, Google Cloud
Haifa, Israel; Tel Aviv, Israel · · Nov 17, 2026
-
Staff Software Engineer, Google Distributed Cloud AI Storage
Sunnyvale, CA, USA; Kirkland, WA, USA · · Nov 17, 2026