Software Engineer, AI Infrastructure, Cloud ML

Google

5 - 7 years

Hyderabad

Posted: 23/08/2025

Job Description

Minimum qualifications:

Bachelor’s degree or equivalent practical experience.
5 years of experience with software development in one or more programming languages.
3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
3 years of experience in testing, maintaining, or launching software products.
3 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential selection making), ML infrastructure, or specialization in a ML related field.

Preferred qualifications:

Master's degree in Computer Science or a related field, or equivalent practical experience.
10 years of experience in the software industry creating distributed systems, tools, or services.
Experience working with Graphics Processing Unit (GPU), Tensor Processing Unit (TPU), or HPC clusters.
Experience with orchestration tools like SLURM or Kubernetes.
Knowledge of GPUs and related ecosystems and technologies.

About the job

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. The Google Cloud AI Research team addresses AI challenges motivated by Google Cloud’s mission of bringing AI to tech, healthcare, finance, retail and many other industries. We work on a range of unique problems focused on research topics that maximize scientific and real-world impact, aiming to push the state-of-the-art in AI and share findings with the broader research community. We also collaborate with product teams to bring innovations to real-world impact that benefits our customers.

Responsibilities

Deploy cluster environments, and offer informed opinions on orchestrators like SLURM or Google Cloud Platform (GCP) Google Kubernetes Engine (GKE). Differentiate the high performance compute (HPC) or Machine Learning (ML) landscape to support the AI/ML or HPC customers.
Design and develop the tools and services with incremental milestones, enabling iteration for new models entering the market.
Work with peers across Cloud ML Compute Services (CMCS) to contribute to leadership and influence decision-making.
Manage relationships with partners within CMCS and across Core ML, GCE, GKE, NetInfra etc. Partner with the United States teams to ensure technical designs align across the organization, considering feasibility and maintainability.
Contribute to the open-source community, manage the repository, and promote internal and external community around this offering.

About Company

Google is a multinational technology company founded in 1998 by Larry Page and Sergey Brin. It is best known for its search engine but also develops products and services in areas like online advertising (Google Ads), cloud computing (Google Cloud), operating systems (Android, Chrome OS), web browsers (Chrome), and consumer electronics (Pixel devices, Nest). Google is a subsidiary of Alphabet Inc., its parent company formed in 2015. It plays a major role in shaping the internet, AI, and digital innovation globally.