Software Development Engineer-II for AI frameworks

Microsoft

2 - 5 years

Noida

Posted: 14/10/2025

Getting a referral is 5x more effective than applying directly

Job Description

Overview

The Artificial Intelligence (AI) Frameworks team at Microsoft develops the AI software used to train and deploy the world’s most advanced AI models. We collaborate with our hardware teams and partners to build the software stacks for Microsoft’s next-generation supercomputers and the new Maia-100 AI accelerator.  We work closely with ML researchers and developers to optimize and scale out model training and inference. 

The team operates at the intersection of AI algorithmic innovation, purpose-built AI hardware, systems, and software. We are a cross-disciplined team of highly capable and motivated people with a collaborative and inclusive culture.  We collaborate with hardware design team and build system software stack and developer tools (debugger, profiler, simulator) for the novel AI accelerator. 

Join our team to help develop system software and tools for large-scale AI model training and inference on new hardware.  

It requires hands-on software design and development skills. We’re looking for someone who has a demonstrated history of solving hard technical problems and is motivated to tackle the hardest problems in building a full end-to-end AI stack.  An entrepreneurial approach and ability to take initiative and move fast are essential

Qualifications

Required Qualifications:

B.S. or advanced degree in computer engineering, computer science, or related fields

2+ years of software development and experience of leading at least two commercialized features from requirement to deployment.

2+ years' experience with C/C++  A

Exposure to NVIDIA/AMD development environment comprising CUDA / ROCm for Deep Neural Network training and inference development

Preferred Qualifications:

A strong technical background and solid foundation in software engineering principles and architecture design

Strong intellectual curiosity and passion about learning new technologies

Great cross-team collaboration skills and the desire to collaborate in a team of researchers and developers

Strong communication skills (both written and oral)

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

#aiplatform

Responsibilities

Responsibilities:

Identify / estimate work, schedule deliverables

Apply strong engineering principles for developing SW in modern languages.

Participate in design discussion and evaluation of alternatives

Collaborate broadly across multiple disciplines from hardware designers, tool developers, performance analysis and with ML application developers

Owns the next gen features of Microsoft AI accelerator directly contributing to the business impact.

About Company

Microsoft Corporation is a leading American multinational technology company founded in 1975 by Bill Gates and Paul Allen. Headquartered in Redmond, Washington, Microsoft is best known for its software products, including the Windows operating system, Microsoft Office Suite, and Azure cloud services. The company also produces hardware like the Surface devices and owns LinkedIn, GitHub, and the Xbox gaming brand. Microsoft is one of the world's most valuable companies, playing a key role in personal computing, enterprise software, AI, and cloud computing.