Software Engineer

AI is the strategic bet for Microsoft. The Azure CoreAI Platform is right at the front end. Our project involves cutting edge technologies and problems. Joining the projects you will gain knowledge and experience about generative AI, large language model, transformers, GPU optimization, AI applications, etc. The AI business is also growing rapidly, and our products will directly face the impact of the large number of customers, which is continuously growing. 

Within the AI Platform, the CoreAI team enables data scientists and developers to build quickly and easily, train, deploy, manage, and consume machine learning models.

The Core AI MaaS&RP team is hiring Software Engineers. The team designs, builds, and operates the largest scale engineering system in the industry for Large Language Models and GenAI Services. Key areas that we are working on  

1. Building and Scaling our Inferencing Cloud across our flagships AOAI Service and growing the Model as A Service model Families. 
2. Expand the Gen AI Model Offerings to more model providers, and best and latest models and provide a unified experience across AOAI and MAAS/MAAP for Azure AI customers 

Responsibilities

• Collaborate with appropriate stakeholders (e.g., project manager, technical lead) to determine user requirements 

• Leads discussions for architecture of products/solutions and creates proposals for architecture by testing design hypotheses 

• Leads by example within the team by producing extensible and maintainable code. Applies debugging tools and examines logs to verify assumptions through writing and developing code 

• Respond, resolve, and integrate customer feedback with agility and dedication
  
• Takes ownership for key parts of the LLM platform, and delivers end to end solutions alongside product stakeholders and provides operational support.