Microsoft
Microsoft

Software Engineer II

June 6, 2025
Full-time
$100,600.00/yr - $215,400.00/yr
Remote · Mountain View, CA
Not Applicable
Full-stack Developer
Apply now

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and sky is the limit thinking in a cloud-enabled world.

Artifical Intelligence (AI) is the strategic bet for Microsoft. The Azure AI Platform is right at the forefront of innovation. Our projects involve cutting edge technologies and problems. Joining these projects you will gain knowledge and experience about generative AI, large language models, large scale inference infrastructure, Graphics Processing Unit (GPU) optimization, AI applications, etc.

The Model Scaling Platform team within AI Platform is responsible for managing all the inferencing capacity that powers Microsoft’s AI ambitions. Our fleet running state-of-the-art Open AI models provides the foundation for Microsoft’s various Copilots and Azure Open AI Service. We manage a vast number of premium AI accelerators and aim to leverage them in the most agile and efficient manner. Our services and the products they power are experiencing incredible growth. As part of this team, you will have opportunities to work across team boundaries and tackle hard system problems which translate to business impact that directly affect Microsoft’s bottom line.

We are looking for a Software Engineer II to help build the next wave of capabilities for the inferencing platform. You will have the opportunity to work with a team of talented engineers in a fast-paced environment to lay the foundations for a new set of systems we are building. The successful candidate will possess technical prowess, be highly motivated, and have a methodological approach to problem solving.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Responsibilities

Required/Minimum Qualifications

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python

  • OR equivalent experience.

  • Experience with distributed systems design and implementation.

Other Requirements

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Additional Or Preferred Qualifications

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Master's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD)
  • Experience with machine learning, artificial intelligence, and data science.
  • Experience working on large-scale projects or applications.
  • Familiarity with Azure
  • Familiarity with large language model and generative AI

Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $100,600 - $199,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $131,400 - $215,400 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft posts positions for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.