APIs are the backbone of our connected digital world. The API Management and AI Gateway team is part of the CoreAI organization, which offers a comprehensive solution for managing the full API lifecycle—securing, governing, and controlling AI Tools. The platform empowers thousands of developers globally to build and manage Agentic, Web, Mobile, Event-Driven, and IoT applications. It also underpins key Microsoft services like Azure AI Foundry, Consumer Copilot, Logic Apps, Copilot Studio, Power Platform, Bing, and more – enabling rich developer and consumer experiences.
Bringing simplicity to customers creates challenging engineering opportunities and we are hiring a Senior Software Engineer - CoreAI to tackle these challenges in areas like scalability, high-density, multi-tenancy, high availability, user experience and developer tools.
The rise of generative AI opens new frontiers – join the API Management and AI Gateway team to help shape the future of AI developer and application workloads!
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day, we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.
Responsibilities
We’re looking for an engineer who is passionate about building new products in an AI-driven world while managing a globally distributed service. The individual stepping into this role delivers high-quality solutions independently and thrives in a collaborative, diverse team. Versatility, quick learning, and adaptability are essential.
In this role, you’ll design and deliver the next generation of services, features, and developer tools that shape how AI applications are built and operated. You’ll work across open-source and platform components in multiple programming languages. This is a unique opportunity to contribute to large-scale distributed systems and drive initiatives central to Microsoft’s Core AI strategy!
Key Responsibilities:
- Lead System Design & Architecture: Drive architecture discussions, author design documents, and ensure systems meet security, compliance, and scalability requirements while balancing long-term sustainability with short-term delivery.
- Deliver High-Quality Code: Write extensible, maintainable, and performant code; debug and optimize complex systems; and uphold engineering standards through rigorous code reviews.
- Drive Implementation & Deployment: Lead project planning and experimentation, validate the impact of changes, and ensure safe, reliable deployments across distributed environments.
- Ensure Reliability & Operational Excellence: Maintain live site health, develop incident response playbooks, lead root cause analyses (RCAs), and implement systemic improvements to reduce incident volume and improve SLAs.
- Advance Engineering Tools & Practices: Identify and build developer tools, apply automation in production workflows, and stay current with emerging technologies and industry trends.
- Shape Product Strategy: Influence the product roadmap by aligning technical direction with business goals, leveraging customer feedback, data insights, and competitive analysis.
- Foster Cross-Team Alignment: Collaborate with partner teams to deliver cohesive end-to-end experiences and ensure shared ownership of technical direction.
- Build Core Capabilities: Design and develop foundational platform components and reusable building blocks that accelerate innovation and team velocity.
- Other: Embody our culture and values
Qualifications
Required/Minimum Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred/Additional Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.
- 6+ years of experience designing, building, and operating production-grade software and services at scale, with a proven track record of delivering high-impact.
- Proven experience in designing and building distributed systems and cloud-based services.
- Understanding of cloud platforms such as Azure, AWS, or GCP.
- Hands-on experience developing in AI-enhanced environments using tools like GitHub Copilot or similar.
- Hands-on experience with generative AI API platforms such as Azure AI Foundry, OpenAI, Claude, or similar.
- Familiarity with Authorization, Authentication and OAuth standard protocols, lifecycle and specifications.
- Familiarity with agentic protocols such as MCP or A2A.
- Verbal and written communication skills, with the ability to clearly articulate complex technical concepts.
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar Jobs at Microloft
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
