New 
Senior Software Engineer - CoreAI
 Microsoft | |
 United States, Washington, Redmond | |
 Aug 19, 2025 | |
|
OverviewJoin our team withinCoreAI, where we are building theAI data-planethat powers all LLM inferencing workloads across Microsoft and Azure customers-from cutting-edge startups to Fortune 500 enterprises. Ourconverged AI fabricdelivers inference capabilities for all LLMs in Microsoft catalog, including OpenAI, Mistral, Cohere, Llama, and more. As aSenior Software Engineer - CoreAI, you will help build one of thelargest and fastest-growing services in Azure, foundational to Microsoft's AI strategy. Our mission is to serve models at scale-reliably, efficiently, and with ultra-low latency-enabling a rich set of AI-powered product experiences. This is a rapidly evolving space with immense opportunities to learn, innovate, and drive industry-wide impact. At Microsoft, our mission is toempower every person and every organization on the planet to achieve more. We embrace a growth mindset, foster innovation, and work together to realize our shared goals. Every day, we build on our values ofrespect, integrity, and accountabilityto create a culture where everyone can thrive.
ResponsibilitiesDrive innovation and deliver impact on acritical Azure servicethat underpins Microsoft's AI vision. Collaborate with aworld-class teamof engineers, architects, and leaders committed to technical excellence and career growth. Innovate on product shape and offers to define how developers leverage cutting edge AI technologies and build world class applications. Ship new product features and improvements at a high velocity where ideas to production is a matter of week(s).Design, implement and deliver AI services to support product offerings for large-scale LLM serving. Innovate on technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products. Engage with customers to gather feedback and resolve complex issues. Embody ourcultureandvalues | |