Key responsibilities include:

• Leading, mentoring, and growing a high-performing engineering team responsible for both the customer-facing Model Serving product and its foundational infrastructure.
• Defining and owning the product and technical roadmap for Model Serving, balancing customer experience, functionality, and foundational investments across deployment, inference, monitoring, and scaling.
• Collaborating closely with product, research, platform, and infrastructure teams to drive end-to-end delivery from ideation and prioritization to launch and operation.
• Ensuring Model Serving meets stringent SLAs, SLOs, and performance and reliability goals, continuously improving operational efficiency and customer experience.
• Driving architectural decisions and product design around latency, throughput, autoscaling, GPU/CPU placement, and cost optimization.
• Advocating for customer needs through direct engagement, ensuring engineering decisions translate to clear product impact.
• Promoting best practices in code quality, testing, observability, and operational readiness.
• Fostering a culture of excellence, inclusion, and continuous improvement across the team.
• Partnering with recruiting to attract, hire, and develop top-tier engineering talent.

XML job scraping automation by YubHub

Microsoft are looking for a highly experienced Principal Software Engineer to join their Ads Engineering Platform team to design and build next-generation Ads products that drive revenue growth and create innovative advertising experiences for users and advertisers.

About the Role

We are seeking a highly experienced software engineer to join our Ads Engineering Platform team to design and build next-generation Ads products that drive revenue growth and create innovative advertising experiences for users and advertisers. You will play a key role in evolving the core capabilities of our ad-serving infrastructure—the engine that powers advertising across Bing Search, MSN, Microsoft Start, and shopping experiences in Microsoft Edge. Our serving stack operates at massive global scale, delivering millions of ad requests per second through a geo-distributed, low-latency system that integrates real-time bidding, intelligent ranking, and ML-driven decisioning pipelines. We leverage a mix of CPU and GPU-based inference to balance latency, throughput, and cost efficiency. This role combines product innovation, distributed systems architecture, and performance engineering. You will help shape both new monetization capabilities and the next generation of model serving infrastructure that powers them.

Accountabilities

• Design and build new Ads products and monetization capabilities that unlock incremental revenue and enhance advertiser and end-user experiences.
• Lead the development of large-scale, distributed online serving systems to process millions of ad requests per second with ultra-low latency and high reliability.

The Candidate we're looking for

Experience:

• 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.

Technical skills:

• Proficient experience designing and operating real-time online serving or ranking systems.
• Proficient understanding of distributed systems fundamentals: concurrency, multi-threading, memory management, networking, and fault tolerance.

Personal attributes:

• Demonstrated ability to diagnose performance bottlenecks and improve latency, throughput, and cost efficiency in high-traffic systems.

Benefits

• Competitive salary range of $163,000 - $296,400 per year.
• Benefits and other compensation.
• Opportunities for professional growth and development.

XML job scraping automation by YubHub