Microsoft are looking for a talented Member of Technical Staff, Applied Scientist at their Mountain View office. This role sits at the heart of designing and building advanced Copilot features such as Deep Research and Web artifact generation. You'll contribute to the evolution of Copilot by developing scalable methods for evaluating feature performance, designing data collection pipelines for prompt engineering and fine-tuning, and training content classifiers that support intelligent, context-aware interactions.

About the Role

This role demands deep expertise in large language models (LLMs) and a strong architectural mindset to shape complex, user-facing systems. You'll lead evaluation efforts of models deployed within Copilot, ensuring performance aligns with product goals. You'll also design scalable systems that leverage LLMs to deliver intelligent, user-facing experiences. Additionally, you'll develop evaluation frameworks and metrics to assess feature performance and user impact, conduct thorough reviews of data analysis and techniques to identify gaps and areas for re-examination, and build data collection pipelines to support prompt engineering and fine-tuning of LLMs.

Accountabilities

• Architect and implement advanced Copilot features such as Deep Research and Web artifact generation
• Lead evaluation efforts of models deployed within Copilot, ensuring performance aligns with product goals

The Candidate we're looking for

Experience:

• 4+ years related experience (e.g., statistics predictive analytics, research)

Technical skills:

• Experience prompting, evaluating, and working with large language models
• Experience writing production-quality Python code

Personal attributes:

• Proactive collaborator who communicates clearly
• Thrives in fast-paced environments
• Takes ownership of delivering world-class consumer experiences

Benefits

• Competitive salary
• Comprehensive benefits package
• Opportunities for professional growth and development
• Collaborative and dynamic work environment
• Recognition and rewards for outstanding performance

XML job scraping automation by YubHub