At Microsoft AI, we deliver exceptional products and services that empower users to be more productive and efficient.

In this role, you will work across all four stages of our evaluation platform: data sampling, AI data collection and processing, data analysis and evaluation, and insight generation.

You will contribute across the full stack—from backend databases and middle-tier services to browser automation, statistical analysis, and dashboard creation.

Expect to dive into prompt engineering and leverage cutting-edge AI tools to drive meaningful impact.

This engineering position offers exposure to a wide range of technologies and surfaces, including desktop, web, and mobile.

You will collaborate closely with teams across Microsoft AI to assess Copilot’s relevance, performance, trustworthiness, and visual appeal.

Our platform supports desktop and mobile automation and UX studies—enabling scenarios like multi-turn conversations with voice input on iOS and Android apps.

The possibilities are endless.

Responsibilities:

• Expertise in experimentation methodologies, including A/B evaluation, data sampling, measurement techniques, evaluation design, and data analysis.

• Demonstrating strategic vision by understanding organizational goals, translating metrics into actionable insights, and enhancing product quality.

• Designing pipeline architecture to ensure rapid iteration and scalability.

• Conducting post-analysis of labeled data and developing dashboards to visualize insights.

• Collaborating closely with the product team to enhance quality and address gaps.

Qualifications:

• Bachelor’s Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to C#, Java, or Python OR equivalent experience.

• 2+ years’ experience with SQL, PostgreSQL or MySQL

• 2+ years’ experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP.

• Extensive use datastores like RDBMS, key-value stores, etc.

• Experience with Development & Debugging with dev environments like Visual Studio or Visual Studio Code

• HTML, CSS, JavaScript, ASP.NET, REST, jQuery

• Familiarity with browser automation tools like Selenium, Puppeteer or Playwright

• Familiarity with mobile automation tools like Appium

• Familiarity with LLMs and AI ChatBots Prompt Engineering

• Azure DevOps, GIT

• Azure Open AI, Azure Foundry

• Experience in leading technical projects and supporting architectural decisions with data.

Software Engineering IC4 – The typical base pay range for this role across the U.S. is USD $119,800 – $234,700 per year.

There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 – $258,000 per year.

Certain roles may be eligible for benefits and other compensation.

Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

XML job scraping automation by YubHub

You will work closely with Product Managers, Designers, and Engineers to ship end to end features, influence architecture decisions, and raise the quality bar across the team.

Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals.

Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities:

• Build and operate scalable, reliable, distributed services on Azure using modern frameworks and event-driven architectures.
• Apply solid JavaScript expertise to design and maintain efficient, reliable data instrumentation mechanisms that ensure accurate, performant, and privacy-conscious analytics with minimal impact on customer websites.
• Contribute to analytics data quality by improving the accuracy, coverage, and efficiency of data collection for features you work on, ensuring trustworthy insights while respecting performance and privacy constraints.
• Implement AI-forward product features and use AI-assisted engineering tools within the SDLC, applying solid engineering fundamentals to deliver reliable and secure outcomes with appropriate accountability.
• Participate in engineering excellence practices including design discussions, code reviews, testing, and operational readiness, helping improve system resilience with minimal customer impact.
• Collaborate closely with product team to ship end-to-end features, contribute to architectural discussions, and uphold a high quality bar.

Qualifications:

• Bachelor’s Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
• 2+ years experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP
• Solid expertise in JavaScript / TypeScript, HTML, CSS and browser internals
• Solid understanding of web performance, accessibility, and cross-browser compatibility
• Experience with Development & Debugging with dev environments like Visual Studio or Visual Studio Code
• Familiarity with LLMs and AI ChatBots Prompt Engineering, Azure DevOps, GIT
• Solid problem-solving skills and ability to work independently
• Experience in leading technical projects and supporting architectural decisions with data.

#MicrosoftAI Software Engineering IC4 – The typical base pay range for this role across the U.S. is USD $119,800 – $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 – $258,000 per year.

XML job scraping automation by YubHub

Microsoft AI are looking for a talented Member of Technical Staff - Full Stack Software Engineer to help build the next wave of capabilities for their personalized AI assistant, Copilot. At Microsoft AI, they push boundaries to deliver exceptional products and services that empower users to be more productive and efficient.

About the Role

In this role, you will work across all four stages of their evaluation platform: data sampling, AI data collection and processing, data analysis and evaluation, and insight generation. You will contribute across the full stack—from backend databases and middle-tier services to browser automation, statistical analysis, and dashboard creation. Expect to dive into prompt engineering and leverage cutting-edge AI tools to drive meaningful impact. This engineering position offers exposure to a wide range of technologies and surfaces, including desktop, web, and mobile.

Accountabilities

• Expertise in experimentation methodologies, including A/B evaluation, data sampling, measurement techniques, evaluation design, and data analysis.
• Demonstrating strategic vision by understanding organizational goals, translating metrics into actionable insights, and enhancing product quality.
• Designing pipeline architecture to ensure rapid iteration and scalability.
• Conducting post-analysis of labeled data and developing dashboards to visualize insights.
• Collaborating closely with the product team to enhance quality and address gaps.

The Candidate we're looking for

Experience:

• 4+ years technical engineering experience with coding in languages including, but not limited to C#, Java, or Python.

Technical skills:

• SQL, PostgreSQL or MySQL.
• Experience with Development & Debugging with dev environments like Visual Studio or Visual Studio Code.
• HTML, CSS, JavaScript, ASP.NET, REST, jQuery.

Personal attributes:

• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.

Benefits

• Competitive salary.
• Comprehensive benefits package.
• Opportunities for professional growth and development.
• Collaborative and dynamic work environment.

XML job scraping automation by YubHub