{"version":"0.1","company":{"name":"YubHub","url":"https://yubhub.co","jobsUrl":"https://yubhub.co/jobs/skill/hands-on-experience-with-ml-and-or-ai-evaluation"},"x-facet":{"type":"skill","slug":"hands-on-experience-with-ml-and-or-ai-evaluation","display":"hands on experience with ML and/or AI evaluation","count":1},"x-feed-size-limit":100,"x-feed-sort":"enriched_at desc","x-feed-notice":"This feed contains at most 100 jobs (the most recently enriched). For the full corpus, use the paginated /stats/by-facet endpoint or /search.","x-generator":"yubhub-xml-generator","x-rights":"Free to redistribute with attribution: \"Data by YubHub (https://yubhub.co)\"","x-schema":"Each entry in `jobs` follows https://schema.org/JobPosting. YubHub-native raw fields carry `x-` prefix.","jobs":[{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_bab8e903-9f8"},"title":"Member of Technical Staff - Copilot AI Evaluation Engineering Manager","description":"<p><strong>Summary</strong></p>\n<p>Microsoft AI are looking for a talented Member of Technical Staff - Copilot AI Evaluation Engineering Manager at their Mountain View office. This role sits at the heart of strategic decision-making, turning market data into actionable insights for a company that&#39;s revolutionising AI technology. You&#39;ll work directly with leadership to shape the company&#39;s direction in the AI market.</p>\n<p><strong>About the Role</strong></p>\n<p>As a Member of Technical Staff - Copilot AI Evaluation Engineering Manager, you will lead building our LLM evaluation solutions for Copilot. You&#39;ll work in a deeply iterative, collaborative, fast-paced environment to improve our technology for millions of users around the world. You will lead a team of talented software engineers and applied AI engineers to deliver world-class evaluation solutions that are secure, reliable, and scalable, while collaborating closely with cross-functional teams including Product and Research.</p>\n<p><strong>Accountabilities</strong></p>\n<ul>\n<li>Hire, manage, and lead a team of software engineers, AI engineers, and machine learning engineers responsible for delivering world-class LLM evaluation solutions.</li>\n<li>Collaborate with Eng and Product leadership to prioritize features and improve our world-class AI companion to the world.</li>\n</ul>\n<p><strong>The Candidate we&#39;re looking for</strong></p>\n<p><strong>Experience:</strong></p>\n<ul>\n<li>6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.</li>\n</ul>\n<p><strong>Technical skills:</strong></p>\n<ul>\n<li>Hands on experience with ML and/or AI evaluation.</li>\n</ul>\n<p><strong>Personal attributes:</strong></p>\n<ul>\n<li>Thrive in a fast-paced, collaborative environment and are comfortable making progress in ambiguity.</li>\n</ul>\n<p><strong>Benefits</strong></p>\n<ul>\n<li>Software Engineering M5 – The typical base pay range for this role across the U.S. is USD $139,900 – $274,800 per year.</li>\n<li>Certain roles may be eligible for benefits and other compensation.</li>\n</ul>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_bab8e903-9f8","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Microsoft AI","sameAs":"https://microsoft.ai","logo":"https://logos.yubhub.co/microsoft.ai.png"},"x-apply-url":"https://microsoft.ai/job/member-of-technical-staff-copilot-ai-evaluation-engineering-manager/?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply","x-work-arrangement":"onsite","x-experience-level":"staff","x-job-type":"full-time","x-salary-range":"USD $139,900 – $274,800 per year","x-skills-required":["C","C++","C#","Java","JavaScript","Python","ML","AI evaluation"],"x-skills-preferred":["hands on experience with ML and/or AI evaluation"],"datePosted":"2026-03-06T07:25:46.473Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Mountain View"}},"employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"C, C++, C#, Java, JavaScript, Python, ML, AI evaluation, hands on experience with ML and/or AI evaluation","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":139900,"maxValue":274800,"unitText":"YEAR"}}}]}