<?xml version="1.0" encoding="UTF-8"?>
<source>
  <jobs>
    <job>
      <externalid>60a7e1e6-b51</externalid>
      <Title>Tech Lead/Manager, Machine Learning Research Scientist- LLM Evals</Title>
      <Description><![CDATA[<p>As the leading data and evaluation partner for frontier AI companies, we&#39;re dedicated to advancing the evaluation and benchmarking of large language models (LLMs). Our Research teams work with the industry&#39;s leading AI labs to provide high-quality data and accelerate progress in GenAI research.</p>
<p>We&#39;re seeking a Tech Lead Manager to lead a talented team of research scientists and research engineers focused on developing and implementing novel evaluation methodologies, metrics, and benchmarks to assess the capabilities and limitations of our cutting-edge LLMs.</p>
<p>Key responsibilities:</p>
<ul>
<li>Lead a team of highly effective research scientists and research engineers on LLM evals.</li>
<li>Conduct research on the effectiveness and limitations of existing LLM evaluation techniques.</li>
<li>Design and develop novel evaluation benchmarks for large language models, covering areas such as instruction following, factuality, robustness, and fairness.</li>
<li>Communicate, collaborate, and build relationships with clients and peer teams to facilitate cross-functional projects.</li>
<li>Collaborate with internal teams and external partners to refine metrics and create standardized evaluation protocols.</li>
<li>Implement scalable and reproducible evaluation pipelines using modern ML frameworks.</li>
<li>Publish research findings in top-tier AI conferences and contribute to open-source benchmarking initiatives.</li>
</ul>
<p>Ideal candidate has 5+ years of hands-on experience in large language model, NLP, and Transformer modeling, in the setting of both research and engineering development. Experience supporting and leading a team of research scientists and research engineers is also required.</p>
<p style="margin-top:24px;font-size:13px;color:#666;">XML job scraping automation by <a href="https://yubhub.co">YubHub</a></p>]]></Description>
      <Jobtype>full-time</Jobtype>
      <Experiencelevel>senior</Experiencelevel>
      <Workarrangement>onsite</Workarrangement>
      <Salaryrange>$264,800-$331,000 USD</Salaryrange>
      <Skills>large language model, NLP, Transformer modeling, research and engineering development, team leadership, cross-functional collaboration, evaluation methodologies, metrics and benchmarks, scalable and reproducible evaluation pipelines, modern ML frameworks, published research in top-tier AI conferences, open-source benchmarking initiatives, customer-facing role</Skills>
      <Category>Engineering</Category>
      <Industry>Technology</Industry>
      <Employername>Scale</Employername>
      <Employerlogo>https://logos.yubhub.co/scale.com.png</Employerlogo>
      <Employerdescription>Scale develops reliable AI systems for the world&apos;s most important decisions, providing high-quality data and full-stack technologies.</Employerdescription>
      <Employerwebsite>https://scale.com/</Employerwebsite>
      <Compensationcurrency></Compensationcurrency>
      <Compensationmin></Compensationmin>
      <Compensationmax></Compensationmax>
      <Applyto>https://job-boards.greenhouse.io/scaleai/jobs/4304790005</Applyto>
      <Location>San Francisco, CA; Seattle, WA; New York, NY</Location>
      <Country></Country>
      <Postedate>2026-04-18</Postedate>
    </job>
    <job>
      <externalid>3386dafd-10b</externalid>
      <Title>Senior Research Engineer - Interactive Avatars</Title>
      <Description><![CDATA[<p><strong>Senior Research Engineer - Interactive Avatars</strong></p>
<p><strong>About the role</strong></p>
<p>As a Research Engineer, you will join a team of 40+ Researchers and Engineers within the R&amp;D Department working on cutting edge challenges in the Generative AI space, with a focus on avatar-centric interactive video diffusion models. Within the team you’ll have the opportunity to work on the applied side of our research efforts and directly impact our solutions that are used worldwide by over 60,000 businesses.</p>
<p><strong>Responsibilities</strong></p>
<ul>
<li>Adapt diffusion models to incorporate diverse conditioning signals (e.g., audio, motion, interaction cues).</li>
<li>Develop methods for streaming infinitely long video sequences at real-time rates.</li>
<li>Work on the perceptual layer of interactive agents, including understanding user audio and generating appropriate contextual reactions.</li>
<li>Improve lip-sync accuracy, motion realism, and overall visual quality in video diffusion models.</li>
<li>Build robust evaluation frameworks and test suites to enable continuous quality tracking.</li>
<li>Collaborate closely with our data team to define data needs and ensure high-quality datasets.</li>
<li>Stay up to date with research in world models, interactive human/agent modeling, diffusion models, and related areas.</li>
</ul>
<p><strong>What we&#39;re looking for:</strong></p>
<ul>
<li>Comfortable owning and executing on the responsibilities listed above.</li>
<li>Strong ML (e.g., diffusion, GANs, VAEs) and computer vision background with relevant industry experience.</li>
<li>Hands-on experience with diffusion models (ideally avatar-centric or video-focused) and up to date with recent advances.</li>
<li>Proficient in PyTorch and familiar with modern ML frameworks and tooling.</li>
<li>Strong Python engineering skills, confident with git and version control, and a commitment to clean, maintainable research code.</li>
<li>Outcome-driven, detail-oriented, and motivated to push state-of-the-art research into real product impact.</li>
<li>Clear communicator of hypotheses, experiments, and results.</li>
</ul>
<p><strong>What will make you stand out:</strong></p>
<ul>
<li>Experience with audio-conditioned video diffusion models and deep knowledge of recent video DiT architectures.</li>
<li>Demonstrated ability to own the full model development pipeline end to end, from data preparation to model design, training, and evaluation.</li>
<li>A strong publication record in areas such as world models, interactive agents, or video diffusion models.</li>
</ul>
<p><strong>Why join us?</strong></p>
<p>We’re living the golden age of AI. The next decade will yield the next iconic companies, and we dare to say we have what it takes to become one. Here’s why,</p>
<p><strong>Our culture</strong></p>
<p>At Synthesia we’re passionate about building, not talking, planning or politicising. We strive to hire the smartest, kindest and most unrelenting people and let them do their best work without distractions. Our work principles serve as our charter for how we make decisions, give feedback and structure our work to empower everyone to go as fast as possible. <strong>You can find out more about these principles here.</strong></p>
<p><strong>Serving 50,000+ customers (and 50% of the Fortune 500)</strong></p>
<p>We’re trusted by leading brands such as Heineken, Zoom, Xerox, McDonald’s and more. Read stories from happy customers and what 1,200+ people say on G2.</p>
<p><strong>Proprietary AI technology</strong></p>
<p>Since 2017, we’ve been pioneering advancements in Generative AI. Our AI technology is built in-house, by a team of world-class AI researchers and engineers. Learn more about our AI Research Lab and the team behind.</p>
<p><strong>AI Safety, Ethics and Security</strong></p>
<p>AI safety, ethics, and security are fundamental to our mission. While the full scope of Artificial Intelligence&#39;s impact on our society is still unfolding, our position is clear: <strong>People first. Always.</strong>  Learn more about our commitments to AI Ethics, Safety &amp; Security.</p>
<p><strong>The good stuff...</strong></p>
<ul>
<li>Competitive compensation (salary + stock options + bonus)</li>
<li>Hybrid work setting with an office in London, Amsterdam, Zurich, Munich, or remote in Europe.</li>
<li>25 days of annual leave + public holidays</li>
<li>Great company culture with the option to join regular planning and socials at our hubs</li>
<li>\+ other benefits depending on your location</li>
</ul>
<p>You can see more about Who we are and How we work here: https://www.synthesia.io/careers</p>
<p>LI-MD1</p>
<p style="margin-top:24px;font-size:13px;color:#666;">XML job scraping automation by <a href="https://yubhub.co">YubHub</a></p>]]></Description>
      <Jobtype>full-time</Jobtype>
      <Experiencelevel>senior</Experiencelevel>
      <Workarrangement>hybrid</Workarrangement>
      <Salaryrange>Competitive compensation (salary + stock options + bonus)</Salaryrange>
      <Skills>ML, computer vision, PyTorch, modern ML frameworks and tooling, Python engineering skills, git and version control, audio-conditioned video diffusion models, deep knowledge of recent video DiT architectures, publication record in areas such as world models, interactive agents, or video diffusion models</Skills>
      <Category>Engineering</Category>
      <Industry>Technology</Industry>
      <Employername>Synthesia</Employername>
      <Employerlogo>https://logos.yubhub.co/synthesia.io.png</Employerlogo>
      <Employerdescription>Synthesia is the world&apos;s leading AI video platform for business, used by over 90% of the Fortune 100. The company is headquartered in London, with offices and teams across Europe and the US.</Employerdescription>
      <Employerwebsite>https://www.synthesia.io/</Employerwebsite>
      <Compensationcurrency></Compensationcurrency>
      <Compensationmin></Compensationmin>
      <Compensationmax></Compensationmax>
      <Applyto>https://jobs.ashbyhq.com/synthesia/2a637b27-92db-4752-8c0d-343e267ea299</Applyto>
      <Location>London</Location>
      <Country></Country>
      <Postedate>2026-03-06</Postedate>
    </job>
  </jobs>
</source>