A suitable candidate will have solid Software Engineering skills with practical experience in integrating machine learning models in production workflows in both online and offline settings. Moreover, the candidate will also have solid experience in building and optimizing distributed systems that are able to leverage available compute and storage resources to build efficient applications for serving users.

We hire people motivated to solve the hard problems, keen to work in a larger team of data scientists and engineers, and ready to make a difference in how search and AI assistant landscape evolves.

Responsibilities:

• Design, implement, and ship AI-first product capabilities end-to-end from rapid prototype to production, spanning LLM-powered services, retrieval/grounding pipelines, and intelligent UX experiences.

• Design and execute offline and online experiments to assess product impact, iterating on techniques to improve models and maximize impact.

• Own implementation across the full stack integrating front-end experiences, back-end services, and AI orchestration layers that connect models, context, and tools to deliver cohesive, extensible, high-performance systems.

• Collaborate with design, research, and platform teams to adapt or fine-tune, optimize LLMs/SLMs models for real-world customer scenarios, ensuring outcomes are contextual, transparent, and human-centered.

• Build agentic, tool-using, and multimodal workflows that reason across data and services; optimize for safety, latency, reliability, and cost efficiency.

• Contribute to engineering excellence secure-by-design, accessibility compliance, automated testing, and code craftsmanship across the product lifecycle.

• Drive live-site reliability and operational excellence, participating in On-Call rotations while maintaining a sustainable, high-ownership engineering culture.

Qualifications:

• Bachelor's Degree in Computer Science, or related technical discipline with proven experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.

• Professional experience working with generative artificial intelligence, large language models or agent-based systems.

• Comfortable driving complex server and client architecture across large product teams.

• Hands-on experience with modern LLM evaluation techniques, including LLM-as-a-Judge, agentic evaluations and RAG assessments.

• A track record of delivering successful, large scale applied ML projects in an industry setting.

• Experience with MLOps practices, model versioning, automated testing, monitoring and CI/CD for machine learning.

• Cloud & Infrastructure: Skilled in building and operating infrastructure using Azure, AWS, or Google Cloud, and deploying containerized models with Docker, Kubernetes, or similar tools.

• Experience with proficient coding, debugging, and problem-solving skills.

• Excellent problem solving and data analysis skills.

• Outstanding communication and collaboration skills.

Preferred Qualifications:

• Master's Degree in Computer Science or related technical field with proven experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.

• OR Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.

• OR equivalent experience.

XML job scraping automation by YubHub

We are seeking a Research Operations (ResOps) program manager for our team to help our UX Researchers do the most impactful work possible. For this role we're looking for someone who can help our team improve our research processes, manage our relationships with vendors, navigate the contracting process, and bring more velocity and happiness to the team. Someone who is un-blockable and finds creative new approaches when obstacles come up. Someone who always puts people and the team first, no matter how challenging things get. Someone who is energized by making everyone around them better.

Responsibilities:

Engage, partner, and collaborate with research team members, leadership, and key stakeholders to proactively identify opportunities to leverage programming and AI automation to improve the efficiency, effectiveness, and the impact of research insights for our team. Communicate operational goals and strategy. Design and launch programs that reduce process friction and enhance researcher impact and satisfaction. Define, measure and manage strategic initiatives that improve team efficiency and impact, establishing operational systems and outcomes. Contribute to overall research operations infrastructure, updating processes and tools and initiating improvements where needed. Proactively manage expectations: define clear program roadmaps, provide frequent program updates, identify and communicate risks and adjustments, and ensure commitments are delivered. Support knowledge management by helping centralize, document, and maintain internal processes and resources, tracking of research deliverables and capacity, etc. Drive year over year tooling and supplier management contracts, management, administration and pricing and forecasting to ensure we have the best platforms and tools to conduct user research. Management of budget, expenses, and compliance with financial policies. Cross-functional coordination, partnering with finance, legal, procurement to keep UXR running smoothly. Coordination with Creative Ops team, including Design Operations and Business Management to keep entire productive and customer-focused.

Qualifications:

Bachelor's Degree AND 4+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience 2+ years of experience managing cross-functional and/or cross-team projects.

Preferred Qualifications:

Extensive knowledge of UX research methods. 5+ years relevant domain experience within technology sector. Excellent collaboration skills across disciplines – PM, Data Science, Engineering, and Product Design. Enthusiasm to partner on key goals and evolve the program based on feedback. Superb communication skills to convey complex ideas and insights across cross-disciplinary audiences, along with strong presentation, project management and process management skills. Experience leading horizontal initiatives and scaling ResOps impact spanning across multiple cross-disciplinary teams. Understanding of trends in generative Artificial Intelligence (AI). Passion for learning new technologies and understanding the needs of users across a wide range of technical abilities. Deep understanding of user research tools like Qualtrics, Dscout, and UserTesting and experience with new AI-first research tools. Experience with business applications and enterprise product research. Experience scaling research through enablement. Experience leveraging data to inform decisions and drive change. Track record of operating independently and taking initiative, embracing ambiguity, demonstrating creativity, being detail-oriented, and delivering results in an organized manner. Budgeting, forecasting and ability to analyze data and performance to support decision-making. Extensive experience coordinating across departments (Finance, HR, Ops, etc) and vendor management, contracts, and procurement.

XML job scraping automation by YubHub