Key responsibilities include:

• Developing and deploying ML-based search and discovery relevance models and systems integrated with Databricks' products and services.
• Designing and implementing automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration.
• Collaborating with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience.
• Contributing to building a robust framework for evaluating search ranking improvements - both offline and online.

Requirements include:

• A Bachelor's degree in Computer Science or a related field, with a Master's or PhD preferred.
• 5+ years of experience developing search relevance systems at scale in production or in high-impact research environments.
• Experience applying LLM to search relevance.
• Strong understanding of computer science fundamentals.
• Contributions to well-used open-source projects.

XML job scraping automation by YubHub