In this role, you'll have end-to-end ownership of the architecture and technical strategy behind automation and agentic workflows that reduce mean time to mitigate (MTTM), boost quality, and enable our Support organization to scale impact without scaling headcount. You'll work hands-on with teams across Support, Product, and Platform Engineering to build seamless systems that anticipate customer needs before they arise.

You'll lead the technical foundation that transforms how customers experience support , where issues are auto-diagnosed, solutions are delivered instantly, and engineers focus their time on the toughest challenges. Your success will mean customers moving faster, trusting Databricks deeper, and feeling the impact of your systems every day.

Key responsibilities include:

• Owning the technical vision and architecture for Databricks' Support Automation and Tooling ecosystem
• Leading hands-on development of automation to improve customer experience and Support scalability
• Driving rapid, iterative development while upholding quality, safety, and reliability standards
• Designing agentic workflows that evolve from human-in-the-loop to fully automated systems
• Implementing observability, transparency, and rollback mechanisms for AI-driven decisions
• Acting as the primary technical interface between Support, Product, and Platform Engineering to align technical roadmaps and unblock dependencies
• Setting a high engineering bar for quality, reliability, and maintainability in line with Databricks standards
• Mentoring engineers and SMEs across Software and Support Engineering functions

We're looking for someone with:

• A BS or higher degree in Computer Science or a related field
• Technical leadership experience in large projects similar to those described, including automation tooling, distributed systems, and APIs
• Extensive full-stack development experience
• Proven success designing and deploying production-grade automation in complex technical environments
• Hands-on experience with ML-assisted systems, decision support, or agentic automation
• Deep familiarity with distributed data platforms, developer tooling, and large-scale infrastructure systems
• Understanding of multi-cloud environments (AWS, Azure, GCP), compliance, and security constraints

Pay Range Transparency

Databricks is committed to fair and equitable compensation practices. The pay range for this role is $190,000-$261,250 USD.

XML job scraping automation by YubHub

As a Senior Data Engineer, you'll lead the design, implementation, and testing of data systems, from architecture to production. You'll build batch and real-time data systems that support business needs and critical products, ensuring data systems' quality, performance, and stability through rigorous monitoring and quality assurance practices.

You'll collaborate with cross-functional teams, including product managers, data scientists, and engineers, to develop scalable systems and drive data-driven decisions. You'll maintain strong partnerships with backend, data science, and machine learning teams to ensure seamless integration of data systems.

Key responsibilities include:

• Leading the design, implementation, and testing of data systems, from architecture to production
• Building batch and real-time data systems that support business needs and critical products
• Ensuring data systems' quality, performance, and stability through rigorous monitoring and quality assurance practices
• Collaborating with cross-functional teams to develop scalable systems and drive data-driven decisions
• Maintaining strong partnerships with backend, data science, and machine learning teams to ensure seamless integration of data systems

We're looking for someone with 9+ years of relevant experience, a Bachelor's/Master's degree in CS/EE, and extensive experience in designing, building, and operating distributed data platforms. You should be proficient in Java, Scala, or Python, with strong skills in data processing and SQL querying. Proven track record of designing and optimizing batch and real-time data pipelines is a must.

In addition to technical expertise, we're looking for someone with excellent written and verbal communication skills, with the ability to influence stakeholders and convey complex technical concepts. You should be a strong leader and mentor, with experience guiding teams on best practices and technical strategies.

XML job scraping automation by YubHub