{"version":"0.1","company":{"name":"YubHub","url":"https://yubhub.co","jobsUrl":"https://yubhub.co/jobs/skill/big-data-engineering"},"x-facet":{"type":"skill","slug":"big-data-engineering","display":"Big Data Engineering","count":3},"x-feed-size-limit":100,"x-feed-sort":"enriched_at desc","x-feed-notice":"This feed contains at most 100 jobs (the most recently enriched). For the full corpus, use the paginated /stats/by-facet endpoint or /search.","x-generator":"yubhub-xml-generator","x-rights":"Free to redistribute with attribution: \"Data by YubHub (https://yubhub.co)\"","x-schema":"Each entry in `jobs` follows https://schema.org/JobPosting. YubHub-native raw fields carry `x-` prefix.","jobs":[{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_a03720f6-bc3"},"title":"Solutions Architect","description":"<p>As a Solutions Architect at Databricks, you will partner with our customers to design scalable data architectures using Databricks technology and services.</p>\n<p>You have technical depth and business knowledge and can drive complex technology discussions which express the value of the Databricks platform throughout the sales lifecycle.</p>\n<p>In partnership with our Account Executives, you will engage with our customers&#39; technical leads, including architects, engineers, and operations teams with the goal of establishing yourself as a trusted advisor to achieve tangible outcomes.</p>\n<p>You will work with teams across Databricks and our executive leadership to represent your customer&#39;s needs and build valuable customer engagements and report to the Field Engineering Manager.</p>\n<p>The impact you will have:</p>\n<ul>\n<li>Work with Sales and other essential partners to develop account strategies for your assigned accounts to grow their usage of the platform.</li>\n</ul>\n<ul>\n<li>Establish the Databricks Lakehouse architecture as the standard data architecture for customers through excellent technical account planning.</li>\n</ul>\n<ul>\n<li>Build and present reference architectures and demo applications for prospects to help them understand how Databricks can be used to achieve their goals to land new users and use cases.</li>\n</ul>\n<ul>\n<li>Capture the technical win by consulting on big data architectures, data engineering pipelines, and data science/machine learning projects; prove out the Databricks technology for strategic customer projects; and validate integrations with cloud services and other 3rd party applications.</li>\n</ul>\n<ul>\n<li>Become an expert in, and promote Databricks inspired open-source projects (Spark, Delta Lake, MLflow, and Koalas) across developer communities through meetups, conferences, and webinars.</li>\n</ul>\n<p>What we look for:</p>\n<ul>\n<li>5+ years in a customer-facing pre-sales, technical architecture, or consulting role with expertise in at least one of the following technologies:</li>\n</ul>\n<ul>\n<li>Big data engineering (Ex: Spark, Hadoop, Kafka)</li>\n</ul>\n<ul>\n<li>Data Warehousing &amp; ETL (Ex: SQL, OLTP/OLAP/DSS)</li>\n</ul>\n<ul>\n<li>Data Science and Machine Learning (Ex: pandas, scikit-learn, HPO)</li>\n</ul>\n<ul>\n<li>Data Applications (Ex: Logs Analysis, Threat Detection, Real-time Systems Monitoring, Risk Analysis and more)</li>\n</ul>\n<ul>\n<li>Experience translating a customer&#39;s business needs to technology solutions, including establishing buy-in with essential customer stakeholders at all levels of the business.</li>\n</ul>\n<ul>\n<li>Experienced at designing, architecting, and presenting data systems for customers and managing the delivery of production solutions of those data architectures.</li>\n</ul>\n<ul>\n<li>Fluent in SQL and database technology.</li>\n</ul>\n<ul>\n<li>Debug and development experience in at least one of the following languages: Python, Scala, Java, or R.</li>\n</ul>\n<ul>\n<li>Desired: Built solutions with public cloud providers such as AWS, Azure, or GCP</li>\n</ul>\n<ul>\n<li>Desired: Degree in a quantitative discipline (Computer Science, Applied Mathematics, Operations Research)</li>\n</ul>\n<ul>\n<li>Travel to customers in your region up to 30% of the time.</li>\n</ul>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_a03720f6-bc3","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Databricks","sameAs":"https://databricks.com","logo":"https://logos.yubhub.co/databricks.com.png"},"x-apply-url":"https://job-boards.greenhouse.io/databricks/jobs/5898477002","x-work-arrangement":"remote","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":"$164,500-$224,000 CAD","x-skills-required":["Big data engineering","Data Warehousing & ETL","Data Science and Machine Learning","Data Applications","SQL and database technology","Python, Scala, Java, or R"],"x-skills-preferred":["Built solutions with public cloud providers such as AWS, Azure, or GCP","Degree in a quantitative discipline (Computer Science, Applied Mathematics, Operations Research)"],"datePosted":"2026-04-18T15:54:41.801Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Toronto, Canada"}},"jobLocationType":"TELECOMMUTE","employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"Big data engineering, Data Warehousing & ETL, Data Science and Machine Learning, Data Applications, SQL and database technology, Python, Scala, Java, or R, Built solutions with public cloud providers such as AWS, Azure, or GCP, Degree in a quantitative discipline (Computer Science, Applied Mathematics, Operations Research)","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":164500,"maxValue":224000,"unitText":"YEAR"}}},{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_fd1da18e-84d"},"title":"Principal Software Engineer II - Observability","description":"<p>We&#39;re looking for a Principal Software Engineer to join the Observability Experience Team as one of the Tech Leads. As part of this team, you will work at the intersection of big data engineering, backend architecture, and experiences to help users obtain the best insights from their Observability signals, especially logs, metrics, and traces.</p>\n<p>Key responsibilities include collaborating with product management, product design, and multiple teams across Elastic to define and evolve the end-to-end experiences for Observability. You will also be a contact point for other teams within Elastic, providing hands-on support and guidance. Additionally, you will help the team define coding practices and standards, foster a culture of mutual respect, collaboration, and consensus-based decision-making, and stay true to the principles of software development as adopted by the team.</p>\n<p>The ideal candidate will have experience leading technical projects in the data and enterprise architecture areas, with a proven knowledge in building and running sophisticated technical infrastructures and engineering sound software systems. They should also have hands-on experience using and developing Observability tools, preferably in the Logs space, and experience mentoring expert engineers, providing technical and professional guidance. Furthermore, they should be able to define a long-term technical vision for an area of a data-intensive application, working across teams and organizations to collaboratively build the technical roadmap.</p>\n<p>Bonus points for experience as a user of the Elastic Stack and experience in SRE roles.</p>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_fd1da18e-84d","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Elastic, the Search AI Company","sameAs":"https://www.elastic.co/","logo":"https://logos.yubhub.co/elastic.co.png"},"x-apply-url":"https://job-boards.greenhouse.io/elastic/jobs/7635297","x-work-arrangement":"remote","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":null,"x-skills-required":["Observability tools","Logs space","Big data engineering","Backend architecture","Experiences"],"x-skills-preferred":["Elastic Stack","SRE roles"],"datePosted":"2026-04-18T15:45:58.943Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Greece"}},"jobLocationType":"TELECOMMUTE","employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"Observability tools, Logs space, Big data engineering, Backend architecture, Experiences, Elastic Stack, SRE roles"},{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_70fe3dd2-f85"},"title":"Senior Data Engineer","description":"<p><strong>About the Role</strong></p>\n<p>We&#39;re hiring a Senior Data Engineer to work on our Data Infrastructure Team. This team is responsible for building and maintaining the Data Platform, a comprehensive set of tools and infrastructure used daily by every data scientist and ML engineer in our company.</p>\n<p><strong>Responsibilities</strong></p>\n<ul>\n<li>Job scheduling and orchestration for data pipelines.</li>\n<li>Deployment and management of BI tools.</li>\n<li>Real-time analytics infrastructure (ClickHouse, AWS Lambda, Cube.js, and related tooling).</li>\n<li>Real-time log ingestion and processing, including data compliance.</li>\n<li>Core data services (e.g., Kubernetes, Ray, metadata services) and enterprise-wide observability solutions (based on ClickHouse and OpenTelemetry).</li>\n</ul>\n<p><strong>Requirements</strong></p>\n<p>We are seeking an engineer with at least 4 years of experience who possesses strong programming skills (ideally in Python), and expertise in big data engineering, web services, and cloud platforms (ideally AWS). We are looking for someone eager to build diverse components and drive the evolution of our platform while working closely with our users. Excellent English communication skills and robust computer science background is a strong requirement.</p>\n<p><strong>Benefits</strong></p>\n<ul>\n<li>Unlimited vacation time - we strongly encourage all of our employees take at least 3 weeks per year</li>\n<li>Fully remote team - choose where you live</li>\n<li>Work from home stipend! We want you to have the resources you need to set up your home office</li>\n<li>Apple laptops provided for new employees</li>\n<li>Training and development budget for every employee, refreshed each year</li>\n<li>Maternity &amp; Paternity leave for qualified employees</li>\n<li>Work with smart people who will help you grow and make a meaningful impact</li>\n<li>This position has a base salary range between $80k and $120k USD. The offer varies on many factors including job related knowledge, skills, experience, and interview results.</li>\n<li>Regular team offsites to connect and collaborate</li>\n</ul>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_70fe3dd2-f85","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Constructor","sameAs":"https://apply.workable.com","logo":"https://logos.yubhub.co/j.com.png"},"x-apply-url":"https://apply.workable.com/j/C6407C4CB5","x-work-arrangement":"remote","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":"$80k - $120k USD","x-skills-required":["Python","big data engineering","web services","cloud platforms (AWS)"],"x-skills-preferred":["ClickHouse","AWS Lambda","Cube.js"],"datePosted":"2026-03-09T10:57:40.511Z","jobLocationType":"TELECOMMUTE","employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"Python, big data engineering, web services, cloud platforms (AWS), ClickHouse, AWS Lambda, Cube.js","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":80000,"maxValue":120000,"unitText":"YEAR"}}}]}