{"version":"0.1","company":{"name":"YubHub","url":"https://yubhub.co","jobsUrl":"https://yubhub.co/jobs/skill/hdfs"},"x-facet":{"type":"skill","slug":"hdfs","display":"Hdfs","count":4},"x-feed-size-limit":100,"x-feed-sort":"enriched_at desc","x-feed-notice":"This feed contains at most 100 jobs (the most recently enriched). For the full corpus, use the paginated /stats/by-facet endpoint or /search.","x-generator":"yubhub-xml-generator","x-rights":"Free to redistribute with attribution: \"Data by YubHub (https://yubhub.co)\"","x-schema":"Each entry in `jobs` follows https://schema.org/JobPosting. YubHub-native raw fields carry `x-` prefix.","jobs":[{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_df9a4b26-709"},"title":"Senior Software Engineer","description":"<p>The Ads Data Platform Team, part of Microsoft AI, is hiring a Senior Software Engineer. This role is available in Redmond, WA. Our team powers the backbone of Microsoft’s global ads marketplace—gathering, storing, and enriching over half a trillion ad-serving events every day. We build data platforms that fuel business analytics, machine learning models, and real-time reporting at massive scale.</p>\n<p>As part of our team, you’ll:</p>\n<p>Design and operate high-scale, high-performance systems that process billions of events through near-real-time and offline pipelines.\nBuild data applications that directly impact Microsoft Ads’ double-digit annual growth.\nWork on cutting-edge technologies in distributed systems, machine learning, and big data.</p>\n<p><strong>Responsibilities</strong></p>\n<p>Work with BingAds stakeholders to determine requirements for new features to drive up Ads business.\nCreate system design for feature requirements.\nAssure system meets security and compliance requirements and expectations.\nCreates a clear and articulated plan for testing and assuring quality solutions.\nImplement the features with high efficiency, extensibility, diagnosability, reliability, and maintainability with few defects.\nReviews code of product to assure it meets the team’s and Microsoft’s quality standards, is reliable and accurate, and is appropriate for the scale of the product feature.\nMaintain operations of live service as issues arise on a rotational, on-call basis.\nIdentifies solutions and mitigations to simple and complex issues and escalates as necessary.\nActs as a Designated Responsible Individual (DRI) working on call to monitor system/product feature/service for degradation, downtime, or interruptions.\nResponds within Service Level Agreement (SLA) timeframe.\nEscalate issues to appropriate owners.\nBuild knowledge, share new ideas, and share pinpoints of engineering tool gaps to improve software developer tools to support other programs, tools, and applications to create, debug, and maintain code for product features.\nContribute to the development of automation within production and deployment of a product feature.\nProfile and analyze distributed system performance and capacity bottlenecks.\nPropose and implement solutions to improve system latency and capacity to meet BingAds online serving requirements.</p>\n<p><strong>Qualifications</strong></p>\n<p>Required Qualifications:</p>\n<ul>\n<li>Bachelor’s Degree in Computer Science or related technical field</li>\n<li>4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python</li>\n<li>Ability to meet Microsoft, customer and/or government security screening requirements</li>\n</ul>\n<p>Preferred Qualifications:</p>\n<ul>\n<li>Master’s Degree in Computer Science or related technical field</li>\n<li>6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python</li>\n<li>Experience in Azure</li>\n<li>Experience in Machine learning and online system design, implementation and qualification</li>\n<li>2+ years’ experience in Distributed Systems and Big Data Technologies such as Spark, Hadoop, HDFS, Kafka, Flink, Scala</li>\n</ul>\n<p>#MicrosoftAI #BingAds Software Engineering IC4 – The typical base pay range for this role across the U.S. is USD $119,800 – $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 – $258,000 per year.</p>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_df9a4b26-709","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Microsoft AI","sameAs":"https://microsoft.ai","logo":"https://logos.yubhub.co/microsoft.ai.png"},"x-apply-url":"https://microsoft.ai/job/senior-software-engineer-92/","x-work-arrangement":"hybrid","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":"USD $119,800 – $234,700 per year","x-skills-required":["C","C++","C#","Java","JavaScript","Python","Azure","Machine learning","Distributed Systems","Big Data Technologies"],"x-skills-preferred":["Spark","Hadoop","HDFS","Kafka","Flink","Scala"],"datePosted":"2026-03-08T22:17:03.136Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Redmond"}},"employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"C, C++, C#, Java, JavaScript, Python, Azure, Machine learning, Distributed Systems, Big Data Technologies, Spark, Hadoop, HDFS, Kafka, Flink, Scala","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":119800,"maxValue":234700,"unitText":"YEAR"}}},{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_c873a489-0dc"},"title":"Data Engineer, Analytics","description":"<p><strong>Data Engineer, Analytics</strong></p>\n<p><strong>Location</strong></p>\n<p>San Francisco</p>\n<p><strong>Employment Type</strong></p>\n<p>Full time</p>\n<p><strong>Department</strong></p>\n<p>Applied AI</p>\n<p><strong>Compensation</strong></p>\n<ul>\n<li>$230K – $385K • Offers Equity</li>\n</ul>\n<p>The base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. If the role is non-exempt, overtime pay will be provided consistent with applicable laws. In addition to the salary range listed above, total compensation also includes generous equity, performance-related bonus(es) for eligible employees, and the following benefits.</p>\n<p><strong>Benefits</strong></p>\n<ul>\n<li>Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts</li>\n</ul>\n<ul>\n<li>Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)</li>\n</ul>\n<ul>\n<li>401(k) retirement plan with employer match</li>\n</ul>\n<ul>\n<li>Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)</li>\n</ul>\n<ul>\n<li>Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees</li>\n</ul>\n<ul>\n<li>13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)</li>\n</ul>\n<ul>\n<li>Mental health and wellness support</li>\n</ul>\n<ul>\n<li>Employer-paid basic life and disability coverage</li>\n</ul>\n<ul>\n<li>Annual learning and development stipend to fuel your professional growth</li>\n</ul>\n<ul>\n<li>Daily meals in our offices, and meal delivery credits as eligible</li>\n</ul>\n<ul>\n<li>Relocation support for eligible employees</li>\n</ul>\n<ul>\n<li>Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided.</li>\n</ul>\n<p><strong>About the team</strong></p>\n<p>The Applied team works across research, engineering, product, and design to bring OpenAI’s technology to consumers and businesses.</p>\n<p>We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth.</p>\n<p><strong>About the role</strong></p>\n<p>We&#39;re seeking a Data Engineer to take the lead in building our data pipelines and core tables for OpenAI. These pipelines are crucial for powering analyses, safety systems that guide business decisions, product growth, and prevent bad actors. If you&#39;re passionate about working with data and are eager to create solutions with significant impact, we&#39;d love to hear from you. This role also provides the opportunity to collaborate closely with the researchers behind ChatGPT and help them train new models to deliver to users. As we continue our rapid growth, we value data-driven insights, and your contributions will play a pivotal role in our trajectory. Join us in shaping the future of OpenAI!</p>\n<p><strong>In this role, you will:</strong></p>\n<ul>\n<li>Design, build and manage our data pipelines, ensuring all user event data is seamlessly integrated into our data warehouse.</li>\n</ul>\n<ul>\n<li>Develop canonical datasets to track key product metrics including user growth, engagement, and revenue.</li>\n</ul>\n<ul>\n<li>Work collaboratively with various teams, including, Infrastructure, Data Science, Product, Marketing, Finance, and Research to understand their data needs and provide solutions.</li>\n</ul>\n<ul>\n<li>Implement robust and fault-tolerant systems for data ingestion and processing.</li>\n</ul>\n<ul>\n<li>Participate in data architecture and engineering decisions, bringing your strong experience and knowledge to bear.</li>\n</ul>\n<ul>\n<li>Ensure the security, integrity, and compliance of data according to industry and company standards.</li>\n</ul>\n<p><strong>You might thrive in this role if you:</strong></p>\n<ul>\n<li>Have 3+ years of experience as a data engineer and 8+ years of any software engineering experience(including data engineering).</li>\n</ul>\n<ul>\n<li>Proficiency in at least one programming language commonly used within Data Engineering, such as Python, Scala, or Java.</li>\n</ul>\n<ul>\n<li>Experience with distributed processing technologies and frameworks, such as Hadoop, Flink and distributed storage systems (e.g., HDFS, S3).</li>\n</ul>\n<ul>\n<li>Expertise with any of ETL schedulers such as Airflow, Dagster, Prefect or similar frameworks.</li>\n</ul>\n<ul>\n<li>Solid understanding of Spark and ability to write, debug and optimize Spark code.</li>\n</ul>\n<p><strong>About OpenAI</strong></p>\n<p>OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.</p>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_c873a489-0dc","directApply":true,"hiringOrganization":{"@type":"Organization","name":"OpenAI","sameAs":"https://jobs.ashbyhq.com","logo":"https://logos.yubhub.co/openai.com.png"},"x-apply-url":"https://jobs.ashbyhq.com/openai/fc5bbc77-a30c-4e7a-9acc-8a2e748545b4","x-work-arrangement":"onsite","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":"$230K – $385K • Offers Equity","x-skills-required":["Python","Scala","Java","Hadoop","Flink","HDFS","S3","Airflow","Dagster","Prefect","Spark"],"x-skills-preferred":[],"datePosted":"2026-03-06T18:20:01.101Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"San Francisco"}},"employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"Python, Scala, Java, Hadoop, Flink, HDFS, S3, Airflow, Dagster, Prefect, Spark","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":230000,"maxValue":385000,"unitText":"YEAR"}}},{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_26c57034-3a3"},"title":"Senior Software Engineer","description":"<p><strong>Summary</strong></p>\n<p>Microsoft AI are looking for a talented Senior Software Engineer at their Redmond office. This role sits at the heart of strategic decision-making, turning market data into actionable insights for a company that&#39;s revolutionising haptic entertainment technology. You&#39;ll work directly with leadership to shape the company&#39;s direction in the cinema and simulation markets.</p>\n<p><strong>About the Role</strong></p>\n<p>As a Senior Software Engineer, you&#39;ll design and operate high-scale, high-performance systems that process billions of events through near-real-time and offline pipelines. You&#39;ll build data applications that directly impact Microsoft Ads&#39; double-digit annual growth. You&#39;ll work on cutting-edge technologies in distributed systems, machine learning, and big data.</p>\n<p><strong>Accountabilities</strong></p>\n<ul>\n<li>Conduct in-depth market research across cinema and simulation sectors, identifying emerging trends, competitive threats, and partnership opportunities that directly inform the company&#39;s quarterly strategic planning sessions</li>\n<li>Work with BingAds stakeholders to determine requirements for new features to drive up Ads business</li>\n</ul>\n<p><strong>The Candidate we&#39;re looking for</strong></p>\n<p><strong>Experience:</strong></p>\n<ul>\n<li>2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python</li>\n</ul>\n<p><strong>Technical skills:</strong></p>\n<ul>\n<li>Experience in Azure</li>\n<li>Experience in Machine learning and online system design, implementation and qualification</li>\n<li>2+ years’ experience in Distributed Systems and Big Data Technologies such as Spark, Hadoop, HDFS, Kafka, Flink, Scala</li>\n</ul>\n<p><strong>Personal attributes:</strong></p>\n<ul>\n<li>Strong problem-solving skills</li>\n<li>Excellent communication and collaboration skills</li>\n</ul>\n<p><strong>Benefits</strong></p>\n<ul>\n<li>Competitive salary</li>\n<li>Comprehensive benefits package</li>\n<li>Opportunities for professional growth and development</li>\n</ul>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_26c57034-3a3","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Microsoft AI","sameAs":"https://microsoft.ai","logo":"https://logos.yubhub.co/microsoft.ai.png"},"x-apply-url":"https://microsoft.ai/job/senior-software-engineer-79/","x-work-arrangement":"onsite","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":"USD $119,800 – $234,700 per year","x-skills-required":["C","C++","C#","Java","JavaScript","Python","Azure","Machine learning","Distributed Systems","Big Data Technologies"],"x-skills-preferred":["Spark","Hadoop","HDFS","Kafka","Flink","Scala"],"datePosted":"2026-03-06T07:33:27.032Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Redmond"}},"employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"C, C++, C#, Java, JavaScript, Python, Azure, Machine learning, Distributed Systems, Big Data Technologies, Spark, Hadoop, HDFS, Kafka, Flink, Scala","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":119800,"maxValue":234700,"unitText":"YEAR"}}},{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_e3ce7035-a47"},"title":"Software Engineer II","description":"<p><strong>Summary</strong></p>\n<p>Microsoft AI are looking for a talented Software Engineer II to join their Ads Data Platform Team. This role is available in Redmond, WA and is a great opportunity for those who are passionate about solving complex problems and driving innovation.</p>\n<p><strong>About the Role</strong></p>\n<p>As a Software Engineer II, you will design and operate high-scale, high-performance systems that process billions of events through near-real-time and offline pipelines. You will build data applications that directly impact Microsoft Ads&#39; double-digit annual growth. You will work on cutting-edge technologies in distributed systems, machine learning, and big data.</p>\n<p><strong>Accountabilities</strong></p>\n<ul>\n<li>Design and operate high-scale, high-performance systems that process billions of events through near-real-time and offline pipelines.</li>\n<li>Build data applications that directly impact Microsoft Ads&#39; double-digit annual growth.</li>\n<li>Work on cutting-edge technologies in distributed systems, machine learning, and big data.</li>\n</ul>\n<p><strong>The Candidate we&#39;re looking for</strong></p>\n<p><strong>Experience:</strong></p>\n<ul>\n<li>2+ years of technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.</li>\n</ul>\n<p><strong>Technical skills:</strong></p>\n<ul>\n<li>Experience in Azure.</li>\n<li>Experience in machine learning and online system design, implementation and qualification.</li>\n<li>2+ years&#39; experience in Distributed Systems and Big Data Technologies such as Spark, Hadoop, HDFS, Kafka, Flink, Scala.</li>\n</ul>\n<p><strong>Personal attributes:</strong></p>\n<ul>\n<li>Strong problem-solving skills and ability to work in a fast-paced environment.</li>\n<li>Excellent communication and collaboration skills.</li>\n</ul>\n<p><strong>Benefits</strong></p>\n<ul>\n<li>Competitive salary range of $100,600 - $199,000 per year.</li>\n<li>Comprehensive benefits package including health, dental, and vision insurance.</li>\n<li>401(k) matching program.</li>\n<li>Paid time off and holidays.</li>\n<li>Opportunities for professional growth and development.</li>\n</ul>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_e3ce7035-a47","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Microsoft AI","sameAs":"https://microsoft.ai","logo":"https://logos.yubhub.co/microsoft.ai.png"},"x-apply-url":"https://microsoft.ai/job/software-engineer-ii-7/","x-work-arrangement":"onsite","x-experience-level":"mid","x-job-type":"full-time","x-salary-range":"$100,600 - $199,000 per year","x-skills-required":["C","C++","C#","Java","JavaScript","Python","Azure","machine learning","Distributed Systems","Big Data Technologies"],"x-skills-preferred":["Spark","Hadoop","HDFS","Kafka","Flink","Scala"],"datePosted":"2026-03-06T07:28:17.990Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Redmond"}},"employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"C, C++, C#, Java, JavaScript, Python, Azure, machine learning, Distributed Systems, Big Data Technologies, Spark, Hadoop, HDFS, Kafka, Flink, Scala","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":100600,"maxValue":199000,"unitText":"YEAR"}}}]}