{"version":"0.1","company":{"name":"YubHub","url":"https://yubhub.co","jobsUrl":"https://yubhub.co/jobs/city/san-francsico/"},"x-facet":{"type":"city","slug":"san-francsico","display":"San Francsico","count":1},"x-feed-size-limit":100,"x-feed-sort":"enriched_at desc","x-feed-notice":"This feed contains at most 100 jobs (the most recently enriched). For the full corpus, use the paginated /stats/by-facet endpoint or /search.","x-generator":"yubhub-xml-generator","x-rights":"Free to redistribute with attribution: \"Data by YubHub (https://yubhub.co)\"","x-schema":"Each entry in `jobs` follows https://schema.org/JobPosting. YubHub-native raw fields carry `x-` prefix.","jobs":[{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_277caa80-b4a"},"title":"Senior Staff Engineer, Big Data Infrastructure","description":"<p><strong>Job Description</strong></p>\n<p><strong>Who we are</strong></p>\n<p>Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world’s largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead.</p>\n<p><strong>About the team</strong></p>\n<p>In this role, you’d be joining the Big Data Infrastructure team. Our team builds and maintains the platforms that power data work across Stripe, managing three core layers:</p>\n<ul>\n<li>Data Orchestration (Airflow)</li>\n<li>Batch Compute (Spark, Celeborn)</li>\n<li>Data Lake (Iceberg, Hive, S3, Azure Blob Storage)</li>\n</ul>\n<p>We support over 2,000 engineers and 600+ internal teams, processing workloads that organically grow more than 30% year over year. Our infrastructure handles massive scale, managing over 800 PB of data, running 325,000 applications a day, and accounting for hundreds of millions of dollars in annual spend, directly powering critical pipelines like inbound payments, network reconciliation, and capital underwriting.</p>\n<p><strong>What you’ll do</strong></p>\n<p>As the technical leader for the Big Data Infrastructure organization, you will guide a 40+ person engineering team to scale our foundational data systems. You will partner closely with major internal customers like Data Foundations, Payins Engineering, and AI/ML Foundations to modernize our tech stack and execute Stripe&#39;s transition to the &quot;Agentic Era&quot; - building &quot;invisible infrastructure&quot; where AI agents operate data pipelines end-to-end.</p>\n<p><strong>Responsibilities</strong></p>\n<ul>\n<li>Serve as the technical leader for the Big Data Infrastructure organization, overseeing distributed systems that manage 20% of Stripe&#39;s total AWS spend</li>\n<li>Execute Stripe&#39;s transition to the &quot;Agentic Era&quot; by building invisible infrastructure that empowers AI agents to author, validate, ship, and operate data pipelines</li>\n<li>Drive the architecture and delivery of critical modernization bets, including YARN to Kubernetes migrations, native vectorization (Gluten/Velox), and Airflow and Data Catalog modernization</li>\n<li>Lead the implementation of a multi-region and multi-cloud data strategy for high availability, disaster recovery, and Azure Blob Storage compliance</li>\n<li>Reduce operational burden and maintenance overhead (KTLO) from over 40% to under 10% by shifting fixes into the platform instead of relying on runbooks</li>\n<li>Foster a culture of operational excellence and mentor engineers at various stages in their careers, up to Staff+</li>\n</ul>\n<p><strong>Who you are</strong></p>\n<p><strong>Requirements</strong></p>\n<ul>\n<li>BS or MS in Computer Science or a related field</li>\n<li>This is a Senior Staff role, so ideally 12+ years of professional experience in a software development role</li>\n<li>A strong engineering background in distributed infrastructure and/or platform services, including one or more of the following: storage, databases, or compute</li>\n<li>Experience leading projects on a cross-team and company-wide scale, including scaling and migrating systems with little to no downtime</li>\n<li>Experience developing, maintaining, and debugging distributed systems while optimizing their reliability and security</li>\n<li>Experience driving a culture of operational excellence, with a deep understanding of metrics, alerts, and dashboards</li>\n</ul>\n<p><strong>Preferred qualifications</strong></p>\n<ul>\n<li>Experience driving AI-led architectural transformations and integrating agentic workflows into large-scale data systems</li>\n<li>Experience in a development team at AWS, Azure, OCI, or Google</li>\n<li>Experience with big data infrastructure at scale, such as Spark, Iceberg, S3, Airflow, YARN, and Celeborn</li>\n<li>Experience with database internals and/or with Kubernetes</li>\n</ul>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">Job Data by <a href=\"https://yubhub.co\">YubHub</a>.</p>","url":"https://job-boards.greenhouse.io/stripe/jobs/8317306","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Stripe","sameAs":"https://stripe.com","logo":"https://logos.yubhub.co/stripe.com.png"},"x-apply-url":"https://job-boards.greenhouse.io/stripe/jobs/8317306","x-work-arrangement":null,"x-experience-level":"senior","x-job-type":"full-time","x-salary-range":null,"x-skills-required":["Computer Science","Distributed Infrastructure","Platform Services","Storage","Databases","Compute","Project Management","Operational Excellence"],"x-skills-preferred":["AI-led Architectural Transformations","Agentic Workflows","AWS","Azure","OCI","Google","Big Data Infrastructure","Spark","Iceberg","S3","Airflow","YARN","Celeborn","Kubernetes","Database Internals"],"x-benefits":[],"x-licences":[],"x-visa-sponsorship":"unknown","x-visa-sponsorship-text":null,"x-work-authorisation":"unknown","x-work-authorisation-text":null,"datePosted":"2026-11-05T01:19:27.000Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"San Francsico"}},"employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"Computer Science, Distributed Infrastructure, Platform Services, Storage, Databases, Compute, Project Management, Operational Excellence, AI-led Architectural Transformations, Agentic Workflows, AWS, Azure, OCI, Google, Big Data Infrastructure, Spark, Iceberg, S3, Airflow, YARN, Celeborn, Kubernetes, Database Internals"}]}