Location: Dublin, Ireland

Department: R&D

Job Description:

Intercom is seeking a Senior Data Engineering Manager to lead the design and evolution of the core infrastructure that powers our entire data ecosystem. As a leader, you will partner with product and business teams to drive key data initiatives and ensure the success of our data engineering team.

Responsibilities:

• Next-Gen Platform Evolution: Partner with product and business teams to design and implement the next generation of our data stack, ensuring it can meet the demands of advanced analytics and AI applications.

• Enablement Through Tooling: Partner closely with Analytics Engineers, Analysts, and Data Scientists to build self-service tooling and infrastructure that enables them to move fast and deploy safely.

• Data Quality Guardianship: Implement advanced monitoring systems to proactively detect, surface, and resolve data quality issues across our high-throughput environment.

• Driving Automation: Develop automation and tooling that streamlines the creation and discovery of high-quality analytics data, making the entire data lifecycle more efficient.

Strategic Impact You'll Drive:

• GTM Data Platform Strategy: Build the data acquisition strategy that will enable us to build the next generation of business-focused internal software.

• Conversational BI Strategy: Lead the charge to shift away from complex, technical reporting toward natural language interaction to make data truly democratized and accessible.

• Platform & Warehousing Strategy: Lead the architectural- and cost review and revamp of our core data infrastructure to ensure it can scale exponentially for future growth and advanced use cases.

Recent Wins You'll Build Upon:

• AI-assisted Local Analytics Development Environment for Airflow and DBT.

• Data-rich AI apps containerized on Snowflake SPCS.

• A new, modern data catalog solution.

• Migrating critical MySQL ingestion pipelines from Aurora to PlanetScale.

Who You Are:

• A leader, a builder, and a problem-solver who thrives on solving real-world business problems.

• 7+ years of experience in the data space, leading teams of 6+ engineers.

• Stakeholder focus: ability to communicate complex technical solutions to a business-focused audience and vice versa.

• Technical depth: not afraid to get hands dirty and write code when needed.

• A leader and mentor: naturally recognizes opportunities to step back and mentor others.

Bonus Points (Our Modern Stack Knowledge):

• Airflow at scale: extensive experience working with Apache Airflow, especially the nuances of operating it reliably in a high-volume environment.

• Modern data stack fluency: familiarity with tools like Snowflake and DBT.

• Future-focused: keeps a keen eye on industry trends and emerging technologies.

Benefits:

• Competitive salary and equity in a fast-growing start-up.

• We serve lunch every weekday, plus a variety of snack foods and a fully stocked kitchen.

• Regular compensation reviews - we reward great work!

• Pension scheme & match up to 4%.

• Peace of mind with life assurance, as well as comprehensive health and dental insurance for you and your dependents.

• Open vacation policy and flexible holidays so you can take time off when you need it.

• Paid maternity leave, as well as 6 weeks paternity leave for fathers, to let you spend valuable time with your loved ones.

• If you’re cycling, we’ve got you covered on the Cycle-to-Work Scheme. With secure bike storage too.

• MacBooks are our standard, but we also offer Windows for certain roles when needed.

Policies:

• Intercom has a hybrid working policy. We believe that working in person helps us stay connected, collaborate easier and create a great culture while still providing flexibility to work from home.

• We have a radically open and accepting culture at Intercom. We avoid spending time on divisive subjects to foster a safe and cohesive work environment for everyone.

XML job scraping automation by YubHub

As an Analytics Engineer, you will design, build, and manage scalable data pipelines and ETL processes to support a robust, analytics-ready data platform. You will partner with AI analysts, ML scientists, engineers, and business teams to understand data needs and ensure accurate, reliable, and ergonomic data solutions. You will lead initiatives in data model development, data quality ownership, warehouse management, and production support for critical workflows. You will conduct data analysis and build custom models to support strategic business decisions and performance measurement. You will streamline data collection and reporting processes to reduce manual effort and improve efficiency. You will create scalable solutions like unified data pipelines and access control systems to meet evolving organisational needs. You will work with partner teams to align data collection with long-term analytics and feature development goals.

We're looking for someone who writes advanced SQL with a preference for well-architected data models, optimized query performance, and clearly documented code. You should be familiar with the modern data stack, including dbt and Snowflake. You should have a growth mindset and eagerness to learn. You should exhibit great judgment and sharp business and product instincts that allow you to differentiate essential versus nice-to-have and to make good choices about trade-offs. You should practice excellent communication skills, and you should tailor explanations of technical concepts to a variety of audiences.

Nice to have: exposure to Apache Airflow or other DAG frameworks, worked in Tableau, Looker, or similar visualization/business intelligence platform, experience with operational tools and business systems like Google Analytics, Marketo, Salesforce, Segment, or Stripe, familiarity with Python.

XML job scraping automation by YubHub

Your work will involve developing data models that enable the efficient analysis and manipulation of data for merchandising optimization, ensuring data quality, consistency, and accuracy. You'll also develop high-quality data assets for product use-cases by partnering with Product, AI/ML, and Data Science teams.

As a Senior Data Engineer, you'll contribute to creating standards and best practices for Airbnb's Data Engineering and shape the tools, processes, and standards used by the broader data community. You'll collaborate with cross-functional teams to define data requirements and deliver data solutions that drive merchandising and sales improvements.

To succeed in this role, you'll need 6+ years of relevant industry experience, a BE/B.Tech in Computer Science or a relevant technical degree, and hands-on experience in DSA coding, data structure, and algorithm. You'll also need extensive experience designing, building, and operating robust distributed data platforms and handling data at the petabyte scale.

XML job scraping automation by YubHub

Who we are

Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world’s largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their revenue, and accelerate new business opportunities.

About the team

The Big Data Infrastructure organization is a globally distributed team of approximately 40 engineers spread across Dublin, Bangalore, Seattle, and San Francisco. This team is the backbone of the company’s data ecosystem, responsible for building, scaling, and maintaining the highly reliable platforms that power data storage, orchestration, and processing at scale.

As the Head of Big Data Infra, you will lead a global, ~40-person engineering organization responsible for the foundational data platforms that drive the business. Reporting directly to the Head of Compute, you will define the strategic vision and roadmap for the company's data lake, orchestration pipelines, and batch computing environments.

The team's technical portfolio spans four core domains:

• Datalake (Storage): Managing scalable cloud storage and metadata layers, leveraging Amazon S3, Apache Iceberg (metastore and integrations), SAL, and Hive Metastore (HMS).

• Data Orchestration: Ensuring robust pipeline execution and scheduling using Apache Airflow.

• Batch Compute Infra (Data Store): Maintaining foundational data infrastructure and legacy systems, including Hadoop.

• Batch Compute Experience (Data Processing): Optimizing and delivering powerful data processing environments utilizing Apache Spark and Apache Celeborn.

What you’ll do

You will move beyond day-to-day management to act as an industry leader, effectively advocating for your organization's mission and impact. You will be expected to see problems others don't and rally people to independently create solutions.

Responsibilities

• Set Strategic Vision: Define the scope, vision, and goals for your organization with little or no guidance. You will anticipate industry trends to influence Stripe's long-range plans and set direction on a multi-year timeframe.

• Lead at Scale: Manage the achievement of and accountability for broad swaths of programs. You will establish wide-ranging and scaled processes, anticipating and removing roadblocks across multiple teams.

• Drive Operational Excellence: Instill a culture of rigorous thinking and meticulous craftsmanship. You will ensure your organization drives constant improvement in team processes and maintains high standards of operational rigor.

• Indirect Influence: Use indirect influence to steer other teams toward making the right decisions for Stripe. You will effectively communicate your team's plan and how it links to Stripe's company vision to cross-functional stakeholders.

• Obsess Over Talent: Proactively invest in the development of the organization and its people at all levels. You will recruit world-class talent and coach your direct reports,who are themselves managers - to elevate the skills of the leadership team.

• Stewardship & Culture: Act as an ambassador and advocate for Stripe, modeling ownership for all other Stripes. You will actively work to increase Stripe's inclusivity and diversity and use our operating principles to guide decision-making.

Who you are

We’re looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The preferred qualifications are a bonus, not a requirement.

Minimum requirements

• Bachelor’s degree or equivalent practical experience with minimum 5 years of experience with software development.

• Minimum 5 years of experience in a technical leadership role; overseeing strategic projects.

• Minimum 3 years of Manager of Managers experience (managing other engineering managers).

• Experience building diverse teams to tackle challenging technical problems.

• Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts.

Preferred qualifications

• Strategic Ambiguity: Proven ability to translate chaos into clarity and navigate complex, high-impact work where you must define your own scope.

• Infrastructure at Scale: Successfully shipped and operated critical infrastructure with significant responsibility over funds or critical data.

• Cross-Functional Influence: A track record of getting other teams on board with your vision to support execution in a way that benefits the broader company.

• Curiosity: You enjoy learning and diving into the nuts-and-bolts of how things work (e.g., global money movement rails, currency conversion, or inter-company flows).

• Humility and Adaptability: You are humble and self-aware, with a history of adapting your management approach across different environments and seeking feedback to grow as a leader.

XML job scraping automation by YubHub

As a Principal Software Engineer, you'll solve complex distributed systems challenges, build modular tooling that accelerates delivery, and set the standard for observability and operational excellence. You'll have a dedicated manager handling all HR and administrative responsibilities. A product manager connects business needs with technical work. Your focus is 100% technical leadership, mentorship, and hands-on execution.

Key Responsibilities:

• Technical Leadership & System Design: Proven experience building web crawling or large-scale data systems from scratch. Strong architectural skills designing scalable, fault-tolerant distributed systems. Track record leading complex technical initiatives and driving architecture direction for teams.

• Data Engineering Expertise: Deep background in large-scale data engineering (terabytes daily). Hands-on experience with cloud data warehouses (BigQuery, Snowflake). Experience with Apache Kafka, Kubernetes (GKE/EKS), and orchestration tools (Airflow).

• Web Crawling & Data Extraction: Deep expertise in web crawling technologies and advanced scraping (Scrapy or similar). Experience extracting structured/unstructured web data and SERP extraction. Knowledge of proxy infrastructure management, anti-bot detection, and ethical crawling.

• Leadership & Team Development: Experience mentoring engineers at all levels and fostering collaborative culture. Strong ability to influence technical direction and establish best practices. Track record hiring, coaching, and developing senior engineers.

Ideal Candidate Profile:

• 10+ years software engineering experience. 5+ years focused on data engineering. 3+ years in senior/principal-level technical leadership.

• Strong CS fundamentals (algorithms, data structures, distributed systems). Self-starter who thrives in fast-paced environments.

Core Technical Stack:

• Python & Java
• Apache Kafka
• GCP (BigQuery, GKE, Vertex AI)
• Snowflake & Starburst/Trino
• Terraform
• Scrapy / Web Scraping Frameworks
• Proxy Management Systems
• Distributed Systems & Kubernetes
• Apache Airflow
• Large-Scale ETL Pipelines

XML job scraping automation by YubHub

We are seeking an FBS Associate Analytics Engineer to join our team. As an FBS Associate Analytics Engineer, you will play a key role in transforming raw data into structured, high-quality datasets that are ready for analysis. You will work on low to moderately complex business problems, receiving coaching and guidance from data leadership. Your primary focus will be on end-to-end data workflow, including data ingestion, transformation, modeling, and validation to enable data-driven decision-making across the organization.

Responsibilities

• Emerging data infrastructure development with coaching and guidance: Pipeline Design and Development – Architects and builds scalable data pipelines using modern ETL (Extract, Load, Transform) tools and frameworks such as DBT (Data Build Tool), Apache Airflow, or similar.
• Automates data ingestion processes from various sources including databases, APIs, and third party services.
• Data Storage and Management - Designs and implements data warehousing solutions using platforms like Snowflake, Redshift, or BigQuery.
• Optimizes storage solutions for performance, cost efficiency, and scalability.
• Data Modeling - Develops and maintains logical and physical data models to support business analytics.
• Creates and manages dimensional models, star/snowflake schemas, and other data structures.
• Data Transformation - Transforms raw data into clean, organized, and analytics-ready datasets using SQL, Python, or other relevant languages.
• Data Quality Assurance - Conducts data validation and consistency checks to ensure the accuracy and reliability of data.
• Technology Stack - Utilizes modern data tools and technologies such as SQL, Python, dbt, Airflow, and cloud platforms like AWS, Azure, or GCP.
• Continuous Learning – Stays updated with the latest trends, best practices, and advancements in data engineering and analytics.
• Participates in professional development opportunities to enhance technical and analytical skills.
• Provides code as requirements for hardening and operationalization by technology with significant coaching, guidance, and feedback.
• Performs other duties as assigned.

Requirements

• 1+ year of experience working on a Data Environment
• Good Analytics mindset
• Knowledge in SQL
• Strong verbal communication and listening skills.
• Demonstrated written communication skills.
• Demonstrated analytical skills.
• Demonstrated problem solving skills.
• Effective interpersonal skills.
• Seeks to acquire knowledge in area of specialty.
• Possesses strong technical aptitude. Basic experience with SQL or similar, dimensional modeling, pipeline orchestration, building data pipelines to transform data, and BI visualizations.
• Python experience is a plus

Benefits

This position comes with a competitive compensation and benefits package.

• A competitive salary and performance-based bonuses.
• Comprehensive benefits package.
• Flexible work arrangements (remote and/or office-based).
• You will also enjoy a dynamic and inclusive work culture within a globally renowned group.
• Private Health Insurance.
• Paid Time Off.
• Training & Development opportunities in partnership with renowned companies.

XML job scraping automation by YubHub