We're hiring a Senior Data Engineer to work on our Data Lake Team. As a key member of the team, you will be responsible for building and operating various data platform components, including data quality, data pipelines, infrastructure, and monitoring.

Responsibilities

• Maintain data pipeline job framework
• Develop Data Quality framework ( internal set of tools for internal and external data sources validation )
• Maintain and develop public facing data ingestion service with 17 000+ RPS.
• Maintain and develop core data pipelines in batch and streaming manners.
• Be a last line of support for our internal platform users.
• Take a part in an on-call rotation for data platform incidents (shared across the team).

Requirements

• Fluent English
• 4+ years building production services and data pipelines (batch and/or streaming)
• Strong experience with Python or the readiness to ramp up quickly.
• Hands-on experience with at least one MPP system (Spark, Trino, Redshift etc.)
• Hands-on experience operating services in a cloud environment (AWS preferred)

Nice to Have

• Terraform/CloudFormation or other IaC tools
• ClickHouse or similar analytical databases
• Experiences with data quality/observability tools

Benefits

• Unlimited vacation time - we strongly encourage all employees to take at least 3 weeks per year
• Fully remote team - choose where you live
• Work from home stipend - we want you to have the resources you need to set up your home office
• Apple laptops provided for new employees
• Training and development budget - refreshed each year for every employee
• Maternity & Paternity leave for qualified employees
• Work with smart people who will help you grow and make a meaningful impact
• Base salary: $80k–$120k USD, depending on knowledge, skills, experience, and interview results
• Stock options - offered in addition to the base salary
• Regular team offsites to connect and collaborate

XML job scraping automation by YubHub