The ideal candidate will have deep expertise in AWS technologies, data lake architecture, and cross-functional collaboration to deliver high-quality data solutions.

Key Responsibilities:

Data Ingestion & Framework Development

• Design, build, and maintain reusable, modular, and configuration-driven frameworks for ingesting both historical and incremental data from diverse sources into Iceberg tables on AWS S3.

• Expose ingested data to Snowflake via Snowflake external tables, ensuring seamless integration and accessibility.

• Implement robust logging mechanisms to monitor all data processes, ensuring completeness, timeliness, accuracy, and validity (ABC metrics).

• Configure automated notifications to alert support teams of process statuses and anomalies.

• Adhere to architectural standards and development best practices throughout the lifecycle.

Solution Design & Execution

• Translate complex business requirements into scalable and efficient technical solutions.

• Independently plan and execute the implementation of new data capabilities, including:

• Development of project plans with clear milestones and delivery timelines.

• Task breakdown, assignment, and management.

• Comprehensive documentation and tracking of work using Rally or equivalent tools.

• Identification and management of dependencies across cross-functional teams.

Cross-Team Collaboration

• Coordinate effectively with internal and external stakeholders, including:

• Cloud Operations

• Information Security

• Business Units

• Other Development Teams

• Facilitate alignment and secure commitment from partner teams to meet project deliverables and dependency timelines.

Proactive, Timely, Concise and Audience Appropriate Communication

• Communicates complex technical concepts to technical and non-technical personnel.

• Delivers routine progress and status to stakeholders.

• Communicates information in line with the target audience experience, background, and expectations; uses terms, examples, and analogies that are meaningful to the audience.

• Ensures accuracy of information communicated to effectively support project leadership decision making.

Continuous Improvement

• Proactively accumulates and maintains knowledge of current and emerging/evolving technologies, concepts, and trends in the IT field.

• Provides input on improving or enhancing existing organizational processes based on lessons learned and experiences from project work.

• Performs root cause analysis to quickly identify and resolve issues causing recurring technical problems.

Self-Driven Problem Solving & Initiative

• Demonstrates a high degree of independence and ownership in driving initiatives from concept to completion.

• Proactively identifies challenges and inefficiencies, and takes swift action to resolve them without waiting for direction.

• Navigates complex organizational structures to engage the right stakeholders and ensure timely delivery.

• Maintains a solution-oriented mindset, continuously seeking opportunities to improve processes, enhance collaboration, and deliver value.

XML job scraping automation by YubHub