Data Engineer Lead
Prefer a full account with a password? Sign Up to Apply
Job Description
Job Description
We’re looking for a Lead Data Engineer to support the design, development, and optimization of data solutions for a high-impact enterprise initiative. This role will focus on preparing and enabling the Snowflake data required for a Dataiku PO agent Proof of Concept (POC).
The ideal candidate has strong hands-on experience with Snowflake, SQL, data modeling, and data quality validation. You will be responsible for ensuring that data is properly ingested, transformed, standardized, and structured to support the POC and its downstream analytical workflows.
You will work closely with technical and business stakeholders to deliver reliable, high-quality datasets and scalable data pipelines that meet the initiative’s requirements.
What will you be doing?
• Prepare, structure, and enable the Snowflake data required to support the Dataiku PO agent POC.
• Design, develop, and maintain data pipelines to ingest, transform, normalize, and prepare data from multiple sources.
• Design and implement data ingestion workflows in Snowflake, ensuring scalability, reliability, and maintainability.
• Develop and maintain data models that support analytical use cases and the requirements of the POC.
• Implement data quality checks and validation rules to ensure data accuracy, consistency, completeness, and reliability.
• Use SQL and Python to process, transform, and validate large datasets efficiently.
• Identify and resolve data inconsistencies, anomalies, and structural issues that could affect downstream consumption.
• Support ETL processes and file-handling workflows for structured and semi-structured data.
• Collaborate with business and technical stakeholders to understand data requirements and translate them into reliable data solutions.
• Contribute to technical documentation and continuously improve data processes, standards, and validation practices.
Requirements
Function: Marketing
Experience Level: Mid-Senior Level