Scope:
The Data Engineer will deliver end-to-end data ingestions into the Group Data Platform. This includes building and maintaining ingestion pipelines, handling metadata-driven ingestion processes, tracking lineage and classification, and supporting incident management. The engineer will work within a product team, receive ingestion assignments from the Product Owner, and report progress to key stakeholders. The role requires close collaboration with technical teams, data governance, and platform operations.
Skills:
Core Technical Skills:
- Azure Data Factory (ADF) & Databricks
- Azure Data Lake Storage Gen2 (ADLS)
- Azure Synapse & Azure SQL/PostgreSQL
- ETL/ELT pipeline development
- CI/CD using Azure DevOps
- Power BI / Qlik (basic integration)
Specialized Ingestion Skills:
- Metadata-driven ingestion frameworks
- Data quality rules & validation
- Data lineage, classification, and GDPR compliance
- Monitoring & incident troubleshooting
- IaC (ARM templates) and automation
SNI sp. z o.o. will process personal data for the purpose of the recruitment process in accordance with Data Privacy Policy. The data may also be stored and processed for future recruitment purposes, in accordance with the given consent.