Job details:

• Full-time
• Remote
• Start date: asap
• Duration: 6-12 months + extensions

Scope:

• Design, develop and maintain data pipelines to extract data from a variety of sources and populate data lake and data warehouse

• Develop the various data transformation rules and data modelling capabilities

• Collaborate with Product Analyst, Data Scientists, and Machine Learning Engineers to identify and transform data to make data understandable.

• Experience in implementing data quality checks, maintain data catalogues, use orchestration, logging, and monitoring tools, data analysis, information architecture concept and implementation, Git for version control and understand various branching strategies

• Use test driven development methodology when building ELT/ETL pipelines

Skills:

• 5-8  years of relevant experience

• DSCS and DPTM knowledge will be value add

• Solid experience with AWS services (S3, IAM, Redshift, Sagemaker, Glue, Lambda, Step Functions, CloudWatch)

• Experience with platforms like Databricks, Dataiku

• Proficient in Python / Java, SQL – Redshift preferred, Jenkins, CloudFormation, Terraform, Git, Docker, 2-3 years of Spark – PySpark

• Good communication and SDLC documentation skills.
• Fluent English

SNI sp. z o.o. will process personal data for the purpose of the recruitment process in accordance with Data Privacy Policy. The data may also be stored and processed for future recruitment purposes, in accordance with the given consent.