Job details:

• Role: Data Engineer
• Full-time
• TBC
• Start date: ASAP
• End date: 31/12/2026

Scope:

• As Expert Data Engineer you will be building data systems to support decision making processes.
• You will focus on developing and maintaining data pipelines..
• This position will require advanced technical depth and experience, and communication skills.
• What you’ll be doing:
• Building a distributed and highly parallelized Big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time
• Leveraging Spark @Scla to transform corporate data to enable data products to be built
• Continuous delivery on Hadoop and other Big Data Platforms
• Automating processes where possible and are repeatable and reliable

Skills:

• Experience in Spark & Scala – minimum 5 years;
• Experience in Python – minimum 7 years
• Experience in Linux – minimum 5 years
• Experience with distributed data processing engines like Spark
• Experience with Hadoop and (Hive, Oozie, map reduce, ect)
• Strong/Advanced SQL skills
• Previous experience in creating data flows
• BitBucket and GIT expert
• Unit testing Experience (Junit 5, Mockito, Spark testing)
• Advanced English skills
• If above skill set turns out to be too challenging, please try combination Python + Spark + Java

Nice to have:

• Code versioning strategy & Branching strategy
• Familiar with Agile/Safe framework

SNI sp. z o.o. will process personal data for the purpose of the recruitment process in accordance with Data Privacy Policy. The data may also be stored and processed for future recruitment purposes, in accordance with the given consent.