For one of our international Client we are looking for a Poland based Senior Data Engineers responsible for maintaining, enhancing technologies related to Data Analytics Catalog as well Data Management area (Master Data Management or Reference Data Management). It covers Collibra, Schedulix, Trillium, Tibco CIM, Tibco EBX, Informatica MDM and Informatica SaaS MDM.
- Senior Data Engineer
- Full-time
- Remote
- Start date: asap
- Duration: 12 months (option to extend)
- Industry: various
Scope:
- Scope covers software development, maintenance and configuration of Collibra and MDM/RDM tools, AWS configuration, testing and quality assurance. Engineers will be led by internal Technical Product Manager and working in Scrum/Kanban on assigned tasks. Performance will be evaluated by the TPM
Skills:
- Strong focus on Python (5+ years of experience)
- Proficient in Groovy (for Collibra-related tasks)
- Experience with AWS cloud platform, focusing on serverless solutions and Infrastructure as Code (IaC) principles (Terraform preferred)
- Familiarity with microservices architecture and design patterns
- Deep expertise in Collibra Data Governance, including configuration, metadata ingestion, metamodels, and workflows
- Strong experience in configuring and connecting to various data sources for metadata, data lineage, data profiling, and data quality
- Ability to design, develop, and maintain robust and scalable applications
- Hands-on experience with REST APIs and Graph APIs usage patterns
- Proficient in version control systems, particularly Git
- Experience working in Agile/Scrum environments
- Highly knowledgeable in DevOps methodologies and CI/CD practices, preferably with GitHub Actions
- Experience with containerization technologies (e.g., Docker, Kubernetes)
- Familiarity with testing frameworks (e.g., pytest, unittest) and best practices
- Conduct code reviews to ensure code quality, maintainability, and adherence to best practices
- Knowledge of data transformation (ETL/ELT) routines
- Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., DynamoDB)
- Ability to produce high-quality technical documentation
- Strong attention to detail in all aspects of work
- Fluent English (spoken and written)