Data Engineer
Location
Warsaw/Remote
Responsibilities:
- Independent work on projects
- Designing and implementation of complex ETL processes
- Designing of databases structures, according to business requirements
- Operationalization and optimization of dataflow
- Quality and performance testing
- Close cooperation with external or internal customers (Data Science and BI teams)
- Gathering of requirements
- Presentation of concepts and business-cases
Requirements:
- Min. 2-3 years of experience in the data processing field
- Good knowledge of Python programming language
- Experience with orchestration of dataflow using Airflow
- Very good knowledge of SQL and relational databases
- Experience in working with huge data sets
- Understanding of clean code practices and CI/CD approach
- Practical knowledge of Microsoft Azure platform and ADF, Azure Databricks and Azure Data Lake solutions
- Free communication in English
Nice to have:
- Experience with real-time building using Kafka
- Practical knowledge of containerization (Kubernetes, Docker)
We offer:
- A stack of modern technology and openness to implementing new solutions
- Participation in various and technologically advanced projects
- Private medical care and sports card
- Flexible working hours and the possibility of 100% remote work
- Integration meetings and unforgettable corporate events
- No dress code
Last modified Monday, October 14, 2024