Data Engineer (Airflow) in RecruitGarden

Congratulations! Do you want to develop an IT product used by all Ukrainians?

Influence the architecture with a huge load?

We are looking for a Data Engineer with Python/Airflow for a well-known company.

TOP conditions, benefits, insurance, a project that will be pleasant tell.

Want to learn more?

Main Responsibilities:

–  Design, optimization and support of Apache Airflow cluster and Python code for data orchestration
-Logic development and support of ETL processes (data collection, transformation, loading)
– Design integration interaction between systems, creating services for integration and data exchange
– Optimizing the performance of data processing processes, identifying and eliminating bottlenecks
– Cooperation with analysts and developers to ensure quality data delivery

Mandatory Requirements:

– Apache Airflow: creation of DAGs, operator configuration, performance monitoring and optimization
– Experience with Python ( emphasis on backend and integration solutions) from 3 years
– Bash, Docker, DBT, GitLab CI/CD (process automation, deployment, optimization of pipelines)
– MS SQL Server and PostgreSQL (writing complex SQL queries, optimization, creating procedures and functions)

Will be a plus:
– Experience with Apache Spark (distributed processing of large data sets)
– Knowledge of tools Big Data or cloud platforms (AWS/GCP/Azure)
– Understanding of DataOps and CI/CD principles

We offer:

• Highly loaded systems with real scaling challenges
• Modern stack and freedom of technological solutions
• Ability to influence the architecture of products used by millions
Professional:
• Mentoring from seniors from with the experience of enterprise solutions
• Compensation of additional costs related to work tasks are carried out according to the company's internal policies
• Medical and life insurance
• Corporate discounts from Nova partners
• Mental health support. Possibility of free consultations with a corporate psychologist
• Social responsibility and volunteer movement "Yours for your own"
• Interest clubs: running, chess and other initiatives for inspiration
• Social holidays and compensations in accordance with the Labor Code of Ukraine