Data Engineer in EpicentrK

Requirements:

Experience with Docker, Dbt, Gitlab CI\CD, Airflow

Experience with MSSQL Server, Clickhouse

Python experience

Knowledge of data architecture design and development including various schema types, data replication, aggregation and optimization for high availability and performance.

Tasks:

Interaction with Data Scientists to ensure access to data

Development and support of existing ETL processes for effective data exchange and processing.

Development of data exchange services to ensure integration between different systems and data sources.

Development and support of data schemas for the operation of machine learning and analytics pipelines, ensuring reliable and fast access to data for analytics