Data Engineer w ANVI

Technology stack

• Kubernetes, Docker, Airflow, DBT, Dataflow , Data Hub

• Power BI

• Google Cloud Platform, Terraform, GitLab

• BigQuery, BigTable

• Python, SQL

Scope of service

• Design, develop, implement, and document data warehouses that support data analysis requirements and adhere to performance and availability standards

• Assist in defining, managing, and documenting data analytics platform requirements

• Design, develop, implement, and document the data delivery layer upon which the analysis tools and user interface are built to view and generate reports in real time

• Design, develop, implement, and document monitoring and alerting checks for data pipelines

• Perform routine data quality checks and cleanups

• Design, develop, implement, and document data pipelines to acquire, prepare, and store data in the data warehouse using data engineering standard (ETL/ELT)

• Collaborate on review work with others

• Design test cases, create test scripts and test data, perform system integration testing, and automate the deployment process

Remote