Data Team Lead (Azure Databricks) #14348 in Capgemini Engineering

Purpose Of The JobOur client is American multinational information technology company.Main Tasks And ResponsibilitiesLead the team of 2 engineers.Education, Skills And Experience MUST HAVE:Primary Skills: Azure Databricks.7-8 years of hands on development Design and Develop applications using Azure ADF Databricks.In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.Good to have programming language experience with Python/ SQL or PySpark/Scala.Expertise in using Spark SQL with various data sources like RDBMS, Files, Parquet and Key Value Pair.Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark SQL/Scala.In depth understanding of Azure cloud and Data lake and Analytics solutions on Azure.Able to build ingestion to ADLS and enable BI layer for Analytics.Design and develop solutions on Microsoft Azure and related technologies including ADF, ADLS, AAS, Databricks and Power BI.Design and Develop data Ingestion using ADF and processing layer using Databricks.Knowledge of deployment procedure in the cloud.Must have data migration experience from on prem to cloud. Show more Show less Посадовий рівень Помічник Тип зайнятості Повний робочий день Посадові обов’язки Інформаційні технології Галузі ІТ-послуги та ІТ Консалтинг