Senior Big Data SW Engineer in Godel Technologies Europe

Godel is on the constant lookout for talented **Senior Big Data** Engineers to join one of our teams engaged in the development of business applications for major British companies. We always have new and exciting projects with opportunities to improve your skills in a wide spectrum of technologies related to web development. If you are an enthusiastic and ambitious developer, willing to take active participation in shaping a product, this job is for you ### Responsibilities * Creating functional design specifications, Azure reference architectures, and assisting with other project deliverables as needed. * Design and Develop Platform as a Service (PaaS) Solutions using different Azure Services. * Create a data factory, orchestrate data processing activities in a data-driven workflow, monitor and manage the data factory, move, transform and analyze data. * Design complex enterprise Data solutions that utilize Azure Data Factory. Creating migration plans to move legacy SSIS packages into Azure Data Factory. * Build conceptual and logical data models. * Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, as well as cloud-based), distributed / elastic environments, and downstream applications and/or self-service solutions. * Develop and document mechanisms for deployment, monitoring, and maintenance. * Identifying performance bottlenecks, and accessing external data sources. * Implementing security requirements. * Monitoring and managing. ### Required skills * Extensive knowledge of data architecture principles (e.g., data lake, data warehousing, etc.). * Strong knowledge of relational databases, as well as skills in SQL query design and development. * Experience working with the data in Python * Conceptual understanding of cloud architectures, service tiers and hybrid deployment models. * Ability to independently troubleshoot and performance tune large scale enterprise systems. * Expertise with ETL/ELT design patterns, and DataMart structures (star, snowflake schemas, etc.). * Experience with Microsoft Cloud Data Platform: Azure Data Lake, Azure Blob Storage, Azure Data Factory, Azure Cosmos DB, Azure Databricks, Synapse Analytics. * Experience in Azure Data Factory (ADF) creating multiple pipelines and activities using Azure for full and incremental data loads into Azure Data Lake Store and Azure SQL DW. * Hands-on experience with data migration methodologies and processes to transform on-premises data to cloud using tools like Azure Data Factory, Data Migration Service, SSIS, etc. * Must have an ability to communicate clearly and be a team player. * Intermediate level of English. ### As a plus * Hands-on programming experience in additional technologies, such as Python, Java, Scala , C#, Spark, Databricks, Powershell is a plus. * Experience working with developer tools such as Azure DevOps and GitLabs. * Power BI reporting tool experience. * Understanding of big data tools such as Hadoop. * Experience managing Microsoft Azure environments with VM’s, VNETS, Subnets, NSG’s, Resource Groups. * Azure certification would be desired. ### We offer Trust-focused culture Professional team Agile delivery Challenging projects Business trips to the UK Investment into your training Flexible working schedule & WFH option Financial stability _Some details:_ 20 w. days of Annual paid vacation 1 paid day off in honor of Your Birthday Medical insurance Sick days compensation Compensation for your prof. certification & support for your learning activities Corporate Perks (training, English courses, corporate events/team buildings) _And many more!:-)_ ** _We are always looking for great people to join our team!_**