Lead Data Engineer (Python/BigQuery/Spark, Ukraine) #14667 in Capgemini Engineering

Purpose Of The JobWe are looking for a Lead Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is a strategic thinker and hands-on technical leader, passionate about data architecture, performance optimization, and cloud-based data engineering. They should be self-directed, proactive, and comfortable driving data strategy, ensuring our infrastructure meets evolving business needs. You will work closely with software developers, database architects, data analysts, and data scientists to ensure a consistent, scalable, and high-performance data ecosystem across multiple teams, systems, and products.Main Tasks And ResponsibilitiesDesign and drive the development of scalable, high-performance data pipeline architectures, ensuring optimal data processing, transformation, and storage solutionsAssemble large, complete data sets that meet functional / non-functional business requirementsLead the design and optimization of data infrastructure, leveraging modern data technologies to ensure scalability, reliability, and efficiencyIdentify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, performance, etc.Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, revenue management, operational efficiencies, and other key business performance metricsWork with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and their data infrastructure needs supportKeep our data separated and secure across national boundaries through multiple data centers and AWS regionsCreate data tools for analytics and data scientist team members that assist them in building and optimizing our offeringsWork with data and analytics experts to strive for greater functionality in our data systemsAct as a technical advisor to engineering, product, and executive teams, translating business requirements into scalable data solutionsEducation, Skills And Experience MUST HAVE:7+ years of experience in data engineering, designing and implementing scalable data solutionsExtensive experience working with relational databases and data warehouses, including GCP BigQuery, PostgreSQL, Microsoft SQL Server, Oracle, etc.Expertise in real-time and batch data processing using Spark/Kafka StreamingExperience with programming and scripting languages: Python, Scala/JavaHands-on experience with big data technologies such as Hadoop, Hive, and HBaseProficiency in NoSQL data stores, with experience in Elasticsearch or similar technologiesProven track record of architecting and optimizing large-scale data pipelines, ETL workflows, and data infrastructureFamiliarity with workflow orchestration tools like Apache NiFi, AirflowAbility to mentor and guide data engineering teams while driving technical strategy and best practicesShow more Show less Position level Not applicable Type of employment Full time Job duties Information technologies Industries IT services and IT Consulting