Lead Data Engineer in Ciclium

Direct message from Ciklum to the member who posted the job Roksolana Kurylo (Kozevych) Roksolana Kurylo (Kozevych) Global Senior Recruitment Consultant at Ciklum. Hiring in Poland (Wroclaw, Gdansk, remote), Czech Republic (Prague, Hradec Králové, Zlín, remote) Ciklum is looking for a Lead Data Engineer to join our team full-time in Ukraine. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live. About the role: As a Lead Data Engineer, become a part of a cross-functional development team engineering experiences of tomorrow. Responsibilities: Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process data quickly at big data scales Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading across multiple data storagesOwns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platform's quality, robustness, maintainability, and speedCross-trains other team members on technologies being developed, while also continuously learning new technologies from other team membersInteracts with engineering teams and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliabilityPerforms development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutionsWorks directly with business analysts and data scientists to understand and support their use-casesContribute in the Unit's activities and community building, participate in conferences, provide excellence in exercise and best practicesHelp in sales activities, customer meetings and digital servicesRequirements: We know that sometimes, you can't tick every box. We would still love to hear from you if you think you're a good fit!5+ years of experience coding in SQL, Java, Python, Scala, with solid CS fundamentals including data structure and algorithm design3+ years contributing to production deployments of large backend data processing and analysis systems as a team lead2+ years of hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka, Storm, SQL and NoSQL data warehouses such as Hbase and Cassandra3+ years of experience in cloud data platforms (AWS, Azure, GCP)Experience with KubernetesKnowledge of SQL and MPP databases (e.g. Vertica, Netezza, Greenplum, Aster Data)Knowledge of professional software engineering best practices for the full softwareKnowledge of Data Warehousing, design, implementation and optimizationKnowledge of Data Quality testing, automation and results visualizationKnowledge of BI reports and dashboards design and implementation (PowerBI, Tableau)Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operationsExperience participating in an Agile software development team, e.g. SCRUMExperience designing, documenting, and defending designs for key components in large distributed computing systemsA consistent track record of delivering exceptionally high-quality software on large, complex, cross-functional projectsDemonstrated ability to learn new technologies quickly and independentlyAbility to handle multiple competing priorities in a fast-paced environmentUndergraduate degree in Computer Science or Engineering from a top CS program required. Masters preferredExperience with supporting data scientists and complex statistical usecases highly desirableDesirable:Understanding of cloud infrastructure design and implementationExperience in data science and machine learningExperience in backend development and deploymentExperience in CI/CD configurationGood knowledge of data analysis in enterprisesExperience with Databricks, SnowflakeWhat's in it for you?Care: your mental and physical health is our priority. We ensure comprehensive company-paid medical insurance, Mental Health programs, as well as financial and legal consultationsTailored education path: boost your skills and knowledge with our regular internal events (meetups, conferences, workshops), Udemy license, language courses and company-paid certificationsGrowth environment: share your experience and level up your expertise with a community of skilled professionals, locally and globallyOwn your schedule – you are the one to decide when to start your working day. Just don’t miss your regular team stand-upOpportunities: we value our specialists and always find the best options for them. Our Internal Mobility Program helps change a project if needed to help you grow, excel professionally and fulfill your potentialGlobal impact: work on large-scale projects that redefine industries with international and fast-growing clientsWelcoming environment: feel empowered with a friendly team, open-door policy, informal atmosphere within the company and regular team-building eventsAbout us:Discover the pros of 20-year global experience! Join one of the largest IT companies in Ukraine, awarded as one of the top 10 employers in Ukraine by Forbes.Boost your skills and make a difference with cutting-edge projects, skilled colleagues and the latest tech stacks.Ciklum has been recognised as a veteran-friendly business by the Veteran Hub in Ukraine.We're committed to creating a welcoming environment for veterans and developing processes that meet their needs. We value the skills and uniqueperspectives military veterans can bring to our business and are willing to support their transition to civilian life. Be bold, not bored! Interested already? We would love to get to know you! Submit your application. Can't wait to see you at Ciklum. Show more Show less Position level Senior secondary level Type of employment Full time Job duties Information technologies Industries IT services and IT Consulting