Data Engineer in MEGOGO

We are looking for a Senior Data Engineer who is not afraid of working with hundreds of millions of events, and is responsible for creating tools and data processing processes to support the creation of machine learning models and conduct experiments that will determine the development of one of the largest video services in the CIS. We are on the data driven path and you have the opportunity to implement your skills and abilities in our team. ** What are we waiting for: ** * 5+ years of experience in designing, developing, testing, deploying and supporting Data Lake / Data Warehouse solutions. * Expert knowledge of Python in the context of creating ETL data pipelines. * Expert knowledge of PySpark: transformations, aggregations, windowing, writing and optimizing UDFs. * Expert knowledge of SQL / NoSQL databases: MySQL, PostgreSQL, MongoDB. * Experience in practical operation of the Big Data stack: Hadoop, Hive, Kafka, Spark, Cassandra. * Experience in creating complex analytical systems. * Ability to find both quick solutions for experiments and stable production-ready, depending on the circumstances. ** Will be a plus: ** * Experience with AWS (EC2, EMR, ECS, Kinesis, S3). * Java / Scala programming experience. * Experience with analytical databases: Vertica, Exasol, Teradata, Redshift, BigQuery, Druid, Clickhouse. * Development skills in Docker / Kubernetes environment. * Unforgettable university knowledge of ruler, matan and statistics. * Experience in creating products using machine learning. * Creation and validation of ideas for building data driven in the company. ** What to do: ** * Generate and validate ideas for building data driven in the company. * Development of architecture and selection of technical solutions. * Development and support of corporate DWH. * Development of ETL data pipelines: loading from various sources, cleaning, transformation, enrichment with external data, normalization / denormalization, saving taking into account nuances and limitations, test coverage, monitoring, operation. ** What we offer: ** * Work in a stable company - we have been on the media market for more than eight years. * Opportunity to participate in the creation of the video service of the future. * Competitive level of wages. * Cool corporate parties. For example, the whole team at Atlas Weekend :) * Relationships built on trust. * Outdoor activities: play soccer or table tennis. We have our own football team, and our ping-pong coach will teach you everything, he is always in the office. Choose what you like and take part in the competition! If you really want to, there is even an opportunity to fulfill your childhood dream, if you wanted to become a sports commentator. * Always fresh fruit in the office and your own barista. * Opportunities for development. * Free English lessons in the office. * Do you feel like your skills are up to date? Do you want to be part of our cool team? Submit your resume quickly! By answering the vacancy and sending your resume to the Company (LLC "MEGOGO"), registered and operating in accordance with the legislation of Ukraine, registration number 38347009, address of location: Ukraine, Kiev, st. Novokonstantinovskaya, 18 V (hereinafter referred to as the "Company"), you confirm and agree that the Company processes your personal data presented in your resume in accordance with the Law of Ukraine "On the Protection of Personal Data" and GDPR rules.