Senior/Lead Big Data Software Engineer in EPAM Systems

Our client is a Swiss international company, in the field of agricultural science and technology, specifically listening to a supplier of seeds and fertilizers along with their technologies. They are looking for a senior data software engineer to join the team to implement a Big Data system based on Cloudera on AWS .The employee will work with an AWS-based serverless data lake that downloads data from multiple databases, stores it in AWS S3, encapsulates it using Glue to allow SQL-like access (Athena, Snowflake), and then aggregates/calculates the data (AWS EMR) for downstream applications via AWS AppSync API).Skills Commercial experience in Big Data 3+ years General experience in the IT field - 4+ years English proficiency level - B2+ Strong problem solving skills Project technologies Web services AmazonApache SparkPySparkPythonAWS LambdaApache AirflowWork with us on a flexible schedule remotely or in any of our comfortable offices or co-working spaces in Ukraine Get the necessary equipment to perform work tasks Change projects and the technology stack within EPAM Get experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Traveling, Media, Artificial Intelligence and others) Consider options for relocation to more than 30 countries around the worldJoin volunteer, charity programs and communities (both in technical directions and by interests) We will help you in professional developmentPlan your individual career path together with the managerReceive regular feedback from colleaguesImprove for free English language with certified teachers (Speaking Clubs, client interview preparation courses, etc.) Get the opportunity to undergo training and certification with AWS, GCP or Azure Clouds for free Use the internal training program E-learn (18,200+ specialized training and mentoring programs) Get access to corporate accounts on LinkedIn Learning, Get Abstract and other partner resources Learn at the Solution Architecture School with practicing architects as teachers Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and others Get taught in internal communities (500+ meetings, technical discussions, brainstorming sessions, online events and conferences every year) What we offer Vacation and sick days (including without a medical certificate) A wide range of Voluntary Health Insurance (VHI) insurance programs with the provision of both medical treatment and various preventive options (incl. with sports activities) Issuance of medical insurance for family members at corporate rates Support from the company during significant life events (birth or adoption of a child, marriage, etc.) Support for psychological comfort: discounts on the services of mental health specialists or coaches, thematic trainings E-kids - a free training program for children of EPAM-ers in programming languages ​​Pleasant corporate giftsAbout EPAMERAM strives to provide its global team of more than 60,000+ professionals in more than 45 countries with opportunities for professional growth from the first day of cooperation. Our colleagues are sourcesabout the success of ERAM, so we value cooperation, always try to understand the business of our clients and strive for the highest quality standards. No matter where you are, you'll join a dedicated, diverse community that will help you reach your full potential Show more Show less Position level Senior secondary level Type of employment Full time Job duties Engineering and Information Technologies Industries IT services and IT Consulting