Big Data Software Engineer [Senior/Lead] in EPAM Systems

Our client is a Swiss international company in the field of agricultural science and technology, a supplier of seeds and fertilizers with their technologies. They are looking for a senior data engineer that connects to the Big Data -based team based on Cloudra in AWS.The employee will work with a non -serviceable Lake -based Lake Date, which downloads data from numerous databases, stores them in AWS S3, processes them for AWS GLUE to ensure SQL-shaped access (attena, SnowfLake), and then aggregates/calculates data with AWS EMR for downward applications through AWS AppSync Api.What will you engage in this rolling and implementation data, AWS GLUE to organize data and access to them, as well as integration with other cloud services and software optimization on Apache Spark and Pyspark for processing of data formation and optimization of non -service solutions using AWS Lambda and ORCACTION ORCORATION ORCORATION ORDERFACE processing API Settings and Settings to Access Data Access through AWS AppSyncnc Development High -performance solutions for processing large data using best practices in the field of support, testing and monitoring on AWS resources to increase Effectiveness of technical solutions and processes for commanders commercial experience with Big Data at least 4 years of study and experience work with AWS, including S3, Glue, EMR, Lambda, Athena and AppSync. Automation of workers Python programming skills for data processing and building a solution to the design principles and optimization of scaled and reliable solutions for Big Data Working with SQL-like systems such as attena or snowflake-ownership in English at B2+Ability to solve complex. including principles Encrypting, control, control and protection of personal data of the principles of work of non -service architectures and the experience of their introduction of testing and maintenance Data processing tools such as KFKA, Presto, or other solutions for real -time work with Snowflake systems for analytics and data processing, which we offer a seat and hospital days (including without medical certificate) a wide line of insurance programs of voluntary medical insurance (DMS) ( providing both medical treatment and various preventive options (inclusive andwith sports activities) Health insurance for family members at corporate tariffs from the company during sign events (birth or adoption of a child, marriage, etc.) support of psychological comfort: discounts on the services of specialists in mental health or coaches, thematic training - FREE EPAM EPAM EPS It seeks to provide its global team with more than 60,000+ professionals in more than 45 countries opportunities for professional growth from the first day of cooperation. Our colleagues are the source of success of Erams, so we value cooperation, try to always understand our clients' business and strive for the highest quality standards. Regardless of the place where you are, you will join a devoted, diverse community that will help you realize your potential as fully as possible. Show More Show LESS Official level Senior average Type of employment Full -time Job responsibilities Information technologies, engineering and business development Industry Development of software and IT services and IT Consulting