Big Data Software Engineer [Senior/Lead] in EPAM Systems

Epam in search of Senior/Lead Big Data Software Engineer for the development and maintenance of internal data storage systems for the products and applications of our client. You will be engaged in this role and support of complex data storage systems for large data processing and optimization Data Development and Introduction Effective SQL requests for analysis and processing Data Development and implementation of software solutions using the Hadoop ecosystem (YARN, MAPRODUCE, HIVE, HDFS) Use of Spark and Kafka to process and transmit data in real variations and control cloud services AWS (EMR, S3, LAMBDA) Resources work with others Engineers and teams to create scaled and efficient decision -making of data analysis, creation of reports and recommendations for improving the system determination and implementation of the best practices for ensuring security and integrity to the preparation of technical documentation and support of documentation for users more than 4 years of experience in the development of data recessions and databases. SQL with work experience at least 2+ years Python Development of software solutions using Hadoop ecosystem components (YARN, Mapreduce, Hive, HDFS) Practical experience with Spark and Kafka's work with cloud services AWS (EMR, S3, Lambda). Skill to Details Abstanding County Terms and Ability to Priority Advanced Working in Administration Denials Working on AWS Redshift Practical Experience with Pysparkark Understanding Voluntary Health Insurance (SMS) with both medical treatment and various preventive options (including sports activities) of health insurance for family members at corporate tariffs support from the company during sign events (birth or adoption of a child, marriage, etc.) Psychological comfort: Discounts on the services of specialists in mental health or coaches, thematic Training-Kids-a free EPAM-Epam Children's Learning Program for Enterprise Corporate Corporate Gifts to give their global team from more than 60,000+ professionals in more than 45 countries opportunities for professional growth from the first day of cooperation. Our colleagues are the source of success of Erams, so we value cooperation, try to always understand our clients' business and strive for the highest quality standards. Regardless of the place where you are, you will join a devoted, diverse community that will help you realize your potential as fully as possible. Show More Show LESS Official levelSenior average Type of employment Full -time Job responsibilities Information technologies, engineering and business development Industry Development of software and IT services and IT Consulting