Lead Big Data Engineer in EPAM Systems

Our client is an international manufacturer of cosmetics, perfumes, skin and hair care products. The goal of the project is to create a solution for the integration of unstructured data for our client's Data Lake using Azure's own cloud services Skills Experience with Data Platform & Solution engineering and Azure's PaaS offerings Competence in Azure: Data Factory, Data Lake, Databricks, Microsoft Purview, Monitor, Storage Services, ADLS, Azure Functions, Log Analytics, Serverless Architecture, Azure Cognitive Services, Azure Form Recognizer Hands-on experience and high level of proficiency in Python and GraphQL Knowledge of security best practices (e.g. use of Azure Key Vault, IAM, RBAC, Monitor, etc.) Ability to integrate , transform and consolidate data from various structured and unstructured data systems into a structure suitable for building various analytical solutions Experience in organizing and following an efficient and effective development process for an Agile team Good communication skills, ability to work in a team High level of understanding of Azure DevOps, experience working in an Agile environment (Scrum, Kanban)Experience with Azure ML would be an advantageResponsibilitiesCoordinate and oversee the work of a data processing software development teamAdjust and support the development process and tools to ensure efficient and effective execution according to industry best practices (EngX)Lead and facilitate the implementation of MVPs for unstructured of data entering the system Participate in backlog support and Scrum processes Participate in the creation of BRD, SAD and further implementation of the backlog and instructions for the next stages of the project Expected results: MVP for entering unstructured data into a corporate data warehouse based on Azure cloud services for ETL, OCR . technology stack within EPAM Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Traveling, Media, Artificial Intelligence and others) Consider options for relocation to more than 30 countries around the world Join volunteer, charity programs and communities (as per technical directions and interests) We will help you in your professional development Plan your individual career path together with your manager Get regular feedback from colleagues Improve your English for free with certified teachers (Speaking Clubs, courses for preparation for client interviews, etc.) Get the opportunity to undergo free training and certification with AWS, GCP or Azure Clouds Use the internal training program E-learn (18,200+ specialized training and mentoring programs) Get access to corporate accounts on LinkedIn Learning, Get Abstract and other partner resources Learn at the Solution Architecture School with practitioners by architects as teachers Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and others Accept teach in internal communities (500+ meetings, technical discussions, brainstorming sessions, online events and conferences every year) What we offer Vacation and sick days (including without a medical certificate) Wide line of insurance programs of Voluntary Medical Insurance (DMS) with provision of both medical treatment and various preventive options (including sports activities) Issuance of medical insurance for family members at corporate rates Support from the company during significant life events (birth or adoption of a child, marriage, etc.) Support for psychological comfort : discounts on the services of mental health specialists or coaches, thematic trainings E-kids - a free training program for children of EPAM-ers in programming languages ​​Pleasant corporate giftsAbout EPAMERAM is committed to providing its global team of more than 60,000+ professionals in more than 45 countries with opportunities for professional growth from the first day of cooperation. Our colleagues are the source of ERAM's success, so we value cooperation, always try to understand our clients' business and strive for the highest quality standards. No matter where you are, you'll join a dedicated, diverse community that will help you reach your full potential Show more Show less Position level Senior secondary level Type of employment Full time Job duties Engineering and Information Technologies Industries IT services and IT Consulting