Lead Big Data Engineer (Databricks + AWS) in SoftServe

WE ARESoftServe is a global digital solutions company with headquarters in Austin, Texas, founded in 1993. Our team is passionate innovators working on over 2,000+ cutting-edge projects around the globe, from the USA and Europe to the Asia-Pacific region.We are the Big Data & Analytics Center of Excellence, a data consulting and data engineering branch of SoftServe. 200 data engineers and architects build Data and Analytics end-to-end solutions: from strategy, through technical design and proof of concept, to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains across North America, EMEA, APAC, and LATAM.We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like Snowflake, Confluent, Cloudera, Starburst, Collibra, Tableau, and others.Together with the Software Engineering Institute and Carnegie Mellon University, we adapted ADD and ATAM architecture design methodologies to Big Data needs and invented the Smart Decisions game to promote architecture design best practices in AI and Big Data.We are looking for a skilled Lead Big Data Engineer who will contribute to our client – a worldwide leader in IT who delivers innovative software-defined networking, cloud, and security solutions to help transform businesses, empowering an inclusive future for all.IF YOU AREA Big Data Engineer specializing in data pipeline creationWell-versed in batch processing and streaming processingProficient in Databricks and Apache SparkSkilled in Python and SQLExperienced in developing data solutions on the AWS cloud platformFamiliar with orchestration tools like Apache Airflow or Managed Apache Airflow (MWAA)Knowledgeable about Apache Kafka, Amazon MSK (Managed Streaming for Apache Kafka), or Kinesis for data streamingAND YOU WANT TOBe a part of the team of data-focused engineers dedicated to continuous learning, improvement, and knowledge sharing every dayWork with a cutting-edge technology stack, including services from major cloud providers that are at the forefront of innovation and may not yet be generally availableEngage with customers from diverse backgrounds, ranging from large global corporations to emerging crypto startups preparing to launch their first productBe involved in the entire project lifecycle, from initial design and proof of concepts (PoCs) to minimum viable product (MVP) development and full-scale implementationTOGETHER WE WILLDive into the cutting-edge technology stack, including major cloud providers' services which are not generally available yetSupport your technical and personal growth – we have a dedicated career plan for all roles in our companyInvestigate new technologies, build internal prototypes, and share knowledge with the SoftServe Big Data CommunityUpskill with full access to Udemy learning coursesPass professional certifications, encouraged and covered by the companyAssimilate best practices from experts while working in a team of top-notch Engineers and ArchitectCollaborate with world-leading companies and attend professional eventsHave a chance to address different business and technology challenges,engage in challenging projects and top-notch technologies, and drive multiple projects and initiatives as a part of the Center of Excellence SoftServe is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment regardless of race, color, religion, age, sex, nationality, disability, sexual orientation, gender identity and expression, veteran status, and other protected characteristics under applicable law. Let’s put your talents and experience in motion with SoftServe Show more Show less Посадовий рівень Старший середній рівень Тип зайнятості Повний робочий день Посадові обов’язки Дослідження, Інформаційні технології і Інженерія Галузі ІТ-послуги та ІТ Консалтинг