Senior Data Engineer in Intellias

Direct message the member who posted the job with Intellias Hanna Fetova Hanna Fetova IT Recruiter - Intellias Dive deep into Digital! For 20 years Intellias has been developing top-tier digital solutions for the world's leading companies, keeping them in line with the latest technology trends. Join in and provide innovations for the future!Project Overview: Project focus: to move from BigQuery to Databricks and set up DatabricksRequirements:5+ years of hands-on experience in data engineering with Python and SQL3+ years of experience with cloud vendors Azure, DWH services (Databricks, BigQuery), cloud storages (Azure Storage), etcStrong experience with ETL/ELT/orchestration tools (e.g., Airflow, ADF) Drive the design and implementation of data warehouse and data lakesKnowledge of DevOps practices and CI/CD pipelines. Experience with requirement gathering and documentation. Will be a plus: Experience with NoSQLBachelor's or Master's in Computer Science, Engineering, or a related field. Relevant Azure and Databricks certifications (e.g., Data Engineer Associate) .Familiarity with machine learning frameworks and data visualization techniques.Responsibilities:Collaborate with business stakeholders and technical teams to understand and analyze data requirementsDesign, build, test, and maintain scalable data systems using Azure DatabricksDevelop data processing pipelines with Databricks Notebooks, Python (and Python libraries), and other toolsEnsure efficient ETL processes and optimal data performanceMonitor and improve data reliability, efficiency, and qualityMaintain documentation on data pipeline architecture and governanceProvide technical support for data-related issues to both internal data engineers and BI developersEnsure data integrity, consistency, and accuracy through robust data quality assurance measuresReview and support team members, providing guidance and mentorshipSupervise and contribute to the data-driven strategy for the project, aligning it with business objectives Show more Show less Position level Senior secondary level Type of employment Full time Job duties Engineering IndustriesIT services and IT Consulting