Middle Python/Data Engineer in Sombra

29 серпня 2024

Middle Python/Data Engineer

Київ, Львів, Івано-Франківськ

Our client is a private investment company based in the United States that specializes in agriculture and food-related investments.

The main idea behind the product that we are developing is to boost the agricultural industry by providing farming companies with product is a comprehensive Business Intelligence tool. This solution will empower them to acquire, analyze, and visualize data related to Agricultural areas, driving informed decision-making and maximizing revenue potential.

Requirements:

• 3+ years of development experience with Python using FastAPI or similar web frameworks.
• Passion for continuous learning and sharing knowledge with others, great communication skills
• Strong debugging skills,
• Good understanding of all parts of the web application stack,
• Experience with Pandas/Pyarrow,
• Experience working with microservices architecture.
• Strong experience with data processing techniques in tools
• Experience with ETL pipelines,
• Experience with Apache Spark/Delta Lake or similar tools
• Airflow orchestrator experience — preferably.

Nice to have experience with:

• AWS EMR/SNS/SQS, Docker,
• Experience with Apache Airflow building out workflow DAGs and scheduling jobs,
• Experience with OAuth,
• Some UI development skills might be useful later on in a project (Dash),
• Experience with NoSQL databases (DynamoDB, Redis).

Responsibilities:

• Develop and maintain web applications:
  — Build high-performance and scalable web applications using Python with FastAPI or similar web frameworks.
• Design and optimize ETL pipelines:
  — Handle large data volumes using tools like Apache Spark, Delta Lake, or similar, ensuring efficient data processing.
• Manage relational databases:
  — Optimize and maintain RDBMS, ensuring database performance and reliability.
• Orchestrate microservices architecture:
  — Design, implement, and manage microservices, ensuring smooth communication and data flow.
• Debugging and troubleshooting:
  — Apply strong debugging skills to identify and resolve issues across the web application stack.
• Workflow automation.
  — Utilize Airflow or similar tools to automate workflows and ensure timely data processing.

We offer:

• Annual paid vacation of 18 working days.
• Extra vacation days for long-lasting cooperation.
• Annual paid illness of 10 days.
• Maternity/Paternity leave.
• The opportunity for sabbatical leave.
• Marriage and Parenthood Package.
• Compensation for sports activities (up to 6000 UAH\year).
• 50 % cost compensation for attending self-development courses.
• Corporate doctor.
• Internal education(corporate library, Udemy courses).
• Career development plan.
• English and Spanish classes.
• Paying taxes and managing PE(Private Entrepreneur).
• Technical equipment.
• Internal Referral program.
• Opportunity to take part in company volunteering activities.
• Sombra is a “Friendly to Veterans” award-holder.