Data Engineer/ Software engineer (Python) in GreenM

The customer company was founded in 2006. About 200 employees. On the Fortune 100 list.

Partners: Tableau, AWS, Microsoft, Mapbox, etc.

The main goal of this project is to create a Python-based reporting framework that uses SQL tables, flat files, and various other data sources to create a report configuration that is then provided to other applications via Kafka.

Services of the team from the technical side:

Data storages: Vertica, MS SQL Server, Dynamo DB, S3, Elasticsearch;

ETLs: Amazon services (Lambda, SWF, Athena, etc), Spark, Airflow, Kettle;

Web: .Net, Angular;

Visualization: Tableau, Kibana, Splunk.

Daily tasks and your contribution to their implementation:

- Creation of structured Python OOP code that can efficiently receive data from various sources;

- Performance of modular and integration testing;

- Participate in the analysis and resolution of data quality problems and other issues;

- Application of practices to optimize database and query performance, as well as application of efficient Python code;

- Daily written and verbal communication with customers, other developers, infrastructure and support teams;

- Constant search for better solutions and recommendations of new ideas to the client.

Experience and skills required for the implementation of tasks:

- 2-3 years of Python development experience with a special emphasis on writing structured and readable Python OOP code;

- At least 1-2 years of experience in SQL programming, query writing, query performance tuning and database technologies;

- Experience in flexible work methodologies, testing and CI/CD;

- Knowledge of basic Linux commands;

- Organizational and analytical abilities;

- Ability to manage parallel tasks;

- Good problem solving skills;

- Excellent communication skills in English (both written and spoken, upper-intermediate level);

- Smart, communicative, team person who is interested and ready to learn new skills and technologies)

A big advantage will be:

- experience with Kafka and Proto3;

- experience with multiprocessor, design patterns and best practices in Python;

- experience in developing solutions based on complex business requirements.

How the company can help from its side:

- First of all, this is fast and high-quality professional development;

- Learning opportunities: continuous learning is important, so we have an internal mentoring system and invest in various external courses, conferences and certifications in the field.

- In addition, Corporate Friday Talks (knowledge sharing sessions) and Meetups will allow you to get to know technologies outside of your core field and improve your communication skills.

That's what really inspires!)