Senior Data Engineer in AgileEngine

Cardlytics makes marketing more relevant and measurable through their Purchase Intelligence™ platform. Partnering with financial institutions (FIs) to run their banking rewards programs, Cardlytics has a secure view into where and when consumers are spending their money. By applying advanced analytics to this massive aggregation of purchase data, Cardlytics makes it actionable, helping marketers/ advertisers identify, reach and influence likely buyers at scale, and measure the true sales impact of their marketing spend.

On Behalf of Cardlytics, AgileEngine is looking for an experienced Senior Scala Data Engineer focused on backend and data development to join our team full time. You will be primarily responsible for the design and coding of new features and applications, enhancing existing products, and implementing new technologies, paradigms, and practices to provide the best solutions to our customers. This includes technical design and development of Cardlytics current and future systems as a part of a team of other data engineers and across other Engineering and business teams. The senior data engineer will also be responsible for implementing organizational and industry standards and best practices to ensure compatibility, reliability, resiliency, scalability, performance, and maintainability.

What is required?

• 4+ years of experience in data engineering using Scala, Apache Spark
• Hands-on experience with Apache Spark (Batch & Streaming)
• Experienced in building high performing, scalable, observable, reliable, extensible data pipelines that process large volumes of data in both batches and streams
• Practical experience in designing and using Data Lakes and MPP DW systems (Snowflake, Yellowbrik, Vertica)
• Using logs, tools, and other data to methodically identify issues (performance, environmental or otherwise)
• Consuming and supplying data via APIs
• Well versed in a variety of Spark, Kafka, RDBS, and other Big Data technologies
• Self-motivated and self-managing, with strong organizational skills
• Team Leadership skills and experience setting up process on the project
• Great English and communication skills

What you will do:

• Develop new applications and features within a scrum team providing data and data services to the enterprise, other engineering teams, data science, analysts, product, management/executives, and other business teams
• Build high performing and scalable data platforms to support multiple data pipelines to ingest and deliver data as fast and reliably as possible
• Implement new technologies and practices to provide the best solutions to our customers
• Develop and maintain solutions on our tech stack environments (Spark Streaming, Spark, Kafka, Vertica, SQL Server, etc.)
• Work with business teams to create technical requirements and deliver within time and scope
• Help develop team members through code reviews, enforcing standards, best practices, policies, and processes
• Perform functional testing, end-to-end testing, performance testing, and UAT of applications and code written by self and other members of the team

What we offer:

• Great compensation package, highest salaries on the market
• Flexible work schedule
• Friendly and a very skilled team with great corporate culture and mentorship (visit us and see it yourself)
• Opportunities for self-realization, professional and career growth
• Cool events and team activities
• Professional workshops and training, a great engineering culture