SENIOR BIG DATA ENGINEER - COLLAB

We are looking for an seasoned backend engineer with a strong background who understands the principles of distributed data processing engines and has built complicated data processing pipelines. Familiar with modern data processing stack, have a strong problem-solving attitude and, most importantly, youre passionate about understanding the business side of the platform. Our platform engineers have an end-to-end understanding of the data our products generate and the commercial models and data structures in which they fit.
What you'll do:
Develop end-to-end ETLs and data infrastructure features from data processing logic to database choice and implementation through to API development
Improve the scalability and performance of existing data pipelines and query engine
Solve scalability challenges for ad-hoc querying
Delve into existing pipelines and business logic, target weaknesses and add functionality
Work with Product and other members of R&D in finding creative solutions to our customers problems
Continuously learn and follow new technologies both for personal growth and to ensure we are making the most informed technology choices possible