Senior Big Data Developer (Scala)

Tired of big data performance bottlenecks? Our Tel-Aviv based client is an end-to-end performance platform that is focused on mitigating these. They help businesses become more data-driven, looking to make impactful decisions by identifying and alerting on performance issues in real time. You’ll be at the forefront of building intelligent solutions that help companies understand and optimise their Spark applications performance, turning complex metrics into actionable insights.

What’s in it for me?

You’ll get a salary of up to 45,000 Shekels a month plus significant equity, and be joining a company that has managed to build a really strong, welcoming environment and culture. You’ll get a set limit for food each day and the co-founders are all big music fans and like to have fun, which they’re also trying to bring to the interview process.

You’ll join a 4 person team comprised entirely of seniors, they’re looking for you to really come in and take ownership of what you’re building. Initially, you’re going to be focusing on Spark applications; building and enhancing their real-time performance monitoring and alerting system and developing features that translate Spark metrics into actionable insights. There’s also a few other things to get stuck into:

• Designing and implementing algorithms to detect performance bottlenecks and anomalies.
• Creating intelligent alerting mechanisms for proactive performance issue detection.
• Working closely with customers to understand their performance optimisation needs.
• Collaborating with the wider team to improve their bottleneck detection and analysis capabilities.

What experience do you need?

You’ll need to be someone who comes from a software engineering background and has worked extensively with data, as well as Scala (or vice versa a data engineer who’s moved into software), with it being a huge bonus if you’ve worked on enterprise systems before.

Since they are very early-stage, having experience in small startups would really set you apart and help you hit the ground running in this environment. That said, if your background is in large enterprises and you're eager to transition into a smaller startup, we’d still love to hear from you!

As a senior, you would need to have at least 5-6 years of experience, with a strong background in working with Apache Spark and cloud infrastructure (preferably AWS), along with hands-on experience using Kubernetes and Docker. Plus any of the following would be a great addition:

• Python experience.
• A sound knowledge of the Databricks platform and ecosystem.
• Knowledge of performance optimization in JVM environments.
• Production experience in a SaaS environment.

Interview Process

This is an initial half-hour phone call, followed by an hour meeting over coffee where you’d get to know each other a little more on a personal level. Third and finally, there is a technical task that is open-source and adds to the open-source community.

If this is of interest, then please get in touch with me on [email protected] and we can discuss further.