Senior Big - Data Engineer

ControlUp is the market leader in IT platform for Monitoring, Self-healing and Analyzing customers’ virtual environments, creating solutions that save IT organizations time, money, and stress.

If you’re looking to be part of a fast-growing, cutting-edge technology company, join us for the ride and play a significant role in developing the next generation of ControlUp innovation.

We are looking for a Big - Data Engineer to join our team. If you are interested in real-scale data challenges, working on a life-changing product, your place is with us!

Responsibilities:

Build infrastructure and products Working in a high-volume production environment that gets bigger and bigger

Mastering scalability and enterprise-grade production services implementation

Sense of ownership - leading design for new products and initiatives as well as integrating with currently implemented best-practices

Working with a number of modern technologies including Flink, Spark, Kafka, K8s, and more

Collaborating and working as part of a highly skilled team that enjoys doing the impossible together every day

Requirements:

4+ years of coding experience with data streaming application, performance optimization and scaling out data worldwide

Coding experience in high throughput real time data processing with Scala or Java - Must!

Knowledge with Python

Experience with the following technologies: Kafka, SQL DB's, Spark and Flink - Must!

End-to-end experience - owning features from an idea stage, through design, architecture, coding, integration, and deployment stages

Dealing with data on high volume, high availability production systems

Fluent with SQL

Strong data modeling skills

Design, develop, and deliver microservices knowledge

Advantages:

Experience working with a cloud provider (AWS / Azure / GCP)

Bachelor's degree or higher in Computer Science or equivalent professional Software Engineering experience

Experience working with CI/CD systems

MapReduce, Airflow