Senior Software Engineer

A big data startup (after a big Seed) focused on mitigating big data performance bottlenecks, is looking for an experienced Backend Developer to join our core platform team.

As a member of the team, you'll build the backbone of our real-time performance monitoring platform. You'll work on systems that process performance metrics, detect bottlenecks, and generate actionable alerts that help companies optimize their applications and make data-driven decisions.

We are looking for an engineer who will work with our modern tech stack: Python, FastAPI, PostgreSQL, AWS services, and Kubernetes.

Using Python as our primary backend language, you'll build efficient and scalable services that process and analyze Spark application data.

Key Responsibilities

• Design and implement APIs for real-time performance monitoring and alerting
• Build robust systems for processing and analyzing Spark performance metrics
• Develop intelligent algorithms for bottleneck detection and analysis
• Create scalable alert delivery mechanisms
• Implement features that help customers understand and optimize their Spark applications
• Work closely with the frontend and big data team to deliver intuitive performance insights

Qualifications

• At least 6 years of experience as a backend developer
• Strong Python development skills
• Experience with SQL and PostgreSQL
• Familiarity with RESTful APIs and FastAPI
• B.Sc. in Computer Science or related engineering degree
• Experience with AWS services
• Understanding of containerization and Kubernetes