Senior Software Engineer (Big Data team)

Granulate, an Intel Company, empowers enterprises and digital native businesses with real-time, continuous application performance optimization and capacity management, leading to up to 45% reduced cloud and on-prem compute costs, with no code changes needed.

Our dedicated R&D team is spearheading innovations in the Big Data realm, specifically focusing on Spark. We are in search of a highly motivated, result-driven Performance Researcher with a strong background in backend development and scalability to join our dynamic team. While prior knowledge in Java/Spark is beneficial, we truly value your ability to learn swiftly on the job and contribute to our groundbreaking optimization solutions.

Responsibilities:

• Explore new paths for cost reduction / optimizations for the product.
• Keep expanding the range of adoption for the product (targeting new solutions, frameworks & technologies).
• Expand & own a scalable, real time autonomous system that implements the optimizations
• Instrumentation & enhancement: develop, maintain, and enhance our Java agent that performs low-level instrumentation of Spark applications to optimize their performance.
• Backend systems Scaling: design, implement, and scale robust backend systems that continuously configure our optimization agent, ensuring high availability and performance for our growing clientele.
• Continuous learning: stay abreast of the latest developments in Big Data technologies, especially Spark, and leverage this knowledge to suggest and implement improvements to our optimization strategies.
• Performance analysis & optimization: collaborate with the team to analyze application performance data, identify bottlenecks, and devise strategies to overcome performance-related challenges, ensuring optimal scalability.
• Collaboration & mentorship: work closely with other team members, providing guidance, mentorship, and expertise, fostering a culture of continuous improvement and knowledge sharing.

Requirements:

• 5+ years of proven experience in backend system development with a focus on scalability, performance, and reliability.
• Strong coding skills with Python, with an emphasis on developing scalable backend systems.
• Experience with Spark.
• Experience with public Cloud, preferably with AWS.
• Experience with Java, Databricks, MapReduce, YARN - an advantage.
• Knowledge of Kubernetes - an advantage.
• Learning agility: demonstrated ability to quickly learn and adapt to new technologies and methodologies.
• Problem-Solving Skills: Excellent analytical and problem-solving abilities, with a knack for identifying and resolving performance bottlenecks.
• Team Player: Strong interpersonal and communication skills, with the ability to collaborate effectively in a team setting.