Software Engineer - Spark

Speedata is modernizing analytics infrastructure with the first purpose-built ASIC processor, the Analytics Processing Unit (APU), for analytics and AI data workloads. Delivering up to 100x faster Apache Spark performance while cutting infrastructure TCO by 90%, the APU executes analytics operations directly in silicon with seamless integration and no code changes.

We’re seeking an outstanding Senior SW Engineer to join our team and help us develop our data frameworks integrations. This is a rare opportunity to influence the future of data processing.

Requirements:

• BSc or equivalent or higher degree in Computer Science, Computer Engineering, or Electrical Engineering.
• 6+ years of experience in software development with a strong focus on data engineering
• Strong proficiency in Java and Scala, Python - an advantage
• Experience with Apache Spark / other big data frameworks
• Excellent communication skills and ability to explain complex technical concepts to non-technical stakeholders

Advantages

• Experience with database systems and SQL

Responsibilities:

• Develop our Spark plugin and integrations
• Develop in Scala and Java
• Contribute to open source projects
• Develop in Python
• Design advanced algorithms of processing and optimizing query plans
• Define our query abstraction layer
• Collaborate with other software teams to optimize software and hardware integration for maximum performance