Senior Data Engineer - Big Data & Scalable Pipelines

About Us

Malanta is redefining enterprise security for the pre-attack era. As the perimeter disappears and AI attacks accelerate, Malanta focuses on what happens before the breach: identifying and dismantling the infrastructure adversaries build to target enterprises. Instead of chasing alerts, security teams use Malanta to see what's coming, act earlier and stay ahead of attackers that never make the news.

Expect cutting-edge tech, meaningful work, and a collaborative culture.

If you thrive on tackling challenging technological problems, love diving deep into data, and are driven to engineer end-to-end data solutions – we want you on our team!

What You Will Do

• Pipeline Development: Lead the design, development, implementation, and maintenance of complex, highly scalable Big Data ETL/ELT pipelines, ensuring the delivery of clean, reliable, and timely data for both real-time and batch processes.
• Architecture & Design: Implement and enforce best practices within our Data Lake and Data Warehouse, leveraging a deep understanding of the Medallion Architecture (Bronze, Silver, Gold layers).
• Performance Optimization: Continuously monitor and optimize pipeline and data query performance to ensure efficiency and cost-effectiveness.
• Collaboration: Work closely with Research Engineers and Software Engineers to translate business needs into cutting-edge data solutions.

What You Bring

• Experience: 5+ years of proven, hands-on experience as a Data Engineer or in a similar Big Data focused role.
• Big Data Expertise: Extensive experience working with distributed Big Data systems (e.g., Spark, Hadoop, Databricks).
• Coding Proficiency: Excellent command of Python and SQL.
• Data Stores: Hands-on experience with modern Data Warehouses (e.g., Snowflake, Databricks, Redshift) and Data Lakes (S3, ADLS).
• Cloud Environment: Practical experience working with a major cloud platform (AWS, GCP, or Azure).
• Orchestration: Experience with pipeline orchestration and scheduling tools (e.g., Airflow, Prefect).
• Advantage: Familiarity with relational databases (e.g., PostgreSQL, MySQL).
• Significant Advantage: Experience developing and maintaining Streaming infrastructure (e.g., Kafka).

Why Join Us?

• Impact: A unique opportunity to shape the data landscape of a rapidly growing company, with a direct impact on our product and success.
• Technology: Work with the latest and most advanced tools and technologies in the industry.
• Culture: A dynamic, flexible, and inspiring work environment that encourages continuous learning and professional growth.

Ready for the Challenge? Send us your CV and let's talk!