Data Engineer

We are seeking a Data Engineer to design, build, and optimise data pipelines and workflows that

power our analytics and business operations.

Responsibilities

• Design, develop, and optimise data pipelines and workflows
• Write and maintain complex SQL including transformations, window functions, and stored
• procedures
• Design and maintain data warehouse schemas and architecture
• Monitor data quality, integrity, and pipeline performance
• Collaborate with cross-functional teams to ensure clean data integration
• Troubleshoot and resolve data issues

Requirements

• Apache Spark (Structured Streaming and batch) on EMR or equivalent open-source
• deployment
• Apache Kafka, Apache Iceberg, or ClickHouse/Trino — strong experience in at least one,
• familiarity with the others
• Java for ingestion services and Kafka producers/consumers
• Strong SQL: window functions, MERGE patterns, complex transformations
• AWS: MSK, EMR, ECS, S3, Glue, MWAA, EventBridge
• Python: Airflow DAGs, data quality, scripting
• HeavyAI coding assistant usage is expected and treated as a core productivity multiplier in
• this role

Nice to Have

• ClickHouse or Trino/Starburst
• Databricks
• Flink
• Avro, schema registries
• Delta Lake or Hudi