Data Engineer

For our customer , a great cyber security company, We are looking for a skilled Data Engineer to design, develop, and maintain data pipelines and data Lakehouse architectures that support efficient data processing and analytics. The ideal candidate will have experience with big data technologies, ETL/ELT processes, and cloud/on prem platforms to ensure data availability, reliability, and scalability.

Responsibilities

• Design, build, model and maintain scalable ETL/ELT pipelines for structured and unstructured data.
• Develop, Model and optimize data warehouse, data lake, and Lakehouse.
• Work with SQL, NoSQL (Elastic/Solr), and big data technologies.
• Ensure data quality, governance, Lineage and security across the pipeline.
• Collaborate with data scientists, analysts, and software engineers to support business needs.
• Implement monitoring, logging, and automation to improve data infrastructure performance.

Requirements

• 5+ years of experience in data engineering or related fields.
• Strong skills in Python, SQL, and distributed computing.
• Experience with on prem and cloud platforms (AWS, GCP, or Azure)
• Experience with data tools like Python, Spark, Airflow, NIFI, DBT.
• Familiarity with data modelling, data lakes, and data warehousing concepts.
• Knowledge of real-time data processing and streaming technologies is a plus.