Senior Data Engineer- 3144

A company in the field of AI is looking for a Senior Data Engineer

Responsibilities

• Design, develop and implement robust data pipelines using ETL/ELT to move data from various sources into our lakehouse while ensuring scalability, security, and performance
• Ensure quality and integrity of data by implementing validations, testing and monitoring
• End-to-end feature development and ownership, from design to production
• Work directly with stakeholders to develop a solid understanding of the business application and requirements for which the application is being designed

Requirements

• BSC in a related technical field or equivalent practical experience
• Over 3 years of experience in a Data Engineering role
• Coding experience with Python
• Experience with SQL and NoSQL databases
• Experience with data modeling, and building ELT/ETL pipelines
• Experience with common data warehouse and lakehouse technologies
• Experience with AWS platform
• Experience working with Git, CI-CD flows and Docker
• Experience building data pipelines with big data frameworks such as Spark
• Technologically diverse background and ability/willingness to learn new things quickly

Advantages

• Experience working closely with data scientists / data science project (MLOps)
• Experience with big data architectures and infrastructures
• Experience with BI tools (Tableau, Looker, power bi etc.)
• Experience with IaC technologies like CDK & CloudFormation