Senior Data Engineer (Python, AWS, CI/CD, PySpark)

The Company:

An industry leading, enterprise, AI platform that is helping the largest healthcare companies globally. Backed with $60 million+ in R&D, and their platform powers over 100 million users on a daily basis.

The Role:

As a Data Engineer, you will work closely with all R&D teams and business stakeholders to own the entire data process and shape our data strategy. This is a great opportunity for someone who is passionate about cloud data infrastructure / technologies and wants to make a significant impact in a fast-paced start-up environment.

Responsibilities:

• Design, develop and implement robust data pipelines using ETL/ELT to move data from various sources into our lakehouse while ensuring scalability, security, and performance
• Ensure quality and integrity of data by implementing validations, testing and monitoring
• End-to-end feature development and ownership, from design to production
• Work directly with stakeholders to develop a solid understanding of the business application and requirements for which the application is being designed

Qualifications:

• BSC in a related technical field or equivalent practical experience
• Over 3 years of experience in a Data Engineering role
• Coding experience with Python
• Experience with SQL and NoSQL databases
• Experience with data modeling, and building ELT/ETL pipelines
• Experience with common data warehouse and lakehouse technologies
• Experience with AWS platform
• Experience working with Git, CI-CD flows and Docker
• Experience building data pipelines with big data frameworks such as Spark
• Technologically diverse background and ability/willingness to learn new things quickly

Advantages:

• Experience working closely with data scientists/data science projects (MLOps)
• Experience with big data architectures and infrastructures
• Experience with BI tools (Tableau, Looker, Power BI etc.)
• Experience with IaC technologies like CDK & CloudFormation

If you are an experienced, Senior Data Engineer with a strong infrastructure background that includes, CI/CD, AWS, Pyspark, Microservices then please send a copy of your CV directly to this advertisement for immediate consideration.