Senior Data Engineer

We are seeking an experienced Data Engineer to join our innovative Data & ML Engineering team. You will work closely with data scientists to design and develop robust, scalable solutions tailored for both batch and real-time environments. Your responsibilities will include developing Python packages, building REST APIs, and implementing end-to-end data pipelines.

Success in this role requires a strong production mindset, attention to code quality and maintainability, and the ability to build generic, scalable components for a variety of ML and data-driven use cases.

Requirements

• 6+ years of Python development experience
• Strong coding skills and experience in code reviews
• 4+ years working with Git/GitLab and Jenkins
• 3+ years of experience in developing RESTful APIs, including FastAPI
• Experience designing and implementing CI/CD pipelines
• Proven experience building data pipelines for ingestion, transformation, and loading from various sources
• Experience with automation, quality assurance, and monitoring of production systems
• 3+ years of SQL experience, including query optimization (MS-SQL, MySQL, Postgres, etc.)
• 2+ years working with NoSQL databases (HBase, MongoDB, Cassandra)
• 2+ years of experience with the Hadoop ecosystem (HDFS, Hive, Spark)
• 2+ years of experience working with containers, Kubernetes, and OpenShift