Software Data Engineer

Job Description

Our software team is growing, and we are looking for a data engineer to be entrusted with designing, building, and optimizing large-scale data pipelines in both on-premise and cloud environments. Your role will encompass the management and storage of binary and tabular data, integration and collaboration with our AI/ML teams and stable large scale ETL pipelines. We value agility, so staying updated and adaptable to our evolving tech stack is inherent to the role.

Responsibilities

• A solid experience with SQL and other databases
• Collaborating with the data team and stakeholders
• Manage and set up visualization tools
• Monitoring and logging frameworks such as Grafana, Prometheus, Kibana and Elastic
• Manage and design ETL processes, data cleansing, transformation, and integration
• Work closely with our ML/AI teams
• Proficiency in tools like Jenkins and Airflow
  
  

• Bachelor's/Master's degree in Computer Science, Engineering or a related field
• 5+ years of proven experience as a Data Engineer or similar role in a startup or fast-paced environment
• Strong proficiency in Python
• Expertise in SQL and familiarity with other database systems
• Hands-on experience with data visualization tools
• Proficiency with monitoring and logging tools
• Experience with data flow and CI/CD frameworks
• Understanding of object storage solutions and best practices for binary data
• Excellent problem-solving skills, analytical mindset, and attention to detail
• Strong communication and collaboration skills