Senior Data Engineer

For a leading and funded cyber startup, I'm looking for a Data Engineer (Python Developer).

What will you do?

1. Design and build scalable, efficient data ingestion pipeline that accommodates a wide range of data types and sources, tailored to the specific needs of our cybersecurity application.

2. Implement and manage Knowledge Graph based on Graph DB, including Ontology crafting, advanced queries, reasoning over the graph, coreference and conflicts resolution.

3. Design, build, and evolve a scalable self-serve data integration platform, empowering teams to seamlessly connect and ingest diverse external data sources while ensuring high data quality and integrity.

4. Stay abreast of emerging technologies and trends in data engineering, database management, and cybersecurity, integrating innovative solutions to enhance our data infrastructure. 5. Ensure compliance with data privacy and protection regulations, implementing rigorous data security measures and practices.

6. Participate in the entire development lifecycle, from concept to deployment of production-grade system, incorporating feedback from the clients and implementing optimizations

What you need?

1. Proven experience in data engineering, with expertise in designing and implementing data ingestion pipelines, ETL processes, and database management.

2. In-depth knowledge of relational and non-relational databases and vector and graph databases (e.g., Elastic Search, Snowflake, MySQL, MongoDB, Neo4j)

3. Proficiency in programming languages commonly used in data engineering, such as Python, Java, or Scala.

4. Advantage: Familiarity with cybersecurity concepts and the specific data requirements of AI-driven cybersecurity solutions is a plus.

5. Advantage: Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, with a strong emphasis on data engineering.

6. Advantage: experience with Data Orchestration platforms (like Airflow)

Keywords: Python, ETL, MySQL, Elastic Search, MongoDB, Snowflake, Kubernetes, AWS, Azure