Senior Data Engineer

we are looking for a Data Engineer Technical lead to join Networking Clusters Solutions group. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines for our clusters performance analysis, cluster management and monitoring solutions. You will dive into emerging technologies, define and prove concepts, and identify or create the necessary frameworks. Your responsibilities will include defining and implementing large-scale telemetry pipelines, ensuring data integrity, and designing simulation solutions and other innovative technologies. You will also design and optimize data architecture to support robust and scalable systems. Networking Cluster Solutions (NCS) group is responsible to build the biggest AI clusters in our company Israel to qualify and optimize our company Networking solutions at scale.
What You'll Be Doing:
Define and implement the groups data technical roadmap, ensuring alignment with teams inside and outside the group
Oversee the quality, performance, and maintainability of the data analytics codebase and delivered solutions
Drive best practices in software engineering, data modelling, data quality, code quality, security, observability, and operational excellence
Build high-performance pipelines with advanced data integrity control of NCS group
Define and build NCS group different pipelines and reports for HPC & AI clusters performance, telemetry and E2E tests coverage.