Big Data Developer

An innovative, established, and successful fintech startup company. Specializing in algo-trading and electronic trading based on algorithms developed by the company's software engineers.

At the forefront of technology, the company offers a research-oriented environment, an innovative and unique work environment, and plenty of opportunities for personal and professional development.

A values-driven company, committed to making a positive impact in the world on a daily basis.

Located in the Sharon region (near the railway line), with flexible working hours.

Responsibility

• Lead the architecture and development of mission-critical, diverse and large-scale data pipelines over both public and on-prem cloud solutions.

• Derive policies for data storage and versioning over peta-bytes scale complex storage solutions of multiple data lakes.

• Design and develop smart ML infrastructure in order to build Agile ML processes (MLOps).

• Work with Data Scientists to understand needs and design ML infrastructure solutions

• Be a part of a collaborative heterogeneous data team which includes developers, data scientists, data engineers, MLOps and data scouts.

Position Requirements:

• BSc / MSc degree in Computer Science/ Engineering / Mathematics or Statistics

• 5 years of experience working as a Data Engineer or Data Architect or ML Engineer

• 3 years of experience working in high level software development, preferably in Python

• Proven hands-on experience in designing, developing and optimizing complex solutions that move and/or manipulate large volumes of data

• Sound understanding of different big data file formats such as Parquet, Arrow, HDF5, etc.

• Experience with Docker, Linux, CI/CD tools and concepts, Kubernetes.

• Experience with data pipelining tools such as Airflow, Kubeflow, MLFlow and similar technologies.

• Hands-on experience with large-scale distributed computing systems and related technologies (e.g., Spark, Hive)

• Understanding of ML concepts and processes.

• Result oriented, self-motivated, fast learner, can do attitude and a great team player