Data Engineer

Clalit Innovation is a world-leading center for innovation and research in healthcare. Leveraging one of the world's largest and most diverse medical databases, our team provides tools and insights that change lives.

We are looking for a Data Engineer to join the data innovation team, with proven experience in data systems analysis and implementation processes. The core purpose of this role is to support Big Data and AI driven medical research teams. As part of the team you will take part in creating and maintaining full data preparation process from end to end as well as supplying ad-hoc solutions for data. This role is an excellent opportunity to work on different data types (genomic, text, image, IOT, medical), data bases (MSQL, Hadoop, PostgreSQL) and processes from source to target while being in charge on the complete process - initial analysis, curation, documentation, ETL to Hadoop, data exploration and maintaining the Cloudera Environment.

This position is ideal for well-seasoned data engineer who wants to make a real impact on people life and well-being by Data with on of the biggest medical data worldwide.

Responsibilities:

• Understand the researcher's needs and transform it to a requirement document while exploring the data sources and Characterization
• Maintain ETL processes; extract, process, and upload data from the data warehouse (DWH) to various information systems
• Use and maintain data in Cloufera/Hadoop environment
• Create data engineering solutions for ad-hoc data preparation initiatives and tasks using Python, SQL, Impala, Hive, Talent ETC.
• Design schema structures to support application needs to ensure best performance
• Explore and find insights within large databases and continuously improve processes in order to maximize the value of the data for the researchers
• Work closely with technical and medical teams regarding design and implementation of big data solutions
• Collaborate with various stakeholders within Clalit Health Services
• Continuously improve operational process and procedures
• Provide creative solutions for advanced challenges

Requirements:

• BA/BS in industrial/information system engineering, computer science, or equivalent work experience - must
• Minimum 3 years of working experience (hands on) using SQL (MSSSQL, PL/SQL, T-SQL) - must
• Minimum 3 years of working experience (hands on) in DWH/BI/Data Driven projects - must (experience in ETL processes - advantage)
• Hands-on experience in R/Python - must
• Strong understanding of data modeling and database concepts
• Curious, methodical, self-starter and independent, capable of taking ownership on issues from beginning to end
• Excellent interpersonal and communication skills and team player
• Experience with FHIR, OMOP, unstructured data and/ or cloud based big data environments - advantage

For additional details, please send your CV to : [email protected] and include that you are inquiring about "Data Engineer - position # 1089