BI Deve (Databricks)

Join Israel’s leading healthcare organization and play a key role in shaping a world-class, data-driven healthcare ecosystem.

The Data & Analytics Division at Sheba Medical Center is driving an ambitious data strategy to transform healthcare through advanced analytics, scalable data platforms, and innovative data solutions. We are looking for an experienced Senior BI Developer (Databricks) to design and develop end-to-end data solutions that enable impactful business and clinical decision-making. 

• Design, develop, maintain, and optimize complex ELT/ETL pipelines.
• Integrate data from multiple sources including databases, APIs, files, streaming platforms, Data Lakes, and Data Warehouses.
• Ensure scalability, performance, and reliability of data pipelines.
• Implement best practices for data quality, validation, and error handling. 

• Develop solutions using Apache Spark within the Databricks ecosystem (Python/PySpark, Scala, SQL).
• Build and manage Databricks Notebooks, Jobs, and Workflows.
• Leverage Delta Lake capabilities including ACID Transactions, Schema Evolution, Time Travel, and Z-Ordering.
• Develop semantic data layers and perform advanced analytics using Databricks SQL.
• Implement Data Governance and access controls using Unity Catalog.
• Optimize cluster and Spark job performance. 

• Write and optimize complex SQL queries across various database platforms.
• Design and implement dimensional data models, including Star and Snowflake schemas.
• Develop and optimize Views, Stored Procedures, Functions, and Materialized Views.
• Support enterprise Data Warehouse and Data Mart initiatives. 

• Ensure data consistency, integrity, and quality throughout the data lifecycle.
• Document data models, processes, and architectural components.
• Collaborate closely with business analysts, data scientists, software engineers, and operational teams.
• Translate business requirements into scalable technical solutions.
• Present insights and technical solutions to both business and technical stakeholders. 

Must Have

• Proven experience in BI Development and/or Data Engineering.
• Strong hands-on experience with Databricks, including:
• Spark
• Delta Lake
• Notebooks
• Jobs
• Workflows
• Databricks SQL
• Unity Catalog
• Advanced SQL expertise, including query optimization and performance tuning.
• Extensive experience developing ELT/ETL processes.
• Strong background in dimensional data modeling (Star/Snowflake schemas).
• Proficiency in Python (PySpark preferred) or Scala.
• Experience with Git and CI/CD tools such as Jenkins, GitLab CI, CodePipeline, or CodeBuild.
• Excellent analytical thinking and problem-solving abilities.
• Strong communication skills and ability to work effectively in a multidisciplinary team environment.