Big Data Developer (Log Analysis)

Nice to meet you - we are Kornit Digital!

Kornit Digital is a worldwide market leader in sustainable, on-demand, digital fashion and textile production technologies. The Company is writing the operating system for fashion with end-to-end solutions including digital printing systems, inks, consumables, and an entire global ecosystem that manages workflows and fulfilment.

Every day we take the chance to re-invent, create, solve, adapt, improve and conquer the unexpected. Our engagement drives us to change the way people print on textiles today and in the future.

You are invited to be part of it to #expressyourbest!

Click to learn more > www.kornit.com

Reports to: Software Manager

Location: Rosh Haain, Park Afek

What will you do?

Analysis of large numbers of logs from printers sent several times a day in the form of zip files into Azure Blob Storage.

Currently, the logs require a lot of cleaning and transformation.

Logs from various files are aggregated and combined to calculate and present KPIs that are important for the business.

· analyze and organize raw data

· evaluate business needs and objectives

· developing the existing data lake

· notebook implementation for ELT processes and business logic

· code optimization

· refactoring

· writing unit tests

· preparing documentation

What should you have?

· 2 years of experience developing big data platform.

· 1 year experience developing data bricks.

· Azure knowledge (must have): Azure Data Factory, ADLS gen2 , Event Hub/ IoT Hub/ Stream Analytics, and Networking

in Azure (Vnet/ subnets/ gateway/ private endpoints)

· Databricks knowledge - Pyspark or Spark SQL

· Languages:

- Advanced SQL knowledge (query optimization, partitioning, clustering etc) -> TSQL, ANSI SQL

- Regular Python knowledge

- Git knowledge

- Basic knowledge about NoSQL databases

· Roles and security (Microsoft Entra ID, security groups etc) - Advantage

· Snowflake – basic/ regular knowledge - advantage

· Data Warehousing knowledge – designing, data modelling, methodologies (like Kimball) and so on

· Data Lake and Lakehouse concept – medallion architecture etc

· Big Data concepts knowledge – Hive, Spark, partitioning, scaling up and out, streaming processing

· Basic DevOps knowledge:

- Azure data DevOps (Boards, tasks, creating PR...)

- CICD processes basic knowledge

Don't check all the boxes? Don't sweat it. We’re passionate about building a diverse team of humans and as such, if you think you've got what it takes in our passionate -and-fun, remote-friendly, fast paced environment—apply anyway. While we have a pretty good idea of what we need, we're ready for you to challenge our thinking on who needs to be in this role.

KORNIT is committed to fostering a diverse and inclusive workplace and is proud to be an equal opportunity employer. We encourage people from all backgrounds to apply. We are committed to ensuring that our technology is made available and accessible to everyone. All employment decisions are made without regard to race, color, national origin, ancestry, sex, gender, gender identity or expression, sexual orientation, age, genetic information, religion, disability, medical condition, pregnancy, marital status, family status, veteran status, or any other characteristic protected by law.