Big Data Software Engineer

Job Description
General Motors Israel (Herzelia) takes a significant part in shaping the autonomous vehicle. We shape the face of the future vehicles in diverse fields by developing cutting edge technologies

We are looking for a Big Data SW Engineer for the autonomous vehicle project as part of ADAS group (Advanced Driver Assistance Systems).

What will you do:

Develop a scalable data platform to support continuing increases in data volume and complexity - petabytes scale on thousands core cluster.
Develop data driven processes for the ingestion and enrichment of the data
Assemble large, complex data sets that meet functional / non-functional business requirements.
Build the infrastructure required for optimal extraction, transformation, and loading of data.
Create, manage and optimize large scale data pipelines using popular open-source frameworks: Apache Spark, Airflow, Iceberg etc.
Support the needs of advanced ML development (Neural net training, reinforcement learning)
Design and implement data validation and quality checks
Work with data and analytics experts to strive for greater functionality in our data systems

#LI-KY1

#GM

Additional Job Description

Your Skills & Abilities (Required Qualifications):

B.Sc. in computer sciences or equivalent
Over 5 years of experience in software development, experience in at least one high-level programming language (Java, Scala, python - preferred )
Strong background in Big Data frameworks and Data pipelines: Apache Spark, Apache Airflow, Apache Iceberg, Dremio, Databricks
Cloud: experience and strong familiarity with at least one cloud platform (Microsoft Azure - preferred , AWS, GCP)
Background in distributed data processing microservices building high-quality, scalable data products.
Strong background in data modeling, metadata management, ETL development, and data quality.
Knowledge in both relational and non-relational DB and experience in Schema design
Good understanding and experience with CI/CD practices
Team player: Ability to work and collaborate effectively with other team members

About GM

Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.

Why Join Us

We aspire to be the most inclusive company in the world. We believe we all must make a choice every day – individually and collectively – to drive meaningful change through our words, our deeds and our culture. Our Work Appropriately philosophy supports our foundation of inclusion and provides employees the flexibility to work where they can have the greatest impact on achieving our goals, dependent on role needs. Every day, we want every employee, no matter their background, ethnicity, preferences, or location, to feel they belong to one General Motors team.

Diversity Information

General Motors is committed to being a workplace that is not only free of discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that workforce diversity creates an environment in which our employees can thrive and develop better products for our customers. We understand and embrace the variety through which people gain experiences whether through professional, personal, educational, or volunteer opportunities.

We encourage interested candidates to review the key responsibilities and qualifications and apply for any positions that match your skills and capabilities.