Staff Data Engineer (Data & AI solutions)

Our Mission

At Palo Alto Networks®, we’re united by a shared mission—to protect our digital way of life. We thrive at the intersection of innovation and impact, solving real-world problems with cutting-edge technology and bold thinking. Here, everyone has a voice, and every idea counts. If you’re ready to do the most meaningful work of your career alongside people who are just as passionate as you are, you’re in the right place.

Who We Are

In order to be the cybersecurity partner of choice, we must trailblaze the path and shape the future of our industry. This is something our employees work at each day and is defined by our values: Disruption, Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the impact every individual can have. If you are passionate about solving real-world problems and ideating beside the best and the brightest, we invite you to join us!

We believe collaboration thrives in person. That’s why most of our teams work from the office full time, with flexibility when it’s needed. This model supports real-time problem-solving, stronger relationships, and the kind of precision that drives great outcomes.

Job Summary

IDIRA by Palo Alto Networks is looking for an experienced and motivated Data Engineer with high professional skills to join our AI and Data Solutions unit. Spearhead the development of Data Lakehouse processes and modeling CyberArk products; Define and popularize best practices in the data field. Working closely with business entities such as sales and product from IDIRA organization, along with data science and data analytic from the AI and Data Solutions unit. identify opportunities and help specify data requirements to improve on boarding, sales, and security for Idira products and customers along with product managers and data scientists.

Key Responsibilities

• Own the end-to-end design, implementation, and optimization of scalable Data Lakehouse and Data Warehouse architectures across diverse cloud ecosystems.
• Spearhead the development of robust ETL/ELT pipelines and data ingestion processes utilizing SQL, Python, PySpark, and DBT.
• Apply advanced data modeling techniques to structure complex data assets into optimized facts, dimensions, and partitions.
• Partner closely with cross-functional leadership across data science, analytics, R&D, and IT teams to identify data requirements and improve onboarding workflows.
• Orchestrate and automate complex data workflows by combining industry-standard tools like Airflow and DBT with advanced Gen-AI development workflows.
• Define, document, and popularize data engineering best practices, design patterns, and data quality standards across the AI and Data Solutions unit.
• Evaluate and implement modern data technologies spanning vendor-specific and open-source landscapes including GCP, AWS, and Apache Iceberg.
• Provide technical direction and hands-on guidance to ensure high-performance execution, reliable pipeline delivery, and proactive problem-solving.
  
  

Qualifications

Required Qualifications

• 4+ years of data modeling techniques and concepts (e.g., Facts, Dimensions, Partitions).
• 4+ years of experience designing and implementing data ingestion and ETL processes, preferably within Data Lakehouse and Data Warehouse architectures.
• 4+ years of hands-on experience in SQL and Python / PySpark (or Java / Scala).
• Proven experience working within cloud environments (AWS or GCP) is a must, with a strong preference for AWS.
• Solid understanding of the data landscape, from vendor-specific to open-source tools (e.g., Iceberg, DBT, Airflow).
• Proven capabilities using and orchestrating Gen-AI workflows based on CloudCode and Cursor.
• A versatile, proactive team player with a can-do attitude, quick learning agility, and excellent execution skills.
  
  

Preferred Qualifications

• Deep expertise in the AWS ecosystem (Glue, Athena, SageMaker, EMR).
• Experience with Data Warehouse technologies (especially Iceberg or BigQuery).
• Familiarity with the GCP ecosystem.
• Background in cybersecurity is a strong advantage.
  
  

Our Commitment

We’re trailblazers that dream big, take risks, and challenge cybersecurity’s status quo. It’s simple: we can’t accomplish our mission without diverse teams innovating, together.

We are committed to providing reasonable accommodations for all qualified individuals with a disability. If you require assistance or accommodation due to a disability or special need, please contact us at [email protected].

Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.

All your information will be kept confidential according to EEO guidelines.

Is role eligible for Immigration Sponsorship? No. Please note that we will not sponsor applicants for work visas for this position.