Data Engineer

About the Company

At Nogamy, we help leading organizations turn data into business value through cutting-edge Data & AI solutions. If you're passionate about building scalable data platforms and working alongside top AI professionals, we'd love to hear from you.

About the Role

We're looking for a Data Engineer to join our team and work on innovative AI-driven projects.

Responsibilities

• Design, build, and maintain scalable and complex data pipelines.
• Ingest and process large volumes of data from diverse sources.
• Perform data analysis and gain deep insights from complex datasets.
• Collaborate closely with Data Scientists to support AI and Machine Learning initiatives.
• Work across both Cloud and On-Prem environments.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field.

Required Skills

• 3+ years of experience as a Data Engineer.
• 3+ years of experience with Object-Oriented Programming (OOP).
• 3+ years of hands-on Python development.
• Strong experience with Apache Spark for large-scale data processing.
• Deep understanding of designing, developing, and optimizing high-volume data processing solutions.
• Experience with data formats and partitioning strategies such as Parquet, Avro, HDF5, and Delta Lake.
• Hands-on experience with Docker, Linux, CI/CD tools, and Kubernetes.
• Experience with data orchestration tools such as Airflow or Kubeflow.
• Understanding of Machine Learning concepts and workflows.

Preferred Skills

• 2+ years of hands-on AWS experience with services such as Athena, Glue, Step Functions, EMR, Redshift, and RDS.
• Familiarity with GenAI solutions and Prompt Engineering.