Senior Data Engineer-BIG DATA

We are seeking a highly skilled and experienced fata engineer to take on a hands-on role within our Connected Insurance team. The ideal candidate will be responsible for managing our AWS Data infrastructure, developing and maintaining our operational data processing, and handling big data analysis. You will play a critical role in driving our software and data engineering efforts, ensuring efficient integrations with customer systems, and contributing to our business intelligence initiatives.

Key Responsibilities:

Manage and optimize AWS infrastructure, ensuring robustness, scalability, and security.

Develop, maintain, and optimize Postgres (RDS) operational databases.

Design and execute Glue (Spark) jobs for big data analytics, deriving insights from large customer datasets.

Contribute to business intelligence efforts, preferably with experience in Quicksight.

Develop and maintain software primarily in Python, adhering to best coding practices.

Manage multiple integrations with customer systems, ensuring reliable data exchange.

Write and maintain bash scripts to automate routine tasks and processes.

Collaborate with cross-functional teams to understand requirements and deliver solutions.

Stay updated with the latest trends in technology and apply them to improve existing systems and processes.

Required Qualifications:

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Proven experience in software/data engineering, +5Y.

Strong experience with AWS cloud services and infrastructure +2Y.

Solid experience in Python programming.

Experience in big data processing, preferably with AWS Glue and Spark.

Familiarity with business intelligence tools and Quicksight experience is an advantage.

Demonstrated ability in handling integrations with external systems.

Excellent problem-solving skills and ability to work in a dynamic and challenging environment.

Strong communication and collaboration skills.

Additional Skills (Advantageous):

Knowledge of additional programming languages or technologies used in big data and cloud environments.

What We Offer:

A dynamic and supportive work environment where you can grow your skills and career.

Competitive salary and benefits.

Opportunities to work on cutting-edge technologies.

A culture of innovation and continuous improvement.

Full-time