Senior Data Engineer

abra professional services is seeking for an senior data engineer.

We are seeking a Senior Data Engineer to lead the technical development of our Data Fabric within a military program.

This role involves technical leadership in building contextual data pipelines, working with big data Lakehouse architectures, and driving data pipeline automation.

Requirements:

MUST HAVE Requirements:

• 5+ years of hands-on experience as a Big Data Engineer
• Proven ability to design and deploy Big Data & AI solutions using frameworks and tools such as:
• Apache NiFi
• Kafka
• Spark
• Graph DB
• NoSQL databases
• Strong coding proficiency in Python and Bash
• Experience building large-scale data pipelines for data processing, transformation, and analytics
• Ability to define and manage metadata schemas
• Experience developing data workflows (e.g., metadata generation, auto-extraction, validation, format conversion)
• Experience developing tools for data observability and compliance analytics
• Ability to analyze and report on complex datasets and results
• Experience working with big data lakehouse architectures
• Ability to explore, enhance, and manage data fusion from multiple data sources
• Experience developing analytics tools, algorithms, and programs
• Technical leadership of data structure design for contextual pipelines
• Collaboration experience with Data Scientists and Architects
• Strong ability to work independently, learn new technologies, and apply innovative solutions
• Excellent interpersonal skills and ability to work as part of a team
• MSc in Computer Science or Data Science

Advantages:

• Experience with managing metadata and taxonomy concepts alongside big data objects
• Experience working with public cloud Big Data & AI services
• Familiarity with machine learning concepts
• Strong technical skills
• Independent, hands-on developer
• Curious, open-minded, fast learner, and a strong team player