Senior Data Platform Engineer- Remote

Job Description

Does building the next generation of AI/ML platforms excite you?

Do Big Data challenges and open-source innovation speak your language?

Join our Aegis team

Aegis is an end-to-end Big Data AI/ML platform built on top of Linode. It bridges the gap between research and production, enabling teams to innovate faster and deliver ML products more efficiently. We leverage open-source tools and AI accelerators to avoid reinventing the wheel integrating across platforms where it matters most.

Make a difference in your own way

You'll join our growing Engineering group, working hands-on to shape a powerful, flexible ML platform that supports real-world, large-scale data and AI workflows. You'll be a key contributor to an environment that spans Kubernetes, Spark, MLFlow, JupyterHub, and PyTorch and that pushes the boundaries of performance and collaboration.

In This Role You Will Be

• Designing and implementing scalable data and ML pipelines using Spark, MLFlow, and Kubernetes
• Building platform components in Python or Scala to connect research and production environments
• Integrating with orchestration tools such as Argo Workflows (or equivalents)
• Supporting hybrid data environments across S3/ADLS and cloud/on-prem compute
• Collaborating with researchers and MLOps engineers to deliver reproducible and high-performance workflows
  
  

Do What You Love

To be successful in this role you will:

• Have 4+ years of experience in backend or data platform development
• Be proficient in Python or Scala
• Have experience with at least one of: Spark, MLFlow, or Kubernetes
• Understand principles of Big Data processing and distributed systems
• Bring familiarity with the ML lifecycle and related tools (Feature Stores, model tracking, etc.)
• Have experience with Argo Workflows or similar orchestration tools
• Be motivated, curious, and thrive in a collaborative and high-ownership environment
  
  

Build your career at Akamai

Our ability to shape digital life today relies on developing exceptional people like you. The kind that can turn impossible into possible. We’re doing everything we can to make Akamai a great place to work. A place where you can learn, grow and have a meaningful impact.

With our company moving so fast, it’s important that you’re able to build new skills, explore new roles, and try out different opportunities. There are so many different ways to build your career at Akamai, and we want to support you as much as possible. We have all kinds of development opportunities available, from programs such as GROW and Mentoring, to internal events like the APEX Expo and tools such as Linkedin Learning, all to help you expand your knowledge and experience here.

Learn more

Not sure if this job is the right match for you or want to learn more about the job before you apply? Schedule a 15-minute exploratory call with the Recruiter and they would be happy to share more details.