AI Infrastructure Engineer

We are looking for a hands-on engineer to own and build the core AI infrastructure layer powering production-grade AI agents across the organization. This is a foundational role responsible for taking AI systems from prototype to scalable, reliable, and secure production platforms.

You will design and operate the platform that hosts and orchestrates AI agents, build the underlying infrastructure, and ensure observability, cost efficiency, reliability, and safety at scale.

Responsibilities:

• Architect and own AWS + Kubernetes-based infrastructure for AI agents and internal tools
• Build and maintain Infrastructure-as-Code for compute, agent runtimes, vector DBs, and supporting services
• Design and deploy production-grade AI agents and multi-agent pipelines using modern agent frameworks
• Own the full lifecycle of agent systems: design, build, deploy, monitor, evaluate, and iterate
• Implement end-to-end observability
• Define and enforce SLOs/SLIs for AI systems (latency, reliability, cost, success rates)
• Drive FinOps practices: cost optimization, model routing, caching strategies, and budget controls
• Implement security and safety guardrails: prompt injection protection, PII handling, audit logs, and access controls
• Integrate AI workflows into internal systems via APIs, databases, and event-driven architectures
• Identify high-impact opportunities and translate them into scalable AI-driven automations

Requirements:

• 3–5 years of software engineering experience in production environments
• Proven experience with AWS, Kubernetes, and Terraform (ownership level)
• Proven experience building and deploying LLM/agent-based systems in production
• Strong Python coding skills
• Experience with agentic systems (tool calling, orchestration, memory, vector databases)
• Hands-on experience with AWS Bedrock or similar enterprise LLM platforms
• Production CI/CD ownership (GitHub Actions, Argo CD or equivalent)
• Strong observability and debugging experience in distributed systems
• E2E ownership mindset: design; build; deploy; operate; improve