AI Software Engineer

Were looking for a Principal Software Engineer to own the RL Gym platform end-to-end: from architecting multi-site web environments that simulate real-world attack surfaces, to optimizing our in-house orchestration harness (AgenticVerse) for high-performance delivery into customer training pipelines.
This is a builder role. Youll lead a small team (including a dedicated web environments engineer), operating with high autonomy, moving fast from concept to working prototype to production system. Youll interact directly with customer engineering teams to understand their infrastructure constraints and deliver environments that meet their scale and reliability requirements.
Why this role:
This is one of the few roles in the industry where your code directly influences how the next generation of AI models are trained. Youll be at the center of advancing AI safety, building systems that the worlds top labs depend on to make their models more robust. The work is technically deep, the problem space is genuinely novel, and the field is moving faster than any team can keep up with alone. Theres no playbook. Youll write it.
What youll do:
Platform & performance:
Own and evolve AgenticVerse, our in-house orchestration harness that provisions and manages RL environments at scale. Focus on performance: low-latency provisioning, high concurrency, minimal overhead per environment instance
Design and build isolated, reproducible web environments using Firecracker microVMs or Docker containers
Architect multi-site scenarios (3-4 interconnected web applications per task) with rich interactions: drag-and-drop, file uploads, authentication flows, LLM-in-the-loop components
Implement deterministic verifiers that evaluate agent behavior with zero ambiguity
Customer delivery:
Work directly with engineering teams at leading AI labs to integrate RL Gym environments into their training and evaluation pipelines
Translate customer specs into working environments, iterating rapidly on feedback
Own the technical relationship: SLAs, API contracts, integration architecture
Adapt environment delivery formats to cus tomer infrastructure (real-time API calls vs. offline batch, managed vs. raw artifacts)
Build customer-facing UIs when needed (dashboards, environment configuration portals, monitoring interfaces)
Rapid prototyping:
Take ambiguous problem descriptions and produce working prototypes within days, not weeks
Validate new environment types, interaction patterns, and verifier approaches quickly
Build internal tooling that accelerates scenario authoring and testing.