Software Engineer - AI Platform

Job Description

About Us
HiBob helps modern, mid-size businesses transform the way they manage people, giving HR and managers all they need to connect, engage, develop, and retain top talent. Since 2015, we’ve achieved consecutive triple-digit year-over-year growth, all backed by our amazing team of Bobbers from across the globe, making us the choice HRIS of over ~4500 midsize and multinational companies and over 1 Milion users.
Our HR platform is intuitive, data-driven, and built for the way people work today: globally, remotely, and collaboratively. 
What this role is really about
We’re building Hibob’s internal AI Platform as a foundation that enables safe, scalable, and cost‑effective AI across the company. Our mission is to support internal business units in becoming more productive and driving business growth. As a Software Engineer on Business Innovation (Internal), you’ll develop high‑leverage platform capabilities used by Product, Customer Success, Sales, Operations, Data, and IT. You’ll work across the entire stack, from APIs and services to data and UI. transforming business requi

Job Requirements

• 5+ years of hands‑on software engineering experience building production systems at scale.

• Strong proficiency in Python and solid experience with React..

• Deep experience with cloud infrastructure (AWS), containers (Docker, Kubernetes), and distributed systems.

• Professional experience designing event‑driven or microservice architectures (e.g., Kafka/PubSub, queues, webhooks).

• Practical knowledge in data stores (Postgres, Redis, or equivalent) and analytics (SQL, Snowflake/BigQuery).

• Strong grounding of LLM/AI application patterns (RAG, tool use, function calling, guardrails) and vendor APIs (OpenAI or similar).

• Experience with vector search (pgvector, Pinecone, OpenSearch), feature/semantic layers, or retrieval pipelines

• Familiarity with LLMOps: eval frameworks, prompt/version management, offline/online A/B testing, and cost/latency optimization
  Excellence in testing (unit/integration), observability, and CI/CD; you instrument before you ship.

• Clear written and verbal communication; able to drive alignment with concise design docs and reviews.
  
  

• Build core AI platform services - Design and implement agent orchestration, prompt management, RAG, Connectors, and evaluation pipelines that power AI experiences across the company.

• Develop complex agentic workflows - Develop a multi-step workflow that coordinates tools and services with proper observability, guardrails, and cost controls (using OpenAI Agent SDK, LangGraph, or a similar framework).

• Build LLM evaluation and optimization systems -Develop evaluation harnesses, offline/online experiments, prompt-testing frameworks, and dashboards to balance quality, latency, and spend across all AI services.

• Ship the internal AI portal - Build user-facing products that democratize AI access: prompt directories, agent designers, templates,  approval workflows, and more.

• Ensure security and compliance - Develop RBAC, data classification, PII redaction, audit logging, and policy enforcement.

• Create robust integrations - Connect the platform with Salesforce, NetSuite, Slack, Snowflake, HRIS, and other critical business systems.

• Establish operational excellence - Implement CI/CD, testing strategies, monitoring/tracing, and SLOs for high-reliability services.

• Enable developers -  build SDKs, CLIs, and templates that help teams create safe, scalable AI workflows. Lead technical discussions and write design documentation.

• Experience building developer platforms or internal tooling

• Familiarity with workflow orchestration (Airflow, Prefect, Dagster) or multi-model routing strategies

• Hands-on experience with model optimization, fine-tuning, or distillation techniques

• Background in SaaS/enterprise environments with compliance requirements (SOC2, GDPR)
  
  

• Company share options plan
• We have a flexible hybrid working model
• Work from home allowance- to get your home office set up!
• Payment for sick leave from the first day
• 2 Social Impact days per year for volunteering
• Annual Headspace subscription and wellness benefits
• Awesome employee referral program- $2,500 for each successful referral with an additional ambassador programme
• 10 bis or cibus/wolt- you get to pick!
• Transportation allowance
• Dog-friendly
• Temporary remote work from anywhere in the world for up to 2 months (after 6 months of employment)
• Fun company and team social events (locally and virtually with our global teams)
• Bob balance days - 4 additional days within a calendar year - Enjoy a company-wide long weekend at the beginning of each quarter