Senior AI Engineer

Who we are:

Founded in 2016, K Health's mission is to deliver accessible, high-quality healthcare at scale. As a leading clinical AI company in primary care, K Health has developed a suite of clinical AI agents that enhance provider efficiency and improve patient outcomes. K Health's virtual primary care platform is enhanced by an AI copilot to complete the initial patient intake, summarizing relevant history from the EMR, and generating “the perfect note” to reduce the time providers spend on basic data collection and non-clinical tasks. Unlike other virtual medicine companies, K Health delivers comprehensive, longitudinal primary care in a virtual setting, enabling our clinicians to be true primary care providers without sacrificing scope of practice or continuity of care. 

As a venture-backed startup trusted with nearly $400 million in funding and a $900 million valuation as of July 2024, K Health is well-positioned for sustained future growth. We are expanding our partnerships with major health systems (Cedars-Sinai, Hackensack Meridian Health, Hartford HealthCare), enhancing accessibility and quality of care by pairing people with technology. Our providers are credentialed at these renowned academic health systems and adhere to their clinical guidelines, ensuring patient-first, evidence-based care. Fully integrated into Epic, our AI platform enables K Health to operate as an extension of existing healthcare systems, benefiting from a built-in network of specialists and social services to seamlessly serve patients within those communities. Our unique care delivery model enables our providers to deliver the same high-quality, accessible care to a mixed-payer population, including those with commercial insurance, Medicare, and Medicaid.  

Join us in our mission to deliver smarter, simpler healthcare of the future - today!

About the role:

We are looking for a highly experienced Senior Backend Engineer with deep expertise in Python and a strong understanding of the AI models and agents domain. While this role does not involve building models from scratch, it requires close collaboration with our AI and Data Science teams to build scalable, production-ready infrastructure and APIs that power intelligent systems.

As a core member of our AI Engineering team, you will work closely with cross-functional stakeholders, including data scientists, ML engineers, and product managers, to design and deliver backend systems that serve AI-driven workflows. This role is ideal for someone passionate about backend engineering in the AI space, with a strong architectural mindset and a background in health tech.

What you'll be doing:

As a Senior Backend Engineer in the AI Engineering team, you will:

• Build and maintain reliable, scalable backend services to support AI agent execution and orchestration.
• Develop text and voice based AI systems designed to execute complex operational and administrative workflows, using LangChain, LangGraph, LiteLLM, and Langfuse.
• Orchestrating a hybrid model stack that includes OpenAI and Google Gemini alongside self-hosted and fine-tuned smaller LLMs like Gemma and Llama.
• Collaborate with the Data Science and Machine Learning teams to productionize AI features and model-serving pipelines.
• Build and maintain integrations with clinical systems (FHIR, EMR, GraphQL APIs).
• Drive observability and reliability using OpenTelemetry, Datadog, and Langfuse.
• Design APIs, background workers, and event-driven systems that interface with AI inference engines and agent runtimes.
• Write clean, testable, and well-documented code using best practices.
• Take ownership of system design and backend architecture decisions for AI-powered products.
• Work with other engineers to optimize performance, scalability, and fault tolerance of distributed backend systems.
• Participate in code reviews, knowledge sharing, and mentoring to elevate the team’s technical capabilities.
• Support monitoring, observability, and incident response related to backend infrastructure.

What we're looking for:

• 6+ years of backend engineering experience with a strong focus on Python; experience with additional languages such as Java, Go, Rust, Kotlin, or Node.js/NestJS is a plus.
• Solid understanding of AI systems architecture and experience working in environments involving AI agents, LLMs, or inference pipelines.
• Proven experience in building and scaling backend APIs, microservices, and background jobs.
• Experience with both relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., MongoDB, Redis) databases, including schema design, query optimization, and data modeling.
• Hands-on experience with message brokers (e.g., PubSub, Redis Streams, RabbitMQ) and distributed systems.

We offer competitive compensation packages based on industry benchmarks for function, level, and geographic location. Offer amounts are determined by multiple factors such as a candidate's experience and expertise.  

We are proud to be an Equal Opportunity Employer and consider applicants for employment regardless of race, ethnicity, religion, color, national origin, ancestry, disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, sexual orientation, pregnancy, childbirth and breastfeeding, age, citizenship, military or veteran status, or any other class protected by applicable federal, state, and local laws. We’re deeply committed to building teams as diverse as the patients we serve and strive to cultivate an environment where everyone can bring their most authentic self to work. We depend on our differences to make our team stronger, our workplace more dynamic, and our product accessible to all of our users.

We are committed to maintaining the integrity of our hiring process and ensuring a safe environment for all candidates. All communication for job offers from K Health will come from email addresses ending in @khealth.com. K Health will never ask you to provide financial information about yourself during the recruitment process. We will never use personal email accounts or other domains for official correspondence. Our official job postings are only listed on our official website and reputable job boards. Be cautious of job offers from sources other than these platforms.