Senior Software Engineer

Senior Software Engineer - Deep Tech / AI Platform (Python)

About SparkBeyond

SparkBeyond is building the future of AI in the enterprise. Our AI technology allows a company to optimize operational performance using GenAI, 24x7. Our customers are already using AI to predict and explain product demand, decide which loans should be given, check transactions for fraud, give maintenance instructions to engineers and much more. Operating at the intersection of Generative AI, Data Science, and Machine Learning, our platform pushes the boundaries of what machines and LLM’s can infer from large volumes of structured data and reason what to do based on that knowledge — to the point it’s been described as “science fiction made real.”

We serve large enterprises looking to jump to the future where GenAI deeply understands what drives the performance of a business and so can help decision-making and innovation through data-driven discovery.

The Role

We’re looking for a Senior Software Engineer who thrives on tackling hard problems and building the infrastructure behind cutting-edge AI systems. You’ll work across backend systems, AI integration, and infrastructure, shaping how our research engine scales, learns, and delivers insight.

This role combines deep engineering challenges with architectural ownership and leadership. You’ll design and implement core platform components, mentor teammates, and help define the future of our technical stack.

What You’ll Do

• Lead, Design, implement, and optimize backend services for large-scale AI-driven computation.
• Work with Python, Polars, and DuckDB, introducing new tools and frameworks to enhance performance and scalability.
• Collaborate with AI scientists to productionize algorithms and embed intelligence into the platform.
• Architect and maintain containerized systems using Docker, Kubernetes, and Terraform.
• Drive best practices in performance, reliability, and maintainability across the engineering team.
• Mentor engineers and contribute to a culture of technical excellence.

What We’re Looking For

• Someone excited by cutting edge use of GenAI in novel and sophisticated contexts generating real results for businesses.
• 8+ years of progressive experience in software engineering, with a focus on building distributed, high-performance systems and strong hands-on Python expertise.
• Mastery of large-scale system design, distributed systems, and complex data processing pipelines.
• Proven track record of architecting, building, and operating production-grade backend and infrastructure components at scale.
• Deep Experience with containerization (Docker) and orchestration (Kubernetes).
• Experience with Terraform, ArgoCD or other IaC tools in a continuous delivery environment.
• A history of technical leadership, mentoring, and driving significant architectural or technological shifts within an organization.
• Passion for solving hard technical problems and working close to the edge of what’s possible in Deep Tech and AI.
• Experience developing or contributing to Open Source Software (OSS) is a significant advantage.