C++ Software Engineer

An elite AI-Semiconductor startup operating in strict stealth mode, founded by a highly successful serial entrepreneur with a track record of significant exits. The company is developing a revolutionary software system designed to run Large Language Models (LLMs) on custom-built hardware.

Backed by top-tier investors and staffed by veterans of leading technology companies and successful startups, they are building the next generation of AI compute infrastructure.

Located in the Central District (adjacent to the train station), operating a hybrid model with one day of remote work per week.

Role Overview-

• Designing and optimizing a high-performance software system for executing massive AI models on specialized hardware.
• Architecting complex infrastructures that bridge the gap between high-level AI frameworks and low-level hardware execution.
• Developing core components in C++ while integrating Python layers for model orchestration.
• Evaluating technical trade-offs and driving critical architectural decisions to maximize performance and scalability.
• Working at the intersection of deep learning internals, compilers, and hardware acceleration.

Requirements-

• 5 years of experience in Low-Level programming, Compiler development, or AI Infrastructure.
• B.Sc. or higher in Computer Science, Electrical Engineering, or a related field from a top-tier university – Mandatory.
• Expert-level proficiency in C++ and professional experience with Python.
• Proven background in Linux-based development environments.
• Exceptional debugging skills with a track record of optimizing performance across software and hardware layers.
• Experience with MLIR and IR-based compiler development – Strong Advantage.
• Solid understanding of Deep Learning architectures and hands-on experience with framework internals (e.g., PyTorch/TensorFlow) – Strong Advantage.