Senior Software Engineer, ML Infrastructure

Innodata’s Frontier AI teams are looking for exceptional engineers who ship fast and lead from the front. Innodata’s frontier AI practices are building the teams, tools, data, and methods that develop, support, evaluate, train, and stress-test the world's most advanced AI models and agents. Innodata partners with leading frontier AI labs to push the boundaries of what AI systems can reliably do.

You will architect production systems for large-scale AI evaluation and training, drive technical decisions, and build the engineering culture on a growing team. You will be tasked with taking theory and operationalizing it in software. This role demands both hands-on excellence and the ability to multiply the output of those around you. We move quickly- if you thrive in environments where you're building, deploying, and iterating in days not months, this is your role.

What You'll Do

• Lead technical projects end-to-end: scope, design, build, ship, and iterate- on timelines measured in hours and days
• Architect and implement high-performance systems for large-scale ML evaluation and training workloads
• Build distributed data pipelines that process and curate training data at scale with correctness guarantees
• Set the technical bar: write code that others learn from, establish patterns, and elevate the team's engineering standards
• Leverage coding agents and AI-assisted development as a force multiplier- move at 10x speed without sacrificing quality
• Mentor and grow engineers- conduct code reviews, pair on hard problems, and help teammates level up
• Make pragmatic tradeoffs between speed and quality- know when to build for durability and when to move fast
• Collaborate with researchers and partners to turn experimental approaches into production systems rapidly

What You'll Bring

• MSc or PhD in Computer Science, Software Engineering, Mathematics, or a related technical field
• Exceptional coding ability with demonstrable evidence: competitive programming results, major open-source contributions, or systems you built that scaled
• Track record of shipping production systems quickly- you know how to cut scope intelligently and get things into users' hands
• Fluency with coding agents and AI-assisted development tools- you use them daily to amplify your output, not as a crutch
• Experience leading technical projects or teams, whether formally or informally- you make others around you more effective
• Deep computer science fundamentals: algorithms, data structures, systems programming, concurrency, and performance
• Mastery of Python and at least one systems language (C++, Rust, or Go); additional languages are a plus
• Experience with distributed systems, data pipelines, or ML infrastructure at scale
• Strong debugging intuition- you isolate problems quickly across unfamiliar codebases
• Excellent English communication skills

Evidence of Excellence

We're looking for concrete signals of exceptional engineering ability:

• Competitive programming achievements (Codeforces, ICPC, IOI, TopCoder)
• Significant contributions to widely-used open-source projects
• Systems you designed and built that operate at significant scale or complexity
• History of rapidly shipping high-quality products in startup or high-growth environments
• Strong academic performance in CS/Math at a rigorous institution
• Technical leadership: teams you've built, engineers you've mentored, cultures you've shaped

Bonus Points

• Experience with ML frameworks and infrastructure (PyTorch, distributed training, model serving)
• GPU programming and low-level performance optimization (CUDA, Triton)
• Cluster orchestration and cloud infrastructure (Kubernetes, AWS/GCP)
• Understanding of LLM architectures and training dynamics
• Interest in cybersecurity, including malware analysis, reverse engineering, or adversarial techniques

Why Innodata

Innodata (NASDAQ: INOD) is a fast-growing tech services company at the critical intersection of frontier AI development and rigorous evaluation. Our work directly shapes how the world's most capable AI systems are tested, refined, and deployed. You will build systems that matter- and you'll build them fast.

We're a small, high-output team scaling rapidly. The problems are hard, the pace is intense, and the engineering bar is high. If you want to ship meaningful work every week alongside people who care about craft, this is the place.

How to Apply

We believe strong teams are built from people with different experiences and perspectives. We encourage candidates from underrepresented groups to apply, even if you don't meet every item above. Please provide your CV, links to code or projects that demonstrate your engineering ability, and a brief note on why this role interests you. Email that to: israeljobs@innodata.com