Senior Deep Learning Researcher, LLM Inference

We are seeking a highly motivated Senior Deep Learning Researcher to join our team! This is an outstanding opportunity to conduct impactful research and develop the next generation of large language model (LLM) inference algorithms. You will work on technologies that directly enhance our software, making the latest LLMs more efficient and accessible for users worldwide. By joining us, you will be part of a strategic effort to establish us as the definitive platform for high-performance LLM inference. You will engage with skilled problem-solvers and top organizations, crafting AI technology advancements.

What you'll be doing:
Research, invent, and implement groundbreaking algorithms for LLM inference to advance the state of the art in both low-latency and high-throughput scenarios.
Translate research into practical software solutions that directly impact our products and customers.
Collaborate with internal research, engineering, and product teams across the globe to drive the develop

דרישות:

What we need to see:
MSc/PhD in Computer Science, Electrical Engineering, or a closely related field.
At least 3 years of proven experience in deep learning research or applied research.
At least one publication in a top-tier AI/ML conference (e.g., NeurIPS, ICLR, ICML).
Deep understanding of LLM architectures coupled with hands-on experience in training large-scale models.
Excellent programming skills, particularly in Python and deep learning frameworks like PyTorch, and experience with software engineering best practices.
A strong problem-solving mentality and a proactive demeanor, driven by the ambition to deliver solutions with real-world impact.

Ways to stand out from the crowd:
Hands-on research experience in LLM inference optimization algorithms such as speculative decoding or parallelization strategies.
Proven experience with High-Performance Computing (HPC) environments, including training or running inference on large-scale GPU clusters (tens to hundreds of GPUs).
Deep fami