Deep Learning Engineer

Our team is looking for a Deep Learning Engineer.

AI21 is one of the few companies to have trained multi-billion parameter Large Language Models (LLMs), a feat that involves the most advanced engineering (large scale distributed training on hundreds of cores). Serving these LLMs efficiently requires cutting-edge technology as well. As a deep learning engineer on the team, you will be responsible for maintaining and improving our training and serving infrastructure.

Role and Responsibilities:

• Optimize model serving to support high throughput and low latency in production
• Enable model serving on various hardware and environments
• Perform large-scale evaluations and comparisons of trained models across a range of benchmarks, as well as adding support for new benchmarks
• Develop Large Language Models as part of our applied research projects and in support of AI21 Platform, including designing, implementing and training massive-scale deep language models
  
  

Requirements:

• B.Sc. in computer science, software engineering or equivalent
• Self learner, and proven record of ability to remove technical road-blocks
• 5+ years experience developing software for production systems and/or internal infrastructure/tools
• Prior experience working with cloud computing platforms (e.g. AWS, GCP, Docker, Kubernetes)
• Skilled at writing production-grade Python code
• Hands-on experience in deep learning and machine learning (TensorFlow/PyTorch..)
• Any one of the following:
  
  

Optimization of deep learning models (DeepSpeed, serialization, quantization)

• or -
  
  

C/C++ and CUDA

• or -
  
  

Distributed Systems, in particular distributed deep learning training/serving.

• or -
  
  

M.Sc. in computer science, software engineering or equivalent

About Us:

AI21 Labs was formed by AI luminaries and veterans of the elite technology unit of Israel’s IDF (Yoav Shoham, Amnon Shashua, and Ori Goshen), with the mission of building AI systems with an unprecedented capacity to understand and generate natural language. The company’s products - Wordtune and Wordtune Read - aim to transform the way we read and write. Wordtune is the first AI-based writing companion that understands context and meaning, while Wordtune Read is an AI-based reading companion which helps people read faster, more efficiently and process information in less time. AI21 Studio is our B2B channel focused on empowering developers anywhere to build text based apps and services using our state-of-the-art language models.