French Data Annotator and Analyst

About The Role

We are looking for a native French speaker with a high level of proficiency in English to join our Annotation and Analysis team at the as a Data Annotator and Analyst. In this role, you will work with large volumes of data in both French and English, annotating and analyzing datasets used to evaluate and train machine learning models, including large language models (LLMs). Your work will involve reviewing model outputs and preparing high-quality training data that supports the development and continuous improvement of AI-driven products. In addition, as part of the job, you will conduct complex analysis on the annotated data and provide insights to the other stakeholders. This position is ideal for someone passionate about linguistics and data, and who enjoys working on detail-oriented tasks that directly impact model quality. As part of a collaborative, cross-functional team, you will work closely with Data Scientists and Product Managers to ensure that datasets are accurately labeled and annotation standards support the development of reliable machine learning systems.

Responsibilities

• Evaluate the quality of machine-translated text, with a focus on French language accuracy and fluency.
• Annotate and assess AI model responses to support systematic evaluation and improvement of model performance.
• Create high-quality annotated datasets used to train and evaluate LLMs and other NLP models.
• Write and refine LLM prompts that support scalable human annotation workflows.
• Collaborate with cross-functional teams, including Data Scientists and Product Managers, to communicate linguistic nuances and implications of French translations on model behavior and user experience.
• Analyze annotated data and evaluation results to identify patterns, assess model quality, and surface insights for model improvement.
  
  

• Native French speaker and high proficiency in English.
• Strong attention to detail and ability to perform precise, consistent work across large volumes of data.
• Interest in linguistics, language quality, and the interaction between language and AI systems.
• Ability to follow detailed annotation guidelines and maintain high accuracy and consistency.
• Ability to analyze annotated data and evaluation results to identify patterns and assess model performance.
• Ability to work independently with strong communication skills.
• Experience with using excel for data analysis