Hebrew & English Language Specialist - Content Evaluation | $40.56/hr Remote

Position: Generalist – English & Hebrew

Type: Hourly contract

Compensation: $40.56/hour

Location: Remote

Commitment: 10–40 hours/week

Role Responsibilities

• Evaluate LLM-generated responses for accuracy, relevance, and effectiveness across a wide range of topics.
• Conduct fact-checking using trusted public sources and external tools.
• Generate high-quality human evaluation data by annotating response strengths, gaps, and factual inaccuracies.
• Assess reasoning quality, clarity, tone, and completeness of AI-generated responses.
• Ensure outputs align with expected conversational behavior and system guidelines.
• Apply consistent annotations using established taxonomies, benchmarks, and evaluation frameworks.

Requirements

• Should hold Bachelor’s degree completed.
• Native-level or near-native fluency in Hebrew (ILR 5 / CEFR C2) with strong English proficiency.
• Demonstrated experience using large language models and understanding real-world LLM usage patterns.
• Excellent writing skills with the ability to provide clear, nuanced, and structured feedback.
• Strong attention to detail and analytical thinking abilities.
• Comfortable working across multiple topics, domains, and evolving requirements.
• Background in structured analytical fields such as research, policy, analytics, linguistics, or engineering.
• Strong college-level mathematics skills.

Application Process (Takes 20 Min)

• Upload resume
• Interview (15 min)
• Submit form