AI Prompt Evaluator - Hebrew

We are seeking meticulous and highly motivated evaluators to join our team. We want you to play a pivotal role in refining AI-generated content!

Role Overview:

There are 5 different tasks in this project:

• Standard Evaluation

There are two primary tasks for evaluation:

- Task where the reviewer evaluates a single AI-generated response against the user’s prompt.

- Task where the reviewer compares two AI-generated responses side by side and selects the better response overall.

• AI Human Evaluation

The reviewer Will be assessing AI-generated responses, ensuring clarity, accuracy, and adherence to the given prompts. The task focuses on evaluating three key areas:

-Formula details

-Table details, and

-Summarization details.

• Inbox Context Evaluation

Users Will be evaluating two responses, A and B, to a given prompt using context sources A and B. The aim is to assess the quality, accuracy, and relevance of both responses, ensuring they appropriately address the prompt and align with the provided context sources.

• Short Summary Evaluation

Users Will be evaluating machine-generated summarization. The objective is to ensure that summaries are concise, accurate, and effectively help users understand the essence of the email content, enabling them to quickly assess its relevance followed by a justification of the ratings.

• No Context Evaluation

The Users will be evaluating 2 responses, A and B, to a given prompt. The aim is to assess the quality, accuracy, and relevance of both responses, ensuring they appropriately address the prompt.

Requirements

• Language Proficiency: Native Hebrew (Israel) speakers and fluent in English.
• You can be based anywhere in the world but not in the following countries: Afghanistan, Cuba, Iran, Iraq, Syria, Russia, Ukraine (Crimea region, Luhansk, and Donetsk), China, North Korea, Venezuela, Yemen, Argentina, Bolivia, Brazil, Chile, Colombia, Ecuador, Mexico, Panama, United Kingdom and Sudan.
• Analytical and Creative Skills: We value detail-oriented, logical thinkers with a creative flair and the ability to empathize with user needs.
• Communication: Strong communicative skills and a willingness to collaborate with the team.

Compensation: 16.50 USD per hour

Interested? Follow the below steps to apply:

1. Create your OneForma Profile through https://www.oneforma.com/
2. Click on the link below to apply once you already have a OneForma account: http://my.oneforma.com/UserPortal/job_page.php?job_id=3592
3. Or just go to Jobs>LLM>Find "Rocket – Prompt and Response Evaluator - Hebrew (Israel)" and apply.

For any other issues, feel free to contact us at [email protected], we will be more than happy to help!