Arabic Data Quality Analyst – Remote, $11/hr

About the role

This is a short‑term contract position focused on evaluating and improving the quality of personalized AI responses in Arabic. You will work remotely, collaborating with a global team to ensure AI outputs are relevant, accurate, and respectful of personal data.

Key responsibilities

• Design multi‑turn conversational prompts that incorporate personal context.
• Assess AI‑generated responses for relevance, grounding, helpfulness, and correct use of personal data.
• Perform side‑by‑side evaluations and rank AI outputs.
• Identify grounding errors, poor inferences, and forced personalization.
• Write clear, structured rationales referencing specific conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain strict data hygiene by deleting evaluation conversations after review.

Required profile

• Fluent in Arabic (reading and writing).
• Experience in data annotation, AI quality evaluation, content moderation, or similar roles.
• Strong analytical thinking and attention to detail.
• Ability to evaluate nuanced and ambiguous AI responses.
• BS/BA degree or equivalent analytical experience.
• Excellent written communication and structured feedback skills.
• Self‑motivated, able to work independently in a remote setting.
• Reliable desktop/laptop with stable internet and full‑time availability (8 hours/day) with a 4‑hour overlap with PST.

Required skills

• Arabic language proficiency (reading and writing).

What we offer

• Hourly compensation of $11.
• Fully remote work with flexible scheduling.
• Opportunity to contribute to cutting‑edge LLM personalization projects.