Talent.com
Arabic Language Expert

Arabic Language Expert

Innodata Inc.WorkFromHome, Al-Qassim Province, Saudi Arabia
27 days ago
Job description

Overview

We are looking for native Arabic experts from Saudi Arabia to contribute on our ongoing AI / LLM project. This is remote, freelance work.

Position Overview :

  • Experience Level : Degree in Linguistics or a related field
  • Location : Remote | Freelance
  • Mandatory : To complete LLM Evaluation assessment by coming Sunday, September 28th

LLM Evaluation Guidelines :

  • No. of Questions : 122
  • No. of Sections : 7
  • Test Duration : 120 minutes (2 hours)
  • Total Marks : 122
  • Passing Criteria : High (Get at least 100+ questions correct to pass)
  • Required : Complete by Sunday, 28th September
  • Note : Assessment auto-submits after 120 minutes; maintain speed with accuracy.
  • Job Description :

    We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI / LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

    Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.
  • Requirements :

  • Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance, content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviors, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like OpenAI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.
  • Seniorities and Employment Details :

  • Seniority level : Mid-Senior level
  • Employment type : Part-time
  • Job function : Writing / Editing and Art / Creative
  • Industries : Business Consulting and Services and IT Services and IT Consulting
  • Referrals increase your chances of interviewing at Innodata Inc. by 2x

    Other job postings related to this project may appear below.

    #J-18808-Ljbffr

    Create a job alert for this search

    Arabic • WorkFromHome, Al-Qassim Province, Saudi Arabia

    Related jobs
    • Promoted
    Freelance Arabic Translator

    Freelance Arabic Translator

    TransPerfectWorkFromHome, Al-Qassim Province, Saudi Arabia
    Direct message the job poster from TransPerfect.Senior Vendor Manager @ TransPerfect | Vendor Onboarding, Management and Relations. In order to meet the translation needs of our Marketing, Technical...Show moreLast updated: 23 days ago
    • Promoted
    Live Online Arabic Trainer

    Live Online Arabic Trainer

    Executive Language Training - elt Language SolutionsWorkFromHome, Al-Qassim Province, Saudi Arabia
    Executive Language Training - elt Language Solutions.Executive Language Training (ELT) is a premier language service provider based in the United States, specializing in delivering customized langu...Show moreLast updated: 30+ days ago
    • Promoted
    Urgent Hiring for English to Arabic - Business Management

    Urgent Hiring for English to Arabic - Business Management

    UlatusWorkFromHome, Al-Qassim Province, Saudi Arabia
    We are looking Freelancer for our upcoming project details are given below : .Language pair Urgent Hiring for English > . We review your resume and check whether your overall profile meets our require...Show moreLast updated: 6 days ago
    • Promoted
    Freelance Translator with Arabic

    Freelance Translator with Arabic

    LocalEyes Ltd.WorkFromHome, Al-Qassim Province, Saudi Arabia
    LocalEyes Group is a leading provider of Localization Services to the international computer and software sectors with headquarters in Ireland and subsidiaries in Europe. We work with the world's mo...Show moreLast updated: 30+ days ago
    • Promoted
    Remote : Media Search Analyst - Arabic (SA)

    Remote : Media Search Analyst - Arabic (SA)

    TELUS DigitalWorkFromHome, Al-Qassim Province, Saudi Arabia
    Remote : Media Search Analyst - Arabic (SA) – TELUS Digital.This role offers the flexibility to set your own schedule and complete tasks using an innovative web-based evaluation tool.In this role, y...Show moreLast updated: 29 days ago
    • Promoted
    Arabic Voice Actor

    Arabic Voice Actor

    Lifted, an Upwork CompanyWorkFromHome, Al-Qassim Province, Saudi Arabia
    As a voice actor, you’ll use your performance skills and high-quality audio setup to help train and build cutting-edge AI applications. Your day to day responsibilities include : .Record spoken versi...Show moreLast updated: 3 days ago
    • Promoted
    Live Online Arabic Trainer

    Live Online Arabic Trainer

    eltlearnWorkFromHome, Al-Qassim Province, Saudi Arabia
    Executive Language Training (ELT) is a premier language service provider based in the United States, specializing in delivering customized language training to multinational corporations worldwide....Show moreLast updated: 30+ days ago
    • Promoted
    WFH : Media Search Analyst - Arabic Speakers

    WFH : Media Search Analyst - Arabic Speakers

    TELUS DigitalWorkFromHome, Al-Qassim Province, Saudi Arabia
    WFH : Media Search Analyst - Arabic Speakers at TELUS Digital.This is a part-time, long-term role with flexible scheduling and a web-based evaluation tool. Conduct comprehensive assessments across di...Show moreLast updated: 18 days ago
    • Promoted
    Translated Sentence Review - Native Arabic Speakers with Data Labeling Experience

    Translated Sentence Review - Native Arabic Speakers with Data Labeling Experience

    UpworkWorkFromHome, Al-Qassim Province, Saudi Arabia
    We are looking for native ARABIC speakers to review translated sentences.Please review the attached instructions as well as the example sentences in the sheet it contains all languages so simply fi...Show moreLast updated: 3 days ago
    • Promoted
    Arabic Tutor

    Arabic Tutor

    DataAnnotationWorkFromHome, Al-Qassim Province, Saudi Arabia
    We are looking for an Arabic Tutor to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each mo...Show moreLast updated: 30+ days ago
    • Promoted
    Arabic linguistic projects (Remote)

    Arabic linguistic projects (Remote)

    Sigma AIWorkFromHome, Al-Qassim Province, Saudi Arabia
    Arabic linguistic projects (Remote) role at.As part of our linguistic projects, your responsibilities may include : .Validation of audio, video, images, sentences, or words.All tasks are remote and p...Show moreLast updated: 16 days ago
    • Promoted
    Voice AI Trainer - Saudi Arabic

    Voice AI Trainer - Saudi Arabic

    LingoTribeWorkFromHome, Al-Qassim Province, Saudi Arabia
    LingoTribe is a global voice platform where you.Your conversations power AI that understands your language and culture—making technology accessible for everyone. Voice calls with friends or family i...Show moreLast updated: 13 days ago
    • Promoted
    Remote - Media Search Analyst - Arabic Speakers

    Remote - Media Search Analyst - Arabic Speakers

    TELUS DigitalWorkFromHome, Al-Qassim Province, Saudi Arabia
    Our global AI Community is a vibrant network of 1 million+ contributors from diverse backgrounds who help our customers collect, enhance, train, translate, and localize content to build better AI m...Show moreLast updated: 17 days ago
    • Promoted
    Freelance Translator with Arabic

    Freelance Translator with Arabic

    LocalEyesWorkFromHome, Al-Qassim Province, Saudi Arabia
    LocalEyes Group is a leading provider of Localization Services to the international computer and software sectors with headquarters in Ireland and subsidiaries in Europe. We work with the world's mo...Show moreLast updated: 30+ days ago
    • Promoted
    Media Search Analyst - Arabic

    Media Search Analyst - Arabic

    TELUS Digital AI Data SolutionsWorkFromHome, Al-Qassim Province, Saudi Arabia
    TELUS Digital AI Data Solutions.Ready to ditch the traditional 9-5 grind? If you are an English and Arabic speaker living in Saudi Arabia, join our community as a Media Search Analyst, set your own...Show moreLast updated: 30+ days ago
    • Promoted
    Arabic Interpreter in Saudi Arabia

    Arabic Interpreter in Saudi Arabia

    AsiaLocalizeWorkFromHome, Al-Qassim Province, Saudi Arabia
    AsiaLocalize provides comprehensive translation and localization services to support clients in accessing and succeeding in global markets. With a wide range of professional native translators, expe...Show moreLast updated: 30+ days ago
    • Promoted
    Arabic English OPI / VRI Interpretation Vacancy -Remote-

    Arabic English OPI / VRI Interpretation Vacancy -Remote-

    KalamWorkFromHome, Al-Qassim Province, Saudi Arabia
    If you are passionate about different languages and interpretation we need you!.We are looking for professional remote interpreters who want to join an international company and be a great help to ...Show moreLast updated: 1 day ago
    • Promoted
    Arabic & English linguistic projects (Remote)

    Arabic & English linguistic projects (Remote)

    Sigma AIWorkFromHome, Al-Qassim Province, Saudi Arabia
    Join the Arabic & English linguistic projects (Remote) role at Sigma AI.Sigma is a leading global technology company specializing in data collection and annotation for Artificial Intelligence.With ...Show moreLast updated: 30+ days ago