Talent.com
عرض العمل هذا غير متوفر في بلدك.
Arabic Language Expert

Arabic Language Expert

Innodata Inc.WorkFromHome, Saudi Arabia
18 منذ ساعات
الوصف الوظيفي

Overview

We are looking for native Arabic experts from Saudi Arabia to contribute on our ongoing AI / LLM project. This is remote, freelance work.

Position Overview :

  • Experience Level : Degree in Linguistics or a related field
  • Location : Remote | Freelance
  • Mandatory : To complete LLM Evaluation assessment by coming Sunday, September 28th

LLM Evaluation Guidelines :

  • No. of Questions : 122
  • No. of Sections : 7
  • Test Duration : 120 minutes (2 hours)
  • Total Marks : 122
  • Passing Criteria : High (Get at least 100+ questions correct to pass)
  • Required : Complete by Sunday, 28th September
  • Note : Assessment auto-submits after 120 minutes; maintain speed with accuracy.
  • Job Description :

    We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI / LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

    Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.
  • Requirements :

  • Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance, content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviors, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like OpenAI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.
  • Seniorities and Employment Details :

  • Seniority level : Mid-Senior level
  • Employment type : Part-time
  • Job function : Writing / Editing and Art / Creative
  • Industries : Business Consulting and Services and IT Services and IT Consulting
  • Referrals increase your chances of interviewing at Innodata Inc. by 2x

    Other job postings related to this project may appear below.

    #J-18808-Ljbffr

    إنشاء تنبيه وظيفي لهذا البحث

    Arabic • WorkFromHome, Saudi Arabia

    وظائف ذات صلة
    • عَرْضٌ مُرَوَّجٌ له
    Arabic Copywriter

    Arabic Copywriter

    Weber ShandwickSaudi Arabia
    We are a leading, full-service, integrated communications and marketing services agency that delivers industry-defining work and next-generation solutions for brands, businesses, and organisations....أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
    • عَرْضٌ مُرَوَّجٌ له
    Accountant - Arabic Speaking for KSA Branch

    Accountant - Arabic Speaking for KSA Branch

    MEI General Trading LLCSaudi Arabia
    Accountant - Arabic Speaking for KSA Branch - Apply Now.Job Title : Accountant - Arabic Speaking for KSA Branch.We are seeking an experienced and detail-oriented. This role includes overseeing payabl...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
    • عَرْضٌ مُرَوَّجٌ له
    Freelance Annotator (Arabic) - AI Trainer

    Freelance Annotator (Arabic) - AI Trainer

    Toloka AnnotatorsWorkFromHome, Saudi Arabia
    At Toloka, we connect smart, curious people from around the world with freelance online tasks that train and improve artificial intelligence. The Toloka Annotators connects individuals with Generati...أظهر المزيدآخر تحديث: 26 منذ أيام
    • عَرْضٌ مُرَوَّجٌ له
    English as an Additional Language (EAL) Teacher

    English as an Additional Language (EAL) Teacher

    NEOMSaudi Arabia
    NEOM is an accelerator of human progress and a vision of what a new future might look like.A region in northwest Saudi Arabia on the Red Sea, NEOM is being built from the ground up to include hyper...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
    • عَرْضٌ مُرَوَّجٌ له
    Transcriptionist (Arabic, Saudi Arabia)

    Transcriptionist (Arabic, Saudi Arabia)

    HireArtSaudi Arabia
    Get AI-powered advice on this job and more exclusive features.HireArt is helping a generative AI company find detail-oriented Transcriptionists to support its audio data annotation and transcriptio...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
    • عَرْضٌ مُرَوَّجٌ له
    Senior Copywriter - Arabic

    Senior Copywriter - Arabic

    PublicisgroupeSaudi Arabia
    The Senior Arabic Copywriter is responsible for creating compelling and effective concepts and copy in the Arabic language for advertising campaigns. In collaboration with other members of the creat...أظهر المزيدآخر تحديث: 13 منذ أيام
    • عَرْضٌ مُرَوَّجٌ له
    Voice Actor (Arabic) - 38961

    Voice Actor (Arabic) - 38961

    TuringWorkFromHome, Saudi Arabia
    Voice Actor to bring characters and stories to life across various domains, using their voice to capture the right emotion, personality, and tone. Record voice-overs from a professional home studio ...أظهر المزيدآخر تحديث: 2 منذ أيام
    • عَرْضٌ مُرَوَّجٌ له
    Arabic Chef de Cuisine Four Seasons Resort and Residences Red Sea

    Arabic Chef de Cuisine Four Seasons Resort and Residences Red Sea

    Four Seasons Hotels and ResortsSaudi Arabia
    Four Seasons is powered by our people.We are a collective of individuals who crave to become better, to push ourselves to new heights and to treat each other as we wish to be treated in return.Our ...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
    • عَرْضٌ مُرَوَّجٌ له
    Arabic Language Consultant | Upto $50 / hr Remote

    Arabic Language Consultant | Upto $50 / hr Remote

    Crossing HurdlesWorkFromHome, Saudi Arabia
    Arabic Language Consultant | Upto $50 / hr Remote.Join to apply for the Arabic Language Consultant | Upto $50 / hr Remote role at Crossing Hurdles. Crossing Hurdles is a recruitment firm.We refer top ca...أظهر المزيدآخر تحديث: 2 منذ أيام
    • عَرْضٌ مُرَوَّجٌ له
    Freelance- Translators / Linguists, English into Arabic

    Freelance- Translators / Linguists, English into Arabic

    IQVIASaudi Arabia
    Are you a freelance translator with a passion for life sciences content? Join us on an exciting journey and become a member of our growing global community of linguists. The IQVIA Translation Servic...أظهر المزيدآخر تحديث: 23 منذ أيام
    • عَرْضٌ مُرَوَّجٌ له
    Data Partner - Computer Science - Arabic - Remote - Global

    Data Partner - Computer Science - Arabic - Remote - Global

    TELUS DigitalWorkFromHome, Saudi Arabia
    Data Partner - Computer Science - Arabic - Remote - Global.Data Partner - Computer Science - Arabic - Remote - Global.Are you ready to use your domain knowledge to advance AI? Join us as a Data Par...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
    Native Saudi Arabia Linguistic Projects (Remote)

    Native Saudi Arabia Linguistic Projects (Remote)

    Sigma GroupSaudi Arabia, SA
    Quick Apply
    Help shape the future of ethical AI.AI – Shaping the Future of Artificial Intelligence.Sigma is a leading global technology company specializing in data collection and annotation for Artificial Int...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
    • عَرْضٌ مُرَوَّجٌ له
    Remote : Media Search Analyst - Arabic (SA)

    Remote : Media Search Analyst - Arabic (SA)

    TELUS DigitalWorkFromHome, Saudi Arabia
    Remote : Media Search Analyst - Arabic (SA) – TELUS Digital.This role offers the flexibility to set your own schedule and complete tasks using an innovative web-based evaluation tool.In this role, y...أظهر المزيدآخر تحديث: 2 منذ أيام
    • عَرْضٌ مُرَوَّجٌ له
    Freelancer Monolingual Data Labeling, Arabic Gulf, Hijazi, Najdi

    Freelancer Monolingual Data Labeling, Arabic Gulf, Hijazi, Najdi

    LILT, IncWorkFromHome, Saudi Arabia
    AI is changing how the world communicates — and LILT is leading that transformation.AI, machine translation, and human-in-the-loop. At LILT, we empower our teammates with leading tools, global colla...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
    • عَرْضٌ مُرَوَّجٌ له
    SAP FICO -Arabic Speaker (3 Months Contract)

    SAP FICO -Arabic Speaker (3 Months Contract)

    Müller`s SolutionsSaudi Arabia
    Müller's Solutions is a trusted SAP consulting firm recognized for our commitment to excellence and client satisfaction.We specialize in delivering tailored SAP solutions that drive operational imp...أظهر المزيدآخر تحديث: 11 منذ أيام
    • عَرْضٌ مُرَوَّجٌ له
    Freelance Luxury Retail Trainer (Arabic Speaker)

    Freelance Luxury Retail Trainer (Arabic Speaker)

    CXG groupWorkFromHome, Saudi Arabia
    Founded in 2006, CXG is a global customer experience agency specializing in the premium and luxury industries.We serve over 200 luxury clients with a multicultural team of 250+ professionals.Our mi...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
    • عَرْضٌ مُرَوَّجٌ له
    Native Saudi Arabia Linguistic Projects (Remote)

    Native Saudi Arabia Linguistic Projects (Remote)

    Sigma AIWorkFromHome, Saudi Arabia
    Native Saudi Arabia Linguistic Projects (Remote) role at Sigma AI.All tasks are remote and performed through an online platform available 24 / 7. This opportunity is offered for freelancers under a co...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
    • عَرْضٌ مُرَوَّجٌ له
    Bilingual Tutor

    Bilingual Tutor

    DataAnnotationWorkFromHome, Saudi Arabia
    You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert level of linguistics.Y...أظهر المزيدآخر تحديث: 4 منذ أيام