This job offer is not available in your country.

Arabic Language Expert

Innodata Inc.WorkFromHome, Tabuk Province, Saudi Arabia

6 days ago

Job description

Overview

We are looking for native Arabic experts from Saudi Arabia to contribute on our ongoing AI / LLM project. This is remote, freelance work.

Position Overview :

Experience Level : Degree in Linguistics or a related field
Location : Remote | Freelance
Mandatory : To complete LLM Evaluation assessment by coming Sunday, September 28th

LLM Evaluation Guidelines :

No. of Questions : 122

No. of Sections : 7

Test Duration : 120 minutes (2 hours)

Total Marks : 122

Passing Criteria : High (Get at least 100+ questions correct to pass)

Required : Complete by Sunday, 28th September

Note : Assessment auto-submits after 120 minutes; maintain speed with accuracy.

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI / LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Key Responsibilities :

Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).

Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.

Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.

Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.

Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.

Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.

Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.

Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.

Strong background in Quality Assurance, content review, or test case development for AI / ML systems.

Understanding of LLM behaviors, failure modes, and model evaluation metrics.

Excellent critical thinking, pattern recognition, and analytical writing skills.

Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.

Preferred Qualifications :

Prior work with teams like OpenAI, Anthropic, Google DeepMind, or other LLM safety initiatives.

Experience in risk assessment, red team security testing, or AI policy & governance.

Background in linguistics, psychology, or computational ethics is a plus.

Seniorities and Employment Details :

Seniority level : Mid-Senior level

Employment type : Part-time

Job function : Writing / Editing and Art / Creative

Industries : Business Consulting and Services and IT Services and IT Consulting

Referrals increase your chances of interviewing at Innodata Inc. by 2x

Other job postings related to this project may appear below.

#J-18808-Ljbffr

Create a job alert for this search

Arabic • WorkFromHome, Tabuk Province, Saudi Arabia

Related jobs

Promoted

Freelance Translator with Arabic

LocalEyes Ltd.WorkFromHome, Tabuk Province, Saudi Arabia

LocalEyes Group is a leading provider of Localization Services to the international computer and software sectors with headquarters in Ireland and subsidiaries in Europe. We work with the world's mo...Show moreLast updated: 30+ days ago

Promoted

Remote : Media Search Analyst - Arabic (SA)

HitekNOFAL SolutionsWorkFromHome, Tabuk Province, Saudi Arabia

Remote : Media Search Analyst - Arabic (SA).Ready to say goodbye to the boring, traditional 9-5 routine and embrace a dynamic and exciting work environment that puts you in control? This position of...Show moreLast updated: 30+ days ago

Promoted

Arabic Language Consultant | Upto $50 / hr Remote

Crossing HurdlesWorkFromHome, Tabuk Province, Saudi Arabia

Arabic Language Consultant | Upto $50 / hr Remote.Join to apply for the Arabic Language Consultant | Upto $50 / hr Remote role at Crossing Hurdles. Crossing Hurdles is a recruitment firm.We refer top ca...Show moreLast updated: 7 days ago

Promoted

Freelance Arabic Translator

TransPerfectWorkFromHome, Tabuk Province, Saudi Arabia

Direct message the job poster from TransPerfect.Senior Vendor Manager @ TransPerfect | Vendor Onboarding, Management and Relations. In order to meet the translation needs of our Marketing, Technical...Show moreLast updated: 3 days ago

Promoted

Remote : Media Search Analyst - Arabic (SA)

Naouri GroupWorkFromHome, Tabuk Province, Saudi Arabia

Remote : Media Search Analyst - Arabic (SA)Company : Industry : : Call Center, Telemarketing and BPO Job Location : : Riyadh, Saudi Arabia Career Level : : Student Date Posted : : Ref.Num...Show moreLast updated: 30+ days ago

Promoted

English to Arabic Translator

DataAnnotationWorkFromHome, Tabuk Province, Saudi Arabia

We are looking for an English to Arabic Translator to join our team to train AI models.You will measure the progress of AI chatbots, evaluate their logic, and solve problems to improve the quality ...Show moreLast updated: 29 days ago

Promoted

Freelance Translator with Arabic

LocalEyesWorkFromHome, Tabuk Province, Saudi Arabia

Promoted

Remote : Media Search Analyst - Arabic (SA)

Pharmacy OneWorkFromHome, Tabuk Province, Saudi Arabia

Remote : Media Search Analyst - Arabic (SA).Please note that you still haven't applied to this job.Kindly click the "Apply Now" button to send your job application and CV. You must first log in befor...Show moreLast updated: 30+ days ago

Promoted

Remote : Media Search Analyst - Arabic (SA)

TELUS DigitalWorkFromHome, Tabuk Province, Saudi Arabia

Remote : Media Search Analyst - Arabic (SA) – TELUS Digital.This role offers the flexibility to set your own schedule and complete tasks using an innovative web-based evaluation tool.In this role, y...Show moreLast updated: 8 days ago

Promoted

Remote : Media Search Analyst - Arabic (SA)

IMC-JordanWorkFromHome, Tabuk Province, Saudi Arabia

Promoted

Arabic Interpreter in Saudi Arabia

AsiaLocalizeWorkFromHome, Tabuk Province, Saudi Arabia

AsiaLocalize provides comprehensive translation and localization services to support clients in accessing and succeeding in global markets. With a wide range of professional native translators, expe...Show moreLast updated: 30+ days ago

Promoted

Freelance Luxury Retail Trainer (Arabic Speaker)

CXG groupWorkFromHome, Tabuk Province, Saudi Arabia

Founded in 2006, CXG is a global customer experience agency specializing in the premium and luxury industries.We serve over 200 luxury clients with a multicultural team of 250+ professionals.Our mi...Show moreLast updated: 30+ days ago

Promoted

Remote : Media Search Analyst - Arabic (SA)

Sitech, LLCWorkFromHome, Tabuk Province, Saudi Arabia

Promoted

Arabic Language Lead Specialist (Saudi Arabia)

WelocalizeWorkFromHome, Tabuk Province, Saudi Arabia

As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences.Welocalize deliver...Show moreLast updated: 2 days ago

Promoted

Arabic & English linguistic projects (Remote)

Sigma AIWorkFromHome, Tabuk Province, Saudi Arabia

Join the Arabic & English linguistic projects (Remote) role at Sigma AI.Sigma is a leading global technology company specializing in data collection and annotation for Artificial Intelligence.With ...Show moreLast updated: 30+ days ago

Promoted

Remote : Media Search Analyst - Arabic (SA)

Amman BaptistWorkFromHome, Tabuk Province, Saudi Arabia

Promoted

Media Search Analyst - Arabic

TELUS Digital AI Data SolutionsWorkFromHome, Tabuk Province, Saudi Arabia

TELUS Digital AI Data Solutions.Ready to ditch the traditional 9-5 grind? If you are an English and Arabic speaker living in Saudi Arabia, join our community as a Media Search Analyst, set your own...Show moreLast updated: 30+ days ago

Promoted

Remote : Media Search Analyst - Arabic (SA)

CrystelWorkFromHome, Tabuk Province, Saudi Arabia

Remote : Media Search Analyst - Arabic (SA).Remote : Media Search Analyst - Arabic (SA).Ready to say goodbye to the boring, traditional 9-5 routine and embrace a dynamic and exciting work environment...Show moreLast updated: 30+ days ago