Data Scientist (Remote)

Apply for the Data Scientist (Remote) role at AI Jobs .

We are looking for a data-driven professional to join our analytics and quality team. In this role, you will analyze the performance of AI agents across finance-sector tasks to uncover root causes of failure and drive improvements in design, evaluation, and benchmarking frameworks.

Key Responsibilities

• Conduct statistical failure analysis to identify recurring patterns in AI agent performance across prompts, rubrics, templates, and file types
• Investigate root causes behind performance issues in task execution, framework design, or data complexity
• Perform multi-dimensional analysis across finance sub-domains, task categories, and input types
• Develop dashboards and reports highlighting performance trends, failure clusters, and improvement opportunities
• Recommend enhancements to task design, quality rubrics, and evaluation metrics based on data findings

Required Qualifications

Preferred Qualifications

Equal Opportunity Statement

We welcome applicants from all backgrounds. Reasonable accommodations are available for qualified individuals with disabilities.

Seniority Level

Not Applicable

Employment Type

Part‑time

Job Function

Information Technology

Industries

IT System Data Services and Technology, Information and Media

Location : Colombo, Western Province, Sri Lanka | Posted 4 days ago

#J-18808-Ljbffr