Primwright Enterprise
English / Arabic AI Evaluation
Pilot-scoped service · Founder-led Arabic work · EN / AR
Evaluation of AI output in English and Arabic — response evaluation, annotation, and QA audits across both languages.
What it is
Two languages, one standard.
Most evaluation vendors are English-first; Arabic is an afterthought. We evaluate in both languages with the same methods — pairwise preference, rubric scoring, annotation, and QA audits — applied by people who actually read the language being evaluated.
A plain statement of capacity: Arabic evaluation work is currently founder-led. That means Arabic projects get senior attention — and that they are sized to founder capacity, agreed up front, with no growth story attached.
Deliverables
What you receive
- Evaluations or annotations in English and/or Arabic, with per-judgment rationales
- The rubric or guideline used — versioned, with worked examples
- Agreement measures and QA report, as with our other evaluation services
- Acceptance review against criteria agreed before work begins
Process
How a pilot works
Language and task scoping
Which language(s), which task, what “good” means — agreed in writing before work starts.
Rubric or guideline review
We review or co-design the rubric, including language-specific examples and edge cases.
Qualification and calibration
Evaluators qualify per language; calibration batches are adjudicated before production.
Production with QA
Production work with reviewer sampling and agreement tracking, as in our evaluation services.
Delivery and acceptance
Results, rationales, and QA report delivered for your acceptance review.
Scope and limits
What this service does not include — stated up front, so there are no surprises in scoping:
- Arabic evaluation work is currently founder-led — sized to that capacity, scheduled per engagement.
- English and Arabic only — no other languages.
- No regulated data; no safety or red-team evaluation.
- No guaranteed accuracy figures; acceptance criteria are agreed per pilot.
Related services
Next step
Start with a scoped pilot.
Tell us about your project. We review every inquiry against our scope — if it’s a fit, we schedule a scoping conversation.