PermanentOn-siteMidPosted 9 days agoTalent pipeline
LLM Evaluator
Software company · Nairobi, Kenya
- Pay, estimated
- KES 1.6M–2M / year · est.
- Level
- Mid
- Hours
- Full time
About the role
Evaluates model outputs, writes rubrics and builds regression sets for AI features. This mid-level opening sits in a software company based in Nairobi. The team works in Python, Jira, Postman.
You will
- Write evaluation rubrics and golden datasets
- Rate and compare model outputs at scale
- Red-team prompts for safety and policy gaps
- Build regression suites for prompt and model changes
- Report quality metrics to product teams
You bring
- Prompting
- Evaluation design
- Python
- Domain expertise
Stack
Talent pipeline role: we regularly place this type of role in this market. Applying adds you to the shortlist for the next matching opening. It is not a single vacancy. Timezone Africa/Nairobi.