PermanentHybridMidPosted 4 days ago
QA Developer, AI Assistant
AI company · Québec & Montréal, Canada
- Pay, estimated
- C$120k–150k / year · est.
- Level
- Mid
- Hours
- Full time
About the role
Evaluates model outputs, writes rubrics and builds regression sets for AI features. This mid-level opening sits in a ai company based in Québec & Montréal. The team works in Docker, Jira, Python.
You will
- Write evaluation rubrics and golden datasets
- Rate and compare model outputs at scale
- Red-team prompts for safety and policy gaps
- Build regression suites for prompt and model changes
- Report quality metrics to product teams
You bring
- Prompting
- Evaluation design
- Python
- Domain expertise
Stack
This is a public vacancy we track on the open market. The employer is not named here. Apply and we confirm the role is still open before any introduction. Timezone America/Toronto.