MSR Project - Portuguese (Brazil) Culture Expert

Overview

Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for Portuguese-speaking experts to join our team.

What you will do:

Identify realistic search-related failures where an AI model provides inadequate responses. Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers.

Common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability. Testing multiple queries before finding failures is expected.