Castilian Spanish Labeler / Annotator

About Blueprint

Blueprint is a technology solutions firm headquartered in Bellevue, Washington, with teams across the United States. We help organizations turn complex challenges into meaningful outcomes by connecting strategy and execution across AI, cloud, data, product development, and emerging technology.

Our culture is built by people who care deeply about doing exceptional work. We set high standards, take ownership, and continually challenge ourselves and one another to be better. We work hard, support each other, and take genuine pride in what we deliver for our clients, partners, and teams.

At Blueprint, you’ll work alongside talented people with different experiences, expertise, and perspectives. You’ll have opportunities to take on meaningful challenges, expand your skills, and see the impact of what you build.

Bring your perspective. Raise the standard. Build what matters.

About the Role

We’re looking for a Castilian Spanish Labeler / Annotator to evaluate responses generated by AI systems. In this role, you’ll perform side-by-side evaluations of outputs from different AI models across a variety of real-world scenarios. Your analysis will help improve how AI systems understand and communicate in Castilian Spanish.

This is not a translation role. It is an evaluation and analysis role that requires strong judgment, cultural awareness, and careful attention to detail.

What You'll Do

Perform side-by-side comparisons of AI-generated responses.

Evaluate outputs for accuracy, relevance, clarity, instruction-following, and overall quality.

Assess AI responses across general-purpose questions and answers, web search results, file-based and image-based responses, content-generation tasks, and single-turn and multi-turn conversations.

Identify nuances in language, tone, meaning, and cultural context specific to Castilian Spanish.

Apply detailed, scenario-specific annotation guidelines accurately and consistently.

Document evaluation decisions clearly and provide rationale when required.

Maintain consistent quality and judgment across a high volume of evaluations.

Participate in training, calibration, and ongoing quality-review activities.

What You'll Bring

Native-level or professional fluency in Castilian Spanish.

Deep familiarity with the linguistic conventions, tone, idioms, and cultural context of Spanish as used in Spain.

Strong English reading comprehension, including the ability to understand detailed guidelines written in English.

Prior experience with side-by-side labeling, annotation, or comparative content evaluation.

Excellent analytical thinking and attention to detail.

Ability to identify subtle differences in quality, meaning, tone, and instruction-following.

Ability to learn and consistently apply structured evaluation frameworks.

Strong written communication and the ability to explain evaluation decisions clearly.

Ability to work independently while maintaining alignment with team quality standards.

Preferred Qualifications

Experience with AI response evaluation or model-quality assessment.

Experience with data labeling or annotation.

Experience evaluating search relevance, content quality, or user-facing digital experiences.

Training and Qualification

All new hires will complete a structured onboarding and qualification program that includes:

Training sessions and guided practice exercises.

Calibration against established quality benchmarks.

A qualification review before moving into production work.

Ongoing feedback and calibration to support consistency and quality.

Compensation

At Blueprint, we strive to offer competitive pay that reflects the value of our team members. Compensation for this role is influenced by a variety of factors, including skills, education, responsibilities, experience, and geographic market.

The anticipated compensation range is $38.46 to $40.87 USD per hour , with a midpoint of $39.66 USD per hour . Please note that we typically do not hire new employees at the top of the posted range. Actual starting pay will be determined based on experience, skills, and internal equity. The final compensation and job title may vary depending on the selected candidate’s qualifications.

Location and Work Arrangement

Remote within the United States.

Candidates must be authorized to work in the United States and reside within a U.S. time zone.

During the approximately 30-day training and qualification period, employees must work from 9:00 a.m. to 5:00 p.m. Pacific Time. After successfully completing training, employees may work standard business hours within their local time zone. Benefits

Blueprint believes that healthy, supported employees do their best work. Eligible employees have access to a comprehensive benefits package that may include:

Medical, dental, and vision coverage

Flexible Spending Account (FSA)

401(k) retirement plan

Competitive paid time off

Parental leave

Professional growth and development opportunities

Benefits and eligibility may vary based on role, employment status, and location.

Equal Employment Opportunity

Blueprint Technologies, LLC is an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, sex, pregnancy, childbirth or related medical conditions, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, marital or familial status, military or veteran status, citizenship status, or any other characteristic protected by applicable law.

Applicant Accommodations

If you need a reasonable accommodation to participate in any part of the application or interview process, please contact recruiting@bpcs.com.