Ph3About The Job /h3pMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. /ppbPosition: /b Multilingual Prompt Designer /ppbType: /b Contract /ppbCompensation: /b $25–$30/hour /ppbLocation: /b Remote /ppbDuration: /b 2+ months /ppbCommitment: /b 20+ hours/week /ph3Role Responsibilities /h3ulliAuthor Italian/English prompt–golden answer pairs to train and evaluate advanced language models. /liliCreate detailed prompts in Italian and/or English with constraints and instructions, ensuring natural phrasing and relevance. /liliEstablish evaluation standards for correct responses in Italian contexts, developing rubrics for linguistic nuance and cultural conventions. /liliRun prompts through models, assessing outputs for accuracy, fluency, and cultural fit in Italian. /liliCollaborate in QA review processes to ensure consistency and reliability across Italian-language benchmarks. /liliWork independently and asynchronously to meet deadlines while improving AI model performance. /li /ulh3Qualifications /h3pbMust-Have /b /pulliNative-level fluency in Italian (written) with strong reading/writing ability in English. /liliBS or BA from a reputable institution (completed or in progress). /liliStrong writing and critical thinking skills. /liliAbility to work independently and meet deadlines. /liliFamiliarity with ChatGPT or similar tools. /liliBased in Italy or able to produce Italy-specific, culturally accurate Italian. /li /ulpbPreferred /b /pulliExperience in teaching, research, editing, or academic writing. /liliExperience creating evaluation criteria, rubrics, or grading guidelines. /liliFamiliarity with LLMs, prompting, or model evaluation. /li /ulh3Application Process /h3ulliComplete an AI-led interview (about 15 minutes). /liliComplete a 45-minute written assessment focused on writing and rubric creation. /liliIf selected, you will be invited to work on the project. /li /ulh3Resources Support /h3ulliFor details about the interview process and platform information, please check: /liliFor any help or support, reach out to: /li /ulpPS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. /p /p #J-18808-Ljbffr