PpAt Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. /p h3What We Do /h3 pThe Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real‑world expertise from across the globe. /p h3About The Role /h3 pDesign realistic and structured evaluation scenarios for LLM‑based agents. Create test cases that simulate human‑performed tasks and define gold‑standard behavior to compare agent actions against. Ensure each scenario is clearly defined, well‑scored, easy to execute, and reusable. Require sharp analytical mindset, attention to detail, and interest in how AI agents make decisions. /p ul liCreate structured test cases that simulate complex human workflows. /li liDefine gold‑standard behavior and scoring logic to evaluate agent actions. /li liAnalyze agent logs, failure modes, and decision paths. /li liWork with code repositories and test frameworks to validate scenarios. /li liIterate on prompts, instructions, and test cases to improve clarity and difficulty. /li liEnsure scenarios are production‑ready, easy to run, and reusable. /li /ul h3How To Get Started /h3 pApply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you'll help shape the future of AI while ensuring technology benefits everyone. /p h3Requirements /h3 ul liBachelor's and/or Master's Degree in Computer Science, Software Engineering, Data Science / Data Analytics, Artificial Intelligence / Machine Learning, Computational Linguistics / NLP, Information Systems or related fields. /li liBackground in QA, software testing, data analysis, or NLP annotation. /li liGood understanding of test design principles (e.g., reproducibility, coverage, edge cases). /li liStrong written communication skills in English. /li liComfortable with structured formats like JSON/YAML for scenario description. /li liCan define expected agent behaviors (gold paths) and scoring logic. /li liBasic experience with Python and JavaScript. /li liCurious and open to working with AI‑generated content, agent logs, and prompt‑based behavior. /li /ul h3Nice to Have /h3 ul liExperience in writing manual or automated test cases. /li liFamiliarity with LLM capabilities and typical failure modes. /li liUnderstanding of scoring metrics (precision, recall, coverage, reward functions). /li /ul h3Benefits /h3 ul liGet paid for your expertise, with rates up to $30/hour depending on skills, experience, and project needs. /li liFlexible, remote, freelance project that fits around professional or academic commitments. /li liParticipate in an advanced AI project and gain valuable experience to enhance your portfolio. /li liInfluence how future AI models understand and communicate in your field of expertise. /li /ul h3Seniority level /h3 pEntry level /p h3Employment type /h3 pPart‑time /p h3Job function /h3 pOther /p h3Industries /h3 pIT Services and IT Consulting /p /p #J-18808-Ljbffr