Compensation
Job description
Compensation is competitive and varies based on location, education level, and prior
experience.
Role Description
In this hourly, remote contractor role, you will review AI-generated legal analyses and/or generate expert legal content, evaluating reasoning quality and step-by-step issue-spotting while providing precise written feedback. You will assess answers for accuracy, clarity, and adherence to the prompt; identify errors in legal methodology or doctrine; fact-check citations and stated rules; write high-quality explanations and model solutions; and rate and compare multiple responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world's largest AI companies and foundation-model labs. Your legal expertise directly helps improve the world's premier AI models by making their legal reasoning more accurate, reliable, and clearly explained.
Your Profile
Bachelor's degree (or higher) in Law (JD/LLB), Legal Studies, Public Policy, or Political Science, with strong grounding in Constitutional Law, Contracts, Torts, Criminal Law, Civil Procedure, and Regulatory/Administrative Law.
Strong legal reasoning and issue-spotting skills, including statutory interpretation, case analysis, and translating facts into elements and defenses.
Fluent in compliance concepts, rights & obligations analysis, and policy frameworks; able to identify missing facts and assumptions that change outcomes.
Exceptional attention to detail when checking rule statements, citations, jurisdictional relevance, procedural posture, and logical consistency; Minimum C1 English proficiency.
Able to write clear, structured feedback that explains errors and the correct reasoning path without unnecessary verbosity.
Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
Previous experience with AI data training/annotation, expert review, legal editing, or QA is strongly preferred.
Key Responsibilities
Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects.
Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance.
Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases.
Show more Show less