Senior Quality Auditor, Artificial General IntelligenceThe Senior Quality Auditor serves as a specialist who becomes the organization's deepest expert on 1-2 complex machine learning data workflows while maintaining hands‐on audit execution. This role within the Machine Learning Data Operations job family leads Quality Audit Design (QuAD) teams for high‐complexity workflows, handles the most ambiguous audit scenarios, and generates workflow‐specific quality analysis that drives customer insights and workflow optimization.Key job responsibilitiesWorkflow Expertise Development
Become the organization's deepest expert on 1-2 assigned complex workflows through intensive pilot participation and continuous learningParticipate in workflow pilots as an annotator to build foundational knowledge before production beginsDevelop comprehensive understanding of workflow conventions, edge cases, and quality requirements
Team Leadership
Lead QuAD teams of 3-5 Quality Auditors for Template 2 (High‐Engagement Support) workflowsProvide day‐to‐day leadership and make real‐time quality decisions during iteration phasesHandle escalations from team members and serve as the go‐to expert for workflow‐specific questionsMentor and develop Quality Auditor team members through coaching, feedback, and knowledge sharing
Audit Execution
Execute audits on the most ambiguous and complex scenarios, reducing escalations to Quality SpecialistsMaintain 60-70% hands‐on audit execution to preserve expertise required for real‐time decision‐makingValidate team audit decisions and ensure consistency across QuAD team membersSupport Template 1 workflows by auditing high‐complexity scenarios requiring specialized judgment
Analysis & Insights
Generate workflow‐specific deep dives and thematic analysis providing insights beyond convention adherence scoresIdentify error patterns, convention evolution, and areas of ambiguity within assigned workflowsProvide actionable recommendations for workflow optimization and quality improvementPartner with DSLs and customers on workflow‐specific quality insights
Strategic Collaboration
Provide input to audit strategy design led by Quality Specialist ICollaborate with Quality Specialists on cross‐workflow patterns and tactical improvementsParticipate in workflow design discussions with customers and stakeholdersSupport new‐tool onboarding for operationalized and bootstrapped interfacesTrack record of generating actionable insights from quality data.
Basic Qualifications
Bachelor's degree or equivalentBachelor's degree or equivalent2+ years of equivalent experienceExperience working with machine learning data workflows or similar technical domainsHands‐on experience in leadership and mentoringStrategic thinking about workflow optimization and process improvementEffective stakeholder communication skills with the ability to influence decision‐makers and customersDomain expertise in STEM, language, or technical domains highly valued.
Preferred Qualifications
Experience with explainable machine learning and artificial intelligence methodologies and toolsExperience in leadership roles, overseeing teams conducting data analysis, process improvements, creative problem solving, and cross‐functional collaborationExperience using data and metrics to drive actionable insights at scaleExperience that includes strong analytical skills, attention to detail, and effective communication abilitiesExperience handling administrative details independently, while exercising good judgment in keeping team members adequately informedFamiliarity with audit methodologies and quality frameworksExperience participating in pilot phases and workflow development.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.Job details
IND, TN, ChennaiCorporate Operations
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability or other legally protected status.#J-18808-Ljbffr