Overview
The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium. The Acceleration Kernel Library team focuses on maximizing performance for AWS's custom ML accelerators. Engineers here craft high‑performance kernels for ML functions, combining deep hardware knowledge with ML expertise to push the boundaries of AI acceleration. The AWS Neuron SDK includes an ML compiler, runtime, and application framework that integrates with popular ML frameworks like PyTorch to deliver high performance for inference and training on AWS accelerators. This role sits at the intersection of machine learning, high‑performance computing, and distributed architectures, helping shape the future of AI acceleration technology. This is an opportunity to work on cutting‑edge products, architect and implement business‑critical features, publish cutting‑edge research, and mentor a team of engineers in a fast, innovative culture. The team collaborates closely with customers on model enablement, providing direct support and optimization expertise to ensure workloads run optimally on AWS ML accelerators.
Explore the product and our history: https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-guide/neuron-cc/index.html; https://aws.amazon.com/machine-learning/neuron/; https://github.com/aws/aws-neuron-sdk; https://www.amazon.science/how-silicon-innovation-became-the-secret-sauce-behind-awss-success
Key job responsibilities
* Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models.
* Analyze and optimize kernel-level performance across multiple generations of Neuron hardware.
* Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks.
* Implement compiler optimizations such as fusion, sharding, tiling, and scheduling.
* Work directly with customers to enable and optimize their ML models on AWS accelerators.
* Collaborate across teams to develop innovative kernel optimization techniques.
A day in the life
* Build high-impact solutions to deliver to our large customer base.
* Participate in design discussions, code review, and communicate with internal and external stakeholders.
* Work cross‑functionally to help drive business decisions with your technical input.
* Work in a startup‑like development environment, focusing on the most important tasks.
About the team
* Diverse Experiences: AWS values diverse experiences. We encourage candidates to apply even if you do not meet all listed qualifications.
* Why AWS: AWS is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and continue to innovate.
* Inclusive Team Culture: We embrace differences and maintain an inclusive culture with multiple affinity groups and ongoing learning experiences, guided by AWS Leadership Principles.
* Work / Life Balance: We value balance and offer flexible working hours.
* Mentorship & Career Growth: We support new members with mentorship and project assignments that foster growth.
Basic Qualifications
* 3+ years of non‑internship professional software development experience.
* 2+ years of non‑internship design or architecture experience (design patterns, reliability and scaling) of new and existing systems.
* Experience programming with at least one software programming language.
Preferred Qualifications
* 3+ years of full SDLC experience including coding standards, code reviews, source control, build processes, testing, and operations.
* Bachelor’s degree in computer science or equivalent.
Los Angeles County applicants: job duties include working safely, communicating effectively, and following laws and policies. Criminal history may affect employment opportunities. We will consider qualified applicants with arrest and conviction records per the Los Angeles County Fair Chance Ordinance.
Our inclusive culture empowers Amazonians to deliver the best results for customers. If the country / region you’re applying in isn’t listed, contact your Recruiting Partner.
Amazon is an equal‑opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Compensation reflects labor costs across US markets. The base pay for this position ranges from $129,300 / year to $223,600 / year, depending on location and experience. Amazon is a total compensation company with potential equity, sign‑on, and other benefits. For more information, visit https://www.aboutamazon.com/workplace/employee-benefits.
#J-18808-Ljbffr