Software Engineer - PyTorch Compiler and Performance

New Today

Summary: We are seeking a talented Software Engineer to join our innovative PyTorch Compiler team. In this role, you will work on developing core technologies for PyTorch 2.0, enhancing machine learning compilers, and promoting the adoption of PT2 through engaging with other open-source and industry users. The PyTorch Compiler team is committed to making PyTorch run faster and more resource-efficient while maintaining its renowned flexibility and ease of use. Join us in our mission to solidify PT2 as the premier ML framework compiler in the industry. Responsibilities: Develop the PT2 compiler (including TorchDynamo, TorchInductor, Export, and PyTorch Core). Enhance PyTorch performance through systematic solutions for the community. Investigate the intersection of the PyTorch compiler and distributed systems. Optimize Generative AI models across all stages, including pre-training, fine-tuning, and inference. Collaborate with users to enable new use cases for PT2 technologies both within and outside of Meta. Minimum Qualifications: Proficient in Python or C++ programming. Bachelor's degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience. 4+ years of research or industry experience in developing compilers, machine learning systems, or GPU performance. Preferred Qualifications: Experience with developing PyTorch/PT2, Triton, MLIR, JAX, XLA, or TVM. Understanding of GPU architecture and high-performance kernel development. Experience building open-source communities and engaging with the machine learning systems domain on social media. Familiarity with training models, end-to-end model optimizations, and applying machine learning to systems. Knowledge of communication collectives, PyTorch distributed systems, and parallelism. Experience with other ML frameworks such as Caffe2, TensorFlow, ONNX, or TensorRT. Compensation: $85.10/hour to $251,000/year + bonus + equity + benefits. Meta is an Equal Opportunity and Affirmative Action employer. We do not discriminate based on race, religion, color, national origin, sex, sexual orientation, gender identity, gender expression, age, protected veteran status, disability, or other legally protected characteristics. Meta participates in the E-Verify program as required by law. We are committed to providing reasonable accommodations for candidates with disabilities throughout the recruiting process; please contact us at accommodations-ext@fb.com if you need assistance.
Apply
Location:
Sunnyvale, CA, United States
Category:
Computer And Mathematical Occupations

We found some similar jobs based on your search