Popular repositories Loading
Repositories
-
- dist_moe Public
Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-compute kernels for training and inference on SM100+ GPUs
- torchinfer Public
PyTorch inference enablement and optimization solution for serving DLRMv3 https//mlcommons.org/2026/02/dlrmv3-inference-meta/ model families
- MSLK Public
MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI training and inference, such as FP8 row-wise quantization and collective communications.
-
- torchcodec Public
Media decoding and encoding for PyTorch: videos, images, and audio, on CPU and GPU.
- tritonbench Public
Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
