Explore projects

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

an easy-to-use knn-mt toolkit

Optimized primitives for collective multi-GPU communication

SpikingJelly is an open-source deep learning framework for Spiking Neural Network (SNN) based on PyTorch.