🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Python Updated: 6 d ago License: Permissive
TensorFlow code and pre-trained models for BERT
Python Updated: 4 mo ago License: Permissive
Mapping a variable-length sentence to a fixed-length vector using BERT model
Python Updated: 5 mo ago License: Permissive
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
Python Updated: 12 d ago License: Permissive
Multilingual Sentence & Image Embeddings with BERT
Python Updated: 3 mo ago License: Permissive
TensorFlow Neural Machine Translation Tutorial
Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）
A PyTorch implementation of the Transformer model in "Attention is All You Need".
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Rust Updated: 3 mo ago License: Permissive
Code for the paper "Jukebox: A Generative Model for Music"
Python Updated: 4 mo ago License: Proprietary
Google AI 2018 BERT pytorch implementation
Python Updated: 6 mo ago License: Permissive
Chinese version of GPT2 training code, using BERT tokenizer.
A TensorFlow Implementation of the Transformer: Attention Is All You Need
A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
Python Updated: 6 mo ago License: No License
Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
Jupyter Notebook Updated: 4 mo ago License: Permissive
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
viewpager with parallax pages, together with vertical sliding (or click) and activity transition
Java Updated: 6 mo ago License: No License