Official codebase for Decision Transformer: Reinforcement Learning via Sequence Modeling.
Support
Quality
Security
License
Reuse
A neural network model for Chinese named entity recognition
Support
Quality
Security
License
Reuse
GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型
Support
Quality
Security
License
Reuse
该仓库主要记录 NLP 算法工程师相关的面试题
Support
Quality
Security
License
Reuse
A framework for few-shot evaluation of autoregressive language models.
Support
Quality
Security
License
Reuse
The implementation of DeBERTa
Support
Quality
Security
License
Reuse
[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang
Support
Quality
Security
License
Reuse
mt code
Support
Quality
Security
License
Reuse
中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（embeddings）和网络层（graph）构建基类，FastText，TextCNN，CharCNN，TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN
Support
Quality
Security
License
Reuse
Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
Support
Quality
Security
License
Reuse
jiant is an nlp toolkit
Support
Quality
Security
License
Reuse
Graphormer is a deep learning package that allows researchers and developers to train custom models for molecule modeling tasks. It aims to accelerate the research and application in AI for molecule science, such as material design, drug discovery, etc.
Support
Quality
Security
License
Reuse
A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
Support
Quality
Security
License
Reuse
Over TypeScript tool to use custom transformers in the tsconfig.json
Support
Quality
Security
License
Reuse
Swift Core ML 3 implementations of GPT-2, DistilGPT-2, BERT, and DistilBERT for Question answering. Other Transformers coming soon!
Support
Quality
Security
License
Reuse
T
Transformer-Explainabilityby hila-chefer
Jupyter Notebook 
1376 Version:Current License: Permissive (MIT)
[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.
Support
Quality
Security
License
Reuse
Super easy library for BERT based NLP models
Support
Quality
Security
License
Reuse
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
Support
Quality
Security
License
Reuse
CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition
Support
Quality
Security
License
Reuse
Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
Support
Quality
Security
License
Reuse
[CVPR-2023] Towards Any Structural Pruning; LLMs / Diffusion / YOLOv8 / CNNs / Transformers
Support
Quality
Security
License
Reuse
Safety helmet wearing detect dataset, with pretrained model
Support
Quality
Security
License
Reuse
Use Google's BERT for named entity recognition （CoNLL-2003 as the dataset）.
Support
Quality
Security
License
Reuse
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
Support
Quality
Security
License
Reuse
Codemod scripts to transform code to next generation JS
Support
Quality
Security
License
Reuse
pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。
Support
Quality
Security
License
Reuse
Transformer seq2seq model, program that can build a language translator from parallel corpus
Support
Quality
Security
License
Reuse
Korean BERT pre-trained cased (KoBERT)
Support
Quality
Security
License
Reuse
OpenAI ChatGPT, GPT-3 and DALL·E API wrapper for Go
Support
Quality
Security
License
Reuse
Russian GPT3 models.
Support
Quality
Security
License
Reuse
Fast, general, and tested differentiable structured prediction in PyTorch
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Support
Quality
Security
License
Reuse
A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021.
Support
Quality
Security
License
Reuse
A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
Support
Quality
Security
License
Reuse
Unsupervised Language Modeling at scale for robust sentiment classification
Support
Quality
Security
License
Reuse
t
transformers-interpretby cdpierse
Jupyter Notebook 1031 Version:Current License: Permissive (Apache-2.0)
Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.
Support
Quality
Security
License
Reuse
l
learn-nlp-with-transformersby datawhalechina
Shell 1017 Version:Current
License: No License (No License)
License: No License (No License)we want to create a repo to illustrate usage of transformers in chinese
Support
Quality
Security
License
Reuse
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
Support
Quality
Security
License
Reuse
Chinese Pre-Trained Language Models (CPM-LM) Version-I
Support
Quality
Security
License
Reuse
PyTorch Implementation of "Attention Is All You Need"
Support
Quality
Security
License
Reuse
This Word Does Not Exist
Support
Quality
Security
License
Reuse
Transform360 is an equirectangular to cubemap transform for 360 video.
Support
Quality
Security
License
Reuse
🤖💬 Transformer TTS: Implementation of a non-autoregressive Transformer based neural network for text to speech.
Support
Quality
Security
License
Reuse
TextBox 2.0 is a text generation library with pre-trained language models
Support
Quality
Security
License
Reuse
Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。
Support
Quality
Security
License
Reuse
An implementation of Performer, a linear attention-based transformer, in Pytorch
Support
Quality
Security
License
Reuse
b
bert_language_understandingby brightmart
Python 945 Version:Current License: No License (No License)
License: No License (No License)Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
Support
Quality
Security
License
Reuse
d
decision-transformerby kzl
Official codebase for Decision Transformer: Reinforcement Learning via Sequence Modeling.
Python 1695Updated: 12 mo ago License: Permissive (MIT)
1695Updated: 12 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
C
ChineseNERby zjy-ucas
A neural network model for Chinese named entity recognition
Python 1692Updated: 1 y ago License: No License (No License)
1692Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
g
gpt2-mlby imcaspar
GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型
Python 1682Updated: 11 mo ago License: Permissive (Apache-2.0)
1682Updated: 11 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
N
NLP-Interview-Notesby km1994
该仓库主要记录 NLP 算法工程师相关的面试题
Jupyter Notebook 1678Updated: 1 y ago License: No License (No License)
1678Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
l
lm-evaluation-harnessby EleutherAI
A framework for few-shot evaluation of autoregressive language models.
Python 1550Updated: 11 mo ago License: Permissive (MIT)
1550Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
D
DeBERTaby microsoft
The implementation of DeBERTa
Python 1542Updated: 12 mo ago License: Permissive (MIT)
1542Updated: 12 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
T
TransGANby VITA-Group
[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang
Python 1536Updated: 12 mo ago License: Proprietary (Proprietary)
1536Updated: 12 mo ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
m
Support
Quality
Security
License
Reuse
K
Keras-TextClassificationby yongzhuo
中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（embeddings）和网络层（graph）构建基类，FastText，TextCNN，CharCNN，TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN
Python 1530Updated: 11 mo ago License: Permissive (MIT)
1530Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
V
ViT-pytorchby jeonsworld
Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
Jupyter Notebook 1522Updated: 11 mo ago License: Permissive (MIT)
1522Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
j
Support
Quality
Security
License
Reuse
G
Graphormerby microsoft
Graphormer is a deep learning package that allows researchers and developers to train custom models for molecule modeling tasks. It aims to accelerate the research and application in AI for molecule science, such as material design, drug discovery, etc.
Python 1517Updated: 11 mo ago License: Permissive (MIT)
1517Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
C
CDial-GPTby thu-coai
A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models
Python 1506Updated: 11 mo ago License: Permissive (MIT)
1506Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
p
pegasusby google-research
Python 1491Updated: 12 mo ago License: Permissive (Apache-2.0)
1491Updated: 12 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
p
pytorch-openai-transformer-lmby huggingface
🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
Python 1456Updated: 11 mo ago License: Permissive (MIT)
1456Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
t
ttypescriptby cevek
Over TypeScript tool to use custom transformers in the tsconfig.json
TypeScript 1450Updated: 12 mo ago License: No License (No License)
1450Updated: 12 mo ago License: No License (No License)Support
Quality
Security
License
Reuse
s
swift-coreml-transformersby huggingface
Swift Core ML 3 implementations of GPT-2, DistilGPT-2, BERT, and DistilBERT for Question answering. Other Transformers coming soon!
Swift 1438Updated: 11 mo ago License: Permissive (Apache-2.0)
1438Updated: 11 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
T
Transformer-Explainabilityby hila-chefer
[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.
Jupyter Notebook 1376Updated: 11 mo ago License: Permissive (MIT)
1376Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
f
fast-bertby kaushaltrivedi
Super easy library for BERT based NLP models
Python 1372Updated: 4 y ago License: Permissive (Apache-2.0)
1372Updated: 4 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
T
TurboTransformersby Tencent
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
C++ 1322Updated: 11 mo ago License: Proprietary (Proprietary)
1322Updated: 11 mo ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
C
CLUENER2020by CLUEbenchmark
CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition
Python 1302Updated: 11 mo ago License: No License (No License)
1302Updated: 11 mo ago License: No License (No License)Support
Quality
Security
License
Reuse
C
Chinese-ELECTRAby ymcui
Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
Python 1289Updated: 11 mo ago License: Permissive (Apache-2.0)
1289Updated: 11 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
T
Torch-Pruningby VainF
[CVPR-2023] Towards Any Structural Pruning; LLMs / Diffusion / YOLOv8 / CNNs / Transformers
Python 1282Updated: 11 mo ago License: Permissive (MIT)
1282Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
S
Safety-Helmet-Wearing-Datasetby njvisionpower
Safety helmet wearing detect dataset, with pretrained model
Python 1242Updated: 11 mo ago License: Permissive (MIT)
1242Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
B
BERT-NERby kyzhouhzau
Use Google's BERT for named entity recognition （CoNLL-2003 as the dataset）.
Python 1176Updated: 1 y ago License: Permissive (MIT)
1176Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
s
sockeyeby awslabs
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
Python 1175Updated: 11 mo ago License: Permissive (Apache-2.0)
1175Updated: 11 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
j
js-codemodby cpojer
Codemod scripts to transform code to next generation JS
JavaScript 1171Updated: 1 y ago License: Permissive (MIT)
1171Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
b
bert_seq2seqby 920232796
pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。
Python 1158Updated: 11 mo ago License: Permissive (Apache-2.0)
1158Updated: 11 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
T
Transformerby SamLynnEvans
Transformer seq2seq model, program that can build a language translator from parallel corpus
Python 1123Updated: 11 mo ago License: Permissive (Apache-2.0)
1123Updated: 11 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
K
KoBERTby SKTBrain
Korean BERT pre-trained cased (KoBERT)
Jupyter Notebook 1115Updated: 12 mo ago License: Permissive (Apache-2.0)
1115Updated: 12 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
g
go-gpt3by sashabaranov
OpenAI ChatGPT, GPT-3 and DALL·E API wrapper for Go
Go 1114Updated: 1 y ago License: Permissive (Apache-2.0)
1114Updated: 1 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
r
ru-gptsby sberbank-ai
Russian GPT3 models.
Python 1084Updated: 3 y ago License: Permissive (Apache-2.0)
1084Updated: 3 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
p
pytorch-structby harvardnlp
Fast, general, and tested differentiable structured prediction in PyTorch
Jupyter Notebook 1069Updated: 1 y ago License: Permissive (MIT)
1069Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
m
multilingual-t5by google-research
Python 1068Updated: 1 y ago License: Permissive (Apache-2.0)
1068Updated: 1 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
T
T2T-ViTby yitu-opensource
ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Jupyter Notebook 1055Updated: 1 y ago License: Proprietary (Proprietary)
1055Updated: 1 y ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
c
contextualized-topic-modelsby MilaNLProc
A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021.
Python 1053Updated: 12 mo ago License: Permissive (MIT)
1053Updated: 12 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
p
pytorch-widedeepby jrzaurin
A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
Python 1049Updated: 12 mo ago License: Permissive (Apache-2.0)
1049Updated: 12 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
s
sentiment-discoveryby NVIDIA
Unsupervised Language Modeling at scale for robust sentiment classification
Python 1047Updated: 1 y ago License: Proprietary (Proprietary)
1047Updated: 1 y ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
t
transformers-interpretby cdpierse
Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.
Jupyter Notebook 1031Updated: 11 mo ago License: Permissive (Apache-2.0)
1031Updated: 11 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
l
learn-nlp-with-transformersby datawhalechina
we want to create a repo to illustrate usage of transformers in chinese
Shell 1017Updated: 11 mo ago License: No License (No License)
1017Updated: 11 mo ago License: No License (No License)Support
Quality
Security
License
Reuse
s
self-attention-cvby The-AI-Summer
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
Python 1008Updated: 1 y ago License: Permissive (MIT)
1008Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
C
CPM-Generateby TsinghuaAI
Chinese Pre-Trained Language Models (CPM-LM) Version-I
Python 997Updated: 3 y ago License: Permissive (MIT)
997Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
t
transformerby hyunwoongko
PyTorch Implementation of "Attention Is All You Need"
Python 995Updated: 11 mo ago License: No License (No License)
995Updated: 11 mo ago License: No License (No License)Support
Quality
Security
License
Reuse
t
this-word-does-not-existby turtlesoupy
This Word Does Not Exist
Python 992Updated: 12 mo ago License: Permissive (MIT)
992Updated: 12 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
t
transform360by facebook
Transform360 is an equirectangular to cubemap transform for 360 video.
C 979Updated: 12 mo ago License: Proprietary (Proprietary)
979Updated: 12 mo ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
T
TransformerTTSby as-ideas
🤖💬 Transformer TTS: Implementation of a non-autoregressive Transformer based neural network for text to speech.
Python 974Updated: 1 y ago License: Proprietary (Proprietary)
974Updated: 1 y ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
T
TextBoxby RUCAIBox
TextBox 2.0 is a text generation library with pre-trained language models
Python 974Updated: 11 mo ago License: Permissive (MIT)
974Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
G
GPT2-NewsTitleby liucongg
Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。
Python 963Updated: 11 mo ago License: Permissive (Apache-2.0)
963Updated: 11 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
p
performer-pytorchby lucidrains
An implementation of Performer, a linear attention-based transformer, in Pytorch
Python 956Updated: 11 mo ago License: Permissive (MIT)
956Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
b
bert_language_understandingby brightmart
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
Python 945Updated: 3 y ago License: No License (No License)
945Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse