Transformer Libraries - Page 2

Official codebase for Decision Transformer: Reinforcement Learning via Sequence Modeling.

Python 1695Updated: 2 y ago License: Permissive (MIT)

A neural network model for Chinese named entity recognition

Python 1692Updated: 2 y ago License: No License (No License)

GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型

Python 1682Updated: 2 y ago License: Permissive (Apache-2.0)

该仓库主要记录 NLP 算法工程师相关的面试题

Jupyter Notebook 1678Updated: 2 y ago License: No License (No License)

A framework for few-shot evaluation of autoregressive language models.

Python 1550Updated: 2 y ago License: Permissive (MIT)

The implementation of DeBERTa

Python 1542Updated: 2 y ago License: Permissive (MIT)

[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang

Python 1536Updated: 2 y ago License: Proprietary (Proprietary)

mt code

JavaScript 1534Updated: 2 y ago License: Permissive (MIT)

中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（embeddings）和网络层（graph）构建基类，FastText，TextCNN，CharCNN，TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN

Python 1530Updated: 2 y ago License: Permissive (MIT)

Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)

Jupyter Notebook 1522Updated: 2 y ago License: Permissive (MIT)

jiant is an nlp toolkit

Python 1519Updated: 2 y ago License: Permissive (MIT)

Graphormer is a deep learning package that allows researchers and developers to train custom models for molecule modeling tasks. It aims to accelerate the research and application in AI for molecule science, such as material design, drug discovery, etc.

Python 1517Updated: 2 y ago License: Permissive (MIT)

A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models

Python 1506Updated: 2 y ago License: Permissive (MIT)

Python 1491Updated: 2 y ago License: Permissive (Apache-2.0)

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

Python 1456Updated: 2 y ago License: Permissive (MIT)

Over TypeScript tool to use custom transformers in the tsconfig.json

TypeScript 1450Updated: 2 y ago License: No License (No License)

Swift Core ML 3 implementations of GPT-2, DistilGPT-2, BERT, and DistilBERT for Question answering. Other Transformers coming soon!

Swift 1438Updated: 2 y ago License: Permissive (Apache-2.0)

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

Jupyter Notebook 1376Updated: 2 y ago License: Permissive (MIT)

Super easy library for BERT based NLP models

Python 1372Updated: 5 y ago License: Permissive (Apache-2.0)

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

C++ 1322Updated: 2 y ago License: Proprietary (Proprietary)

CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition

Python 1302Updated: 2 y ago License: No License (No License)

Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）

Python 1289Updated: 2 y ago License: Permissive (Apache-2.0)

[CVPR-2023] Towards Any Structural Pruning; LLMs / Diffusion / YOLOv8 / CNNs / Transformers

Python 1282Updated: 2 y ago License: Permissive (MIT)

Safety helmet wearing detect dataset, with pretrained model

Python 1242Updated: 2 y ago License: Permissive (MIT)

Use Google's BERT for named entity recognition （CoNLL-2003 as the dataset）.

Python 1176Updated: 2 y ago License: Permissive (MIT)

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

Python 1175Updated: 2 y ago License: Permissive (Apache-2.0)

Codemod scripts to transform code to next generation JS

JavaScript 1171Updated: 2 y ago License: Permissive (MIT)

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

Python 1158Updated: 2 y ago License: Permissive (Apache-2.0)

Transformer seq2seq model, program that can build a language translator from parallel corpus

Python 1123Updated: 2 y ago License: Permissive (Apache-2.0)

Korean BERT pre-trained cased (KoBERT)

Jupyter Notebook 1115Updated: 2 y ago License: Permissive (Apache-2.0)

OpenAI ChatGPT, GPT-3 and DALL·E API wrapper for Go

Go 1114Updated: 2 y ago License: Permissive (Apache-2.0)

Russian GPT3 models.

Python 1084Updated: 4 y ago License: Permissive (Apache-2.0)

Fast, general, and tested differentiable structured prediction in PyTorch

Jupyter Notebook 1069Updated: 2 y ago License: Permissive (MIT)

Python 1068Updated: 2 y ago License: Permissive (Apache-2.0)

ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet

Jupyter Notebook 1055Updated: 2 y ago License: Proprietary (Proprietary)

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021.

Python 1053Updated: 2 y ago License: Permissive (MIT)

A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch

Python 1049Updated: 2 y ago License: Permissive (Apache-2.0)

Unsupervised Language Modeling at scale for robust sentiment classification

Python 1047Updated: 2 y ago License: Proprietary (Proprietary)

Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.

Jupyter Notebook 1031Updated: 2 y ago License: Permissive (Apache-2.0)

we want to create a repo to illustrate usage of transformers in chinese

Shell 1017Updated: 2 y ago License: No License (No License)

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

Python 1008Updated: 2 y ago License: Permissive (MIT)

Chinese Pre-Trained Language Models (CPM-LM) Version-I

Python 997Updated: 4 y ago License: Permissive (MIT)

PyTorch Implementation of "Attention Is All You Need"

Python 995Updated: 2 y ago License: No License (No License)

This Word Does Not Exist

Python 992Updated: 2 y ago License: Permissive (MIT)

Transform360 is an equirectangular to cubemap transform for 360 video.

C 979Updated: 2 y ago License: Proprietary (Proprietary)

🤖💬 Transformer TTS: Implementation of a non-autoregressive Transformer based neural network for text to speech.

Python 974Updated: 2 y ago License: Proprietary (Proprietary)

TextBox 2.0 is a text generation library with pre-trained language models

Python 974Updated: 2 y ago License: Permissive (MIT)

Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。

Python 963Updated: 2 y ago License: Permissive (Apache-2.0)

An implementation of Performer, a linear attention-based transformer, in Pytorch

Python 956Updated: 2 y ago License: Permissive (MIT)

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

Python 945Updated: 4 y ago License: No License (No License)