By continuing you indicate that you have read and agree to our Terms of service and Privacy policy
Language identification can be an important step in a Natural Language Processing (NLP) problem. It involves trying to predict the natural language of a piece of text. It is important to know the language of the text before other actions (i.e. translation/ sentiment analysis) can be taken.
NLP packages
These are general NLP libraries that support language detection.
fastTextby facebookresearch
HTML 24135 Version:0.9.2
fastTextby facebookresearch
HTML 24135 Version:0.9.2 License: Permissive (MIT)
TextBlobby sloria
Python 8406 Version:0.17.1
TextBlobby sloria
Python 8406 Version:0.17.1 License: Permissive (MIT)
polyglotby aboSamoor
Python 2103 Version:16.7.4
polyglotby aboSamoor
Python 2103 Version:16.7.4 License: Others (Non-SPDX)
spaCyby explosion
Python 25129 Version:3.4.4
spaCyby explosion
Python 25129 Version:3.4.4 License: Permissive (MIT)
Language detection packages
These packages are specifically language detection. These make it faster and easier.
langdetectby Mimino666
Python 1376 Version:1.0.9
langdetectby Mimino666
Python 1376 Version:1.0.9 License: Others (Non-SPDX)
pycld3by bsolomon1124
C++ 72 Version:0.22
pycld3by bsolomon1124
C++ 72 Version:0.22 License: Permissive (Apache-2.0)
fast-langidby ffreemt
Python 0 Version:Current
fast-langidby ffreemt
Python 0 Version:Current License: No License
Open Weaver – Develop Applications Faster with Open Source