Library for fast text representation and classification.

fastText is a library for efficient learning of word representations and sentence classification. 

Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.

Multilingual text (NLP) processing toolkit 

💫 Industrial-strength Natural Language Processing (NLP) in Python

spaCy is a library for advanced Natural Language Processing in Python and Cython. It's built on the very latest research, and was designed from day one to be used in real products. spaCy comes with pretrained pipelines and currently supports tokenization and training for 60+ languages. It features state-of-the-art speed and neural network models for tagging, parsing, named entity recognition, text classification and more, multi-task learning with pretrained transformers like BERT, as well as a production-ready training system and easy model packaging, deployment and workflow management. spaCy is commercial open-source software, released under the MIT license. Support for 60+ languages Trained pipelines for different languages and tasks Multi-task learning with pretrained transformers like BERT Support for pretrained word vectors and embeddings State-of-the-art speed Production-ready training system Linguistically-motivated tokenization Components for named entity recognition, part-of-speech-tagging, dependency parsing, sentence segmentation, text classification, lemmatization, morphological analysis, entity linking and more Easily extensible with custom components and attributes Support for custom models in PyTorch, TensorFlow and other frameworks Built in visualizers for syntax and NER Easy model packaging, deployment and workflow management Robust, rigorously evaluated accuracy 

Port of Google's language-detection library to Python.

Port of Nakatani Shuyo's language-detection library (version from 03/03/2014) to Python. 

Detect the programming language of a source code

Guesslang detects the programming language of a given source code:. 

Python3 bindings for the Compact Language Detector v3 (CLD3)

This package contains Python bindings (via Cython) to Google's CLD3 library. The library outputs BCP-47-style language codes. For some languages, output is differentiated by script. Language and script names from Unicode CLDR. It supports over 100 languages/scripts. See full list of supported languages/scripts in Google's CLD3 documentation. 

Language identification based on fasttext (lid.176.ftz https://fasttext.cc/docs/en/language-identification.html). The lid.176.ftz file is licensed under Creative Commons Attribution-Share-Alike License 3.0 and is not part of this module. It is automatically downloaded from its external origin on the first run of this module. This module attempts to immitate the follow two features of langid. langid.classify: fastlid langid.set_languages(langs=[...]): fastlid.set_languages = [...]  import fastlid fastlid.set_languages = ['nl','fr']) TODO: Commandline interface 

NLP Tools For Language Detection

NLP packages

fastTextby facebookresearch

fastTextby facebookresearch

TextBlobby sloria

TextBlobby sloria

polyglotby aboSamoor

polyglotby aboSamoor

spaCyby explosion

spaCyby explosion

Language detection packages

langdetectby Mimino666

langdetectby Mimino666

guesslangby yoeo

guesslangby yoeo

pycld3by bsolomon1124

pycld3by bsolomon1124

fast-langidby ffreemt

fast-langidby ffreemt