technology logo
technology logo

VirtualAssistant Kit

share link

by rn8154 dot icon Updated: Oct 2, 2021

Solution Kit Solution Kit Β 

This starter kit has all the required kits/libraries for creating your own virtual assistant. It contains various kits for getting started such as follows: 1. Development environment 2. Exploratory data analysis 3. Machine learning 4. Text Mining 5. NLP - sentence embedding, cosine similarities

Development Environment

Jupyter notebook and vscode are used for development and are known as IDEs. To write any code it is necessary to have an development environment setup. Jupyter notebook is web based interactive environment.

notebookby jupyter

Jupyter Notebook doticonstar image 9901 doticonVersion:v7.0.0a18doticon
License: Permissive (BSD-3-Clause)

Jupyter Interactive Notebook

Support
    Quality
      Security
        License
          Reuse

            notebookby jupyter

            Jupyter Notebook doticon star image 9901 doticonVersion:v7.0.0a18doticon License: Permissive (BSD-3-Clause)

            Jupyter Interactive Notebook
            Support
              Quality
                Security
                  License
                    Reuse

                      vscodeby microsoft

                      TypeScript doticonstar image 144275 doticonVersion:1.77.0doticon
                      License: Permissive (MIT)

                      Visual Studio Code

                      Support
                        Quality
                          Security
                            License
                              Reuse

                                vscodeby microsoft

                                TypeScript doticon star image 144275 doticonVersion:1.77.0doticon License: Permissive (MIT)

                                Visual Studio Code
                                Support
                                  Quality
                                    Security
                                      License
                                        Reuse

                                          Exploratory data analysis

                                          Libraries that deal with arrays and help in data analysis for data engineering. Arrays can be manipulated meaning the dimensions, reshaping, etc.

                                          pandasby pandas-dev

                                          Python doticonstar image 37439 doticonVersion:v2.0.0rc1doticon
                                          License: Permissive (BSD-3-Clause)

                                          Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more

                                          Support
                                            Quality
                                              Security
                                                License
                                                  Reuse

                                                    pandasby pandas-dev

                                                    Python doticon star image 37439 doticonVersion:v2.0.0rc1doticon License: Permissive (BSD-3-Clause)

                                                    Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
                                                    Support
                                                      Quality
                                                        Security
                                                          License
                                                            Reuse

                                                              numpyby numpy

                                                              Python doticonstar image 23036 doticonVersion:v1.24.2doticon
                                                              License: Permissive (BSD-3-Clause)

                                                              The fundamental package for scientific computing with Python.

                                                              Support
                                                                Quality
                                                                  Security
                                                                    License
                                                                      Reuse

                                                                        numpyby numpy

                                                                        Python doticon star image 23036 doticonVersion:v1.24.2doticon License: Permissive (BSD-3-Clause)

                                                                        The fundamental package for scientific computing with Python.
                                                                        Support
                                                                          Quality
                                                                            Security
                                                                              License
                                                                                Reuse

                                                                                  Machine Learning

                                                                                  Basic machine learning libraries that creates a model and also trains the model using the dataset. Also is used for prediction purposes to test whether model trained is accurate or not.

                                                                                  faissby facebookresearch

                                                                                  C++ doticonstar image 20015 doticonVersion:v1.7.3doticon
                                                                                  License: Permissive (MIT)

                                                                                  A library for efficient similarity search and clustering of dense vectors.

                                                                                  Support
                                                                                    Quality
                                                                                      Security
                                                                                        License
                                                                                          Reuse

                                                                                            faissby facebookresearch

                                                                                            C++ doticon star image 20015 doticonVersion:v1.7.3doticon License: Permissive (MIT)

                                                                                            A library for efficient similarity search and clustering of dense vectors.
                                                                                            Support
                                                                                              Quality
                                                                                                Security
                                                                                                  License
                                                                                                    Reuse

                                                                                                      scikit-learnby scikit-learn

                                                                                                      Python doticonstar image 53572 doticonVersion:1.2.2doticon
                                                                                                      License: Permissive (BSD-3-Clause)

                                                                                                      scikit-learn: machine learning in Python

                                                                                                      Support
                                                                                                        Quality
                                                                                                          Security
                                                                                                            License
                                                                                                              Reuse

                                                                                                                scikit-learnby scikit-learn

                                                                                                                Python doticon star image 53572 doticonVersion:1.2.2doticon License: Permissive (BSD-3-Clause)

                                                                                                                scikit-learn: machine learning in Python
                                                                                                                Support
                                                                                                                  Quality
                                                                                                                    Security
                                                                                                                      License
                                                                                                                        Reuse

                                                                                                                          Exploratory data analysis

                                                                                                                          Libraries which are used for analysis and processing of unprocessed natural language.

                                                                                                                          spaCyby explosion

                                                                                                                          Python doticonstar image 25639 doticonVersion:v3.5.1doticon
                                                                                                                          License: Permissive (MIT)

                                                                                                                          πŸ’« Industrial-strength Natural Language Processing (NLP) in Python

                                                                                                                          Support
                                                                                                                            Quality
                                                                                                                              Security
                                                                                                                                License
                                                                                                                                  Reuse

                                                                                                                                    spaCyby explosion

                                                                                                                                    Python doticon star image 25639 doticonVersion:v3.5.1doticon License: Permissive (MIT)

                                                                                                                                    πŸ’« Industrial-strength Natural Language Processing (NLP) in Python
                                                                                                                                    Support
                                                                                                                                      Quality
                                                                                                                                        Security
                                                                                                                                          License
                                                                                                                                            Reuse

                                                                                                                                              nltkby nltk

                                                                                                                                              Python doticonstar image 11684 doticonVersion:Currentdoticon
                                                                                                                                              License: Permissive (Apache-2.0)

                                                                                                                                              NLTK Source

                                                                                                                                              Support
                                                                                                                                                Quality
                                                                                                                                                  Security
                                                                                                                                                    License
                                                                                                                                                      Reuse

                                                                                                                                                        nltkby nltk

                                                                                                                                                        Python doticon star image 11684 doticonVersion:Currentdoticon License: Permissive (Apache-2.0)

                                                                                                                                                        NLTK Source
                                                                                                                                                        Support
                                                                                                                                                          Quality
                                                                                                                                                            Security
                                                                                                                                                              License
                                                                                                                                                                Reuse

                                                                                                                                                                  NLP

                                                                                                                                                                  Libraries in this group are used to clean the dataset by removing all punctuations, digits, symbols, etc. After data preprocessing, the user query is compared with dataset queries via cosine similarity algorithm which will give us the record in dataset which is similar to user query.

                                                                                                                                                                  Python doticonstar image 9823 doticonVersion:v2.2.2doticon
                                                                                                                                                                  License: Permissive (Apache-2.0)

                                                                                                                                                                  Multilingual Sentence & Image Embeddings with BERT

                                                                                                                                                                  Support
                                                                                                                                                                    Quality
                                                                                                                                                                      Security
                                                                                                                                                                        License
                                                                                                                                                                          Reuse

                                                                                                                                                                            sentence-transformersby UKPLab

                                                                                                                                                                            Python doticon star image 9823 doticonVersion:v2.2.2doticon License: Permissive (Apache-2.0)

                                                                                                                                                                            Multilingual Sentence & Image Embeddings with BERT
                                                                                                                                                                            Support
                                                                                                                                                                              Quality
                                                                                                                                                                                Security
                                                                                                                                                                                  License
                                                                                                                                                                                    Reuse

                                                                                                                                                                                      bert-cosine-simby beekbin

                                                                                                                                                                                      Python doticonstar image 61 doticonVersion:Currentdoticon
                                                                                                                                                                                      no licences License: No License (null)

                                                                                                                                                                                      Fine-tune BERT to generate sentence embedding for cosine similarity

                                                                                                                                                                                      Support
                                                                                                                                                                                        Quality
                                                                                                                                                                                          Security
                                                                                                                                                                                            License
                                                                                                                                                                                              Reuse

                                                                                                                                                                                                bert-cosine-simby beekbin

                                                                                                                                                                                                Python doticon star image 61 doticonVersion:Currentdoticonno licences License: No License

                                                                                                                                                                                                Fine-tune BERT to generate sentence embedding for cosine similarity
                                                                                                                                                                                                Support
                                                                                                                                                                                                  Quality
                                                                                                                                                                                                    Security
                                                                                                                                                                                                      License
                                                                                                                                                                                                        Reuse