sumgram | text documents | Natural Language Processing library

by oduwsdl Python Version: 1.0.2 License: MIT

X-Ray Key Features Code Snippets(3)Community Discussions(1)Vulnerabilities Install Support

kandi X-RAY | sumgram Summary

sumgram is a Python library typically used in Artificial Intelligence, Natural Language Processing, Deep Learning applications. sumgram has no bugs, it has no vulnerabilities, it has build file available, it has a Permissive License and it has low support. You can install using 'pip install sumgram' or download it from GitHub, PyPI.

sumgram (see blogpost) is a tool that summarizes a collection of text documents by generating the most frequent "sumgrams" (conjoined ngrams) in the collection. Sumgrams are higher-order ngrams (e.g., "world health organization") generated by conjoining lower-order ngrams (e.g., "world health" and "health organization"). Unlike convention ngram generators that split multi-word proper nouns, sumgram works hard to avoid this by applying two (pos_glue_split_ngrams and mvg_window_glue_split_ngrams) algorithms. These algorithms enable sumgram to generate conjoined ngrams, or sumgrams of different ngram classes (bigrams, trigrams, k-grams, etc.) as part of the summary, instead of limiting the summary to a single ngram class (e.g., bigrams). From Fig. 1, the six-gram "centers for disease control and prevention" was split (stopwords removed) into 3 different bigrams ("centers disease," "disease control," and "control prevention") by a conventional algorithm that generates bigrams. But sumgram detected and "glued" such split ngrams.

Support

Quality

Security

License

Reuse

Support

sumgram has a low active ecosystem.

It has 44 star(s) with 11 fork(s). There are 10 watchers for this library.

It had no major release in the last 12 months.

There are 6 open issues and 9 have been closed. On average issues are closed in 327 days. There are no pull requests.

It has a neutral sentiment in the developer community.

The latest version of sumgram is 1.0.2

Quality

sumgram has 0 bugs and 0 code smells.

Security

sumgram has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

sumgram code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

sumgram is licensed under the MIT License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

sumgram releases are available to install and integrate.

Deployable package is available in PyPI.

Build file is available. You can build the component from source.

Installation instructions, examples and code snippets are available.

Top functions reviewed by kandi - BETA

kandi has reviewed sumgram and discovered the below as its top functions. This is intended to give you an instant insight into sumgram implemented functionality, and help decide if they suit your requirements.

Generic TextExtractor
Recursively read text from files
Helper function to create a text
Extract text from a gzip file
Generic exception info
Get top sumgrams
Extracts sentences from a document
Combine ngrams
Parse command line arguments
Get top sumgrams from doc_dct_lst
Set logger settings
Process log handler
Get text from folder
R ParallelTaskLists
Generic exception message
Parse arguments
Set log defaults
List all files in a folder
Get a list of all the user s stopwords

Get all kandi verified functions for this library.

sumgram Key Features

No Key Features are available at this moment for sumgram.

sumgram Examples and Code Snippets

Full usage

Python

Lines of Code : 46

License : Permissive (MIT)

Copy

sumgram [options] path/to/collection/of/text/files/

Options:
-n=2                                      The base n (int) for generating top sumgrams, if n = 2, bigrams become the base ngram

-d, --print-details                       Print details
-m,

Python script usage:

Python

Lines of Code : 26

License : Permissive (MIT)

Copy

params = {}
params['sentences_rank_count'] = 20  #For command line argument --sentences-rank-count

import json
from sumgram.sumgram import get_top_sumgrams

doc_lst = [
    {'id': 0, 'text': 'The eye of Category 4 Hurricane Harvey is now over Aransa

Generate top sumgrams from collection of URLs:

Python

Lines of Code : 16

License : Permissive (MIT)

Copy

import json
from NwalaTextUtils.textutils import parallelGetTxtFrmURIs
from sumgram.sumgram import get_top_sumgrams

ngram = 2
uris_lst = [
  'http://www.euro.who.int/en/health-topics/emergencies/pages/news/news/2015/03/united-kingdom-is-declared-fre

Community Discussions

Trending Discussions on sumgram

How to stop Java program when the user enters -1 into any inputs inside a loop?

QUESTION

How to stop Java program when the user enters -1 into any inputs inside a loop?

Asked 2022-Apr-15 at 22:46

I have a code where the user is asked to enter multiple values one after the other, this repeats for N number of users until (-1) is entered into any of the values inside the loop. Below is my code, without a loop because I'm not sure how to go about this, it's also without a counter to find out what N would be (i'll add it later).

...

ANSWER

Answered 2022-Apr-15 at 22:46

I'm not sure if I understood you correctly, but from what I understood is that you want to evaluate each time the user enters an input to make a decision wether to exit the application or continue the journey. If that's the case, you can sort of extend the function where you ask the user for the input and make a decision inside that function. Like this:

Source https://stackoverflow.com/questions/71889151

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install sumgram

OR install/run in locally built docker image. OR install/run from Dockerhub: coming soon.

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: