DataMunging | Scripts that clean up OCR and munge Hathi metadata

by tedunderwood Python Version: Current License: No License

X-Ray Key Features Code Snippets Community Discussions(1)Vulnerabilities Install Support

kandi X-RAY | DataMunging Summary

DataMunging is a Python library. DataMunging has no bugs, it has no vulnerabilities and it has low support. However DataMunging build file is not available. You can download it from GitHub.

This repo contains scripts (mostly in Python 3) for correcting OCR and wrangling metadata drawn from HathiTrust. But let's be frank: very little of this is plug-and-play. It's a view inside a messy workshop. Maybe, at best, it's a collection of resources you could cannibalize to build your own workflow. For that reason, I suspect the most useful part of this may be the lexicographic guidelines gathered as /rulesets.

Support

Quality

Security

License

Reuse

Support

DataMunging has a low active ecosystem.

It has 61 star(s) with 15 fork(s). There are 11 watchers for this library.

It had no major release in the last 6 months.

There are 1 open issues and 0 have been closed. On average issues are closed in 2030 days. There are no pull requests.

It has a neutral sentiment in the developer community.

The latest version of DataMunging is current.

Quality

DataMunging has 0 bugs and 0 code smells.

Security

DataMunging has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

DataMunging code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

DataMunging does not have a standard license declared.

Check the repository for any license declaration and review the terms closely.

Without a license, all rights are reserved, and you cannot use the library in your applications.

Reuse

DataMunging releases are not available. You will need to build from source code and install.

DataMunging has no build file. You will be need to create the build yourself to build the component from source.

DataMunging saves you 4072 person hours of effort in developing the same functionality from scratch.

It has 8655 lines of code, 219 functions and 57 files.

It has high code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi has reviewed DataMunging and discovered the below as its top functions. This is intended to give you an instant insight into DataMunging implemented functionality, and help decide if they suit your requirements.

Corrects the words in the stream
Return arabic digits
Check if the given AST string is a word
Check if the given string is non -umeric
Convert a pagelist into a stream
Compute the standard deviation of a list
Return a list of headers from a pagelist
Processes a single file
Return the path to pairtree_root
Given a tokenstream and a list of punctuation marks and punctuation marks
Normalize volume
Correct the words in the stream
Checkumcroncron checksum
Get the metadata evidence for a given volume
Read a TSV file
Parse a MARC record string
Return the path to a pairtree
Determines the types of a volume
Load the pathDictionary
Read genremap file
Reads index from file
Calculate accuracy
Spell check the string
Count phrases in a token stream
Parse MARC
Calls catch_ambiguities
Import rules from rules file
Keep hyphens in words

Get all kandi verified functions for this library.

DataMunging Key Features

No Key Features are available at this moment for DataMunging.

DataMunging Examples and Code Snippets

No Code Snippets are available at this moment for DataMunging.

Community Discussions

Trending Discussions on DataMunging

"BokehUserWarning: ColumnDataSource's columns must be of the same length"

QUESTION

"BokehUserWarning: ColumnDataSource's columns must be of the same length"

Asked 2019-Apr-17 at 13:53

I am trying to plot a fairly big amount of data reaching back all the way to the year 1998.

My code seems to work fine, but when run throws the error message "BokehUserWarning: ColumnDataSource's columns must be of the same length"

Here is my code:

...

ANSWER

Answered 2017-Jun-29 at 16:05

I assume the validation error comes from the length of your x and y series being different. The output is probably cutting off the overhanging section of the longer array, if that makes sense.

You don't "have to" create a ColumnDataSource manually (one is created internally when you pass arrays to a glyph method like line), but it has some validation stuff that helps prevent this situation.

You can create a ColumnDataSource directly from a dataframe via:

Source https://stackoverflow.com/questions/44823050

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install DataMunging

You can download it from GitHub.
You can use DataMunging like any standard Python library. You will need to make sure that you have a development environment consisting of a Python distribution including header files, a compiler, pip, and git installed. Make sure that your pip, setuptools, and wheel are up to date. When using pip it is generally recommended to install packages in a virtual environment to avoid changes to the system.

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: