marklogic-contentpump | MarkLogic Contentpump

by marklogic Java Version: 10.0.10 License: Apache-2.0

X-Ray Key Features Code Snippets Community Discussions(1)Vulnerabilities Install Support

kandi X-RAY | marklogic-contentpump Summary

marklogic-contentpump is a Java library typically used in Big Data, Hadoop applications. marklogic-contentpump has no bugs, it has no vulnerabilities, it has build file available, it has a Permissive License and it has low support. You can download it from GitHub, Maven.

MarkLogic Content Pump (mlcp) is a command-line tool that provides the fastest way to import, export, and copy data to or from MarkLogic databases. Core features of mlcp include:. You can run mlcp across many threads on a single machine or across many nodes in a cluster. Mlcp can now run against MarkLogic clusters hosted on AWS/Azure. The MarkLogic Connector for Hadoop is an extension to Hadoop’s MapReduce framework that allows you to easily and efficiently communicate with a MarkLogic database from within a Hadoop job. From 10.0-5, Hadoop Connector is removed from a separate release, but mlcp still uses Hadoop Connector as an internal dependency.

Support

Quality

Security

License

Reuse

Support

marklogic-contentpump has a low active ecosystem.

It has 34 star(s) with 25 fork(s). There are 24 watchers for this library.

It had no major release in the last 12 months.

There are 33 open issues and 69 have been closed. On average issues are closed in 263 days. There are 5 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of marklogic-contentpump is 10.0.10

Quality

marklogic-contentpump has 0 bugs and 0 code smells.

Security

marklogic-contentpump has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

marklogic-contentpump code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

marklogic-contentpump is licensed under the Apache-2.0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

marklogic-contentpump releases are available to install and integrate.

Deployable package is available in Maven.

Build file is available. You can build the component from source.

Installation instructions, examples and code snippets are available.

marklogic-contentpump saves you 19653 person hours of effort in developing the same functionality from scratch.

It has 38854 lines of code, 1848 functions and 345 files.

It has high code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi has reviewed marklogic-contentpump and discovered the below as its top functions. This is intended to give you an instant insight into marklogic-contentpump implemented functionality, and help decide if they suit your requirements.

Get input splits
Append the query to the StringBuilder
Append the redact test query
Append namespace bindings
Find the next key value
Retrieve properties from configuration
Parse the metadata from the sequence
Initializes the split
Return a query input query based on the specified namespace
Runs the application maps
Create the appropriate Content
Gets the splits
Helper method to apply copying configuration options
Get next key value
Read the next record
Returns a string representing the xquery
Configure connection id
Closes all sessions
Write document
This method writes value to forest
Commits all pending sessions
Insert a batch
Apply filtering configuration options
Returns a list of InputSplits based on the job configuration
Deserialize this node
Initialize the graph version

Get all kandi verified functions for this library.

marklogic-contentpump Key Features

No Key Features are available at this moment for marklogic-contentpump.

marklogic-contentpump Examples and Code Snippets

No Code Snippets are available at this moment for marklogic-contentpump.

Community Discussions

Trending Discussions on marklogic-contentpump

How to add metadata to the document using marklogic mapreduce connector api

QUESTION

How to add metadata to the document using marklogic mapreduce connector api

Asked 2017-Jan-06 at 08:19

I wanted to write the document to marklogic database using marklogic mapreduce api, lets say here is the example. I wanted to add metadata to the document which i am writing it back to the marklogic database in the reducer -

...

ANSWER

Answered 2017-Jan-03 at 17:40

For Metadata, I am assuming you are talking about the document properties fragment. For background on document properties, please see here: https://docs.marklogic.com/guide/app-dev/properties#id_19516

For use in MarkLogic mapreduce, please see here (the output classes): https://docs.marklogic.com/guide/mapreduce/output#id_76625

I believe you need to extend/modify your example to also write content to the properties fragment using the PropertyOutputFormat class.

One of the sample applications in the same documentation is an example of saving content in the properties fragment. If, however, you would like to fast-track yourself by looking at some source code: see some examples - including writing to a document property fragment, see here: https://gist.github.com/evanlenz/2484318 - specifically LinkCountInProperty.java

Source https://stackoverflow.com/questions/41438808

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install marklogic-contentpump

Getting Started with mlcp
Steps to build mlcp:. The build writes to the respective deliverable directory under under the root directory marklogic-contentpump/. For information on contributing to this project see CONTRIBUTING.md. For information on working on development of this project see project wiki page.