hdp-utils | HDP Utilities | Development Tools library

by dstreev Shell Version: Current License: Apache-2.0

X-Ray Key Features Code Snippets Community Discussions(5)Vulnerabilities Install Support

kandi X-RAY | hdp-utils Summary

hdp-utils is a Shell library typically used in Utilities, Development Tools applications. hdp-utils has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. You can download it from GitHub.

HDP Utilities

Support

Quality

Security

License

Reuse

Support

hdp-utils has a low active ecosystem.

It has 9 star(s) with 10 fork(s). There are 6 watchers for this library.

It had no major release in the last 6 months.

hdp-utils has no issues reported. There are 1 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of hdp-utils is current.

Quality

hdp-utils has no bugs reported.

Security

hdp-utils has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

License

hdp-utils is licensed under the Apache-2.0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

hdp-utils releases are not available. You will need to build from source code and install.

Top functions reviewed by kandi - BETA

kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of hdp-utils

Get all kandi verified functions for this library.

hdp-utils Key Features

No Key Features are available at this moment for hdp-utils.

hdp-utils Examples and Code Snippets

No Code Snippets are available at this moment for hdp-utils.

Community Discussions

Trending Discussions on hdp-utils

hadoop new version - HDP-2.6.3.0 failed because unnecessary repo file

Ambari agent is not exist

S3 NoSuchKey error accessing yum repository for Apache Ambari 2.5.1

BDB0091 DB_VERSION_MISMATCH: Database environment version mismatch with Ambari 2.4.2

Prevent Ambari agent overwriting repo files

QUESTION

hadoop new version - HDP-2.6.3.0 failed because unnecessary repo file

Asked 2018-Mar-28 at 09:25

we are trying to install the new hadoop version HDP version as scratch installation on our redhat machines ( redhat 7.3 version)

...

ANSWER

Answered 2018-Mar-28 at 09:25

TLDR;

You need to change the repository information in your hdp.repo file to match that of the new Ambari file before installing your packages. You can keep your custom baseurl but the repository id needs to match the new file.

Long Version:

There is an inconsistency between Ambari Blueprint and the Hortonworks repository files. Ambari Blueprint is using the following file to set up it's repositories: http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.3.0/HDP-2.6.3.0-235.xml

$ curl -sS http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.3.0/HDP-2.6.3.0-235.xml | grep "repoid" HDP-2.6 HDP-UTILS-1.1.0.21

Ambari automatically adds -repo-1 to the repoid before looking for the repositories on the target systems so we get:

HDP-2.6-repo-1
HDP-UTILS-1.1.0.21-repo-1

Hortonworks offer their own yum repo file here: http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.3.0/hdp.repo but the repository IDs are different:

$ curl -sS http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.3.0/hdp.repo | grep "[][]" [HDP-2.6.3.0] [HDP-UTILS-1.1.0.21]

If Ambari does not find the repository (which it doesn't because the IDs are different) then it adds it's own which breaks your setup.

Source https://stackoverflow.com/questions/48243423

QUESTION

Ambari agent is not exist

Asked 2017-Dec-02 at 21:37

I'm trying to setup the Ambari agent in each node in my cluster and it works fine for almost all my nodes unless one, when I try to retray the Ambari wizard to fix the problem for this one I get this error:

...

ANSWER

Answered 2017-Dec-02 at 21:35

Removing the agent then reinstalling the agent should resolve the issue. The following commands (run on the node that is failing to register) should achieve that:

Source https://stackoverflow.com/questions/47596487

QUESTION

S3 NoSuchKey error accessing yum repository for Apache Ambari 2.5.1

Asked 2017-Jul-20 at 04:45

I have built and installed Apache Ambari 2.5.1 in CentOS 6.9. (By Installation Guide for Ambari 2.5.1).

I opened the Ambari UI after started "ambari-server" and "ambari-agent". The default Apache Ambari 2.5.1 Public Repository is "http://s3.amazonaws.com/dev.hortonworks.com/HDP/centos6/2.x/BUILDS/2.6.3.0-63" and "http://s3.amazonaws.com/dev.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6". I opened the browser and input the url, The browser showed that the specified key does not exist. So I think that the Apache Ambari 2.5.1 Public Repository does not exist.

...

ANSWER

Answered 2017-Jul-19 at 06:35

These are in fact valid yum repositories. A yum repo can be served over HTTP. Ambari is using an AWS S3 bucket as a convenient way to serve files over HTTP as a yum repo.

The reason you can't easily see anything in your browser when you navigate to the URL is that S3 does not truly maintain files in a directory hierarchy like a traditional web server providing static content. Instead, it provides a mapping of keys to objects, and applications typically use a convention of a trailing / to simulate directories.

Even though the URL in your question doesn't serve meaningful content to a browser, we can use the AWS Command Line Interface to inspect the bucket. (The following output is trimmed for brevity.)

Source https://stackoverflow.com/questions/45180611

QUESTION

BDB0091 DB_VERSION_MISMATCH: Database environment version mismatch with Ambari 2.4.2

Asked 2017-Feb-15 at 09:32

I am deploying hadoop services on Centos 7.2 hosts through Ambari 2.4.2. When I get to the "Install, Start and Test" stage in the process, I get the following error:

...

ANSWER

Answered 2017-Feb-15 at 09:32

As DC/OS runs along with Ambari on my cluster machines, I found a solution in temporarily unsetting the LD_LIBRARY_PATH env var. As mentioned in https://dcosjira.atlassian.net/browse/DCOS-586, the cause of the problem is the DC/OS installer modifying LD_LIBRARY_PATH to have /opt/mesosphere/lib. With the next release of DC/OS (1.9) the path will no longer being modified by default.

Source https://stackoverflow.com/questions/42157057

QUESTION

Prevent Ambari agent overwriting repo files

Asked 2017-Jan-10 at 21:11

I am installing HDP components behind corporate firewall which need internet proxy for only hortonworks components while some of dependencies are available in private cloud. So need to set proxy specific to repos inside *.repo files. Installation through ambari agent overwrites repo files. Is there a config that I can specify in ambari-agent.ini to stop agent from overwriting repo file

...

ANSWER

Answered 2017-Jan-10 at 21:11

I ran into exactly the same problem and solved it setting up nginx to proxy connections to the hortonworks server and then updated the Ambari configurations to point to the proxy server for the HDP and HDP-UTILS repo configurations.

So, assuming that you are using nginx and that you can access it on your local/Hadoop network via http://myproxy:8888, add the following configuration block in your nginx.conf

Source https://stackoverflow.com/questions/41535708

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install hdp-utils

You can download it from GitHub.

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: