cloudbreak | CDP Public Cloud is an integrated analytics

by hortonworks Java Version: 2.73.0-b61 License: Apache-2.0

X-Ray Key Features Code Snippets Community Discussions(5)Vulnerabilities Install Support

kandi X-RAY | cloudbreak Summary

cloudbreak is a Java library typically used in Big Data, Spark, Hadoop applications. cloudbreak has no bugs, it has no vulnerabilities, it has build file available, it has a Permissive License and it has high support. You can download it from GitHub.

CDP Public Cloud is an integrated analytics and data management platform deployed on cloud services. It offers broad data analytics and artificial intelligence functionality along with secure user access and data governance features.

Support

Quality

Security

License

Reuse

Support

cloudbreak has a highly active ecosystem.

It has 340 star(s) with 235 fork(s). There are 377 watchers for this library.

It had no major release in the last 6 months.

cloudbreak has no issues reported. There are 42 open pull requests and 0 closed requests.

It has a negative sentiment in the developer community.

The latest version of cloudbreak is 2.73.0-b61

Quality

cloudbreak has no bugs reported.

Security

cloudbreak has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

License

cloudbreak is licensed under the Apache-2.0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

cloudbreak releases are not available. You will need to build from source code and install.

Build file is available. You can build the component from source.

Installation instructions, examples and code snippets are available.

Top functions reviewed by kandi - BETA

kandi has reviewed cloudbreak and discovered the below as its top functions. This is intended to give you an instant insight into cloudbreak implemented functionality, and help decide if they suit your requirements.

Generates a platform recommendations for a blueprint .
update configs in template
Save load balancer metadata .
Resize a SDX cluster .
Gets the platform resource request .
Handles hardware info group response .
Launches a database .
Waits for a Cloudbreak cluster deletion .
Compares two strings .
Validate encryption parameters .

Get all kandi verified functions for this library.

cloudbreak Key Features

No Key Features are available at this moment for cloudbreak.

cloudbreak Examples and Code Snippets

No Code Snippets are available at this moment for cloudbreak.

Community Discussions

Trending Discussions on cloudbreak

Service accounts permissions

cbd generate - exec: not started

[Cloudbreak][EC2] Enable autoscaling feature

Ambari server doesn't restart after removing node with cloudbreak

Can't connect to kafka after updating from HDP 2.4 to HDP 2.5 on AWS EC2

QUESTION

Service accounts permissions

Asked 2020-Jan-17 at 14:40

I'm quite new to GCP. I have a service account with following roles: I created a json key for it and used it to authenticate a gcloud client. This client is running on an instance on that project on that service account. I seem not to have permissions for anything:

...

ANSWER

Answered 2019-May-03 at 08:22

There is a long standing bug in GCP in which deleting a service account and recreating it with the same name can cause issues with its permissions not being recognised. The behaviour you describe (creating a new service account with the same permissions and seeing it work) matches the symptoms of this bug.

Source https://stackoverflow.com/questions/55725726

QUESTION

cbd generate - exec: not started

Asked 2019-Jan-03 at 00:14

I followed this documentation to install Hortonworks cloudbreak.

Everything goes through fine as long as I create an instance on Azure and execute the commands specified.

Now I want to automate the installation of cloudbreak through Ansible. It's all simple commands, I could easily write the tasks in ansible but at the step cbd generate I see an error: "exec: not started"

This happens only when I am trying through ansible, If I try executing the commands manually, I can get the cloudbreak working.

I also tried using the shell module in ansible and copy paste the commands from the link and created the task. But it still gives the same problem. I am not able to proceed further from here.

Ansible version: 2.4.2.0
Cloudbreak Version: 2.7.0 (Latest is 2.7.1, We want to use 2.7.0)
OS: Tried both on Centos 7.3 and 7.4
Docker version: 1.13.1

Looking for a solution to this problem.

...

ANSWER

Answered 2018-Jul-19 at 06:18

Issue was with Disc mount script I was using in Automation. These are the steps I was following for Automation:

Create centos 7.3 instance on azure through Terraform
Run Ansible playbook to perform disc mount and install Hortonworks cloudbreak

There was an issue with /etc/fstab entry for the data disc, which is updated by the disc mount script. So when I try to execute 'cbd' command outside the data disc it went through fine. If I execute the command inside the data disc (In my case I had mounted the data disc on the path /media, So whenever I change the directory to media and execute cbd I could see the error cbd: exec not found)

**I corrected the fstab entry like below:

UUID={uuid_name} /media ext4 defaults 0 0**

Script was updating like below:

UUID={uuid_name} /media ext4 noatime,nodiratime,nodev,noexec,nosuid 1 2

Really not sure what made cbd not to work with fstab entries. After changing it to defaults I am able to get the Cloudbreak deployer working through Ansible.

Source https://stackoverflow.com/questions/51375378

QUESTION

[Cloudbreak][EC2] Enable autoscaling feature

Asked 2018-Jun-11 at 21:10

I am trying to setup autoscaling cluster on aws using cloudbreak.

I followed following links to setup cloudbreak, ambari and HDP.

https://hortonworks.github.io/cloudbreak-documentation/latest/aws-launch/index.html https://hortonworks.github.io/cloudbreak-documentation/latest/aws-create/index.html

I used community cloudbreak image(ami-82324cf8 - US East (N. Virginia)). My cloudbreak version is 2.2.0.

I am using replica of builtin blueprint(Data Science: Apache Spark 2.1, Apache Zeppelin 0.7.0)

Now, my problem is that I can't see autoscaling option in cloudbreak, there is an option of manually resizing my cluster under actions but I can't see any autoscaling option anywhere.

...

ANSWER

Answered 2018-Jun-11 at 21:10

I think that version of Cloudbreak UI does not support auto scaling.

Try 2.4 or newer.

This exact question was already answered here: https://community.hortonworks.com/questions/174055/cloudbreakec2-enable-autoscaling-feature.html

More detail about feature parity with older versions: https://community.hortonworks.com/questions/158833/auto-scaling-management-interface-in-the-cloudbrea.html

Source https://stackoverflow.com/questions/48902184

QUESTION

Ambari server doesn't restart after removing node with cloudbreak

Asked 2017-Aug-25 at 08:43

After adding a node to test scaling then removing that node with cloudbreak, the service ambari-server won't restart.

The error at launch is:

...

ANSWER

Answered 2017-Aug-25 at 08:43

I went deeper in my reasonning rather than just restarting postgres.

I opened the ambari table to look in it:

sudo su - postgres psql ambari -U ambari -W -p 5432 (password is bigdata)

and when I looked in tables topology_logical_request, topology_request and topology_hostgroup, I saw that the cluster register a remove request, only an adding request:

Source https://stackoverflow.com/questions/45877581

QUESTION

Can't connect to kafka after updating from HDP 2.4 to HDP 2.5 on AWS EC2

Asked 2017-Mar-25 at 18:21

I had a kafka producer project implemented on Sandbox 2.4 via Virtual box but since implemented this project on AWS EC2 (using Hortonworks cloudbreak). This has led me to upgrade to HDP 2.5 therefore switching from kafka 9 to kafka 10. I made the necessary dependency and IP(localhost) changes but am getting java.net.ConnectException: Connection timed out: no further information

The kafkaBroker internal ip is 10.0.75.111 and the sample kafka producer is below

...

ANSWER

Answered 2017-Mar-25 at 18:21

If you are sending data to your AWS setup cluster, you need to use the external IP addresses. However, if you run from the network you can use both.

In your case you seem to be running from outside the network. Try running using the public IP from outside/internal from the inside. That should get you going.

Source https://stackoverflow.com/questions/43004184

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install cloudbreak

As of now this document focuses on setting up your development environment on macOS. You’ll need Homebrew to install certain components in case you don’t have them already. To get Homebrew please follow the install instructions on the Homebrew homepage: https://brew.sh. As a prerequisite, you need to have Java 11 installed. You can choose from many options, including the Oracle JDK, Oracle OpenJDK, or an OpenJDK from any of several providers. For help in choosing your JDK, consult [Java is Still Free](https://medium.com/@javachampions/java-is-still-free-2-0-0-6b9aa8d6d244). You’ll need Docker. For Mac, use [Docker Desktop for Mac](https://docs.docker.com/docker-for-mac/install/). Please allocate at least 6 CPU and 12 GB Memory to the process. (Depends on that how many service running in your IntelliJ and in Docker containers).

Support

I would like to start by the warm welcome if you would like to contribute to our project, making our - and from the point of contribution, it’s yours also - goals closer. We’re happy for having your helpful intention to make this project greater than ever, but for this, I’d like to introduce you to some of our guidelines that you should follow for a successful contribution. When you would like to make a contribution you can do that by opening pull request against the desired version, but along with some very suggested guidelines not just for the sake of understandability but for having a properly combined request.

Find more information at: