emr-bootstrap-actions | repository hold the Amazon Elastic MapReduce sample | AWS library

by aws-samples Shell Version: Current License: Non-SPDX

X-Ray Key Features Code Snippets Community Discussions(1)Vulnerabilities Install Support

kandi X-RAY | emr-bootstrap-actions Summary

emr-bootstrap-actions is a Shell library typically used in Cloud, AWS applications. emr-bootstrap-actions has no bugs, it has no vulnerabilities and it has low support. However emr-bootstrap-actions has a Non-SPDX License. You can download it from GitHub.

A bootstrap action is a shell script stored in [Amazon S3] that [Amazon EMR] executes on every node of your cluster. Bootstrap actions execute as the hadoop user by default; they execute with root privileges if you use sudo.From the [Ruby EMR Command Line Interface] you can reference a bootstrap action as follows:. For more information about EMR Bootstrap actions see [DeveloperGuide] The code samples in this repository are meant to illustrate how to setup popular applications on Amazon EMR using bootstrap actions. They are not meant to be run in production and all users should carefully inspect code samples before running them.

Support

Quality

Security

License

Reuse

Support

emr-bootstrap-actions has a low active ecosystem.

It has 612 star(s) with 314 fork(s). There are 79 watchers for this library.

It had no major release in the last 6 months.

There are 0 open issues and 90 have been closed. On average issues are closed in 2170 days. There are 3 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of emr-bootstrap-actions is current.

Quality

emr-bootstrap-actions has 0 bugs and 0 code smells.

Security

emr-bootstrap-actions has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

emr-bootstrap-actions code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

emr-bootstrap-actions has a Non-SPDX License.

Non-SPDX licenses can be open source with a non SPDX compliant license, or non open source licenses, and you need to review them closely before use.

Reuse

emr-bootstrap-actions releases are not available. You will need to build from source code and install.

Installation instructions are not available. Examples and code snippets are available.

emr-bootstrap-actions saves you 1318 person hours of effort in developing the same functionality from scratch.

It has 2957 lines of code, 141 functions and 35 files.

It has high code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi has reviewed emr-bootstrap-actions and discovered the below as its top functions. This is intended to give you an instant insight into emr-bootstrap-actions implemented functionality, and help decide if they suit your requirements.

Prepare the classpath .
Configure spark defaults .
Download and unpack and unpack files
Start Spark history server

Get all kandi verified functions for this library.

emr-bootstrap-actions Key Features

No Key Features are available at this moment for emr-bootstrap-actions.

emr-bootstrap-actions Examples and Code Snippets

No Code Snippets are available at this moment for emr-bootstrap-actions.

Community Discussions

Trending Discussions on emr-bootstrap-actions

Amazon EMR pip install in bootstrap actions runs OK but has no effect

QUESTION

Amazon EMR pip install in bootstrap actions runs OK but has no effect

Asked 2020-Dec-07 at 12:49

In Amazon EMR, I am using the following script as a custom bootstrap action to install python packages. The script runs OK (checked the logs, packages installed successfully) but when I open a notebook in Jupyter Lab, I cannot import any of them. If I open a terminal in JupyterLab and run pip list or pip3 list, none of my packages is there. Even if I go to / and run find . -name mleap for instance, it does not exist.

Something I have noticed is that on the master node, I am getting all the time an error saying bootstrap action 2 has failed (there is no second action, only one). According to this, it is a rare error which I get in all my clusters. However, my cluster eventually gets created and I can use it.

My script is called aws-emr-bootstrap-actions.sh

...

ANSWER

Answered 2020-Dec-07 at 12:49

The PYSPARK, Python interpreter that Spark is using, is different than the one to which the OP was installing the modules (as confirmed in comments).

Source https://stackoverflow.com/questions/65174150

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install emr-bootstrap-actions

You can download it from GitHub.

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: