dask-labextension | JupyterLab extension for Dask | Code Editor library
kandi X-RAY | dask-labextension Summary
kandi X-RAY | dask-labextension Summary
This package provides a JupyterLab extension to manage Dask clusters, as well as embed Dask's dashboard plots directly into JupyterLab panes.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Return a copy of the cmdclass
- Build a ConfigParser from a root directory
- Get the project root directory
- Extract the version information
- Create the versioneer config file
- Close all clusters
- Close a cluster
- Install versioneer
- Get a single plot
- Normalize dashboard link
- Get version information
- Scans the setup py file and checks if it is missing
- Get the keywords from the given versionfile
dask-labextension Key Features
dask-labextension Examples and Code Snippets
Community Discussions
Trending Discussions on dask-labextension
QUESTION
I'm interested in running a Dask cluster on EMR and interacting with it from inside of a Jupyter Lab notebook running on a separate EC2 instance (e.g. an EC2 instance not within the cluster and not managed by EMR).
The Dask documentation points to dask-labextension
as the tool of choice for this use case. dask-labextension
relies on a YAML config file (and/or some environment vars) to understand how to talk to the cluster. However, as far as I can tell, this configuration can only be set to point to a local Dask cluster. In other words, you must be in a Jupyter Lab notebook running on an instance within the cluster (presumably on the master instance?) in order to use this extension.
Is my read correct? Is it not currently possible to use dask-labextension
with an external Dask cluster?
ANSWER
Answered 2020-Jun-27 at 16:03Dask Labextension can talk to any Dask cluster that is visible from where your web client is running. If you can connect to a dashboard in a web browser then you can copy that same address to the Dask-Labextension search bar and it will connect.
QUESTION
I have the following basic code which (I thought) should set up xarray to use a LocalCluster.
...ANSWER
Answered 2020-Jun-13 at 15:59When you create a Dask Client it automatically registers itself as the default way to run Dask computations.
You can check to see if an object is a Dask collection with the dask.is_dask_collection
function. As you say, I believe that xr.open_mfdataset
uses Dask by default, but this would be a good way to check.
As to why you're not seeing anything on the dashboard, I unfortunately don't know enough about your situation to be able to help you there.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install dask-labextension
As described in the JupyterLab documentation for a development install of the labextension you can run the following in this directory:.
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page