presto-admin | A tool to install , configure and manage Presto installations
kandi X-RAY | presto-admin Summary
kandi X-RAY | presto-admin Summary
A tool to install, configure and manage Presto installations
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Parse command line options
- Update the environment
- Handle generic set env variables
- Returns the config callback for the given commands
- Install a rpm
- Get the path to the rpm rpm
- Check if the RPM is corrupted
- Return the latest rpm to use
- Upgrade the RPM file
- Add a jar to the plugin
- Returns a list of all available versions
- Return a copy of the presto environment
- Log exception
- Set environment variables from conf dict
- Return the leader configuration
- Configure worker configuration
- Set coordinator configuration
- Uninstall the rpm package
- Restart the server
- Validate the configuration
- Uninstall package
- Run tasks
- Show configuration information
- Return the exit code of the task
- Collects the external ip of the node
- Upgrade the package
presto-admin Key Features
presto-admin Examples and Code Snippets
Community Discussions
Trending Discussions on presto-admin
QUESTION
We not configured in our presto workers the parameter - query.max-memory-per-node
From the log seems that the value for query.max-memory-per-node
is set automatically
ANSWER
Answered 2019-Aug-08 at 18:17The default for query.max-memory-per-node
is 10% of the available heap memory. The default for this property is set here:
IIRC we set the default value so you could have a few large queries running in a cluster. The exact number isn't clear from this value alone. If you take a look at the configurations in the file linked above you will see that the system first reserves 30% of the heap for "unaccounted memory allocations", because Presto doesn't track all allocations. Then the query.max-memory-per-node
is only a limit on "user" memory, which is memory controllable by the query author such as group by
and join
hash tables. This value does not include input and output buffers which are automatically managed by Presto.
With all of that put together, I would expect with the default values you can run 3-5 large queries concurrently on the code.
As for how you want to set these, it really depends on your workload. If you expect to have a large mixed workload, the defaults may work for you. If you want to be able to dedicate the entire cluster to a single worker, you can increase the values to near the heap size (make sure to leave head room for untracked allocations).
QUESTION
I started my cluster as follows:
...ANSWER
Answered 2018-Sep-05 at 12:12This did it for me.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install presto-admin
You can use presto-admin like any standard Python library. You will need to make sure that you have a development environment consisting of a Python distribution including header files, a compiler, pip, and git installed. Make sure that your pip, setuptools, and wheel are up to date. When using pip it is generally recommended to install packages in a virtual environment to avoid changes to the system.
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page