STACKzip | complements STACK , compressing data
kandi X-RAY | STACKzip Summary
kandi X-RAY | STACKzip Summary
STACKzip is a Python library. STACKzip has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. However STACKzip build file is not available. You can download it from GitHub.
STACKzip is a tool that complements STACK, compressing data collected by STACK and moving it to an archive drive. It also allows you to compress and move data collected by twitter-scraper-mongo. Compressing data often will use a lot of CPU. You may want to schedule STACKzip to run at a time when you expect your machine to have free CPU resources (using the time argument). STACKzip also uses nice to reduce its priority, so other processes will have first dibs on CPU time. STACKzip takes a number of CLI arguments. Those are described below, and you can get help with them by running python zipper.py --help.
STACKzip is a tool that complements STACK, compressing data collected by STACK and moving it to an archive drive. It also allows you to compress and move data collected by twitter-scraper-mongo. Compressing data often will use a lot of CPU. You may want to schedule STACKzip to run at a time when you expect your machine to have free CPU resources (using the time argument). STACKzip also uses nice to reduce its priority, so other processes will have first dibs on CPU time. STACKzip takes a number of CLI arguments. Those are described below, and you can get help with them by running python zipper.py --help.
Support
Quality
Security
License
Reuse
Support
STACKzip has a low active ecosystem.
It has 0 star(s) with 0 fork(s). There are no watchers for this library.
It had no major release in the last 6 months.
There are 2 open issues and 2 have been closed. On average issues are closed in 37 days. There are no pull requests.
It has a neutral sentiment in the developer community.
The latest version of STACKzip is current.
Quality
STACKzip has no bugs reported.
Security
STACKzip has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.
License
STACKzip is licensed under the MIT License. This license is Permissive.
Permissive licenses have the least restrictions, and you can use them in most projects.
Reuse
STACKzip releases are not available. You will need to build from source code and install.
STACKzip has no build file. You will be need to create the build yourself to build the component from source.
Installation instructions are available. Examples and code snippets are not available.
Top functions reviewed by kandi - BETA
kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of STACKzip
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of STACKzip
STACKzip Key Features
No Key Features are available at this moment for STACKzip.
STACKzip Examples and Code Snippets
No Code Snippets are available at this moment for STACKzip.
Community Discussions
No Community Discussions are available at this moment for STACKzip.Refer to stack overflow page for discussions.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install STACKzip
Clone the code to your server using git clone https://github.com/bitslabsyr/STACKzip.git.
Rename config_template.py to config.py. Then, modify several parameters in config.py: Modify the values in mongo_auth as appropriate. If your instance of Mongo is password-protected, make sure "AUTH" is true and specify the Mongo username and password. If your instance of Mongo is not password-protected, make sure "AUTH" is false.
Authenticate as a super-user to ensure that STACKzip can read and write all the files in the correct places with sudo su.
Run STACKzip with python3 zipper.py along with the arguments you want to use. Two arguments are required: Server name: "-n MyServerName" Hour (out of 24) when the archiving should happen: "-t 23" Five arguments are optional: Delete raw data files after they are compressed: "-d" Move the tar.gz file to the archive drive: "-a" NOTE: If you use this parameter, confirm that the archive drive path is correct. Use Mongo to identify active STACK projects and automatically find data for those projects: "-m" NOTE: If you use this parameter, STACKzip will assume that all of the data in active projects was collected with a single install of STACK. If you have data in different STACK installs, this option will not work correctly. NOTE: If you do not use this argument, you must specify the paths to the directories that contain data you want to compress. Specify directory where STACK is installed (if not /home/bits/stack): "-s /path/to/stack" NOTE: Providing this argument will overwrite the directory where STACKzip expects to find STACK. You can also change that default path in the code rather than providing it as a CLI argument. Provide the name of the log file: "-l logfile_name" NOTE: If you don't provide this argument, the log file will be called "zipper.log". NOTE: If you want to use STACKzip to zip data in more than one location on this machine, you can run multiple instances of zipper.py at the same time. If you do that, you must use this option or all but one of your instances of zipper will crash eventually. If you want to handle timeline data rather than data collected by STACK: Manual: "-M /path/to/timeline/data" Manual name: "-N timeline-data" NOTE: If you provide -M but not -N, STACKzip will throw an error and quit. STACKzip will continue to run with the settings you give it indefinitely, until you kill the process.
Rename config_template.py to config.py. Then, modify several parameters in config.py: Modify the values in mongo_auth as appropriate. If your instance of Mongo is password-protected, make sure "AUTH" is true and specify the Mongo username and password. If your instance of Mongo is not password-protected, make sure "AUTH" is false.
Authenticate as a super-user to ensure that STACKzip can read and write all the files in the correct places with sudo su.
Run STACKzip with python3 zipper.py along with the arguments you want to use. Two arguments are required: Server name: "-n MyServerName" Hour (out of 24) when the archiving should happen: "-t 23" Five arguments are optional: Delete raw data files after they are compressed: "-d" Move the tar.gz file to the archive drive: "-a" NOTE: If you use this parameter, confirm that the archive drive path is correct. Use Mongo to identify active STACK projects and automatically find data for those projects: "-m" NOTE: If you use this parameter, STACKzip will assume that all of the data in active projects was collected with a single install of STACK. If you have data in different STACK installs, this option will not work correctly. NOTE: If you do not use this argument, you must specify the paths to the directories that contain data you want to compress. Specify directory where STACK is installed (if not /home/bits/stack): "-s /path/to/stack" NOTE: Providing this argument will overwrite the directory where STACKzip expects to find STACK. You can also change that default path in the code rather than providing it as a CLI argument. Provide the name of the log file: "-l logfile_name" NOTE: If you don't provide this argument, the log file will be called "zipper.log". NOTE: If you want to use STACKzip to zip data in more than one location on this machine, you can run multiple instances of zipper.py at the same time. If you do that, you must use this option or all but one of your instances of zipper will crash eventually. If you want to handle timeline data rather than data collected by STACK: Manual: "-M /path/to/timeline/data" Manual name: "-N timeline-data" NOTE: If you provide -M but not -N, STACKzip will throw an error and quit. STACKzip will continue to run with the settings you give it indefinitely, until you kill the process.
Support
For any new features, suggestions and bugs create an issue on GitHub.
If you have any questions check and ask questions on community page Stack Overflow .
Find more information at:
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page