task-spooler | A scheduler for GPU/CPU tasks | Continuous Deployment library
kandi X-RAY | task-spooler Summary
kandi X-RAY | task-spooler Summary
A CPU-only version that is more faithful to the original Task Spooler is being actively developed in here. task spooler is a Unix batch system where the tasks spooled run one after the other. The amount of jobs to run at once can be set at any time. Each user in each system has his own job queue. The tasks are run in the correct context (that of enqueue) from any shell/process, and its output/results can be easily watched. It is very useful when you know that your commands depend on a lot of RAM, a lot of disk use, give a lot of output, or for whatever reason it's better not to run them all at the same time, while you want to keep your resources busy for maximum benfit. Its interface allows using it easily in scripts. For your first contact, you can read an article at linux.com, which I like as overview, guide and examples (original url). On more advanced usage, don't neglect the TRICKS file in the package.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of task-spooler
task-spooler Key Features
task-spooler Examples and Code Snippets
usage: ts [action] [-ngfmdE] [-L ] [-D ] [cmd...]
Env vars:
TS_VISIBLE_DEVICES the GPU IDs that are visible to ts. Jobs will be run on these GPUs only.
TS_SOCKET the path to the unix socket used by the ts command.
TS_MAILTO where to mail the
git clone https://github.com/justanhduc/task-spooler
git checkout cpu-only
./install_cmake
./install_make
./reinstall
Community Discussions
Trending Discussions on task-spooler
QUESTION
I'm using task-spooler to queue up some video encoding tasks (See: http://manpages.ubuntu.com/manpages/artful/en/man1/tsp.1.html and http://vicerveza.homeunix.net/~viric/soft/ts/)
In order to select a specific queue (rather than the default per-user queue), the binary requires that you set an environment variable pointing to a socket. In my case: TS_SOCKET=/tmp/reencode.socket
. Then running tsp
shows the status of that specific queue.
This command works in the terminal, as any user: export TS_SOCKET=/tmp/reencode.socket ; tsp
I want to create a web-based status utility that shows this status. Using php on apache2, however, calling a bash script with exec()
with that same exact command does not work. Nor does putenv('TS_SOCKET=/tmp/reencode.socket'); echo exec('tsp');
I've alse tried echo `export TS_SOCKET=/tmp/reencode.socket ; tsp`
Running passthru('whoami')
on the server shows that it's running as user www-root
, the apache server user. If I log in as that user and run the command, it works fine as expected.
Interestingly, if I run the php interactive shell (php -a
), I can do any of the above php code and it works just fine, so it seems to be some interaction with apache.
This is all running on Ubuntu 17.10 with PHP 7.1.11 on Apache 2.4.27
...ANSWER
Answered 2018-Feb-21 at 09:52Hm, this simple test case seems to work via apache + mod_php (7.0)
QUESTION
How can I check in shellscript (zsh) whether there are any unfinished task-spooler tasks?
I tried already passing ts
through grep but am not sure how expandable this would be.
ANSWER
Answered 2017-Jul-07 at 10:00ts -l | awk '$2 == "queued" || $2 == "running" { print $0 }'
QUESTION
Some command I use (task-spooler) produces text in table format and with some fields as filenames
I'd like to pipe the output of that command to generate a HTML file, s.t. I can click on the filename in the browser, and it would open in a new browser tab.
I am guessing, I should have some way to detect filenames and wrap them as file://x/y/z.txt
. Is there an easy way to make it from the bash command line?
ANSWER
Answered 2017-Mar-20 at 12:44You could use sed
. The regexp here is very simple and will likely require tweaking depending on your particular data.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install task-spooler
Cannot find CUDA: Did you set a CUDA_HOME flag?
/usr/bin/ld: cannot find -lnvidia-ml: This lib lies in $CUDA_HOME/lib64/stubs. Please append this path to LD_LIBRARY_PATH. Sometimes, this problem persists even after adding the lib path. Then one can add -L$(CUDA_HOME)/lib64/stubs to this line in the Makefile.
list.c:22:5: error: implicitly declaring library function 'snprintf' with type 'int (char *, unsigned long, const char *, ...)': Please remove -D_XOPEN_SOURCE=500 -D__STRICT_ANSI__ in the Makefile as reported here.
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page