chronos | Fault tolerant job scheduler for Mesos | Cron Utils library
kandi X-RAY | chronos Summary
kandi X-RAY | chronos Summary
Chronos is a replacement for cron. It is a distributed and fault-tolerant scheduler that runs on top of Apache Mesos that can be used for job orchestration. It supports custom Mesos executors as well as the default command executor. Thus by default, Chronos executes sh (on most systems bash) scripts. Chronos can be used to interact with systems such as Hadoop (incl. EMR), even if the Mesos agents on which execution happens do not have Hadoop installed. Included wrapper scripts allow transfering files and executing them on a remote machine in the background and using asynchronous callbacks to notify Chronos of job completion or failures. Chronos is also natively able to schedule jobs that run inside Docker containers. Chronos has a number of advantages over regular cron. It allows you to schedule your jobs using ISO8601 repeating interval notation, which enables more flexibility in job scheduling. Chronos also supports the definition of jobs triggered by the completion of other jobs. It supports arbitrarily long dependency chains.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of chronos
chronos Key Features
chronos Examples and Code Snippets
Community Discussions
Trending Discussions on chronos
QUESTION
I'm trying to transfer some code I've previously written in python into C++, and I'm currently testing xtensor to see if it can be faster than numpy for doing what I need it to.
One of my functions takes a square matrix d and a scalar alpha, and performs the elementwise operation alpha/(alpha+d)
. Background: this function is used to test which value of alpha
is 'best', so it is in a loop where d
is always the same, but alpha
varies.
All of the following time scales are an average of 100 instances of running the function.
In numpy, it takes around 0.27 seconds to do this, and the code is as follows:
...ANSWER
Answered 2021-Apr-01 at 07:56A problem with the C++ implementation may be that it creates one or possibly even two temporary copies that could be avoided. The first copy comes from not passing the argument by reference (or perfect forwarding). Without looking at the rest of the code its hard to judge if this has an impact on the performance or not. The compiler may move d
into the method if its guaranteed to be not used after the method xk()
, but it is more likely to copy the data into d
.
To pass by reference, the method could be changed to
QUESTION
I am using Mesos 1.3.1 and Chronos in my local. I currently have 100 jobs scheduled every 30 minutes for testing.
Sometimes the tasks get stuck in RUNNING status forever until I restart the Mesos agent that the task is stuck. No agent restarted during this time.
I have tried to KILL the task but its status never gets updated to KILLED while the logs in Chronos say that successfully received the request. I have checked in Chronos that it did update the task as successful and end time is also correct but duration is ongoing and the task is still in RUNNING state.
Also the executor container is running forever for the task that are stuck. I have the executor container that will sleep for 20 seconds and set the offer_timeout to 30 seconds and executor_registration_timeout to 2 minutes.
I have also included Mesos reconciliation every 10 minutes but it updates the task as RUNNING every time.
I have also tried to force the task status to update again as FINISHED before the reconciliation but still not getting updated as FINISHED. It seems like the Mesos leader is not picking up the correct status for the stuck task.
I have tried to run with different task resource allocations (cpu: 0.5,0.75,1...) but does not solve the issue. I changed the number of jobs to 70 for every 30 minute but still happening. This issue is seen once per day which is very random and can happen to any job.
How can I remove this stuck task from the active tasks without restarting the Mesos agent? Is there a way to prevent this issue from happening?
...ANSWER
Answered 2021-Feb-23 at 04:41Currently there is a known issue in Docker in Linux where the process exited but docker container is still running. https://github.com/docker/for-linux/issues/779
Because of this, the executor containers are stuck in running state and Mesos is unable to update the task status.
My issue was similar to this: https://issues.apache.org/jira/browse/MESOS-9501?focusedCommentId=16806707&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16806707
The fix for the work around has been applied after 1.4.3 version. After upgrading the Mesos version this does not occur anymore.
QUESTION
How to find the local timezone offset in Rust? is there an easy way to find it without using a crate like Chronos?
...ANSWER
Answered 2021-Feb-04 at 14:20chrono::offset::Local
uses "the standard time
crate", so you can use that instead of chrono
if you want.
UtcOffset::try_current_local_offset()
should do what you need. Or try_local_offset_at()
if you need the offset as it is, was or will be at a particular moment.
If you want something from std
(or even core
), I don't think it exists. At least not in a platform-independent way.
QUESTION
Recently I installed Neverware's version of Chromium OS, called Cloudready, on VirtualBox 6.1, to develop Python apps for Chromebooks. This version of Chromium OS is 48.0.2564.116 developer build (newer versions won't install due to graphics incompatibilities). As I do not have a Google Account, I login into Chromium OS as Guest user (somehow I have administrative powers as Guest, which is good for my developmental purposes).
I found that Python 2.7.3 was preinstalled. I tried to install Python 3.6, and to do so, I tried to find the preinstalled package manager, which I eventually found. The package manager that is preinstalled (portage), doesn't install anything, because it gives errors similar to this one:
...ANSWER
Answered 2020-Oct-01 at 10:46There can be 2 possibilities:
1). The python3.6 is already installed.
QUESTION
In Typescript, I have a controller class that has a method that I want to run daily at 5am.
My first thought was to schedule something using node-cron or node-scheduler, but these seem to be strictly for node projects, not typescript.
What I need to happen is a) transpile my entire typescript project into node and then b) Run the method as scheduled.
There doesn't seem to be any explanation on how to do this though. The explanations I do see are all about running a node.js function on some schedule, such as this one: I need a Nodejs scheduler that allows for tasks at different intervals
The below code illustrates my best approximation at what I'm trying to do.
controller.ts
...ANSWER
Answered 2020-Nov-10 at 22:35QUESTION
I'm looking for solution that allow me to set lifecycle policy for object in minio storage.
What do I want?
I want to delete objects from minIO
storage after 30 min.
Possible, but not suitable solution
- Chronos +
mc rm -f --older-than 30m
. - AWS S3 Lifecycle rule (it doesn't allow to set lifecycle using minutes).
ANSWER
Answered 2020-Jul-29 at 03:54According to this minio
The lifecycle checks every 24 hours. So the 30 mins expiration won't work.
QUESTION
I'm learning F# and struggling trying to use discriminated unions. I have a simple case where I'm trying to use Map.map
on a simple discriminated union of the type Map but its saying there is a type mismatch. I'm basically just trying to use the type Prices as a Map
Here is a simplified example:
...ANSWER
Answered 2020-Jun-16 at 03:03You cannot "use Prices
as a Map
", because Prices
is not a Map
. The way you have defined it, Prices
is a different type, not at all the same as a Map
, but it contains an instance of a Map
inside it.
If this is indeed what you meant, then in order to get the Map
out of a Prices
value, you need to pattern-match on it. Like this:
QUESTION
I am running into composer/installation errrors on wamp64 setup on Windows 10... had this working previously on older app but now starting new app on 4.0.3 and running into dependency issues
Below is output - Any thoughts on why it's not finding any matching packages? the "myapp" folder is created and cakephp source is copied but then a number of dependencies show "no matching package found"
Can these packages be ignored? some, such as migrations fall under "require" in the composer.json
I have tried both the below command and composer create-project --prefer-dist "cakephp/app:^4.0" myapp
ANSWER
Answered 2020-Apr-14 at 20:38Installation issues turned out to be combination of things. First appears to be a reference to old package in cakephp's composer.json as noted by ndm here
second issue was due to issue with php 7.4.0 and the STNDIN not allowing for a response and throwing exception from composer as noted here and on stack overflow
Thanks for comments to help troubleshoot.
QUESTION
I'm trying to build a JavaFX project with NetBeans but when i run it i have a this :
...ANSWER
Answered 2018-Apr-27 at 18:59I assume the repository server was temporary not working correctly. At least I was able to download the file mentioned in the error message.
Unfortunately Maven caches not-found errors. There are a lot of questions on SO about resetting the cached state and force a re-download.
IMHO the easiest way is to delete all data of the problematic artifact from the local Maven repo which is localed in the subdirectory .m2/repository
in your user home directory.
Open the .m2/repository
and proceed to the path org/codehaus/mojo/exec-maven-plugin/
. There delete the subdirectory 1.2.1
and all contained files. Maven will automatically download them the next time they are required.
QUESTION
I changed the language of my datepicker but the message that appears is still in English. I know it is inside ngx-bootstrap / chronos / locale / locale.defaults.ts where it brings the following information
...ANSWER
Answered 2018-Jul-25 at 09:48I finally managed to do it :
You can import your LocaleData
object and the function defineLocale
:
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install chronos
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page