What tech to run and monitor CRON jobs (Python, Node.js, C#)?
What tech to run and monitor CRON jobs (Python, Node.js, C#)?
Regarding monitoring: I've come to rely on healthchecks.io to ensure my cron jobs when like I expect.
Rundeck is a pretty good tool to schedule, save logs and the like.
At my work we have a rundeck server connect via ssh to differents vm and execute the script there, you can configure alarms, parallel execution, plenty of steps it's pretty good you should try it out.
How long of a job do you need to run?
We use Azure Timer Functions and/or Logic Apps to run and monitor our jobs. All of those languages are supported.
Jenkins can work quite well for this. It keeps logs, success/failure, has hooks for multiple notifications and etc.
A little overkill, but airflow. Free, has history, language agnostic, retries, can handle a large number of time based tasks.
crontab to run them
dogwrap (command-line tool for datadog) to monitor them