If anyone’s interested, here’s a simple “Cylc 101” documented example - used for training at Earthsciences NZ recently - of how to automate the processing of many data files with Cylc.
- The full workflow config for processing any number of files through four scripts that take IO locations from the command line, is only 16 lines long - easy!
- We also extend the workflow a bit with alternative graph paths to automatically handle invalid data.
- The example will run out of the box with local background tasks.