Rose_arch on directories

Rose Rose Support
1

Hi,

Trying to use rose_arch to transfer the cylc log directories from our HPC to JASMIN using gridftp. Is there a way to get rose_arch to pick up directories not files. Giving globus-url-copy a long list of files as sources doesn’t work. At the moment I’ve only managed to get it to tar up the log/job/${ROSE_TASK_CYCLE_TIME} directory and transfer. Ideally we don’t want to tar up as we’ll have to then immediately untar the lot in order to analyse.

Am I missing a trick?

[arch]
command-format=globus-url-copy -vb -cd -r -rst -rst-retries 5 -cc 4 -sync -cred /path/to/cred.jasmin %(sources)s %(target)s
target-prefix=gsiftp://gridftp1.jasmin.ac.uk/path/to/dest/logs/${CYLC_SUITE_NAME}/
source=job/${ROSE_TASK_CYCLE_TIME}
source-prefix=log/
update-check=mtime+size

Thanks.
Cheers,
Ros.

2

Sorry, according to the documentation I think rose_arch is designed to work with files, not directories. You’ll need to use a script rather that a Rose app in this case.