Replicate files without caching locally
Hello, I am replicating files from one SE to another with `dirac-dms-replicate-lfn`, and it seems like it is always using a local cache to store the transferred file. Is there any way to tell it to use a direct transfer between the two SEs instead of going via the local machine? Cheers Lukas -- Lukas KOCH Particle Physics Department STFC Rutherford Appleton Laboratory Mail: lukas.koch@stfc.ac.uk Tel: +44 (0) 1235 44 x6265
Hi Lukas, The dirac-dms-replicate-lfn command will always try to do a direct transfer (3rd party copy) between the SEs first before falling back to using the cache file (even if you explicitly include the cache file on the command line). If you're finding it's creating a local cache file, let me know the details (mainly the source & destination sites, although ideally the full output running with "-ddd" debugging flag) and I'll double check how they are configured. Regards, Simon On Thu, Jan 31, 2019 at 04:44:17PM +0000, Lukas Koch wrote:
Hello,
I am replicating files from one SE to another with `dirac-dms-replicate-lfn`, and it seems like it is always using a local cache to store the transferred file. Is there any way to tell it to use a direct transfer between the two SEs instead of going via the local machine?
Cheers Lukas
Hi Simon, that is interesting. I will have a look at the output of -ddd. I just assumed it is doing the local copy because it complained about there already being a file of the same name in the local directory (when not specifying a cache dir). Cheers Lukas Am 01/02/2019 um 12:07 schrieb Simon Fayer:
Hi Lukas,
The dirac-dms-replicate-lfn command will always try to do a direct transfer (3rd party copy) between the SEs first before falling back to using the cache file (even if you explicitly include the cache file on the command line).
If you're finding it's creating a local cache file, let me know the details (mainly the source & destination sites, although ideally the full output running with "-ddd" debugging flag) and I'll double check how they are configured.
Regards, Simon
On Thu, Jan 31, 2019 at 04:44:17PM +0000, Lukas Koch wrote:
Hello,
I am replicating files from one SE to another with `dirac-dms-replicate-lfn`, and it seems like it is always using a local cache to store the transferred file. Is there any way to tell it to use a direct transfer between the two SEs instead of going via the local machine?
Cheers Lukas
-- Lukas KOCH Particle Physics Department STFC Rutherford Appleton Laboratory Mail: lukas.koch@stfc.ac.uk Tel: +44 (0) 1235 44 x6265
participants (2)
-
Lukas Koch
-
Simon Fayer