Registering dark data -- how important is GUID?
Hello all, I am currently implementing a script to remotely register dark data (files present on a storage element, but not registered on the DFC). I am using the `registerFile` method of the `DataManager`, and have access to the files Adler32 checksums, but since they (generally) do not yet exist in the DFC, I do not know how to generate the GUID as it is done in the DIRAC source, i.e. from the md5 checksum. The SE in question does not support dynamic checksum calculation. Is the GUID important at all? It seems like I am able to register files with a GUID of 'None'. There seems to be a method to generate the GUID from the Adler32 sum, but those look kinda "degenerate" with lots of zeroes in them. Cheers Lukas -- Lukas KOCH Particle Physics Department STFC Rutherford Appleton Laboratory Mail: lukas.koch@stfc.ac.uk Tel: +44 (0) 1235 44 x6265
Hi Lukas, I found this in an old script: infoDict['GUID'] = str(uuid.uuid4()) I don't think the guid is important. Regards, Daniela On Fri, 1 Mar 2019 at 15:46, Lukas Koch <lukas.koch@stfc.ac.uk> wrote:
Hello all,
I am currently implementing a script to remotely register dark data (files present on a storage element, but not registered on the DFC). I am using the `registerFile` method of the `DataManager`, and have access to the files Adler32 checksums, but since they (generally) do not yet exist in the DFC, I do not know how to generate the GUID as it is done in the DIRAC source, i.e. from the md5 checksum. The SE in question does not support dynamic checksum calculation.
Is the GUID important at all? It seems like I am able to register files with a GUID of 'None'. There seems to be a method to generate the GUID from the Adler32 sum, but those look kinda "degenerate" with lots of zeroes in them.
Cheers Lukas
-- Lukas KOCH Particle Physics Department STFC Rutherford Appleton Laboratory Mail: lukas.koch@stfc.ac.uk Tel: +44 (0) 1235 44 x6265
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/
participants (2)
-
Daniela Bauer
-
Lukas Koch