2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: dirac.cfg should be at /user/paolo3/dirac_ui/diracos/etc/dirac.cfg

2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: CFG merged

2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: Updating configuration internals

Parsing command line

Trying to load Resources.LogBackends.StdoutBackend

Trying to load DIRAC.Resources.LogBackends.StdoutBackend

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Refreshing configuration...

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Refreshing from list ['dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server', 'dips://dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server', 'dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server']

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Randomized server list is dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server, dips://dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server, dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to refresh from dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server

2024-07-04 11:57:37 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Already given a valid url dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1c2:9135

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: New version available Updating to version 2024-07-04 11:09:18.197730...

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Updating configuration internals

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Updated to version 2024-07-04 11:09:18.197730

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.LogBackends.StdoutBackend

2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.LogBackends.StdoutBackend

2024-07-04 11:57:38 UTC dirac-dms-add-file/FileCatalogFactory [139702104819520] DEBUG: Creating FileCatalog client of type FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.Catalog.FileCatalogClient

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.Catalog.FileCatalogClient

2024-07-04 11:57:38 UTC dirac-dms-add-file/FileCatalogFactory [139702104819520] DEBUG: Loaded module FileCatalogClient

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] NOTICE:

Uploading /mu3e.org/user/p/paolo3/test/liv-test.txt

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197

2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: Checksum information not provided. Calculating adler32.

2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: Checksum calculated to be 3f560619.

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.Storage.GFAL2_XROOTStorage

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.Storage.GFAL2_XROOTStorage

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: no GFAL_CONFIG_DIR env var found, try to load configuration from default directory /user/paolo3/dirac_ui/diracos/etc/gfal2.d/

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//bdii.conf ...

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//dcap_plugin.conf ...

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//gfal2_core.conf ...

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//gsiftp_plugin.conf ...

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//http_plugin.conf ...

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//sftp_plugin.conf ...

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//srm_plugin.conf ...

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//x509.conf ...

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//xrootd_plugin.conf ...

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Using credentials from X509_USER_PROXY

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Certificate: /user/paolo3/.globus/x509up_u10546

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Private key: /user/paolo3/.globus/x509up_u10546

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: ... no GFAL_PLUGIN_DIR environment variable specified, try to load plugins in the default directory : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins/

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so loaded with success

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so loaded with success

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> [gridftp_plugin] try to load ..

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: define GSIFTP session re-use to TRUE

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> [gridftp_plugin] loaded ..

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so loaded with success

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Enable GRID profile for DAVIX

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Adding CA path /cvmfs/grid.cern.ch/etc/grid-security/certificates to valid CA path list

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Using X509_USER_PROXY to supply credentials: /user/paolo3/.globus/x509up_u10546

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: HTTP/SSL Session caching ENABLED

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Redirection Session caching DISABLED

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: libdavix path /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//../libdavix.so.0, version: 0.8.6

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Enable GRID profile for DAVIX

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Adding CA path /cvmfs/grid.cern.ch/etc/grid-security/certificates to valid CA path list

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Using X509_USER_PROXY to supply credentials: /user/paolo3/.globus/x509up_u10546

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so loaded with success

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so loaded with success

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so loaded with success

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so loaded with success

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: plugin priority order: dcap-2.21.3 -> file-2.21.3 -> gridftp-2.21.3 -> http-2.21.3 -> sftp-2.21.3 -> srm-2.21.3 -> xrootd-2.21.3 ->

2024-07-04 11:57:38 UTC dirac-dms-add-file/GFAL2_XROOTStorage [139702104819520] DEBUG: GFAL2_StorageBase: using None checksum

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: useCatalogURL: False

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localAccessProtocolList ['davs', 'https', 'root', 'dips', 'srm', 'gsiftp']

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localWriteProtocolList ['davs', 'https', 'root', 'srm', 'dips']

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localStageProtocolList ['davs', 'https', 'root', 'dips', 'srm', 'gsiftp']

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: preparing the execution of putFile

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: default argument sourceSize for putFile not present. Setting value 0.

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'putFile' operation with 1 lfns.

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/getStatus [139702104819520] DEBUG: determining status of UKI-NORTHGRID-LIV-HEP-disk.

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: check the operation: WriteAccess

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Filtering plugins for putFile (protocol = None ; inputProtocol = None)

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Allowed protocol: ['davs', 'https', 'root', 'srm', 'dips']

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Potential protocols ['davs', 'https', 'root', 'srm', 'dips']

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/LocalSE [139702104819520] DEBUG: Determining whether UKI-NORTHGRID-LIV-HEP-disk is a local SE.

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.DataManagementSystem.Utilities.DMSHelpers [139702104819520] DEBUG: Grid Types are: LCG, CLOUD, VAC

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugins to be used for putFile: ['AccessProtocol.1']

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Generating 1 protocol URLs for GFAL2_XROOT.

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__generateURLDict [139702104819520] DEBUG: generating url dict for 1 lfn in UKI-NORTHGRID-LIV-HEP-disk.

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._putSingleFile [139702104819520] DEBUG: trying to upload liv1-test.txt to root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> Gfal::Transfer::FileCopy

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ENTER

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ITEM file:///user/paolo3/mu3e/run/GRID/liv1-test.txt => root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:EXIT

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Copy job: tpc_only=0 tpc_delegation=1 tpc_timeout=310

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Impossible to get integer parameter XROOTD PLUGIN:PARALLEL_COPIES, set to default value 20, err Key file does not have key “PARALLEL_COPIES” in group “XROOTD PLUGIN”

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:ENTER file://localhost///user/paolo3/mu3e/run/GRID/liv1-test.txt?xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546&xrdcl.intent=tpc => root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094///dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt?xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546&xrdcl.intent=tpc

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:TYPE streamed

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:EXIT Job finished, [SUCCESS]

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: <- Gfal::Transfer::FileCopy

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._getSingleFileSize [139702104819520] DEBUG: Determining file size of root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt

2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._putSingleFile [139702104819520] DEBUG: destSize: 19, sourceSize: 19

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9133

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Concluding the sending and committing data operation to accounting

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing to accounting concluded

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/getURL [139702104819520] DEBUG: Getting accessUrl (['davs', 'https', 'root', 'gsiftp', 'srm', 'dips']) for lfn in UKI-NORTHGRID-LIV-HEP-disk.

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: preparing the execution of getTransportURL

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Generating 1 protocol URLs for GFAL2_XROOT.

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Concluding the sending and committing data operation to accounting

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing to accounting concluded

2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/registerFile [139702104819520] DEBUG: Attempting to register 1 files.

2024-07-04 11:57:38 UTC dirac-dms-add-file/FCConditionParser [139702104819520] DEBUG: Testing addFile on FileCatalog for 1 lfns

2024-07-04 11:57:38 UTC dirac-dms-add-file/FCConditionParser [139702104819520] DEBUG: Condition string: None

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog

2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197

2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing data operation to accounting

2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore

2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore

2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore

2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore

2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore

2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9133

2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Done committing to accounting

2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] VERBOSE: Committing data operation

2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] VERBOSE: Done committing

2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: putAndRegister: Sending took 0.1 seconds

2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] NOTICE: Successfully uploaded file to UKI-NORTHGRID-LIV-HEP-disk

Also

dirac-proxy-info

subject : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame/CN=5265876890/CN=1167453957

issuer : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame/CN=5265876890

identity : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame

timeleft : 22:36:44

DIRAC group : mu3e.org_user

path : /user/paolo3/.globus/x509up_u10546

username : paolo.beltrame

properties : NormalUser, JobSharing, AccountingMonitor

VOMS : True

VOMS fqan : ['/mu3e.org']

Seems to be OK.

I think there is a stupid bug in my code regarding the copy commands.

Cheers,

Paolo

___

L’amor che move il sole e l’altre stelle

(Paradiso, XXXIII, v. 145, Dante Alighieri)

Dr. Paolo Beltrame

University of Liverpool

Department of Physics

Oliver Lodge Laboratories (Room 223)
Oxford Street
Liverpool
L69 7ZE

Mobile: +39 (339) 1363133
Skype: fedro3

Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351

On 4 Jul 2024, at 12:14 PM, Daniela Bauer <daniela.bauer.grid@googlemail.com> wrote:

Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments.

Hi Paolo,

I have now been able to copy a file to the mu3e area at Liverpool. (I had to use the pilot proxy as I am not a member of mu3e.org).

Could you try to copy a file from your UI to /mu3e.org/user/p/paolo3/test/ with the debug options enabled, just so we can check your permissions ?

Example command:
dirac-dms-add-file -ddd /mu3e.org/user/p/paolo3/test/liv1-test.txt sometestfile UKI-NORTHGRID-LIV-HEP-disk

Please also send the output of dirac-proxy-info, though given that DIRAC let you submit a job, I would assume that's OK.

Thanks,

Daniela

On Thu, 4 Jul 2024 at 10:53, Daniela Bauer <daniela.bauer.grid@googlemail.com> wrote:

Actually I take it back, it looks like it's a DIRAC problem, but I haven't found the solution yet.

I can copy files to Liverpool by hand (even inside a DIRAC environment), but not when using the DIRAC tools.

Needless to say, we haven't had an update since May, and I don't know why it just broke.

I'll get back to you as soon as I have more information.

Apologies,

Daniela

On Thu, 4 Jul 2024 at 09:55, Daniela Bauer <daniela.bauer.grid@googlemail.com> wrote:

Hi,

The paths are what Liverpool is advertising, though it also seems to be advertising this to be a dCache SE. They also advertise support for the gridpp VO, but I get an authorisation error if I try.

@Paolo: I think this is a site issue. I will file a GGUS issue with the site and cc you on it, so you can see when it is resolved.

Daniela

On Wed, 3 Jul 2024 at 17:35, Beltrame, Paolo <Paolo.Beltrame@liverpool.ac.uk> wrote:

The job was running at site LCG.UKI-SCOTGRID-ECDF.uk

___

L’amor che move il sole e l’altre stelle

(Paradiso, XXXIII, v. 145, Dante Alighieri)

Dr. Paolo Beltrame

University of Liverpool

Department of Physics

Oliver Lodge Laboratories (Room 223)
Oxford Street
Liverpool
L69 7ZE

Mobile: +39 (339) 1363133
Skype: fedro3

Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351

On 3 Jul 2024, at 5:29 PM, Sam Skipsey <sskipsey@googlemail.com> wrote:

Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments.

So, those destination SFNs look weird and probably out of date - I suspect that root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ isn't what the uploader should be trying as a destination?

What node is this you are uploading from?

On Wed, 3 Jul 2024, 17:09 Beltrame, Paolo, <Paolo.Beltrame@liverpool.ac.uk> wrote:

This email from Paolo.Beltrame@liverpool.ac.uk originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list to disable email stamping for this address.

Dear all,

I have produced some files and I got error messages when I tried to copy them.

This is the error I get

Uploading /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root

Error: failed to upload /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root to UKI-NORTHGRID-LIV-HEP-disk: {'OK': False, 'Errno': 0, 'Message': "Failed to put file to Storage Element. Failed to copy ./data/mu3e_1E3_signal_run000001.root to srm://hepgrid11.ph.liv.\

ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: srm://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/\

p/paolo3/test', 93) Failed to copy ./data/mu3e_1E3_signal_run000001.root to root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: root\

://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test', 93)", 'CallStack': [' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file", line 8, in <module>\n sys.exit(main())\n', ' File "/cvmfs/dir\

ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py", line 74, in __call__\n return entrypointFunc._func()\n', ' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip\

ts/dirac_dms_add_file.py", line 107, in main\n res = dm.putAndRegister(lfn["lfn"], lfn["localfile"], lfn["SE"], lfn["guid"], overwrite=overwrite)\n', ' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client\

/DataManager.py", line 547, in putAndRegister\n return S_ERROR(f"{errStr} {res[\'Message\']}")\n’]}

Could you please help me in understanding… and possibly solving it.

Cheers,

Paolo

___

L’amor che move il sole e l’altre stelle

(Paradiso, XXXIII, v. 145, Dante Alighieri)

Dr. Paolo Beltrame

University of Liverpool

Department of Physics

Oliver Lodge Laboratories (Room 223)
Oxford Street
Liverpool
L69 7ZE

Mobile: +39 (339) 1363133
Skype: fedro3

Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351

--
_______________________________________________
Gridpp-Dirac-Users mailing list
Gridpp-Dirac-Users@imperial.ac.uk
https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

--
_______________________________________________
Gridpp-Dirac-Users mailing list
Gridpp-Dirac-Users@imperial.ac.uk
https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

--
_______________________________________________
Gridpp-Dirac-Users mailing list
Gridpp-Dirac-Users@imperial.ac.uk
https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

--
_______________________________________________
Gridpp-Dirac-Users mailing list
Gridpp-Dirac-Users@imperial.ac.uk
https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users