Problem in copying the files
******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Dear all, I have produced some files and I got error messages when I tried to copy them. This is the error I get Uploading /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root Error: failed to upload /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root to UKI-NORTHGRID-LIV-HEP-disk: {'OK': False, 'Errno': 0, 'Message': "Failed to put file to Storage Element. Failed to copy ./data/mu3e_1E3_signal_run000001.root to srm://hepgrid11.ph.liv.\ ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: srm://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/\ p/paolo3/test', 93) Failed to copy ./data/mu3e_1E3_signal_run000001.root to root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: root\ ://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test', 93)", 'CallStack': [' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file", line 8, in <module>\n sys.exit(main())\n', ' File "/cvmfs/dir\ ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py", line 74, in __call__\n return entrypointFunc._func()\n', ' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip\ ts/dirac_dms_add_file.py", line 107, in main\n res = dm.putAndRegister(lfn["lfn"], lfn["localfile"], lfn["SE"], lfn["guid"], overwrite=overwrite)\n', ' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client\ /DataManager.py", line 547, in putAndRegister\n return S_ERROR(f"{errStr} {res[\'Message\']}")\n’]} Could you please help me in understanding… and possibly solving it. Cheers, Paolo ___ L’amor che move il sole e l’altre stelle (Paradiso, XXXIII, v. 145, Dante Alighieri) Dr. Paolo Beltrame University of Liverpool Department of Physics<https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
So, those destination SFNs look weird and probably out of date - I suspect that root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ isn't what the uploader should be trying as a destination? What node is this you are uploading from? On Wed, 3 Jul 2024, 17:09 Beltrame, Paolo, <Paolo.Beltrame@liverpool.ac.uk> wrote:
This email from Paolo.Beltrame@liverpool.ac.uk originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list <https://spam.ic.ac.uk/SpamConsole/Senders.aspx> to disable email stamping for this address.
Dear all,
I have produced some files and I got error messages when I tried to copy them. This is the error I get
Uploading /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root
Error: failed to upload / mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root to UKI-NORTHGRID-LIV-HEP-disk: {'OK': False, 'Errno': 0, 'Message': "Failed to put file to Storage Element. Failed to copy ./data/mu3e_1E3_signal_run000001.root to srm://hepgrid11.ph.liv.\
ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: srm:// hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/\ <http://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/%5C>
p/paolo3/test', 93) Failed to copy ./data/mu3e_1E3_signal_run000001.root to root:// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: root\
:// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test', 93)", 'CallStack': [' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file", line 8, in <module>\n sys.exit(main())\n', ' File "/cvmfs/dir\
ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py", line 74, in __call__\n return entrypointFunc._func()\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip%5C>
ts/dirac_dms_add_file.py", line 107, in main\n res = dm.putAndRegister(lfn["lfn"], lfn["localfile"], lfn["SE"], lfn["guid"], overwrite=overwrite)\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client%5C>
/DataManager.py", line 547, in putAndRegister\n return S_ERROR(f"{errStr} {res[\'Message\']}")\n’]}
Could you please help me in understanding… and possibly solving it.
Cheers, Paolo
___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
The job was running at site LCG.UKI-SCOTGRID-ECDF.uk ___ L’amor che move il sole e l’altre stelle (Paradiso, XXXIII, v. 145, Dante Alighieri) Dr. Paolo Beltrame University of Liverpool Department of Physics<https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351 On 3 Jul 2024, at 5:29 PM, Sam Skipsey <sskipsey@googlemail.com> wrote: Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments. So, those destination SFNs look weird and probably out of date - I suspect that root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/<http://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/> isn't what the uploader should be trying as a destination? What node is this you are uploading from? On Wed, 3 Jul 2024, 17:09 Beltrame, Paolo, <Paolo.Beltrame@liverpool.ac.uk<mailto:Paolo.Beltrame@liverpool.ac.uk>> wrote: This email from Paolo.Beltrame@liverpool.ac.uk<mailto:Paolo.Beltrame@liverpool.ac.uk> originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list<https://spam.ic.ac.uk/SpamConsole/Senders.aspx> to disable email stamping for this address. Dear all, I have produced some files and I got error messages when I tried to copy them. This is the error I get Uploading /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root> Error: failed to upload /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root> to UKI-NORTHGRID-LIV-HEP-disk: {'OK': False, 'Errno': 0, 'Message': "Failed to put file to Storage Element. Failed to copy ./data/mu3e_1E3_signal_run000001.root to srm://hepgrid11.ph.liv.\ ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root>: GError('Protocol not supported or path/url invalid: srm://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/\<http://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/%5C> p/paolo3/test', 93) Failed to copy ./data/mu3e_1E3_signal_run000001.root to root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root>: GError('Protocol not supported or path/url invalid: root\ ://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test<http://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test>', 93)", 'CallStack': [' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file<http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file>", line 8, in <module>\n sys.exit(main())\n', ' File "/cvmfs/dir\ ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py<http://ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py>", line 74, in __call__\n return entrypointFunc._func()\n', ' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip\<http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip%5C> ts/dirac_dms_add_file.py", line 107, in main\n res = dm.putAndRegister(lfn["lfn"], lfn["localfile"], lfn["SE"], lfn["guid"], overwrite=overwrite)\n', ' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client\<http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client%5C> /DataManager.py", line 547, in putAndRegister\n return S_ERROR(f"{errStr} {res[\'Message\']}")\n’]} Could you please help me in understanding… and possibly solving it. Cheers, Paolo ___ L’amor che move il sole e l’altre stelle (Paradiso, XXXIII, v. 145, Dante Alighieri) Dr. Paolo Beltrame University of Liverpool Department of Physics<https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351 -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
Hi, The paths are what Liverpool is advertising, though it also seems to be advertising this to be a dCache SE. They also advertise support for the gridpp VO, but I get an authorisation error if I try. @Paolo: I think this is a site issue. I will file a GGUS issue with the site and cc you on it, so you can see when it is resolved. Daniela On Wed, 3 Jul 2024 at 17:35, Beltrame, Paolo <Paolo.Beltrame@liverpool.ac.uk> wrote:
The job was running at site LCG.UKI-SCOTGRID-ECDF.uk ___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
On 3 Jul 2024, at 5:29 PM, Sam Skipsey <sskipsey@googlemail.com> wrote:
Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments.
So, those destination SFNs look weird and probably out of date - I suspect that root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ isn't what the uploader should be trying as a destination?
What node is this you are uploading from?
On Wed, 3 Jul 2024, 17:09 Beltrame, Paolo, <Paolo.Beltrame@liverpool.ac.uk> wrote:
This email from Paolo.Beltrame@liverpool.ac.uk originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list <https://spam.ic.ac.uk/SpamConsole/Senders.aspx> to disable email stamping for this address.
Dear all,
I have produced some files and I got error messages when I tried to copy them. This is the error I get
Uploading /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root Error: failed to upload / mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root to UKI-NORTHGRID-LIV-HEP-disk: {'OK': False, 'Errno': 0, 'Message': "Failed to put file to Storage Element. Failed to copy ./data/mu3e_1E3_signal_run000001.root to srm://hepgrid11.ph.liv.\
ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: srm:// hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/\ <http://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/%5C> p/paolo3/test', 93) Failed to copy ./data/mu3e_1E3_signal_run000001.root to root:// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: root\ :// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test', 93)", 'CallStack': [' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file", line 8, in <module>\n sys.exit(main())\n', ' File "/cvmfs/dir\
ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py", line 74, in __call__\n return entrypointFunc._func()\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip%5C> ts/dirac_dms_add_file.py", line 107, in main\n res = dm.putAndRegister(lfn["lfn"], lfn["localfile"], lfn["SE"], lfn["guid"], overwrite=overwrite)\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client%5C> /DataManager.py", line 547, in putAndRegister\n return S_ERROR(f"{errStr} {res[\'Message\']}")\n’]}
Could you please help me in understanding… and possibly solving it.
Cheers, Paolo
___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
Actually I take it back, it looks like it's a DIRAC problem, but I haven't found the solution yet. I can copy files to Liverpool by hand (even inside a DIRAC environment), but not when using the DIRAC tools. Needless to say, we haven't had an update since May, and I don't know why it just broke. I'll get back to you as soon as I have more information. Apologies, Daniela On Thu, 4 Jul 2024 at 09:55, Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Hi,
The paths are what Liverpool is advertising, though it also seems to be advertising this to be a dCache SE. They also advertise support for the gridpp VO, but I get an authorisation error if I try. @Paolo: I think this is a site issue. I will file a GGUS issue with the site and cc you on it, so you can see when it is resolved.
Daniela
On Wed, 3 Jul 2024 at 17:35, Beltrame, Paolo < Paolo.Beltrame@liverpool.ac.uk> wrote:
The job was running at site LCG.UKI-SCOTGRID-ECDF.uk ___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
On 3 Jul 2024, at 5:29 PM, Sam Skipsey <sskipsey@googlemail.com> wrote:
Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments.
So, those destination SFNs look weird and probably out of date - I suspect that root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ isn't what the uploader should be trying as a destination?
What node is this you are uploading from?
On Wed, 3 Jul 2024, 17:09 Beltrame, Paolo, < Paolo.Beltrame@liverpool.ac.uk> wrote:
This email from Paolo.Beltrame@liverpool.ac.uk originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list <https://spam.ic.ac.uk/SpamConsole/Senders.aspx> to disable email stamping for this address.
Dear all,
I have produced some files and I got error messages when I tried to copy them. This is the error I get
Uploading /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root Error: failed to upload / mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root to UKI-NORTHGRID-LIV-HEP-disk: {'OK': False, 'Errno': 0, 'Message': "Failed to put file to Storage Element. Failed to copy ./data/mu3e_1E3_signal_run000001.root to srm://hepgrid11.ph.liv.\
ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: srm:// hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/\ <http://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/%5C> p/paolo3/test', 93) Failed to copy ./data/mu3e_1E3_signal_run000001.root to root:// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: root\ :// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test', 93)", 'CallStack': [' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file", line 8, in <module>\n sys.exit(main())\n', ' File "/cvmfs/dir\
ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py", line 74, in __call__\n return entrypointFunc._func()\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip%5C> ts/dirac_dms_add_file.py", line 107, in main\n res = dm.putAndRegister(lfn["lfn"], lfn["localfile"], lfn["SE"], lfn["guid"], overwrite=overwrite)\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client%5C> /DataManager.py", line 547, in putAndRegister\n return S_ERROR(f"{errStr} {res[\'Message\']}")\n’]}
Could you please help me in understanding… and possibly solving it.
Cheers, Paolo
___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
Hi Paolo, I have now been able to copy a file to the mu3e area at Liverpool. (I had to use the pilot proxy as I am not a member of mu3e.org). Could you try to copy a file from your UI to /mu3e.org/user/p/paolo3/test/ <http://mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root> with the debug options enabled, just so we can check your permissions ? Example command: dirac-dms-add-file -ddd /mu3e.org/user/p/paolo3/test/liv1-test.txt sometestfile UKI-NORTHGRID-LIV-HEP-disk Please also send the output of dirac-proxy-info, though given that DIRAC let you submit a job, I would assume that's OK. Thanks, Daniela On Thu, 4 Jul 2024 at 10:53, Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Actually I take it back, it looks like it's a DIRAC problem, but I haven't found the solution yet. I can copy files to Liverpool by hand (even inside a DIRAC environment), but not when using the DIRAC tools. Needless to say, we haven't had an update since May, and I don't know why it just broke.
I'll get back to you as soon as I have more information.
Apologies, Daniela
On Thu, 4 Jul 2024 at 09:55, Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Hi,
The paths are what Liverpool is advertising, though it also seems to be advertising this to be a dCache SE. They also advertise support for the gridpp VO, but I get an authorisation error if I try. @Paolo: I think this is a site issue. I will file a GGUS issue with the site and cc you on it, so you can see when it is resolved.
Daniela
On Wed, 3 Jul 2024 at 17:35, Beltrame, Paolo < Paolo.Beltrame@liverpool.ac.uk> wrote:
The job was running at site LCG.UKI-SCOTGRID-ECDF.uk ___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
On 3 Jul 2024, at 5:29 PM, Sam Skipsey <sskipsey@googlemail.com> wrote:
Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments.
So, those destination SFNs look weird and probably out of date - I suspect that root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ isn't what the uploader should be trying as a destination?
What node is this you are uploading from?
On Wed, 3 Jul 2024, 17:09 Beltrame, Paolo, < Paolo.Beltrame@liverpool.ac.uk> wrote:
This email from Paolo.Beltrame@liverpool.ac.uk originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list <https://spam.ic.ac.uk/SpamConsole/Senders.aspx> to disable email stamping for this address.
Dear all,
I have produced some files and I got error messages when I tried to copy them. This is the error I get
Uploading /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root Error: failed to upload / mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root to UKI-NORTHGRID-LIV-HEP-disk: {'OK': False, 'Errno': 0, 'Message': "Failed to put file to Storage Element. Failed to copy ./data/mu3e_1E3_signal_run000001.root to srm://hepgrid11.ph.liv.\
ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: srm:// hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/\ <http://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/%5C> p/paolo3/test', 93) Failed to copy ./data/mu3e_1E3_signal_run000001.root to root:// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: root\ :// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test', 93)", 'CallStack': [' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file", line 8, in <module>\n sys.exit(main())\n', ' File "/cvmfs/dir\
ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py", line 74, in __call__\n return entrypointFunc._func()\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip%5C> ts/dirac_dms_add_file.py", line 107, in main\n res = dm.putAndRegister(lfn["lfn"], lfn["localfile"], lfn["SE"], lfn["guid"], overwrite=overwrite)\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client%5C> /DataManager.py", line 547, in putAndRegister\n return S_ERROR(f"{errStr} {res[\'Message\']}")\n’]}
Could you please help me in understanding… and possibly solving it.
Cheers, Paolo
___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
Dear Daniela, Thank you I believe it works. 2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: dirac.cfg should be at /user/paolo3/dirac_ui/diracos/etc/dirac.cfg 2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: CFG merged 2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: Updating configuration internals 2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: Updating configuration internals Parsing command line Trying to load Resources.LogBackends.StdoutBackend Trying to load DIRAC.Resources.LogBackends.StdoutBackend 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Refreshing configuration... 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Refreshing from list ['dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server', 'dips://dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server', 'dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server'] 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Randomized server list is dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server, dips://dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server, dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to refresh from dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Already given a valid url dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1c2:9135 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: New version available Updating to version 2024-07-04 11:09:18.197730... 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Updating configuration internals 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Updated to version 2024-07-04 11:09:18.197730 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.LogBackends.StdoutBackend 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.LogBackends.StdoutBackend 2024-07-04 11:57:38 UTC dirac-dms-add-file/FileCatalogFactory [139702104819520] DEBUG: Creating FileCatalog client of type FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.Catalog.FileCatalogClient 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.Catalog.FileCatalogClient 2024-07-04 11:57:38 UTC dirac-dms-add-file/FileCatalogFactory [139702104819520] DEBUG: Loaded module FileCatalogClient 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] NOTICE: Uploading /mu3e.org/user/p/paolo3/test/liv-test.txt 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197 2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: Checksum information not provided. Calculating adler32. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: Checksum calculated to be 3f560619. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.Storage.GFAL2_XROOTStorage 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.Storage.GFAL2_XROOTStorage 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: no GFAL_CONFIG_DIR env var found, try to load configuration from default directory /user/paolo3/dirac_ui/diracos/etc/gfal2.d/ 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//bdii.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//dcap_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//gfal2_core.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//gsiftp_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//http_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//sftp_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//srm_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//x509.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//xrootd_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Using credentials from X509_USER_PROXY 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Certificate: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Private key: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: ... no GFAL_PLUGIN_DIR environment variable specified, try to load plugins in the default directory : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins/ 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> [gridftp_plugin] try to load .. 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: define GSIFTP session re-use to TRUE 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> [gridftp_plugin] loaded .. 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Enable GRID profile for DAVIX 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Adding CA path /cvmfs/grid.cern.ch/etc/grid-security/certificates to valid CA path list 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Using X509_USER_PROXY to supply credentials: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: HTTP/SSL Session caching ENABLED 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Redirection Session caching DISABLED 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: libdavix path /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//../libdavix.so.0, version: 0.8.6 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Enable GRID profile for DAVIX 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Adding CA path /cvmfs/grid.cern.ch/etc/grid-security/certificates to valid CA path list 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Using X509_USER_PROXY to supply credentials: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: plugin priority order: dcap-2.21.3 -> file-2.21.3 -> gridftp-2.21.3 -> http-2.21.3 -> sftp-2.21.3 -> srm-2.21.3 -> xrootd-2.21.3 -> 2024-07-04 11:57:38 UTC dirac-dms-add-file/GFAL2_XROOTStorage [139702104819520] DEBUG: GFAL2_StorageBase: using None checksum 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: useCatalogURL: False 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localAccessProtocolList ['davs', 'https', 'root', 'dips', 'srm', 'gsiftp'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localWriteProtocolList ['davs', 'https', 'root', 'srm', 'dips'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localStageProtocolList ['davs', 'https', 'root', 'dips', 'srm', 'gsiftp'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'None' 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: preparing the execution of putFile 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: default argument sourceSize for putFile not present. Setting value 0. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'putFile' operation with 1 lfns. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'putFile' 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/getStatus [139702104819520] DEBUG: determining status of UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: check the operation: WriteAccess 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Filtering plugins for putFile (protocol = None ; inputProtocol = None) 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Allowed protocol: ['davs', 'https', 'root', 'srm', 'dips'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Potential protocols ['davs', 'https', 'root', 'srm', 'dips'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/LocalSE [139702104819520] DEBUG: Determining whether UKI-NORTHGRID-LIV-HEP-disk is a local SE. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.DataManagementSystem.Utilities.DMSHelpers [139702104819520] DEBUG: Grid Types are: LCG, CLOUD, VAC 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugins to be used for putFile: ['AccessProtocol.1'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Generating 1 protocol URLs for GFAL2_XROOT. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__generateURLDict [139702104819520] DEBUG: generating url dict for 1 lfn in UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'putFile' for 1 physical files 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._putSingleFile [139702104819520] DEBUG: trying to upload liv1-test.txt to root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> Gfal::Transfer::FileCopy 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ENTER 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ITEM file:///user/paolo3/mu3e/run/GRID/liv1-test.txt => root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:EXIT 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Copy job: tpc_only=0 tpc_delegation=1 tpc_timeout=310 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Impossible to get integer parameter XROOTD PLUGIN:PARALLEL_COPIES, set to default value 20, err Key file does not have key “PARALLEL_COPIES” in group “XROOTD PLUGIN” 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:ENTER file://localhost///user/paolo3/mu3e/run/GRID/liv1-test.txt?xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546&xrdcl.intent=tpc => root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094///dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt?xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546&xrdcl.intent=tpc 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:TYPE streamed 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:EXIT Job finished, [SUCCESS] 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: <- Gfal::Transfer::FileCopy 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._getSingleFileSize [139702104819520] DEBUG: Determining file size of root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._putSingleFile [139702104819520] DEBUG: destSize: 19, sourceSize: 19 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9133 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Concluding the sending and committing data operation to accounting 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing to accounting concluded 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/getURL [139702104819520] DEBUG: Getting accessUrl (['davs', 'https', 'root', 'gsiftp', 'srm', 'dips']) for lfn in UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: preparing the execution of getTransportURL 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'getTransportURL' operation with 1 lfns. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'getTransportURL' 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Filtering plugins for getTransportURL (protocol = ['davs', 'https', 'root', 'gsiftp', 'srm', 'dips'] ; inputProtocol = None) 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugin GFAL2_XROOT can generate compatible protocol 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugins to be used for getTransportURL: ['AccessProtocol.1'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Generating 1 protocol URLs for GFAL2_XROOT. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__generateURLDict [139702104819520] DEBUG: generating url dict for 1 lfn in UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'getTransportURL' for 1 physical files 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Concluding the sending and committing data operation to accounting 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing to accounting concluded 2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/registerFile [139702104819520] DEBUG: Attempting to register 1 files. 2024-07-04 11:57:38 UTC dirac-dms-add-file/FCConditionParser [139702104819520] DEBUG: Testing addFile on FileCatalog for 1 lfns 2024-07-04 11:57:38 UTC dirac-dms-add-file/FCConditionParser [139702104819520] DEBUG: Condition string: None 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing data operation to accounting 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9133 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Done committing to accounting 2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] VERBOSE: Committing data operation 2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] VERBOSE: Done committing 2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: putAndRegister: Sending took 0.1 seconds 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] NOTICE: Successfully uploaded file to UKI-NORTHGRID-LIV-HEP-disk Also dirac-proxy-info subject : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame/CN=5265876890/CN=1167453957 issuer : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame/CN=5265876890 identity : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame timeleft : 22:36:44 DIRAC group : mu3e.org_user path : /user/paolo3/.globus/x509up_u10546 username : paolo.beltrame properties : NormalUser, JobSharing, AccountingMonitor VOMS : True VOMS fqan : ['/mu3e.org'] Seems to be OK. I think there is a stupid bug in my code regarding the copy commands. Cheers, Paolo ___ L’amor che move il sole e l’altre stelle (Paradiso, XXXIII, v. 145, Dante Alighieri) Dr. Paolo Beltrame University of Liverpool Department of Physics<https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351 On 4 Jul 2024, at 12:14 PM, Daniela Bauer <daniela.bauer.grid@googlemail.com> wrote: Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments. Hi Paolo, I have now been able to copy a file to the mu3e area at Liverpool. (I had to use the pilot proxy as I am not a member of mu3e.org<http://mu3e.org/>). Could you try to copy a file from your UI to /mu3e.org/user/p/paolo3/test/<http://mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root> with the debug options enabled, just so we can check your permissions ? Example command: dirac-dms-add-file -ddd /mu3e.org/user/p/paolo3/test/liv1-test.txt<http://mu3e.org/user/p/paolo3/test/liv1-test.txt> sometestfile UKI-NORTHGRID-LIV-HEP-disk Please also send the output of dirac-proxy-info, though given that DIRAC let you submit a job, I would assume that's OK. Thanks, Daniela On Thu, 4 Jul 2024 at 10:53, Daniela Bauer <daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>> wrote: Actually I take it back, it looks like it's a DIRAC problem, but I haven't found the solution yet. I can copy files to Liverpool by hand (even inside a DIRAC environment), but not when using the DIRAC tools. Needless to say, we haven't had an update since May, and I don't know why it just broke. I'll get back to you as soon as I have more information. Apologies, Daniela On Thu, 4 Jul 2024 at 09:55, Daniela Bauer <daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>> wrote: Hi, The paths are what Liverpool is advertising, though it also seems to be advertising this to be a dCache SE. They also advertise support for the gridpp VO, but I get an authorisation error if I try. @Paolo: I think this is a site issue. I will file a GGUS issue with the site and cc you on it, so you can see when it is resolved. Daniela On Wed, 3 Jul 2024 at 17:35, Beltrame, Paolo <Paolo.Beltrame@liverpool.ac.uk<mailto:Paolo.Beltrame@liverpool.ac.uk>> wrote: The job was running at site LCG.UKI-SCOTGRID-ECDF.uk<http://lcg.uki-scotgrid-ecdf.uk/> ___ L’amor che move il sole e l’altre stelle (Paradiso, XXXIII, v. 145, Dante Alighieri) Dr. Paolo Beltrame University of Liverpool Department of Physics<https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351 On 3 Jul 2024, at 5:29 PM, Sam Skipsey <sskipsey@googlemail.com<mailto:sskipsey@googlemail.com>> wrote: Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments. So, those destination SFNs look weird and probably out of date - I suspect that root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/<http://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/> isn't what the uploader should be trying as a destination? What node is this you are uploading from? On Wed, 3 Jul 2024, 17:09 Beltrame, Paolo, <Paolo.Beltrame@liverpool.ac.uk<mailto:Paolo.Beltrame@liverpool.ac.uk>> wrote: This email from Paolo.Beltrame@liverpool.ac.uk<mailto:Paolo.Beltrame@liverpool.ac.uk> originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list<https://spam.ic.ac.uk/SpamConsole/Senders.aspx> to disable email stamping for this address. Dear all, I have produced some files and I got error messages when I tried to copy them. This is the error I get Uploading /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root> Error: failed to upload /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root> to UKI-NORTHGRID-LIV-HEP-disk: {'OK': False, 'Errno': 0, 'Message': "Failed to put file to Storage Element. Failed to copy ./data/mu3e_1E3_signal_run000001.root to srm://hepgrid11.ph.liv.\ ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root>: GError('Protocol not supported or path/url invalid: srm://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/\<http://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/%5C> p/paolo3/test', 93) Failed to copy ./data/mu3e_1E3_signal_run000001.root to root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root>: GError('Protocol not supported or path/url invalid: root\ ://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test<http://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test>', 93)", 'CallStack': [' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file<http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file>", line 8, in <module>\n sys.exit(main())\n', ' File "/cvmfs/dir\ ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py<http://ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py>", line 74, in __call__\n return entrypointFunc._func()\n', ' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip\<http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip%5C> ts/dirac_dms_add_file.py", line 107, in main\n res = dm.putAndRegister(lfn["lfn"], lfn["localfile"], lfn["SE"], lfn["guid"], overwrite=overwrite)\n', ' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client\<http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client%5C> /DataManager.py", line 547, in putAndRegister\n return S_ERROR(f"{errStr} {res[\'Message\']}")\n’]} Could you please help me in understanding… and possibly solving it. Cheers, Paolo ___ L’amor che move il sole e l’altre stelle (Paradiso, XXXIII, v. 145, Dante Alighieri) Dr. Paolo Beltrame University of Liverpool Department of Physics<https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351 -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
Hi Paolo, Can you try to run your jobs again, please (maybe just with one job) ? What I think happened is that Liverpool still seems to advertise the srm protocol, but not fully support it. I removed the old srm protocol and just left xrootd, and that I think makes it work, but I can only do basic upload tests. Cheers, Daniela On Thu, 4 Jul 2024 at 13:00, Beltrame, Paolo <Paolo.Beltrame@liverpool.ac.uk> wrote:
Dear Daniela,
Thank you I believe it works.
2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: dirac.cfg should be at /user/paolo3/dirac_ui/diracos/etc/dirac.cfg
2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: CFG merged
2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: Updating configuration internals
2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: Updating configuration internals
Parsing command line
Trying to load Resources.LogBackends.StdoutBackend
Trying to load DIRAC.Resources.LogBackends.StdoutBackend
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Refreshing configuration...
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Refreshing from list ['dips:// dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server', 'dips:// dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server', 'dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server']
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Randomized server list is dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server, dips:// dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server, dips:// dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to refresh from dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server
2024-07-04 11:57:37 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Already given a valid url dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1c2:9135
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: New version available Updating to version 2024-07-04 11:09:18.197730...
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Updating configuration internals
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Updated to version 2024-07-04 11:09:18.197730
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.LogBackends.StdoutBackend
2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.LogBackends.StdoutBackend
2024-07-04 11:57:38 UTC dirac-dms-add-file/FileCatalogFactory [139702104819520] DEBUG: Creating FileCatalog client of type FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.Catalog.FileCatalogClient
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.Catalog.FileCatalogClient
2024-07-04 11:57:38 UTC dirac-dms-add-file/FileCatalogFactory [139702104819520] DEBUG: Loaded module FileCatalogClient
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] NOTICE:
Uploading /mu3e.org/user/p/paolo3/test/liv-test.txt
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197
2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: Checksum information not provided. Calculating adler32.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: Checksum calculated to be 3f560619.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.Storage.GFAL2_XROOTStorage
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.Storage.GFAL2_XROOTStorage
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: no GFAL_CONFIG_DIR env var found, try to load configuration from default directory /user/paolo3/dirac_ui/diracos/etc/gfal2.d/
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//bdii.conf ...
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//dcap_plugin.conf ...
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//gfal2_core.conf ...
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//gsiftp_plugin.conf ...
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//http_plugin.conf ...
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//sftp_plugin.conf ...
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//srm_plugin.conf ...
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//x509.conf ...
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//xrootd_plugin.conf ...
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Using credentials from X509_USER_PROXY
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Certificate: /user/paolo3/.globus/x509up_u10546
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Private key: /user/paolo3/.globus/x509up_u10546
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: ... no GFAL_PLUGIN_DIR environment variable specified, try to load plugins in the default directory : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins/
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so loaded with success
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so loaded with success
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> [gridftp_plugin] try to load ..
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: define GSIFTP session re-use to TRUE
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> [gridftp_plugin] loaded ..
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so loaded with success
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Enable GRID profile for DAVIX
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Adding CA path /cvmfs/grid.cern.ch/etc/grid-security/certificates to valid CA path list
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Using X509_USER_PROXY to supply credentials: /user/paolo3/.globus/x509up_u10546
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: HTTP/SSL Session caching ENABLED
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Redirection Session caching DISABLED
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: libdavix path /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//../libdavix.so.0, version: 0.8.6
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Enable GRID profile for DAVIX
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Adding CA path /cvmfs/grid.cern.ch/etc/grid-security/certificates to valid CA path list
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Using X509_USER_PROXY to supply credentials: /user/paolo3/.globus/x509up_u10546
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so loaded with success
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so loaded with success
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so loaded with success
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so loaded with success
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: plugin priority order: dcap-2.21.3 -> file-2.21.3 -> gridftp-2.21.3 -> http-2.21.3 -> sftp-2.21.3 -> srm-2.21.3 -> xrootd-2.21.3 ->
2024-07-04 11:57:38 UTC dirac-dms-add-file/GFAL2_XROOTStorage [139702104819520] DEBUG: GFAL2_StorageBase: using None checksum
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: useCatalogURL: False
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localAccessProtocolList ['davs', 'https', 'root', 'dips', 'srm', 'gsiftp']
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localWriteProtocolList ['davs', 'https', 'root', 'srm', 'dips']
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localStageProtocolList ['davs', 'https', 'root', 'dips', 'srm', 'gsiftp']
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'None'
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: preparing the execution of putFile
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: default argument sourceSize for putFile not present. Setting value 0.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'putFile' operation with 1 lfns.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'putFile'
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/getStatus [139702104819520] DEBUG: determining status of UKI-NORTHGRID-LIV-HEP-disk.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: check the operation: WriteAccess
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Filtering plugins for putFile (protocol = None ; inputProtocol = None)
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Allowed protocol: ['davs', 'https', 'root', 'srm', 'dips']
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Potential protocols ['davs', 'https', 'root', 'srm', 'dips']
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/LocalSE [139702104819520] DEBUG: Determining whether UKI-NORTHGRID-LIV-HEP-disk is a local SE.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.DataManagementSystem.Utilities.DMSHelpers [139702104819520] DEBUG: Grid Types are: LCG, CLOUD, VAC
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugins to be used for putFile: ['AccessProtocol.1']
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Generating 1 protocol URLs for GFAL2_XROOT.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__generateURLDict [139702104819520] DEBUG: generating url dict for 1 lfn in UKI-NORTHGRID-LIV-HEP-disk.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'putFile' for 1 physical files
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._putSingleFile [139702104819520] DEBUG: trying to upload liv1-test.txt to root:// x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> Gfal::Transfer::FileCopy
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ENTER
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ITEM file:///user/paolo3/mu3e/run/GRID/liv1-test.txt => root:// x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:EXIT
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Copy job: tpc_only=0 tpc_delegation=1 tpc_timeout=310
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Impossible to get integer parameter XROOTD PLUGIN:PARALLEL_COPIES, set to default value 20, err Key file does not have key “PARALLEL_COPIES” in group “XROOTD PLUGIN”
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:ENTER file://localhost///user/paolo3/mu3e/run/GRID/liv1-test.txt?xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546&xrdcl.intent=tpc => root:// x509up_u10546@hepgrid11.ph.liv.ac.uk:1094///dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt?xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546&xrdcl.intent=tpc
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:TYPE streamed
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:EXIT Job finished, [SUCCESS]
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: <- Gfal::Transfer::FileCopy
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._getSingleFileSize [139702104819520] DEBUG: Determining file size of root:// x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt
2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._putSingleFile [139702104819520] DEBUG: destSize: 19, sourceSize: 19
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9133
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Concluding the sending and committing data operation to accounting
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing to accounting concluded
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/getURL [139702104819520] DEBUG: Getting accessUrl (['davs', 'https', 'root', 'gsiftp', 'srm', 'dips']) for lfn in UKI-NORTHGRID-LIV-HEP-disk.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: preparing the execution of getTransportURL
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'getTransportURL' operation with 1 lfns.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'getTransportURL'
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Filtering plugins for getTransportURL (protocol = ['davs', 'https', 'root', 'gsiftp', 'srm', 'dips'] ; inputProtocol = None)
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugin GFAL2_XROOT can generate compatible protocol
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugins to be used for getTransportURL: ['AccessProtocol.1']
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Generating 1 protocol URLs for GFAL2_XROOT.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__generateURLDict [139702104819520] DEBUG: generating url dict for 1 lfn in UKI-NORTHGRID-LIV-HEP-disk.
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'getTransportURL' for 1 physical files
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Concluding the sending and committing data operation to accounting
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing to accounting concluded
2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/registerFile [139702104819520] DEBUG: Attempting to register 1 files.
2024-07-04 11:57:38 UTC dirac-dms-add-file/FCConditionParser [139702104819520] DEBUG: Testing addFile on FileCatalog for 1 lfns
2024-07-04 11:57:38 UTC dirac-dms-add-file/FCConditionParser [139702104819520] DEBUG: Condition string: None
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog
2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197
2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing data operation to accounting
2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore
2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore
2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore
2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore
2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore
2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9133
2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Done committing to accounting
2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] VERBOSE: Committing data operation
2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] VERBOSE: Done committing
2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: putAndRegister: Sending took 0.1 seconds
2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] NOTICE: Successfully uploaded file to UKI-NORTHGRID-LIV-HEP-disk
Also
dirac-proxy-info subject : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame/CN=5265876890/CN=1167453957
issuer : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame/CN=5265876890
identity : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame
timeleft : 22:36:44
DIRAC group : mu3e.org_user
path : /user/paolo3/.globus/x509up_u10546
username : paolo.beltrame
properties : NormalUser, JobSharing, AccountingMonitor
VOMS : True
VOMS fqan : ['/mu3e.org']
Seems to be OK.
I think there is a stupid bug in my code regarding the copy commands.
Cheers, Paolo
___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
On 4 Jul 2024, at 12:14 PM, Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments. Hi Paolo,
I have now been able to copy a file to the mu3e area at Liverpool. (I had to use the pilot proxy as I am not a member of mu3e.org). Could you try to copy a file from your UI to /mu3e.org/user/p/paolo3/test/ <http://mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root> with the debug options enabled, just so we can check your permissions ?
Example command: dirac-dms-add-file -ddd /mu3e.org/user/p/paolo3/test/liv1-test.txt sometestfile UKI-NORTHGRID-LIV-HEP-disk
Please also send the output of dirac-proxy-info, though given that DIRAC let you submit a job, I would assume that's OK.
Thanks, Daniela
On Thu, 4 Jul 2024 at 10:53, Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Actually I take it back, it looks like it's a DIRAC problem, but I haven't found the solution yet. I can copy files to Liverpool by hand (even inside a DIRAC environment), but not when using the DIRAC tools. Needless to say, we haven't had an update since May, and I don't know why it just broke.
I'll get back to you as soon as I have more information.
Apologies, Daniela
On Thu, 4 Jul 2024 at 09:55, Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Hi,
The paths are what Liverpool is advertising, though it also seems to be advertising this to be a dCache SE. They also advertise support for the gridpp VO, but I get an authorisation error if I try. @Paolo: I think this is a site issue. I will file a GGUS issue with the site and cc you on it, so you can see when it is resolved.
Daniela
On Wed, 3 Jul 2024 at 17:35, Beltrame, Paolo < Paolo.Beltrame@liverpool.ac.uk> wrote:
The job was running at site LCG.UKI-SCOTGRID-ECDF.uk <http://lcg.uki-scotgrid-ecdf.uk/> ___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
On 3 Jul 2024, at 5:29 PM, Sam Skipsey <sskipsey@googlemail.com> wrote:
Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments.
So, those destination SFNs look weird and probably out of date - I suspect that root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ isn't what the uploader should be trying as a destination?
What node is this you are uploading from?
On Wed, 3 Jul 2024, 17:09 Beltrame, Paolo, < Paolo.Beltrame@liverpool.ac.uk> wrote:
This email from Paolo.Beltrame@liverpool.ac.uk originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list <https://spam.ic.ac.uk/SpamConsole/Senders.aspx> to disable email stamping for this address.
Dear all,
I have produced some files and I got error messages when I tried to copy them. This is the error I get
Uploading /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root Error: failed to upload / mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root to UKI-NORTHGRID-LIV-HEP-disk: {'OK': False, 'Errno': 0, 'Message': "Failed to put file to Storage Element. Failed to copy ./data/mu3e_1E3_signal_run000001.root to srm://hepgrid11.ph.liv.\
ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: srm:// hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/\ <http://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/%5C> p/paolo3/test', 93) Failed to copy ./data/mu3e_1E3_signal_run000001.root to root:// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: root\ :// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test', 93)", 'CallStack': [' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file", line 8, in <module>\n sys.exit(main())\n', ' File "/cvmfs/dir\
ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py", line 74, in __call__\n return entrypointFunc._func()\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip%5C> ts/dirac_dms_add_file.py", line 107, in main\n res = dm.putAndRegister(lfn["lfn"], lfn["localfile"], lfn["SE"], lfn["guid"], overwrite=overwrite)\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client%5C> /DataManager.py", line 547, in putAndRegister\n return S_ERROR(f"{errStr} {res[\'Message\']}")\n’]}
Could you please help me in understanding… and possibly solving it.
Cheers, Paolo
___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
--
Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
Hi Daniela, Now it works. Surely it was a stupid mistake on my part. I tried with one job. And then I also launched several jobs, and it worked. Thank you very very much, Paolo ___ L’amor che move il sole e l’altre stelle (Paradiso, XXXIII, v. 145, Dante Alighieri) Dr. Paolo Beltrame University of Liverpool Department of Physics<https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351 On 4 Jul 2024, at 1:12 PM, Daniela Bauer <daniela.bauer.grid@googlemail.com> wrote: Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments. Hi Paolo, Can you try to run your jobs again, please (maybe just with one job) ? What I think happened is that Liverpool still seems to advertise the srm protocol, but not fully support it. I removed the old srm protocol and just left xrootd, and that I think makes it work, but I can only do basic upload tests. Cheers, Daniela On Thu, 4 Jul 2024 at 13:00, Beltrame, Paolo <Paolo.Beltrame@liverpool.ac.uk<mailto:Paolo.Beltrame@liverpool.ac.uk>> wrote: Dear Daniela, Thank you I believe it works. 2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: dirac.cfg should be at /user/paolo3/dirac_ui/diracos/etc/dirac.cfg 2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: CFG merged 2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: Updating configuration internals 2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: Updating configuration internals Parsing command line Trying to load Resources.LogBackends.StdoutBackend Trying to load DIRAC.Resources.LogBackends.StdoutBackend 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Refreshing configuration... 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Refreshing from list ['dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server>', 'dips://dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server>', 'dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server>'] 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Randomized server list is dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server>, dips://dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server>, dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to refresh from dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> 2024-07-04 11:57:37 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Already given a valid url dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1c2:9135 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: New version available Updating to version 2024-07-04 11:09:18.197730... 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Updating configuration internals 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Updated to version 2024-07-04 11:09:18.197730 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.LogBackends.StdoutBackend 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.LogBackends.StdoutBackend 2024-07-04 11:57:38 UTC dirac-dms-add-file/FileCatalogFactory [139702104819520] DEBUG: Creating FileCatalog client of type FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.Catalog.FileCatalogClient 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.Catalog.FileCatalogClient 2024-07-04 11:57:38 UTC dirac-dms-add-file/FileCatalogFactory [139702104819520] DEBUG: Loaded module FileCatalogClient 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] NOTICE: Uploading /mu3e.org/user/p/paolo3/test/liv-test.txt<http://mu3e.org/user/p/paolo3/test/liv-test.txt> 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197 2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: Checksum information not provided. Calculating adler32. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: Checksum calculated to be 3f560619. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.Storage.GFAL2_XROOTStorage 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.Storage.GFAL2_XROOTStorage 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: no GFAL_CONFIG_DIR env var found, try to load configuration from default directory /user/paolo3/dirac_ui/diracos/etc/gfal2.d/ 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//bdii.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//dcap_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//gfal2_core.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//gsiftp_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//http_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//sftp_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//srm_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//x509.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//xrootd_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Using credentials from X509_USER_PROXY 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Certificate: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Private key: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: ... no GFAL_PLUGIN_DIR environment variable specified, try to load plugins in the default directory : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins/ 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> [gridftp_plugin] try to load .. 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: define GSIFTP session re-use to TRUE 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> [gridftp_plugin] loaded .. 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Enable GRID profile for DAVIX 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Adding CA path /cvmfs/grid.cern.ch/etc/grid-security/certificates<http://grid.cern.ch/etc/grid-security/certificates> to valid CA path list 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Using X509_USER_PROXY to supply credentials: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: HTTP/SSL Session caching ENABLED 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Redirection Session caching DISABLED 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: libdavix path /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//../libdavix.so.0, version: 0.8.6 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Enable GRID profile for DAVIX 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Adding CA path /cvmfs/grid.cern.ch/etc/grid-security/certificates<http://grid.cern.ch/etc/grid-security/certificates> to valid CA path list 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Using X509_USER_PROXY to supply credentials: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: plugin priority order: dcap-2.21.3 -> file-2.21.3 -> gridftp-2.21.3 -> http-2.21.3 -> sftp-2.21.3 -> srm-2.21.3 -> xrootd-2.21.3 -> 2024-07-04 11:57:38 UTC dirac-dms-add-file/GFAL2_XROOTStorage [139702104819520] DEBUG: GFAL2_StorageBase: using None checksum 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: useCatalogURL: False 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localAccessProtocolList ['davs', 'https', 'root', 'dips', 'srm', 'gsiftp'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localWriteProtocolList ['davs', 'https', 'root', 'srm', 'dips'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localStageProtocolList ['davs', 'https', 'root', 'dips', 'srm', 'gsiftp'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org<http://mu3e.org/> 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'None' 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: preparing the execution of putFile 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: default argument sourceSize for putFile not present. Setting value 0. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'putFile' operation with 1 lfns. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org<http://mu3e.org/> 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'putFile' 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/getStatus [139702104819520] DEBUG: determining status of UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: check the operation: WriteAccess 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Filtering plugins for putFile (protocol = None ; inputProtocol = None) 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Allowed protocol: ['davs', 'https', 'root', 'srm', 'dips'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Potential protocols ['davs', 'https', 'root', 'srm', 'dips'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/LocalSE [139702104819520] DEBUG: Determining whether UKI-NORTHGRID-LIV-HEP-disk is a local SE. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.DataManagementSystem.Utilities.DMSHelpers [139702104819520] DEBUG: Grid Types are: LCG, CLOUD, VAC 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugins to be used for putFile: ['AccessProtocol.1'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Generating 1 protocol URLs for GFAL2_XROOT. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__generateURLDict [139702104819520] DEBUG: generating url dict for 1 lfn in UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'putFile' for 1 physical files 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._putSingleFile [139702104819520] DEBUG: trying to upload liv1-test.txt to root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt<http://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt> 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> Gfal::Transfer::FileCopy 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ENTER 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ITEM file:///user/paolo3/mu3e/run/GRID/liv1-test.txt => root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt<http://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt> 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:EXIT 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Copy job: tpc_only=0 tpc_delegation=1 tpc_timeout=310 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Impossible to get integer parameter XROOTD PLUGIN:PARALLEL_COPIES, set to default value 20, err Key file does not have key “PARALLEL_COPIES” in group “XROOTD PLUGIN” 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:ENTER file://localhost///user/paolo3/mu3e/run/GRID/liv1-test.txt?xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546&xrdcl.intent=tpc => root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094///dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt?xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546&xrdcl.intent=tpc<http://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094///dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt?xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546&xrdcl.intent=tpc> 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:TYPE streamed 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:EXIT Job finished, [SUCCESS] 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: <- Gfal::Transfer::FileCopy 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._getSingleFileSize [139702104819520] DEBUG: Determining file size of root://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt<http://x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt> 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._putSingleFile [139702104819520] DEBUG: destSize: 19, sourceSize: 19 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore<http://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore<http://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore<http://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore<http://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9133 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Concluding the sending and committing data operation to accounting 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing to accounting concluded 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/getURL [139702104819520] DEBUG: Getting accessUrl (['davs', 'https', 'root', 'gsiftp', 'srm', 'dips']) for lfn in UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: preparing the execution of getTransportURL 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'getTransportURL' operation with 1 lfns. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org<http://mu3e.org/> 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'getTransportURL' 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Filtering plugins for getTransportURL (protocol = ['davs', 'https', 'root', 'gsiftp', 'srm', 'dips'] ; inputProtocol = None) 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugin GFAL2_XROOT can generate compatible protocol 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugins to be used for getTransportURL: ['AccessProtocol.1'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Generating 1 protocol URLs for GFAL2_XROOT. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__generateURLDict [139702104819520] DEBUG: generating url dict for 1 lfn in UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'getTransportURL' for 1 physical files 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore<http://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore<http://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore> 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Concluding the sending and committing data operation to accounting 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing to accounting concluded 2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/registerFile [139702104819520] DEBUG: Attempting to register 1 files. 2024-07-04 11:57:38 UTC dirac-dms-add-file/FCConditionParser [139702104819520] DEBUG: Testing addFile on FileCatalog for 1 lfns 2024-07-04 11:57:38 UTC dirac-dms-add-file/FCConditionParser [139702104819520] DEBUG: Condition string: None 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog<http://dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog> 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing data operation to accounting 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore<http://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore> 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore<http://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore> 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore<http://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore> 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore<http://dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore> 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9133 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Done committing to accounting 2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] VERBOSE: Committing data operation 2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] VERBOSE: Done committing 2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: putAndRegister: Sending took 0.1 seconds 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] NOTICE: Successfully uploaded file to UKI-NORTHGRID-LIV-HEP-disk Also dirac-proxy-info subject : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame/CN=5265876890/CN=1167453957 issuer : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame/CN=5265876890 identity : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame timeleft : 22:36:44 DIRAC group : mu3e.org_user path : /user/paolo3/.globus/x509up_u10546 username : paolo.beltrame properties : NormalUser, JobSharing, AccountingMonitor VOMS : True VOMS fqan : ['/mu3e.org<http://mu3e.org/>'] Seems to be OK. I think there is a stupid bug in my code regarding the copy commands. Cheers, Paolo ___ L’amor che move il sole e l’altre stelle (Paradiso, XXXIII, v. 145, Dante Alighieri) Dr. Paolo Beltrame University of Liverpool Department of Physics<https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351 On 4 Jul 2024, at 12:14 PM, Daniela Bauer <daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>> wrote: Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments. Hi Paolo, I have now been able to copy a file to the mu3e area at Liverpool. (I had to use the pilot proxy as I am not a member of mu3e.org<http://mu3e.org/>). Could you try to copy a file from your UI to /mu3e.org/user/p/paolo3/test/<http://mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root> with the debug options enabled, just so we can check your permissions ? Example command: dirac-dms-add-file -ddd /mu3e.org/user/p/paolo3/test/liv1-test.txt<http://mu3e.org/user/p/paolo3/test/liv1-test.txt> sometestfile UKI-NORTHGRID-LIV-HEP-disk Please also send the output of dirac-proxy-info, though given that DIRAC let you submit a job, I would assume that's OK. Thanks, Daniela On Thu, 4 Jul 2024 at 10:53, Daniela Bauer <daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>> wrote: Actually I take it back, it looks like it's a DIRAC problem, but I haven't found the solution yet. I can copy files to Liverpool by hand (even inside a DIRAC environment), but not when using the DIRAC tools. Needless to say, we haven't had an update since May, and I don't know why it just broke. I'll get back to you as soon as I have more information. Apologies, Daniela On Thu, 4 Jul 2024 at 09:55, Daniela Bauer <daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>> wrote: Hi, The paths are what Liverpool is advertising, though it also seems to be advertising this to be a dCache SE. They also advertise support for the gridpp VO, but I get an authorisation error if I try. @Paolo: I think this is a site issue. I will file a GGUS issue with the site and cc you on it, so you can see when it is resolved. Daniela On Wed, 3 Jul 2024 at 17:35, Beltrame, Paolo <Paolo.Beltrame@liverpool.ac.uk<mailto:Paolo.Beltrame@liverpool.ac.uk>> wrote: The job was running at site LCG.UKI-SCOTGRID-ECDF.uk<http://lcg.uki-scotgrid-ecdf.uk/> ___ L’amor che move il sole e l’altre stelle (Paradiso, XXXIII, v. 145, Dante Alighieri) Dr. Paolo Beltrame University of Liverpool Department of Physics<https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351 On 3 Jul 2024, at 5:29 PM, Sam Skipsey <sskipsey@googlemail.com<mailto:sskipsey@googlemail.com>> wrote: Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments. So, those destination SFNs look weird and probably out of date - I suspect that root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/<http://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/> isn't what the uploader should be trying as a destination? What node is this you are uploading from? On Wed, 3 Jul 2024, 17:09 Beltrame, Paolo, <Paolo.Beltrame@liverpool.ac.uk<mailto:Paolo.Beltrame@liverpool.ac.uk>> wrote: This email from Paolo.Beltrame@liverpool.ac.uk<mailto:Paolo.Beltrame@liverpool.ac.uk> originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list<https://spam.ic.ac.uk/SpamConsole/Senders.aspx> to disable email stamping for this address. Dear all, I have produced some files and I got error messages when I tried to copy them. This is the error I get Uploading /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root> Error: failed to upload /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root> to UKI-NORTHGRID-LIV-HEP-disk: {'OK': False, 'Errno': 0, 'Message': "Failed to put file to Storage Element. Failed to copy ./data/mu3e_1E3_signal_run000001.root to srm://hepgrid11.ph.liv.\ ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root>: GError('Protocol not supported or path/url invalid: srm://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/\<http://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/%5C> p/paolo3/test', 93) Failed to copy ./data/mu3e_1E3_signal_run000001.root to root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root<http://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root>: GError('Protocol not supported or path/url invalid: root\ ://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test<http://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test>', 93)", 'CallStack': [' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file<http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file>", line 8, in <module>\n sys.exit(main())\n', ' File "/cvmfs/dir\ ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py<http://ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py>", line 74, in __call__\n return entrypointFunc._func()\n', ' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip\<http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip%5C> ts/dirac_dms_add_file.py", line 107, in main\n res = dm.putAndRegister(lfn["lfn"], lfn["localfile"], lfn["SE"], lfn["guid"], overwrite=overwrite)\n', ' File "/cvmfs/dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client\<http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client%5C> /DataManager.py", line 547, in putAndRegister\n return S_ERROR(f"{errStr} {res[\'Message\']}")\n’]} Could you please help me in understanding… and possibly solving it. Cheers, Paolo ___ L’amor che move il sole e l’altre stelle (Paradiso, XXXIII, v. 145, Dante Alighieri) Dr. Paolo Beltrame University of Liverpool Department of Physics<https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351 -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
Just to be clear, that was definitely not a user error, but a DIRAC error, albeit one that was impossible to predict until someone actually tried. The only lesson to take away from this is: If something breaks, please email us immediately, so we can fix it. And even if it turns out it was you after all, there's no penalty involved, it's not like we never make mistakes. Regards, Daniela On Thu, 4 Jul 2024 at 16:02, Beltrame, Paolo <Paolo.Beltrame@liverpool.ac.uk> wrote:
Hi Daniela,
Now it works. Surely it was a stupid mistake on my part. I tried with one job. And then I also launched several jobs, and it worked.
Thank you very very much, Paolo ___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
On 4 Jul 2024, at 1:12 PM, Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments. Hi Paolo,
Can you try to run your jobs again, please (maybe just with one job) ? What I think happened is that Liverpool still seems to advertise the srm protocol, but not fully support it. I removed the old srm protocol and just left xrootd, and that I think makes it work, but I can only do basic upload tests.
Cheers, Daniela
On Thu, 4 Jul 2024 at 13:00, Beltrame, Paolo < Paolo.Beltrame@liverpool.ac.uk> wrote:
Dear Daniela,
Thank you I believe it works.
2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: dirac.cfg should be at /user/paolo3/dirac_ui/diracos/etc/dirac.cfg 2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: CFG merged 2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: Updating configuration internals 2024-07-04 11:57:37 UTC Framework [139702104819520] DEBUG: Updating configuration internals Parsing command line Trying to load Resources.LogBackends.StdoutBackend Trying to load DIRAC.Resources.LogBackends.StdoutBackend 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Refreshing configuration... 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Refreshing from list ['dips:// dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server', 'dips:// dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server', 'dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server'] 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Randomized server list is dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server, dips:// dirac02.grid.hep.ph.ic.ac.uk:9135/Configuration/Server, dips:// dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to refresh from dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Already given a valid url dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// diracweb.grid.hep.ph.ic.ac.uk:9135/Configuration/Server 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1c2:9135 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: New version available Updating to version 2024-07-04 11:09:18.197730... 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Updating configuration internals 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Updated to version 2024-07-04 11:09:18.197730 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.LogBackends.StdoutBackend 2024-07-04 11:57:37 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.LogBackends.StdoutBackend 2024-07-04 11:57:38 UTC dirac-dms-add-file/FileCatalogFactory [139702104819520] DEBUG: Creating FileCatalog client of type FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.Catalog.FileCatalogClient 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.Catalog.FileCatalogClient 2024-07-04 11:57:38 UTC dirac-dms-add-file/FileCatalogFactory [139702104819520] DEBUG: Loaded module FileCatalogClient 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] NOTICE: Uploading /mu3e.org/user/p/paolo3/test/liv-test.txt 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197 2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: Checksum information not provided. Calculating adler32. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: Checksum calculated to be 3f560619. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load Resources.Storage.GFAL2_XROOTStorage 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to load DIRAC.Resources.Storage.GFAL2_XROOTStorage 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: no GFAL_CONFIG_DIR env var found, try to load configuration from default directory /user/paolo3/dirac_ui/diracos/etc/gfal2.d/ 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//bdii.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//dcap_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//gfal2_core.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//gsiftp_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//http_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//sftp_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//srm_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//x509.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: try to load configuration file /user/paolo3/dirac_ui/diracos/etc/gfal2.d//xrootd_plugin.conf ... 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Using credentials from X509_USER_PROXY 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Certificate: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Private key: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: ... no GFAL_PLUGIN_DIR environment variable specified, try to load plugins in the default directory : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins/ 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: [gfal_list_directory_plugins] add plugin to list to load /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_dcap.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_file.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> [gridftp_plugin] try to load .. 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: define GSIFTP session re-use to TRUE 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> [gridftp_plugin] loaded .. 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_gridftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Enable GRID profile for DAVIX 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Adding CA path /cvmfs/grid.cern.ch/etc/grid-security/certificates to valid CA path list 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Using X509_USER_PROXY to supply credentials: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: HTTP/SSL Session caching ENABLED 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Redirection Session caching DISABLED 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: libdavix path /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//../libdavix.so.0, version: 0.8.6 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Enable GRID profile for DAVIX 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Adding CA path /cvmfs/grid.cern.ch/etc/grid-security/certificates to valid CA path list 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Davix: Using X509_USER_PROXY to supply credentials: /user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_http.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_sftp.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_srm.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: [gfal_module_load] plugin /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so loaded with success 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: gfal_plugin loaded successfully : /user/paolo3/dirac_ui/diracos/lib/gfal2-plugins//libgfal_plugin_xrootd.so 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: plugin priority order: dcap-2.21.3 -> file-2.21.3 -> gridftp-2.21.3 -> http-2.21.3 -> sftp-2.21.3 -> srm-2.21.3 -> xrootd-2.21.3 -> 2024-07-04 11:57:38 UTC dirac-dms-add-file/GFAL2_XROOTStorage [139702104819520] DEBUG: GFAL2_StorageBase: using None checksum 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: useCatalogURL: False 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localAccessProtocolList ['davs', 'https', 'root', 'dips', 'srm', 'gsiftp'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localWriteProtocolList ['davs', 'https', 'root', 'srm', 'dips'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk] [139702104819520] DEBUG: localStageProtocolList ['davs', 'https', 'root', 'dips', 'srm', 'gsiftp'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'None' 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: preparing the execution of putFile 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: default argument sourceSize for putFile not present. Setting value 0. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'putFile' operation with 1 lfns. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'putFile' 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/getStatus [139702104819520] DEBUG: determining status of UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: check the operation: WriteAccess 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Filtering plugins for putFile (protocol = None ; inputProtocol = None) 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Allowed protocol: ['davs', 'https', 'root', 'srm', 'dips'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Potential protocols ['davs', 'https', 'root', 'srm', 'dips'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/LocalSE [139702104819520] DEBUG: Determining whether UKI-NORTHGRID-LIV-HEP-disk is a local SE. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.DataManagementSystem.Utilities.DMSHelpers [139702104819520] DEBUG: Grid Types are: LCG, CLOUD, VAC 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugins to be used for putFile: ['AccessProtocol.1'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Generating 1 protocol URLs for GFAL2_XROOT. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__generateURLDict [139702104819520] DEBUG: generating url dict for 1 lfn in UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'putFile' for 1 physical files 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._putSingleFile [139702104819520] DEBUG: trying to upload liv1-test.txt to root:// x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: -> Gfal::Transfer::FileCopy 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ENTER 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ITEM file:///user/paolo3/mu3e/run/GRID/liv1-test.txt => root:// x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:EXIT 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Copy job: tpc_only=0 tpc_delegation=1 tpc_timeout=310 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Impossible to get integer parameter XROOTD PLUGIN:PARALLEL_COPIES, set to default value 20, err Key file does not have key “PARALLEL_COPIES” in group “XROOTD PLUGIN” 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:ENTER file://localhost///user/paolo3/mu3e/run/GRID/liv1-test.txt?xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546&xrdcl.intent=tpc => root:// x509up_u10546@hepgrid11.ph.liv.ac.uk:1094///dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt?xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546&xrdcl.intent=tpc 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:TYPE streamed 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:EXIT Job finished, [SUCCESS] 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: <- Gfal::Transfer::FileCopy 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._getSingleFileSize [139702104819520] DEBUG: Determining file size of root:// x509up_u10546@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/liv-test.txt 2024-07-04 11:57:38 UTC ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/user/paolo3/.globus/x509up_u10546 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/UKI-NORTHGRID-LIV-HEP-disk/GFAL2_StorageBase._putSingleFile [139702104819520] DEBUG: destSize: 19, sourceSize: 19 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9133 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Concluding the sending and committing data operation to accounting 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing to accounting concluded 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/getURL [139702104819520] DEBUG: Getting accessUrl (['davs', 'https', 'root', 'gsiftp', 'srm', 'dips']) for lfn in UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: preparing the execution of getTransportURL 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'getTransportURL' operation with 1 lfns. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for VO mu3e.org 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/isValid [139702104819520] DEBUG: Determining if the StorageElement UKI-NORTHGRID-LIV-HEP-disk is valid for operation 'getTransportURL' 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Filtering plugins for getTransportURL (protocol = ['davs', 'https', 'root', 'gsiftp', 'srm', 'dips'] ; inputProtocol = None) 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugin GFAL2_XROOT can generate compatible protocol 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__filterPlugins [139702104819520] DEBUG: Plugins to be used for getTransportURL: ['AccessProtocol.1'] 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Generating 1 protocol URLs for GFAL2_XROOT. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__generateURLDict [139702104819520] DEBUG: generating url dict for 1 lfn in UKI-NORTHGRID-LIV-HEP-disk. 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[UKI-NORTHGRID-LIV-HEP-disk]/__executeMethod [139702104819520] DEBUG: Attempting to perform 'getTransportURL' for 1 physical files 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Concluding the sending and committing data operation to accounting 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing to accounting concluded 2024-07-04 11:57:38 UTC dirac-dms-add-file/DataManager/registerFile [139702104819520] DEBUG: Attempting to register 1 files. 2024-07-04 11:57:38 UTC dirac-dms-add-file/FCConditionParser [139702104819520] DEBUG: Testing addFile on FileCatalog for 1 lfns 2024-07-04 11:57:38 UTC dirac-dms-add-file/FCConditionParser [139702104819520] DEBUG: Condition string: None 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service DataManagement/FileCatalog -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:38 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9197/DataManagement/FileCatalog 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9197 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Committing data operation to accounting 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: Trying to autodetect client for Accounting/DataStore 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.Core.Tornado.Client.ClientSelector [139702104819520] DEBUG: URL resolved: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Discovering URL for service Accounting/DataStore -> dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Trying to connect to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: Connected to: dips:// dirac01.grid.hep.ph.ic.ac.uk:9133/Accounting/DataStore 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] DEBUG: New connection -> 2a0c:5bc0:c8:2:216:3eff:fe7f:1bf:9133 2024-07-04 11:57:39 UTC dirac-dms-add-file/DIRAC.MonitoringSystem.Client.DataOperationSender [139702104819520] DEBUG: Done committing to accounting 2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] VERBOSE: Committing data operation 2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] VERBOSE: Done committing 2024-07-04 11:57:39 UTC dirac-dms-add-file/DataManager/putAndRegister [139702104819520] DEBUG: putAndRegister: Sending took 0.1 seconds 2024-07-04 11:57:39 UTC dirac-dms-add-file [139702104819520] NOTICE: Successfully uploaded file to UKI-NORTHGRID-LIV-HEP-disk
Also
dirac-proxy-info subject : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame/CN=5265876890/CN=1167453957 issuer : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame/CN=5265876890 identity : /C=UK/O=eScience/OU=Liverpool/L=CSD/CN=paolo beltrame timeleft : 22:36:44 DIRAC group : mu3e.org_user path : /user/paolo3/.globus/x509up_u10546 username : paolo.beltrame properties : NormalUser, JobSharing, AccountingMonitor VOMS : True VOMS fqan : ['/mu3e.org']
Seems to be OK.
I think there is a stupid bug in my code regarding the copy commands.
Cheers, Paolo
___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
On 4 Jul 2024, at 12:14 PM, Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments. Hi Paolo,
I have now been able to copy a file to the mu3e area at Liverpool. (I had to use the pilot proxy as I am not a member of mu3e.org). Could you try to copy a file from your UI to / mu3e.org/user/p/paolo3/test/ <http://mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root> with the debug options enabled, just so we can check your permissions ?
Example command: dirac-dms-add-file -ddd /mu3e.org/user/p/paolo3/test/liv1-test.txt sometestfile UKI-NORTHGRID-LIV-HEP-disk
Please also send the output of dirac-proxy-info, though given that DIRAC let you submit a job, I would assume that's OK.
Thanks, Daniela
On Thu, 4 Jul 2024 at 10:53, Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Actually I take it back, it looks like it's a DIRAC problem, but I haven't found the solution yet. I can copy files to Liverpool by hand (even inside a DIRAC environment), but not when using the DIRAC tools. Needless to say, we haven't had an update since May, and I don't know why it just broke.
I'll get back to you as soon as I have more information.
Apologies, Daniela
On Thu, 4 Jul 2024 at 09:55, Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Hi,
The paths are what Liverpool is advertising, though it also seems to be advertising this to be a dCache SE. They also advertise support for the gridpp VO, but I get an authorisation error if I try. @Paolo: I think this is a site issue. I will file a GGUS issue with the site and cc you on it, so you can see when it is resolved.
Daniela
On Wed, 3 Jul 2024 at 17:35, Beltrame, Paolo < Paolo.Beltrame@liverpool.ac.uk> wrote:
The job was running at site LCG.UKI-SCOTGRID-ECDF.uk <http://lcg.uki-scotgrid-ecdf.uk/> ___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
On 3 Jul 2024, at 5:29 PM, Sam Skipsey <sskipsey@googlemail.com> wrote:
Caution: This email originated from outside of the University. Do not click links or open attachments unless you recognise the source of this email and know the content is safe. Check sender address, hover over URLs and don't open suspicious email attachments.
So, those destination SFNs look weird and probably out of date - I suspect that root://tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ isn't what the uploader should be trying as a destination?
What node is this you are uploading from?
On Wed, 3 Jul 2024, 17:09 Beltrame, Paolo, < Paolo.Beltrame@liverpool.ac.uk> wrote:
This email from Paolo.Beltrame@liverpool.ac.uk originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list <https://spam.ic.ac.uk/SpamConsole/Senders.aspx> to disable email stamping for this address.
Dear all,
I have produced some files and I got error messages when I tried to copy them. This is the error I get
Uploading /mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root Error: failed to upload / mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root to UKI-NORTHGRID-LIV-HEP-disk: {'OK': False, 'Errno': 0, 'Message': "Failed to put file to Storage Element. Failed to copy ./data/mu3e_1E3_signal_run000001.root to srm://hepgrid11.ph.liv.\
ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: srm:// hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/\ <http://hepgrid11.ph.liv.ac.uk:8446/srm/managerv2?SFN=/dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/%5C> p/paolo3/test', 93) Failed to copy ./data/mu3e_1E3_signal_run000001.root to root:// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test/mu3e_1E3_signal_run000001.root: GError('Protocol not supported or path/url invalid: root\ :// tmph7cievym@hepgrid11.ph.liv.ac.uk:1094//dpm/ph.liv.ac.uk/home/mu3e.org/mu3e.org/user/p/paolo3/test', 93)", 'CallStack': [' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/bin/dirac-dms-add-file", line 8, in <module>\n sys.exit(main())\n', ' File "/cvmfs/dir\
ac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Core/Base/Script.py", line 74, in __call__\n return entrypointFunc._func()\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/scrip%5C> ts/dirac_dms_add_file.py", line 107, in main\n res = dm.putAndRegister(lfn["lfn"], lfn["localfile"], lfn["SE"], lfn["guid"], overwrite=overwrite)\n', ' File "/cvmfs/ dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client\ <http://dirac.egi.eu/dirac/v8.0.38/Linux-x86_64/lib/python3.11/site-packages/DIRAC/DataManagementSystem/Client%5C> /DataManager.py", line 547, in putAndRegister\n return S_ERROR(f"{errStr} {res[\'Message\']}")\n’]}
Could you please help me in understanding… and possibly solving it.
Cheers, Paolo
___
*L**’a**mor che move il sole e l**’**altre stelle* (Paradiso, XXXIII, v. 145, Dante Alighieri)
Dr. Paolo Beltrame University of Liverpool Department of Physics <https://www.liverpool.ac.uk/physics/> Oliver Lodge Laboratories (Room 223) Oxford Street Liverpool L69 7ZE
Mobile: +39 (339) 1363133 Skype: fedro3 Zoom: https://liverpool-ac-uk.zoom.us/j/5524672351
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
--
Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
participants (3)
-
Beltrame, Paolo
-
Daniela Bauer
-
Sam Skipsey