errors - issue when uploading files to QMUL
Hi again, In addition to those sent before, please see below the errors got by MoEDAL colleague: Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe<http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe> StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py<http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py>", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py<http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py>", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py<http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py>", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe<http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe> to UKI-LT2-QMUL2-disk Many thanks in advance and cheers, Daniel ________________________________ From: gridpp-dirac-users-bounces@imperial.ac.uk [gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniel Felea [Daniel.Felea@cern.ch] Sent: 20 March 2018 15:41 To: gridpp-dirac-users@imperial.ac.uk Subject: [Gridpp-Dirac-Users] issue when uploading files to QMUL Hello, I recently tried to upload a file to QMUL but it failed, please see below: [gridpp@10 ganga]$ dirac-dms-add-file /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe Error: failed to upload /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe to UKI-LT2-QMUL2-disk A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result. Please, can you help us ? Thank you very much in anticipation ! Cheers, Daniel
Hi Daniel, This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ? Cheers, Daniela On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/ StorageFactory.py", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/ GFAL2_SRM2Storage.py", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/ GFAL2_StorageBase.py", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload /vo.moedal.org/sim/13TEVYY/ FilesByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniel Felea [ Daniel.Felea@cern.ch] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file /vo.moedal.org/user/d/daniel. felea/unweighted_events.lhe unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe Error: failed to upload /vo.moedal.org/user/d/daniel. felea/unweighted_events.lhe to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/
Hi Daniela, Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL. Many thanks for your help !! Cheers, Daniel ________________________________ From: gridpp-dirac-users-bounces@imperial.ac.uk [gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniela Bauer [daniela.bauer.grid@googlemail.com] Sent: 20 March 2018 17:17 To: gridpp-dirac-users@imperial.ac.uk Subject: Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL Hi Daniel, This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ? Cheers, Daniela On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch<mailto:Daniel.Felea@cern.ch>> wrote: Hi again, In addition to those sent before, please see below the errors got by MoEDAL colleague: Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe<http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe> StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py<http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py>", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py<http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py>", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py<http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py>", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe<http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe> to UKI-LT2-QMUL2-disk Many thanks in advance and cheers, Daniel ________________________________ From: gridpp-dirac-users-bounces@imperial.ac.uk<mailto:gridpp-dirac-users-bounces@imperial.ac.uk> [gridpp-dirac-users-bounces@imperial.ac.uk<mailto:gridpp-dirac-users-bounces@imperial.ac.uk>] on behalf of Daniel Felea [Daniel.Felea@cern.ch<mailto:Daniel.Felea@cern.ch>] Sent: 20 March 2018 15:41 To: gridpp-dirac-users@imperial.ac.uk<mailto:gridpp-dirac-users@imperial.ac.uk> Subject: [Gridpp-Dirac-Users] issue when uploading files to QMUL Hello, I recently tried to upload a file to QMUL but it failed, please see below: [gridpp@10 ganga]$ dirac-dms-add-file /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe<http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe<http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> Error: failed to upload /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe<http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> to UKI-LT2-QMUL2-disk A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result. Please, can you help us ? Thank you very much in anticipation ! Cheers, Daniel -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/
Hi Daniel, Arka, this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory) mkdir dirac_ui cd dirac_ui wget -np -O dirac-install https://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M And then run your upload command. Thanks, Daniela On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi Daniela,
Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL.
Many thanks for your help !!
Cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniela Bauer [ daniela.bauer.grid@googlemail.com] *Sent:* 20 March 2018 17:17 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Hi Daniel,
This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ?
Cheers, Daniela
On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/Stora geFactory.py", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2 _SRM2Storage.py", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2 _StorageBase.py", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload /vo.moedal.org/sim/13TEVYY/Fil esByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniel Felea [ Daniel.Felea@cern.ch] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file /vo.moedal.org/user/d/daniel.f elea/unweighted_events.lhe unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe Error: failed to upload /vo.moedal.org/user/d/daniel.f elea/unweighted_events.lhe to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/
Hello all, I think I've had a similar problem with this recently, and indeed it was down to the wrong gfal being picked up by the DIRAC UI used by the Ganga CVMFS scripts. I solved it by running: /cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh after setting up DIRAC etc. (Though it might be worth noting that, if you're using Ganga, some of the CVMFS scripts in there are a bit stale with respect to DIRAC etc. so if you can set up your own DIRAC UI it might be worthwhile anyway.) Cheers, Tom On Wed, 21 Mar 2018 at 10:17 Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Hi Daniel, Arka,
this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory)
mkdir dirac_ui cd dirac_ui wget -np -O dirac-install https://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M
And then run your upload command.
Thanks, Daniela
On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi Daniela,
Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL.
Many thanks for your help !!
Cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniela Bauer [ daniela.bauer.grid@googlemail.com] *Sent:* 20 March 2018 17:17 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Hi Daniel,
This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ?
Cheers, Daniela
On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload / vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniel Felea [ Daniel.Felea@cern.ch] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file / vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe Error: failed to upload / vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
Hi Tom, I tried your solution. But now I am getting the error which Daniel was getting: ''Error: failed to upload /vo.moedal.org/sim/13TEVYY/Fil esByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk" How do you solve this issue? Hi Daniela, I could successfully upload the files to the grid following your instructions. I guess these are the commands I need to run everytime I open a new connection to lxplus6: . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M Thanks, Arka On Wed, Mar 21, 2018 at 1:02 PM, Tom Whyntie <tom.whyntie@ndcn.ox.ac.uk> wrote:
Hello all,
I think I've had a similar problem with this recently, and indeed it was down to the wrong gfal being picked up by the DIRAC UI used by the Ganga CVMFS scripts.
I solved it by running:
/cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh
after setting up DIRAC etc.
(Though it might be worth noting that, if you're using Ganga, some of the CVMFS scripts in there are a bit stale with respect to DIRAC etc. so if you can set up your own DIRAC UI it might be worthwhile anyway.)
Cheers, Tom
On Wed, 21 Mar 2018 at 10:17 Daniela Bauer <daniela.bauer.grid@googlemail .com> wrote:
Hi Daniel, Arka,
this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory)
mkdir dirac_ui cd dirac_ui wget -np -O dirac-install https://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M
And then run your upload command.
Thanks, Daniela
On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi Daniela,
Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL.
Many thanks for your help !!
Cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniela Bauer [ daniela.bauer.grid@googlemail.com] *Sent:* 20 March 2018 17:17 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Hi Daniel,
This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ?
Cheers, Daniela
On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/Stora geFactory.py", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2 _SRM2Storage.py", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2 _StorageBase.py", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload /vo.moedal.org/sim/13TEVYY/Fil esByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniel Felea [ Daniel.Felea@cern.ch] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file /vo.moedal.org/user/d/daniel.f elea/unweighted_events.lhe unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe Error: failed to upload /vo.moedal.org/user/d/daniel.f elea/unweighted_events.lhe to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- =============================================================== *Arka Santra* *Post Doctoral Researcher* * Instituto de Fisica Corpuscular* * Parque Cientifico* * C/Catedratico Jose Beltran, 2* * E-46980, Paterna* * Espana* ===============================================================
@Arka - I didn't have that issue as I wasn't uploading to QMUL (I was using the Oxford disk, which I think uses a different storage backend?) - but using the -ddd (debugging flag) can help... Cheers, Tom On Wed, 21 Mar 2018 at 12:21 Arka Santra <santra.arka@gmail.com> wrote:
Hi Tom, I tried your solution. But now I am getting the error which Daniel was getting:
''Error: failed to upload / vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk"
How do you solve this issue?
Hi Daniela, I could successfully upload the files to the grid following your instructions. I guess these are the commands I need to run everytime I open a new connection to lxplus6:
. bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M
Thanks,
Arka
On Wed, Mar 21, 2018 at 1:02 PM, Tom Whyntie <tom.whyntie@ndcn.ox.ac.uk> wrote:
Hello all,
I think I've had a similar problem with this recently, and indeed it was down to the wrong gfal being picked up by the DIRAC UI used by the Ganga CVMFS scripts.
I solved it by running:
/cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh
after setting up DIRAC etc.
(Though it might be worth noting that, if you're using Ganga, some of the CVMFS scripts in there are a bit stale with respect to DIRAC etc. so if you can set up your own DIRAC UI it might be worthwhile anyway.)
Cheers, Tom
On Wed, 21 Mar 2018 at 10:17 Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Hi Daniel, Arka,
this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory)
mkdir dirac_ui cd dirac_ui wget -np -O dirac-install https://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M
And then run your upload command.
Thanks, Daniela
On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi Daniela,
Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL.
Many thanks for your help !!
Cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniela Bauer [ daniela.bauer.grid@googlemail.com] *Sent:* 20 March 2018 17:17 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Hi Daniel,
This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ?
Cheers, Daniela
On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe
StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload / vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniel Felea [ Daniel.Felea@cern.ch] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file / vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe Error: failed to upload / vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- =============================================================== *Arka Santra*
*Post Doctoral Researcher* * Instituto de Fisica Corpuscular*
* Parque Cientifico* * C/Catedratico Jose Beltran, 2 <https://maps.google.com/?q=C/Catedratico+Jose+Beltran,+2&entry=gmail&source=g>*
* E-46980, Paterna* * Espana* ===============================================================
Hi Arka, once you made the dirac UI, all you need to do is after your log in: cd dirac_ui source bashrc dirac-proxy-init -g vo.moedal.org_user -M and you are good to go (dirac-configure configures the UI, but you only need to do this once, though you probably will have to upgrade the UI 2-3 times a year). I'm not sure where the best place to report ganga related issues, you could try Mark Slater @ CERN. Regards, Daniela On 21 March 2018 at 12:21, Arka Santra <santra.arka@gmail.com> wrote:
Hi Tom, I tried your solution. But now I am getting the error which Daniel was getting:
''Error: failed to upload /vo.moedal.org/sim/13TEVYY/Fil esByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk"
How do you solve this issue?
Hi Daniela, I could successfully upload the files to the grid following your instructions. I guess these are the commands I need to run everytime I open a new connection to lxplus6:
. bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M
Thanks,
Arka
On Wed, Mar 21, 2018 at 1:02 PM, Tom Whyntie <tom.whyntie@ndcn.ox.ac.uk> wrote:
Hello all,
I think I've had a similar problem with this recently, and indeed it was down to the wrong gfal being picked up by the DIRAC UI used by the Ganga CVMFS scripts.
I solved it by running:
/cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh
after setting up DIRAC etc.
(Though it might be worth noting that, if you're using Ganga, some of the CVMFS scripts in there are a bit stale with respect to DIRAC etc. so if you can set up your own DIRAC UI it might be worthwhile anyway.)
Cheers, Tom
On Wed, 21 Mar 2018 at 10:17 Daniela Bauer <daniela.bauer.grid@googlemail .com> wrote:
Hi Daniel, Arka,
this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory)
mkdir dirac_ui cd dirac_ui wget -np -O dirac-install https://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M
And then run your upload command.
Thanks, Daniela
On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi Daniela,
Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL.
Many thanks for your help !!
Cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniela Bauer [ daniela.bauer.grid@googlemail.com] *Sent:* 20 March 2018 17:17 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Hi Daniel,
This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ?
Cheers, Daniela
On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe
StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/Stora geFactory.py", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2 _SRM2Storage.py", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2 _StorageBase.py", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload /vo.moedal.org/sim/13TEVYY/Fil esByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniel Felea [ Daniel.Felea@cern.ch] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file /vo.moedal.org/user/d/daniel.f elea/unweighted_events.lhe unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe Error: failed to upload /vo.moedal.org/user/d/daniel.f elea/unweighted_events.lhe to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- =============================================================== *Arka Santra*
*Post Doctoral Researcher* * Instituto de Fisica Corpuscular*
* Parque Cientifico* * C/Catedratico Jose Beltran, 2 <https://maps.google.com/?q=C/Catedratico+Jose+Beltran,+2&entry=gmail&source=g>*
* E-46980, Paterna* * Espana* ===============================================================
-- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/
Ganga issues can be reported on their GitHub page: https://github.com/ganga-devs/ganga/issues (If it can be shown more people are using the CVMFS scripts, this may help to get them updated too...) Cheers, Tom On Wed, 21 Mar 2018 at 12:31 Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Hi Arka,
once you made the dirac UI, all you need to do is after your log in:
cd dirac_ui source bashrc dirac-proxy-init -g vo.moedal.org_user -M
and you are good to go
(dirac-configure configures the UI, but you only need to do this once, though you probably will have to upgrade the UI 2-3 times a year).
I'm not sure where the best place to report ganga related issues, you could try Mark Slater @ CERN.
Regards,
Daniela
On 21 March 2018 at 12:21, Arka Santra <santra.arka@gmail.com> wrote:
Hi Tom, I tried your solution. But now I am getting the error which Daniel was getting:
''Error: failed to upload / vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk"
How do you solve this issue?
Hi Daniela, I could successfully upload the files to the grid following your instructions. I guess these are the commands I need to run everytime I open a new connection to lxplus6:
. bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M
Thanks,
Arka
On Wed, Mar 21, 2018 at 1:02 PM, Tom Whyntie <tom.whyntie@ndcn.ox.ac.uk> wrote:
Hello all,
I think I've had a similar problem with this recently, and indeed it was down to the wrong gfal being picked up by the DIRAC UI used by the Ganga CVMFS scripts.
I solved it by running:
/cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh
after setting up DIRAC etc.
(Though it might be worth noting that, if you're using Ganga, some of the CVMFS scripts in there are a bit stale with respect to DIRAC etc. so if you can set up your own DIRAC UI it might be worthwhile anyway.)
Cheers, Tom
On Wed, 21 Mar 2018 at 10:17 Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Hi Daniel, Arka,
this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory)
mkdir dirac_ui cd dirac_ui wget -np -O dirac-install https://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M
And then run your upload command.
Thanks, Daniela
On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi Daniela,
Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL.
Many thanks for your help !!
Cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniela Bauer [daniela.bauer.grid@googlemail.com] *Sent:* 20 March 2018 17:17 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Hi Daniel,
This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ?
Cheers, Daniela
On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading / vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload / vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniel Felea [Daniel.Felea@cern.ch] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file / vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe Error: failed to upload / vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- =============================================================== *Arka Santra*
*Post Doctoral Researcher* * Instituto de Fisica Corpuscular*
* Parque Cientifico* * C/Catedratico Jose Beltran, 2 <https://maps.google.com/?q=C/Catedratico+Jose+Beltran,+2&entry=gmail&source=g>*
* E-46980, Paterna* * Espana* ===============================================================
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/
Hi Daniela, Tom, Thank you very much for all your help and support ! So next I'll report this issue to Mark Slater and on the GitHub page and meanwhile we'll use the solution you proposed. Many thanks again and cheers, Daniel ________________________________ From: Tom Whyntie [tom.whyntie@ndcn.ox.ac.uk] Sent: 21 March 2018 13:42 To: Daniela Bauer Cc: santra.arka@gmail.com; gridpp-dirac-users@imperial.ac.uk; Daniel Felea Subject: Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL Ganga issues can be reported on their GitHub page: https://github.com/ganga-devs/ganga/issues (If it can be shown more people are using the CVMFS scripts, this may help to get them updated too...) Cheers, Tom On Wed, 21 Mar 2018 at 12:31 Daniela Bauer <daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>> wrote: Hi Arka, once you made the dirac UI, all you need to do is after your log in: cd dirac_ui source bashrc dirac-proxy-init -g vo.moedal.org_user -M and you are good to go (dirac-configure configures the UI, but you only need to do this once, though you probably will have to upgrade the UI 2-3 times a year). I'm not sure where the best place to report ganga related issues, you could try Mark Slater @ CERN. Regards, Daniela On 21 March 2018 at 12:21, Arka Santra <santra.arka@gmail.com<mailto:santra.arka@gmail.com>> wrote: Hi Tom, I tried your solution. But now I am getting the error which Daniel was getting: ''Error: failed to upload /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe<http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe> to UKI-LT2-QMUL2-disk" How do you solve this issue? Hi Daniela, I could successfully upload the files to the grid following your instructions. I guess these are the commands I need to run everytime I open a new connection to lxplus6: . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> -I dirac-proxy-init -g vo.moedal.org_user -M Thanks, Arka On Wed, Mar 21, 2018 at 1:02 PM, Tom Whyntie <tom.whyntie@ndcn.ox.ac.uk<mailto:tom.whyntie@ndcn.ox.ac.uk>> wrote: Hello all, I think I've had a similar problem with this recently, and indeed it was down to the wrong gfal being picked up by the DIRAC UI used by the Ganga CVMFS scripts. I solved it by running: /cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh<http://grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh> after setting up DIRAC etc. (Though it might be worth noting that, if you're using Ganga, some of the CVMFS scripts in there are a bit stale with respect to DIRAC etc. so if you can set up your own DIRAC UI it might be worthwhile anyway.) Cheers, Tom On Wed, 21 Mar 2018 at 10:17 Daniela Bauer <daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>> wrote: Hi Daniel, Arka, this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory) mkdir dirac_ui cd dirac_ui wget -np -O dirac-install https://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server<http://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> -I dirac-proxy-init -g vo.moedal.org_user -M And then run your upload command. Thanks, Daniela On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch<mailto:Daniel.Felea@cern.ch>> wrote: Hi Daniela, Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL. Many thanks for your help !! Cheers, Daniel ________________________________ From: gridpp-dirac-users-bounces@imperial.ac.uk<mailto:gridpp-dirac-users-bounces@imperial.ac.uk> [gridpp-dirac-users-bounces@imperial.ac.uk<mailto:gridpp-dirac-users-bounces@imperial.ac.uk>] on behalf of Daniela Bauer [daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>] Sent: 20 March 2018 17:17 To: gridpp-dirac-users@imperial.ac.uk<mailto:gridpp-dirac-users@imperial.ac.uk> Subject: Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL Hi Daniel, This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ? Cheers, Daniela On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch<mailto:Daniel.Felea@cern.ch>> wrote: Hi again, In addition to those sent before, please see below the errors got by MoEDAL colleague: Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe<http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe> StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py<http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py>", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py<http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py>", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py<http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py>", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe<http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe> to UKI-LT2-QMUL2-disk Many thanks in advance and cheers, Daniel ________________________________ From: gridpp-dirac-users-bounces@imperial.ac.uk<mailto:gridpp-dirac-users-bounces@imperial.ac.uk> [gridpp-dirac-users-bounces@imperial.ac.uk<mailto:gridpp-dirac-users-bounces@imperial.ac.uk>] on behalf of Daniel Felea [Daniel.Felea@cern.ch<mailto:Daniel.Felea@cern.ch>] Sent: 20 March 2018 15:41 To: gridpp-dirac-users@imperial.ac.uk<mailto:gridpp-dirac-users@imperial.ac.uk> Subject: [Gridpp-Dirac-Users] issue when uploading files to QMUL Hello, I recently tried to upload a file to QMUL but it failed, please see below: [gridpp@10 ganga]$ dirac-dms-add-file /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe<http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe<http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> Error: failed to upload /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe<http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> to UKI-LT2-QMUL2-disk A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result. Please, can you help us ? Thank you very much in anticipation ! Cheers, Daniel -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810<tel:+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810<tel:+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- =============================================================== Arka Santra Post Doctoral Researcher Instituto de Fisica Corpuscular Parque Cientifico C/Catedratico Jose Beltran, 2<https://maps.google.com/?q=C/Catedratico+Jose+Beltran,+2&entry=gmail&source=g> E-46980, Paterna Espana =============================================================== -- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810<tel:+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/
Dear All, I've updated the dirac UI on CVMFS and also updated the Dirac.ini file that Ganga uses for settings. I *think* it should all now be working (at least it was for me!) but I'm willing to be proved wrong! Thanks, Mark On 21/03/2018 15:56, Daniel.Felea@cern.ch wrote:
Hi Daniela, Tom,
Thank you very much for all your help and support !
So next I'll report this issue to Mark Slater and on the GitHub page and meanwhile we'll use the solution you proposed.
Many thanks again and cheers, Daniel
------------------------------------------------------------------------ *From:* Tom Whyntie [tom.whyntie@ndcn.ox.ac.uk] *Sent:* 21 March 2018 13:42 *To:* Daniela Bauer *Cc:* santra.arka@gmail.com; gridpp-dirac-users@imperial.ac.uk; Daniel Felea *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Ganga issues can be reported on their GitHub page:
https://github.com/ganga-devs/ganga/issues
(If it can be shown more people are using the CVMFS scripts, this may help to get them updated too...)
Cheers, Tom
On Wed, 21 Mar 2018 at 12:31 Daniela Bauer <daniela.bauer.grid@googlemail.com <mailto:daniela.bauer.grid@googlemail.com>> wrote:
Hi Arka,
once you made the dirac UI, all you need to do is after your log in:
cd dirac_ui source bashrc dirac-proxy-init -g vo.moedal.org_user -M
and you are good to go
(dirac-configure configures the UI, but you only need to do this once, though you probably will have to upgrade the UI 2-3 times a year).
I'm not sure where the best place to report ganga related issues, you could try Mark Slater @ CERN.
Regards,
Daniela
On 21 March 2018 at 12:21, Arka Santra <santra.arka@gmail.com <mailto:santra.arka@gmail.com>> wrote:
Hi Tom, I tried your solution. But now I am getting the error which Daniel was getting:
''Error: failed to upload /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe <http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe> to UKI-LT2-QMUL2-disk"
How do you solve this issue?
Hi Daniela, I could successfully upload the files to the grid following your instructions. I guess these are the commands I need to run everytime I open a new connection to lxplus6:
. bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server <http://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> -I dirac-proxy-init -g vo.moedal.org_user -M
Thanks,
Arka
On Wed, Mar 21, 2018 at 1:02 PM, Tom Whyntie <tom.whyntie@ndcn.ox.ac.uk <mailto:tom.whyntie@ndcn.ox.ac.uk>> wrote:
Hello all,
I think I've had a similar problem with this recently, and indeed it was down to the wrong gfal being picked up by the DIRAC UI used by the Ganga CVMFS scripts.
I solved it by running:
/cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh <http://grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh>
after setting up DIRAC etc.
(Though it might be worth noting that, if you're using Ganga, some of the CVMFS scripts in there are a bit stale with respect to DIRAC etc. so if you can set up your own DIRAC UI it might be worthwhile anyway.)
Cheers, Tom
On Wed, 21 Mar 2018 at 10:17 Daniela Bauer <daniela.bauer.grid@googlemail.com <mailto:daniela.bauer.grid@googlemail.com>> wrote:
Hi Daniel, Arka,
this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory)
mkdir dirac_ui cd dirac_ui wget -np -O dirac-installhttps://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server <http://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> -I dirac-proxy-init -g vo.moedal.org_user -M
And then run your upload command.
Thanks, Daniela
On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch <mailto:Daniel.Felea@cern.ch>> wrote:
Hi Daniela,
Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL.
Many thanks for your help !!
Cheers, Daniel
------------------------------------------------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk> [gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk>] on behalf of Daniela Bauer [daniela.bauer.grid@googlemail.com <mailto:daniela.bauer.grid@googlemail.com>] *Sent:* 20 March 2018 17:17 *To:* gridpp-dirac-users@imperial.ac.uk <mailto:gridpp-dirac-users@imperial.ac.uk> *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Hi Daniel,
This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ?
Cheers, Daniela
On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch <mailto:Daniel.Felea@cern.ch>> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe <http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe>
StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py <http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py>", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py <http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py>", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py <http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py>", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe <http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe> to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------------------------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk> [gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk>] on behalf of Daniel Felea [Daniel.Felea@cern.ch <mailto:Daniel.Felea@cern.ch>] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk <mailto:gridpp-dirac-users@imperial.ac.uk> *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe <http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe <http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe>
Error: failed to upload /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe <http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk <mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk <mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <tel:+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ <http://www.hep.ph.ic.ac.uk/%7Edbauer/>
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk <mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk <mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <tel:+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ <http://www.hep.ph.ic.ac.uk/%7Edbauer/> -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk <mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- =============================================================== /Arka Santra/ /Post Doctoral Researcher / / Instituto de Fisica Corpuscular/ / Parque Cientifico / /C/Catedratico Jose Beltran, 2 <https://maps.google.com/?q=C/Catedratico+Jose+Beltran,+2&entry=gmail&source=g>/ / E-46980, Paterna / / Espana/ ===============================================================
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk <mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <tel:+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ <http://www.hep.ph.ic.ac.uk/%7Edbauer/>
Hi Tom et al, setting up the EMI UI will leave your environment in an odd state which causes all sorts of problems down the line, so we generally don't recommend this. Here it's really ganga that needs to update their bashrc. Usually it's better if users maintain their own UI so they are independent of any ganga developments. Regards, Daniela On 21 March 2018 at 12:02, Tom Whyntie <tom.whyntie@ndcn.ox.ac.uk> wrote:
Hello all,
I think I've had a similar problem with this recently, and indeed it was down to the wrong gfal being picked up by the DIRAC UI used by the Ganga CVMFS scripts.
I solved it by running:
/cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh
after setting up DIRAC etc.
(Though it might be worth noting that, if you're using Ganga, some of the CVMFS scripts in there are a bit stale with respect to DIRAC etc. so if you can set up your own DIRAC UI it might be worthwhile anyway.)
Cheers, Tom
On Wed, 21 Mar 2018 at 10:17 Daniela Bauer <daniela.bauer.grid@ googlemail.com> wrote:
Hi Daniel, Arka,
this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory)
mkdir dirac_ui cd dirac_ui wget -np -O dirac-install https://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M
And then run your upload command.
Thanks, Daniela
On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi Daniela,
Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL.
Many thanks for your help !!
Cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniela Bauer [ daniela.bauer.grid@googlemail.com] *Sent:* 20 March 2018 17:17 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Hi Daniel,
This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ?
Cheers, Daniela
On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/ StorageFactory.py", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/ GFAL2_SRM2Storage.py", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/ GFAL2_StorageBase.py", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload /vo.moedal.org/sim/13TEVYY/ FilesByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniel Felea [ Daniel.Felea@cern.ch] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file /vo.moedal.org/user/d/daniel. felea/unweighted_events.lhe unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe Error: failed to upload /vo.moedal.org/user/d/daniel. felea/unweighted_events.lhe to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/
Hi Tom, Is the DIRAC UI on CVMFS out of date? I can update it or if there are other specific issues with scripts I can get them fixed as well! Thanks, Mark On 21/03/2018 12:02, Tom Whyntie wrote:
Hello all,
I think I've had a similar problem with this recently, and indeed it was down to the wrong gfal being picked up by the DIRAC UI used by the Ganga CVMFS scripts.
I solved it by running:
/cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh <http://grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh>
after setting up DIRAC etc.
(Though it might be worth noting that, if you're using Ganga, some of the CVMFS scripts in there are a bit stale with respect to DIRAC etc. so if you can set up your own DIRAC UI it might be worthwhile anyway.)
Cheers, Tom
On Wed, 21 Mar 2018 at 10:17 Daniela Bauer <daniela.bauer.grid@googlemail.com <mailto:daniela.bauer.grid@googlemail.com>> wrote:
Hi Daniel, Arka,
this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory)
mkdir dirac_ui cd dirac_ui wget -np -O dirac-installhttps://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server <http://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> -I dirac-proxy-init -g vo.moedal.org_user -M
And then run your upload command.
Thanks, Daniela
On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch <mailto:Daniel.Felea@cern.ch>> wrote:
Hi Daniela,
Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL.
Many thanks for your help !!
Cheers, Daniel
------------------------------------------------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk> [gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk>] on behalf of Daniela Bauer [daniela.bauer.grid@googlemail.com <mailto:daniela.bauer.grid@googlemail.com>] *Sent:* 20 March 2018 17:17 *To:* gridpp-dirac-users@imperial.ac.uk <mailto:gridpp-dirac-users@imperial.ac.uk> *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Hi Daniel,
This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ?
Cheers, Daniela
On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch <mailto:Daniel.Felea@cern.ch>> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe <http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe>
StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py <http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py>", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py <http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py>", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py <http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py>", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe <http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe> to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------------------------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk> [gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk>] on behalf of Daniel Felea [Daniel.Felea@cern.ch <mailto:Daniel.Felea@cern.ch>] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk <mailto:gridpp-dirac-users@imperial.ac.uk> *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe <http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe <http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe>
Error: failed to upload /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe <http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk <mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk <mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <tel:+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ <http://www.hep.ph.ic.ac.uk/%7Edbauer/>
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk <mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk <mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <tel:+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ <http://www.hep.ph.ic.ac.uk/%7Edbauer/> -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk <mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
@Mark: Last time I checked DIRAC didn't work out of the box with Ganga - see, for example: https://github.com/ganga-devs/ganga/issues/842 which is still open... I did some workarounds in the end but if there are more users who are experiencing similar issues updating would be cool, as it makes life a lot easier (especially when working with CernVMs where one has to reinstall the UI each time...). Cheers, Tom On Wed, 21 Mar 2018 at 14:51 Mark Slater <mslater@cern.ch> wrote:
Hi Tom,
Is the DIRAC UI on CVMFS out of date? I can update it or if there are other specific issues with scripts I can get them fixed as well!
Thanks, Mark
On 21/03/2018 12:02, Tom Whyntie wrote:
Hello all,
I think I've had a similar problem with this recently, and indeed it was down to the wrong gfal being picked up by the DIRAC UI used by the Ganga CVMFS scripts.
I solved it by running:
/cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh
after setting up DIRAC etc.
(Though it might be worth noting that, if you're using Ganga, some of the CVMFS scripts in there are a bit stale with respect to DIRAC etc. so if you can set up your own DIRAC UI it might be worthwhile anyway.)
Cheers, Tom
On Wed, 21 Mar 2018 at 10:17 Daniela Bauer < daniela.bauer.grid@googlemail.com> wrote:
Hi Daniel, Arka,
this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory)
mkdir dirac_ui cd dirac_ui wget -np -O dirac-install https://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server -I dirac-proxy-init -g vo.moedal.org_user -M
And then run your upload command.
Thanks, Daniela
On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi Daniela,
Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL.
Many thanks for your help !!
Cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniela Bauer [ daniela.bauer.grid@googlemail.com] *Sent:* 20 March 2018 17:17 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Hi Daniel,
This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ?
Cheers, Daniela
On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload / vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk [ gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniel Felea [ Daniel.Felea@cern.ch] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file / vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe Error: failed to upload / vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
hi Tom I'll look into this and try to get it fixed ASAP! THanks, Mark On 21/03/2018 15:04, Tom Whyntie wrote:
@Mark: Last time I checked DIRAC didn't work out of the box with Ganga - see, for example:
https://github.com/ganga-devs/ganga/issues/842
which is still open... I did some workarounds in the end but if there are more users who are experiencing similar issues updating would be cool, as it makes life a lot easier (especially when working with CernVMs where one has to reinstall the UI each time...).
Cheers, Tom
On Wed, 21 Mar 2018 at 14:51 Mark Slater <mslater@cern.ch <mailto:mslater@cern.ch>> wrote:
Hi Tom,
Is the DIRAC UI on CVMFS out of date? I can update it or if there are other specific issues with scripts I can get them fixed as well!
Thanks, Mark
On 21/03/2018 12:02, Tom Whyntie wrote:
Hello all,
I think I've had a similar problem with this recently, and indeed it was down to the wrong gfal being picked up by the DIRAC UI used by the Ganga CVMFS scripts.
I solved it by running:
/cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh <http://grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh>
after setting up DIRAC etc.
(Though it might be worth noting that, if you're using Ganga, some of the CVMFS scripts in there are a bit stale with respect to DIRAC etc. so if you can set up your own DIRAC UI it might be worthwhile anyway.)
Cheers, Tom
On Wed, 21 Mar 2018 at 10:17 Daniela Bauer <daniela.bauer.grid@googlemail.com <mailto:daniela.bauer.grid@googlemail.com>> wrote:
Hi Daniel, Arka,
this looks like a problem with the ganga UI to which I don't have any immediate access. Could you (plural you) *in a clean shell* (definitely no ganga setup) on either SL6 or SL7 do this: (note you usercet.pem and userkey.oem must be in .globus in your home directory)
mkdir dirac_ui cd dirac_ui wget -np -O dirac-installhttps://raw.githubusercontent.com/DIRACGrid/DIRAC/integration/Core/scripts/d... chmod u+x dirac-install ./dirac-install -r v6r19p10 -i 27 -g v13r0 . bashrc dirac-proxy-init -x # (needs user cert password) dirac-configure -F -S GridPP -C dips://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server <http://dirac01.grid.hep.ph.ic.ac.uk:9135/Configuration/Server> -I dirac-proxy-init -g vo.moedal.org_user -M
And then run your upload command.
Thanks, Daniela
On 21 March 2018 at 08:45, Daniel Felea <Daniel.Felea@cern.ch <mailto:Daniel.Felea@cern.ch>> wrote:
Hi Daniela,
Thank you very much for your help. Arka sent an email with the environment he's been using. I do not have Arka's issue, however, no person from MoEDAL exp. can upload files to QMUL.
Many thanks for your help !!
Cheers, Daniel
------------------------------------------------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk> [gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk>] on behalf of Daniela Bauer [daniela.bauer.grid@googlemail.com <mailto:daniela.bauer.grid@googlemail.com>] *Sent:* 20 March 2018 17:17 *To:* gridpp-dirac-users@imperial.ac.uk <mailto:gridpp-dirac-users@imperial.ac.uk> *Subject:* Re: [Gridpp-Dirac-Users] errors - issue when uploading files to QMUL
Hi Daniel,
This looks like the command is picking up the wrong version of gfal. Is this a recently installed UI ? Could you please sent us your environment ?
Cheers, Daniela
On 20 March 2018 at 16:09, Daniel Felea <Daniel.Felea@cern.ch <mailto:Daniel.Felea@cern.ch>> wrote:
Hi again,
In addition to those sent before, please see below the errors got by MoEDAL colleague:
Uploading /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe <http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe>
StorageFactory._generateStorageObject: Failed to instantiate UKI-LT2-QMUL2-disk: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py <http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/StorageFactory.py>", line 416, in __generateStorageObject storage = storageClass(storageName, parameters) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py <http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_SRM2Storage.py>", line 31, in __init__ super( GFAL2_SRM2Storage, self ).__init__( storageName, parameters ) File "/cvmfs/ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py <http://ganga.cern.ch/dirac_ui/DIRAC/Resources/Storage/GFAL2_StorageBase.py>", line 74, in __init__ self.ctx = gfal2.creat_context() GError: Unable to open the /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so plugin specified in the plugin directory, failure : /usr/lib64/gfal2-plugins//libgfal_plugin_srm.so: undefined symbol: gfalt_get_checksum StorageFactory.getStorages: Failed to instantiate any storage protocols. UKI-LT2-QMUL2-disk Error: failed to upload /vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe <http://vo.moedal.org/sim/13TEVYY/FilesByArka/unweighted_events.lhe> to UKI-LT2-QMUL2-disk
Many thanks in advance and cheers, Daniel
------------------------------------------------------------------------ *From:* gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk> [gridpp-dirac-users-bounces@imperial.ac.uk <mailto:gridpp-dirac-users-bounces@imperial.ac.uk>] on behalf of Daniel Felea [Daniel.Felea@cern.ch <mailto:Daniel.Felea@cern.ch>] *Sent:* 20 March 2018 15:41 *To:* gridpp-dirac-users@imperial.ac.uk <mailto:gridpp-dirac-users@imperial.ac.uk> *Subject:* [Gridpp-Dirac-Users] issue when uploading files to QMUL
Hello,
I recently tried to upload a file to QMUL but it failed, please see below:
[gridpp@10 ganga]$ dirac-dms-add-file /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe <http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> unweighted_events.lhe UKI-LT2-QMUL2-disk Uploading /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe <http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe>
Error: failed to upload /vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe <http://vo.moedal.org/user/d/daniel.felea/unweighted_events.lhe> to UKI-LT2-QMUL2-disk
A colleague from MoEDAL tells me that he also tried to upload a bunch of files on QMUL two weeks ago, but with the same negative result.
Please, can you help us ?
Thank you very much in anticipation !
Cheers, Daniel
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk <mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk <mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <tel:+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ <http://www.hep.ph.ic.ac.uk/%7Edbauer/>
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk <mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair
----------------------------------------------------------- daniela.bauer@imperial.ac.uk <mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <tel:+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/ <http://www.hep.ph.ic.ac.uk/%7Edbauer/> -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk <mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk <mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
participants (5)
-
Arka Santra
-
Daniel Felea
-
Daniela Bauer
-
Mark Slater
-
Tom Whyntie