Hi Daniela, Thanks a lot ! Indeed, could be related to the issue you pointed out. Many thanks and cheers, Daniel ________________________________ From: gridpp-dirac-users-bounces@imperial.ac.uk [gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Daniela Bauer [daniela.bauer.grid@googlemail.com] Sent: 09 November 2017 09:56 To: gridpp-dirac-users@imperial.ac.uk Subject: Re: [Gridpp-Dirac-Users] ConfigError for MoEDAL Grid simulations Hi Daniel, Possibly related to this ? https://github.com/ganga-devs/ganga/issues/1115 I think this is a ganga rather than dirac issue, but I think the people involved are on this list and will hopefully comment. Regards, Daniela On 9 November 2017 at 08:47, Daniel Felea <Daniel.Felea@cern.ch<mailto:Daniel.Felea@cern.ch>> wrote: Hello All, I have got a recent issue when submitting MoEDAL simulations on Grid using Ganga and Dirac. Please see the png file attached, regarding the ConfigError (something with defaults_GaudiXMLSummary). The .gangarc file I have been using is the default one, adapted to VO MoEDAL. And everything goes perfectly when running lxplus or local simulations using Ganga on VM... I would be more than grateful for any hint on this issue. Thank you in anticipation ! Cheers, Daniel -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users -- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/

Hi Rob, Is GangaGaudi uses in LHCb now or do I understand you that it's now not needed? This bug I also saw and fixed for the vanilla_dirac_fix branch but that branch cant be merged yet as it somehow breaks LHCb. Essentially the fix is to move the imports from GangaGaudi/Lib/__init__.py back to GangaGaudi/__init__.py where they used to be. Do you remember why they were moved in the first place given that GangaDirac and GangaLHCb all have the imports in the package_root/__init__.py file? Cheers Alex On 09/11/17 11:22, Robert Currie wrote:

Hi Daniel,

Can you share your .gangarc and the script/commands which are failing for you, thanks :)

This is a bug in ganga trying to load (effectively LHCb/Gaudi) code from the vanilla Dirac plugin and should be fixed.

(This code should either be in the Dirac plugin if it's needed there or removed as I suspect GangaGaudi is no longer strictly needed/supported after recent developments within LHCb)

As a short term I suspect this can be fixed by either loading the GangaGaudi in your .gangarc, let me know if you need help with that,

Regards,

Rob

On 09/11/2017 08:56 AM, Daniela Bauer wrote:

...

Hi Daniel,

Possibly related to this ? https://github.com/ganga-devs/ganga/issues/1115

I think this is a ganga rather than dirac issue, but I think the people involved are on this list and will hopefully comment.

Regards, Daniela

On 9 November 2017 at 08:47, Daniel Felea <Daniel.Felea@cern.ch> wrote:

...

Hello All,

I have got a recent issue when submitting MoEDAL simulations on Grid using Ganga and Dirac. Please see the png file attached, regarding the ConfigError (something with defaults_GaudiXMLSummary). The .gangarc file I have been using is the default one, adapted to VO MoEDAL. And everything goes perfectly when running lxplus or local simulations using Ganga on VM...

I would be more than grateful for any hint on this issue.

Thank you in anticipation !

Cheers, Daniel

-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users [1]

--

Sent from the pit of despair

----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/

Links: ------ [1] https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

-- Dr. Alexander Richards High Energy Particle Physics Imperial College London Blackett 529 (020)-759-47802

Hi Rob, Alex, Thank you very much for your help !! I attached my .gangarc file. The commands I've been using : $ cd $WORKING_DIR/moedal-run-simulations/ganga $ source /cvmfs/ganga.cern.ch/dirac_ui/bashrc $ dirac-proxy-init -g vo.moedal.org_user -M $ source /cvmfs/ganga.cern.ch/runGanga.sh Then: Ganga In [x]: execfile(‘make_local_lhe_job.py’) Ganga In [x]: j.submit() Many thanks and cheers, Daniel ________________________________________ From: gridpp-dirac-users-bounces@imperial.ac.uk [gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Alexander Richards [a.richards@imperial.ac.uk] Sent: 09 November 2017 12:36 To: rob.currie@ed.ac.uk; gridpp-dirac-users@imperial.ac.uk Subject: Re: [Gridpp-Dirac-Users] ConfigError for MoEDAL Grid simulations Hi Rob, Is GangaGaudi uses in LHCb now or do I understand you that it's now not needed? This bug I also saw and fixed for the vanilla_dirac_fix branch but that branch cant be merged yet as it somehow breaks LHCb. Essentially the fix is to move the imports from GangaGaudi/Lib/__init__.py back to GangaGaudi/__init__.py where they used to be. Do you remember why they were moved in the first place given that GangaDirac and GangaLHCb all have the imports in the package_root/__init__.py file? Cheers Alex On 09/11/17 11:22, Robert Currie wrote:

Hi Daniel,

Can you share your .gangarc and the script/commands which are failing for you, thanks :)

This is a bug in ganga trying to load (effectively LHCb/Gaudi) code from the vanilla Dirac plugin and should be fixed.

(This code should either be in the Dirac plugin if it's needed there or removed as I suspect GangaGaudi is no longer strictly needed/supported after recent developments within LHCb)

As a short term I suspect this can be fixed by either loading the GangaGaudi in your .gangarc, let me know if you need help with that,

Regards,

Rob

On 09/11/2017 08:56 AM, Daniela Bauer wrote:

...

Hi Daniel,

Possibly related to this ? https://github.com/ganga-devs/ganga/issues/1115

I think this is a ganga rather than dirac issue, but I think the people involved are on this list and will hopefully comment.

Regards, Daniela

On 9 November 2017 at 08:47, Daniel Felea <Daniel.Felea@cern.ch> wrote:

...

Hello All,

I have got a recent issue when submitting MoEDAL simulations on Grid using Ganga and Dirac. Please see the png file attached, regarding the ConfigError (something with defaults_GaudiXMLSummary). The .gangarc file I have been using is the default one, adapted to VO MoEDAL. And everything goes perfectly when running lxplus or local simulations using Ganga on VM...

I would be more than grateful for any hint on this issue.

Thank you in anticipation !

Cheers, Daniel

-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users [1]

--

Sent from the pit of despair

----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/

Links: ------ [1] https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

-- Dr. Alexander Richards High Energy Particle Physics Imperial College London Blackett 529 (020)-759-47802 -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

Since your not using the LHCb plugin you could try the vanilla_dirac_fix branch code I mentioned. I've written a detailed description of how to setup Ganga for use with dirac here: https://github.com/ganga-devs/ganga/blob/vanilla_dirac_fix/python/GangaDirac... This includes all steps needed from scratch and doesn't require you to have CVMFS. Obviously if your dirac ui is based on CVMFS you can point the ganga config to that instead of setting up your own. Just remember that as this branch is not merged yet you will need to install it using: pip install https://github.com/ganga-devs/ganga/archive/vanilla_dirac_fix.zip Cheers Alex If you try this, since the whole point of this branch is to simplify the process of setting up Ganga for use with Dirac I'd be interested to know how well it works for you. On 09/11/17 12:18, Daniel Felea wrote:

Sorry, instead 'local' it's about 'dirac', of course... :)

Ganga In [x]: execfile(‘make_dirac_lhe_job.py’) Ganga In [x]: j.submit()

Cheers, Daniel

________________________________________ From: Daniel Felea Sent: 09 November 2017 13:15 To: gridpp-dirac-users@imperial.ac.uk; rob.currie@ed.ac.uk; a.richards@imperial.ac.uk Subject: RE: [Gridpp-Dirac-Users] ConfigError for MoEDAL Grid simulations

Hi Rob, Alex,

Thank you very much for your help !!

I attached my .gangarc file.

The commands I've been using :

$ cd $WORKING_DIR/moedal-run-simulations/ganga $ source /cvmfs/ganga.cern.ch/dirac_ui/bashrc $ dirac-proxy-init -g vo.moedal.org_user -M $ source /cvmfs/ganga.cern.ch/runGanga.sh

Then: Ganga In [x]: execfile(‘make_local_lhe_job.py’) Ganga In [x]: j.submit()

Many thanks and cheers, Daniel

________________________________________ From: gridpp-dirac-users-bounces@imperial.ac.uk [gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Alexander Richards [a.richards@imperial.ac.uk] Sent: 09 November 2017 12:36 To: rob.currie@ed.ac.uk; gridpp-dirac-users@imperial.ac.uk Subject: Re: [Gridpp-Dirac-Users] ConfigError for MoEDAL Grid simulations

Hi Rob,

Is GangaGaudi uses in LHCb now or do I understand you that it's now not needed? This bug I also saw and fixed for the vanilla_dirac_fix branch but that branch cant be merged yet as it somehow breaks LHCb.

Essentially the fix is to move the imports from GangaGaudi/Lib/__init__.py back to GangaGaudi/__init__.py where they used to be. Do you remember why they were moved in the first place given that GangaDirac and GangaLHCb all have the imports in the package_root/__init__.py file?

Cheers Alex

On 09/11/17 11:22, Robert Currie wrote:

...

Hi Daniel,

Can you share your .gangarc and the script/commands which are failing for you, thanks :)

This is a bug in ganga trying to load (effectively LHCb/Gaudi) code from the vanilla Dirac plugin and should be fixed.

(This code should either be in the Dirac plugin if it's needed there or removed as I suspect GangaGaudi is no longer strictly needed/supported after recent developments within LHCb)

As a short term I suspect this can be fixed by either loading the GangaGaudi in your .gangarc, let me know if you need help with that,

Regards,

Rob

On 09/11/2017 08:56 AM, Daniela Bauer wrote:

...

Hi Daniel,

Possibly related to this ? https://github.com/ganga-devs/ganga/issues/1115

I think this is a ganga rather than dirac issue, but I think the people involved are on this list and will hopefully comment.

Regards, Daniela

On 9 November 2017 at 08:47, Daniel Felea <Daniel.Felea@cern.ch> wrote:

...

Hello All,

I have got a recent issue when submitting MoEDAL simulations on Grid using Ganga and Dirac. Please see the png file attached, regarding the ConfigError (something with defaults_GaudiXMLSummary). The .gangarc file I have been using is the default one, adapted to VO MoEDAL. And everything goes perfectly when running lxplus or local simulations using Ganga on VM...

I would be more than grateful for any hint on this issue.

Thank you in anticipation !

Cheers, Daniel

-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users [1]

--

Sent from the pit of despair

----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/

Links: ------ [1] https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

-- Dr. Alexander Richards High Energy Particle Physics Imperial College London Blackett 529 (020)-759-47802

-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

-- Dr. Alexander Richards High Energy Particle Physics Imperial College London Blackett 529 (020)-759-47802

As I recall from my testing Rob this wont help but I'd be happy to be proved wrong. Cheers Alex On 09/11/17 12:28, Robert Currie wrote:

Hi Daniel,

Can you try adding:

``` [Configuration] RUNTIME_PATH = GangaDirac:GangaGaudi ```

to your .gangarc file. This may help you get a bit further in submitting your jobs,

Rob

On 09/11/2017 12:18 PM, Daniel Felea wrote:

...

Sorry, instead 'local' it's about 'dirac', of course... :)

Ganga In [x]: execfile(‘make_dirac_lhe_job.py’) Ganga In [x]: j.submit()

Cheers, Daniel

________________________________________ From: Daniel Felea Sent: 09 November 2017 13:15 To: gridpp-dirac-users@imperial.ac.uk; rob.currie@ed.ac.uk; a.richards@imperial.ac.uk Subject: RE: [Gridpp-Dirac-Users] ConfigError for MoEDAL Grid simulations

Hi Rob, Alex,

Thank you very much for your help !!

I attached my .gangarc file.

The commands I've been using :

$ cd $WORKING_DIR/moedal-run-simulations/ganga $ source /cvmfs/ganga.cern.ch/dirac_ui/bashrc $ dirac-proxy-init -g vo.moedal.org_user -M $ source /cvmfs/ganga.cern.ch/runGanga.sh

Then: Ganga In [x]: execfile(‘make_local_lhe_job.py’) Ganga In [x]: j.submit()

Many thanks and cheers, Daniel

________________________________________ From: gridpp-dirac-users-bounces@imperial.ac.uk [gridpp-dirac-users-bounces@imperial.ac.uk] on behalf of Alexander Richards [a.richards@imperial.ac.uk] Sent: 09 November 2017 12:36 To: rob.currie@ed.ac.uk; gridpp-dirac-users@imperial.ac.uk Subject: Re: [Gridpp-Dirac-Users] ConfigError for MoEDAL Grid simulations

Hi Rob,

Is GangaGaudi uses in LHCb now or do I understand you that it's now not needed? This bug I also saw and fixed for the vanilla_dirac_fix branch but that branch cant be merged yet as it somehow breaks LHCb.

Essentially the fix is to move the imports from GangaGaudi/Lib/__init__.py back to GangaGaudi/__init__.py where they used to be. Do you remember why they were moved in the first place given that GangaDirac and GangaLHCb all have the imports in the package_root/__init__.py file?

Cheers Alex

On 09/11/17 11:22, Robert Currie wrote:

...

Hi Daniel,

Can you share your .gangarc and the script/commands which are failing for you, thanks :)

This is a bug in ganga trying to load (effectively LHCb/Gaudi) code from the vanilla Dirac plugin and should be fixed.

(This code should either be in the Dirac plugin if it's needed there or removed as I suspect GangaGaudi is no longer strictly needed/supported after recent developments within LHCb)

As a short term I suspect this can be fixed by either loading the GangaGaudi in your .gangarc, let me know if you need help with that,

Regards,

Rob

On 09/11/2017 08:56 AM, Daniela Bauer wrote:

...

Hi Daniel,

Possibly related to this ? https://github.com/ganga-devs/ganga/issues/1115

I think this is a ganga rather than dirac issue, but I think the people involved are on this list and will hopefully comment.

Regards, Daniela

On 9 November 2017 at 08:47, Daniel Felea <Daniel.Felea@cern.ch> wrote:

...

Hello All,

I have got a recent issue when submitting MoEDAL simulations on Grid using Ganga and Dirac. Please see the png file attached, regarding the ConfigError (something with defaults_GaudiXMLSummary). The .gangarc file I have been using is the default one, adapted to VO MoEDAL. And everything goes perfectly when running lxplus or local simulations using Ganga on VM...

I would be more than grateful for any hint on this issue.

Thank you in anticipation !

Cheers, Daniel

-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users [1]

--

Sent from the pit of despair

----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/

Links: ------ [1] https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

-- Dr. Alexander Richards High Energy Particle Physics Imperial College London Blackett 529 (020)-759-47802

-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

-- Dr. Alexander Richards High Energy Particle Physics Imperial College London Blackett 529 (020)-759-47802

Hi Rob, the up-to-date version for setting up the dirac UI is always at the same place: https://www.gridpp.ac.uk/wiki/Quick_Guide_to_Dirac#Dirac_client_installation (it's the first result when you google 'gridpp dirac'). You can always put your voms configs to /cvmfs/grid.cern.ch/etc/grid-security/vomses/ /cvmfs/grid.cern.ch/etc/grid-security/vomsdir as these are usually up to date (though a fresh UI install will also do). Cheers, Daniela On 9 November 2017 at 12:45, Robert Currie <rob.currie@ed.ac.uk> wrote:

Hi all,

Is there an upto date set of instructions anywhere for how to setup the dirac_ui for the Imperial instance of DIRAC?

From a quick glance the only docs I see online are pointing to the ganga cvmfs space which I think has out-dated voms configs again,

Thanks,

Rob

On 09/11/2017 08:56 AM, Daniela Bauer wrote:

Hi Daniel,

Possibly related to this ? https://github.com/ganga-devs/ganga/issues/1115

I think this is a ganga rather than dirac issue, but I think the people involved are on this list and will hopefully comment.

Regards, Daniela

On 9 November 2017 at 08:47, Daniel Felea <Daniel.Felea@cern.ch> wrote:

...

Hello All,

I have got a recent issue when submitting MoEDAL simulations on Grid using Ganga and Dirac. Please see the png file attached, regarding the ConfigError (something with defaults_GaudiXMLSummary). The .gangarc file I have been using is the default one, adapted to VO MoEDAL. And everything goes perfectly when running lxplus or local simulations using Ganga on VM...

I would be more than grateful for any hint on this issue.

Thank you in anticipation !

Cheers, Daniel

-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

-- Sent from the pit of despair

----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/

The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

-- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/

Hi Daniela, Hmm, I was just a little weary of the instructions as there were dates here going back to January 2017. Does this ever get updated (e.g. for upcoming gpu support) I'll verify 100% that the problems I see with the ganga config from cvmfs are due to the voms issue or not again by pointing this config to use the ones from grid.cern.ch but I'm wondering if we can't better automate the out of the box experience. I think this keeps coming down to the ganga cvmfs area needing to update it's (voms?) config on cvmfs again. Thanks, Rob On 09/11/2017 01:36 PM, Alexander Richards wrote:

This link is also available on the instructions page I linked to earlier.

--Alex

On 09/11/17 13:33, Daniela Bauer wrote:

...

Hi Rob,

the up-to-date version for setting up the dirac UI is always at the same place: https://www.gridpp.ac.uk/wiki/Quick_Guide_to_Dirac#Dirac_client_installation (it's the first result when you google 'gridpp dirac'). You can always put your voms configs to /cvmfs/grid.cern.ch/etc/grid-security/vomses/ /cvmfs/grid.cern.ch/etc/grid-security/vomsdir as these are usually up to date (though a fresh UI install will also do).

Cheers, Daniela

On 9 November 2017 at 12:45, Robert Currie <rob.currie@ed.ac.uk> wrote:

...

Hi all,

Is there an upto date set of instructions anywhere for how to setup the dirac_ui for the Imperial instance of DIRAC?

From a quick glance the only docs I see online are pointing to the ganga cvmfs space which I think has out-dated voms configs again,

Thanks,

Rob

On 09/11/2017 08:56 AM, Daniela Bauer wrote:

Hi Daniel,

Possibly related to this ? https://github.com/ganga-devs/ganga/issues/1115

I think this is a ganga rather than dirac issue, but I think the people involved are on this list and will hopefully comment.

Regards, Daniela

On 9 November 2017 at 08:47, Daniel Felea <Daniel.Felea@cern.ch> wrote:

...

Hello All,

I have got a recent issue when submitting MoEDAL simulations on Grid using Ganga and Dirac. Please see the png file attached, regarding the ConfigError (something with defaults_GaudiXMLSummary). The .gangarc file I have been using is the default one, adapted to VO MoEDAL. And everything goes perfectly when running lxplus or local simulations using Ganga on VM...

I would be more than grateful for any hint on this issue.

Thank you in anticipation !

Cheers, Daniel

-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users

-- Sent from the pit of despair

----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 <+44%2020%207594%207810> http://www.hep.ph.ic.ac.uk/~dbauer/

The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

-- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.