July 2022 - Gridpp-Dirac-Users

The DIRAC upgrade has finished
by Daniela Bauer 02 Aug '22

02 Aug '22

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Dear All, The upgrade of the DIRAC server has now finished; please let us know of any problems. Please note that python3 is now the default and we recommend upgrading your UI to python3 using the instructions provided here: https://www.gridpp.ac.uk/wiki/Quick_Guide_to_Dirac For our cvmfs DIRAC UI users: *After cvmfs syncs the next time - this might take a day*: /cvmfs/dirac.egi.eu/dirac/bashrc_gridpp will point to a python3 install, the legacy python 2 install can be found here: /cvmfs/dirac.egi.eu/dirac/bashrc_gridpp_py2 Regards, Daniela -- ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/

3 4

The DIRAC upgrade starts now
by Daniela Bauer 25 Jul '22

25 Jul '22

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Dear All, The DIRAC server upgrade starts now. We'll let you know when we are done. Regards, Daniela -- ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/

1 0

Reminder of planned upgrade Monday 25/07/22
by Daniela Bauer 18 Jul '22

18 Jul '22

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Dear All, As announced before, the next major (v7r2 -> v7r3) upgrade of the GridPP DIRAC instance (https://dirac.gridpp.ac.uk) will happen on Monday July 25th. What does this mean for you ? As this is a major upgrade we cannot guarantee that jobs that are in a non-final state will survive, though we will try. You might want to consider leaving your jobs to finish over the weekend and only restart once we announce the completion of the upgrade on this list. The upgrade will proceed in the following order: - Server upgrade - Web interface upgrade - cvmfs UI upgrade - cloud interface (in case of problems only) v7r3 is a python3 release. For backwards compatibility we will maintain a python2 UI on cvmfs as well as a python3 UI. Python 3 will be the default. If you are maintaining your own DIRAC UI you should try to upgrade soon thereafter, though the old UIs will probably keep working for quite a while. The instructions on how to update your UI will be published as usual on: https://www.gridpp.ac.uk/wiki/Quick_Guide_to_Dirac as soon as we have ascertained that the server is stable. We expect the whole process to take a couple of hours, though the cvmfs repos might take a while to sync. We will keep you informed as the upgrade progresses. Regards, Daniela -- ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/

1 0

setting up a DIRAC client
by Giuseppe Congedo 07 Jul '22

07 Jul '22

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Hello everyone, I am relatively new to gridPP, having obtained a certificate/VO membership only recently. I am writing because I have started experimenting with the Python DIRAC API (followed the official instructions https://dirac.readthedocs.io/en/latest/UserGuide/GettingStarted/InstallingC… ) Apart one lucky job (which I managed to submit via /cvmfs/ganga.cern.ch/dirac_ui/bashrc as opposed to the manual procedure above, but failed probably due to me deleting the proxy), unfortunately all my other attempts have failed so far. This is the error I always get: > Job submission failure Cannot get URL for > WorkloadManagement/JobManager in setup DIRAC-Certification: > RuntimeError('Option > /DIRAC/Setups/DIRAC-Certification/WorkloadManagement is not defined') I wonder if I am doing something wrong somewere. Unrelated from the above, I was also wondering what environment the code will see when it arrives at the remote node. Can I sandbox my Python package, cd into the directory and install it along with all dependencies all in a job step? For instance: > job.setExecutable('cd my_package_dir && pip install -r > requirements.txt --user && python setup.py install --user') > job.setExecutable('my_package_dir/my_package/my_script.py') > job.setInputSandbox([my_package_dir, other_files]) Also, are directories relative to the home? Many thanks for all your help Giuseppe -- Dr Giuseppe Congedo (Senior Researcher) Institute for Astronomy, University of Edinburgh Royal Observatory, Blackford Hill Edinburgh, EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. Is e buidheann carthannais a th’ ann an Oilthigh Dhùn Èideann, clàraichte an Alba, àireamh clàraidh SC005336.

3 13