- Gridpp-Dirac-Users - imperial.ac.uk

setting up a DIRAC client
by Giuseppe Congedo 07 Jul '22

07 Jul '22

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Hello everyone, I am relatively new to gridPP, having obtained a certificate/VO membership only recently. I am writing because I have started experimenting with the Python DIRAC API (followed the official instructions https://dirac.readthedocs.io/en/latest/UserGuide/GettingStarted/InstallingC… ) Apart one lucky job (which I managed to submit via /cvmfs/ganga.cern.ch/dirac_ui/bashrc as opposed to the manual procedure above, but failed probably due to me deleting the proxy), unfortunately all my other attempts have failed so far. This is the error I always get: > Job submission failure Cannot get URL for > WorkloadManagement/JobManager in setup DIRAC-Certification: > RuntimeError('Option > /DIRAC/Setups/DIRAC-Certification/WorkloadManagement is not defined') I wonder if I am doing something wrong somewere. Unrelated from the above, I was also wondering what environment the code will see when it arrives at the remote node. Can I sandbox my Python package, cd into the directory and install it along with all dependencies all in a job step? For instance: > job.setExecutable('cd my_package_dir && pip install -r > requirements.txt --user && python setup.py install --user') > job.setExecutable('my_package_dir/my_package/my_script.py') > job.setInputSandbox([my_package_dir, other_files]) Also, are directories relative to the home? Many thanks for all your help Giuseppe -- Dr Giuseppe Congedo (Senior Researcher) Institute for Astronomy, University of Edinburgh Royal Observatory, Blackford Hill Edinburgh, EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. Is e buidheann carthannais a th’ ann an Oilthigh Dhùn Èideann, clàraichte an Alba, àireamh clàraidh SC005336.

3 13

Limits on DIRAC jobs
by CURRIE Robert 28 Jun '22

28 Jun '22

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Dear gridpp-dirac-users, I've recently been asked if there are any grid resources for running "long-lived jobs" within the UK grid? Given that proxy-certs are typically only valid for 48hr does anyone know. Is there any support for running ~7day jobs via the DIRAC system? Or, Is there any potential of this being supported in the future? * I had a quick look through the maxCPUTime entries in the DIRAC config and I see that Manchester advertises a very long (multi-year(?)) parameter here, but most appear to be around the 48hr walltime. As a worst-case scenario our back-end batch-system at Edinburgh supports running weeklong jobs. However, that means users having to split their job management between 2 systems and must become more involved in topics such as data-management, which I'd rather avoid if possible. Thanks for any help, Rob *PS: This isn't the first time I've heard this come up in a conversation when discussing grid-use with non-LHC communities so I'm not sure if there is a plan here. The style of workflow seems to be like what LSST users were seeing at some point in the past. Most jobs are well defined and short lived, but a small percentage of jobs, which can't be broken down smaller, take a very long time to process. When this is combined with the fact, they can't be identified ahead of time these prove difficult to handle. The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. Is e buidheann carthannais a th' ann an Oilthigh Dhùn Èideann, clàraichte an Alba, àireamh clàraidh SC005336.

2 3

GridPP DIRAC upgrade
by Daniela Bauer 14 Jun '22

14 Jun '22

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Dear All, This is an advance warning that we are planning the next major version (v7r2 -> v7r3) upgrade of the GridPP DIRAC instance ( https://dirac.gridpp.ac.uk) on Monday July 25th. What does this mean for you ? As this is a major upgrade we cannot guarantee that jobs that are in a non-final state will survive, though we will try. The upgrade will proceed in the following order: - Server upgrade - Web interface upgrade - cvmfs UI upgrade - cloud interface (in case of problems only) v7r3 is a python3 release. For backwards compatibility we will maintain a python2 UI on cvmfs as well as a python3 UI. If you are maintaining your own DIRAC UI you should try to upgrade soon thereafter, though the old UIs will probably keep working for quite a while. Instructions will be supplied nearer the time. Please let me know if you have any questions and/or if this date is the worst possible date for the upgrade we could have picked. Regards, Daniela -- ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/

1 0

Mailing list post
by Abderrazaq El Abassi 12 Jun '22

12 Jun '22

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Hi, Here is my email : abderrazaq.el.abassi(a)cern.ch Cheers, Abderrazaq Get Outlook for Android<https://aka.ms/AAb9ysg>

1 0

Virtual DIRAC Users Workshop
by Daniela Bauer 25 Apr '22

25 Apr '22

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Hi All, The yearly DIRAC users workshop will be held on May 9th/10th. You can find the agenda (work in progress) here: https://indico.cern.ch/event/1107386/ For end-users this workshop offers the opportunity to engage with all the DIRAC developers in one go, so if there is a topic you are interested in (even if it is "Why does X never work as I expect?"), please let me know and I'll get it on the agenda somewhere. Similarly if there is a tutorial you would like. Regards, Daniela -- ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/

1 0

Issues with GRID
by Aditya Upreti 09 Mar '22

09 Mar '22

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Hi, I am trying to run my simulations on the GRID but while generating the proxy, using dirac-proxy-init -g vo.moedal.org_user -M, I get the following message. Added VOMS attribute /vo.moedal.org Uploading proxy for vo.moedal.org_user... Proxies with DIRAC group extensions not allowed to be uploaded Could you please help me understand why this is happening? Also, when I visit https://dirac.gridpp.ac.uk, I don't see my user name (aditya.upreti) in the Owner list under Job Summary. It was there previously, and I could see my submitted jobs. I still have a valid membership of vo.moedal.org (attached screenshot). Best Regards Aditya Upreti

4 7

GridPP DIRAC update on Monday
by Daniela Bauer 13 Dec '21

13 Dec '21

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Dear All, This is just to remind everyone that we are still aiming to upgrade our DIRAC instance on Monday and you might want to make sure anything of importance to you has been dealt with by Monday morning. Regards, Daniela -- Sent from my guinea pig enhanced living room ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/

1 2

Planned DIRAC upgrade 13/12/21
by Daniela Bauer 29 Nov '21

29 Nov '21

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Dear All, The GridPP DIRAC instance is due for another upgrade (from v7r1p45 to v7r2p28) as the current version is only supported in big-fix-only mode. This is currently scheduled for Monday 13/12/21, starting around 10 am. *How will this affect you:* - Possibly not at all: As far as we can tell this release is backwards compatible, but we can't guarantee that we tested your exact use case. We recommend upgrading at your leisure. - If you are using the cvmfs UI, this will be upgraded a day or two after the upgrade (once we are sure it has worked). The default UI will remain in python 2 for the foreseeable future (see below). - Jobs: We *hope* to do the upgrade so it will not affect any jobs currently in the system, but there is a risk we will lose some. So if you have any results you care about, it'll be worth collecting them on Monday morning. *What's new: * - You will be able to submit to the GridPP DIRAC instance using a python3 API. We will supply instructions for this on the GridPP DIRAC Wiki: https://www.gridpp.ac.uk/wiki/Quick_Guide_to_Dirac (Once we are confident this works, we will try and make it available via cvmfs, but this is not a priority item.) - If you are submitting multi-core jobs, please note that the syntax has changed. The new syntax is: NumberOfProcessors = 8; (The old syntax was: Tags = {"8Processors"};) If you are trying to submit jobs with more than 8 cores, please let Simon and me know - the internal workings of DIRAC have changed and the old 'let the user submit anything they like and let the sites sort it out' maxime is no longer true. Regards, Daniela -- Sent from my guinea pig enhanced living room ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/

1 0

Copying large simulation output files
by Aditya Upreti 17 Nov '21

17 Nov '21

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Hi, I'm having a slight issue with copying a directory containing my simulation output files (which are pretty large) from the vo.moedal.org directory using the command dirac-dms-directory-sync<https://dirac.readthedocs.io/en/latest/UserGuide/CommandReference/DataManag…> which is turning out to be a tedious time taking task. Is there an alternate faster way to do this for larger files? Currently, I'm using the following job submit file. JobName = "LFNDATA"; Executable = "SHNAME"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = {"SHNAME", "CFGNAME", "GANGANAME"}; InputData = {"DATA"}; OutputPath = "/70G_4gD_outputs/"; OutputData = {"*.root"}; OutputSandbox = {"*.root"}; OutputSE = "UKI-LT2-QMUL2-disk"; (the provided output path stores my output in the directory /vo.moedal.org/user/a/aditya.upreti/..) I wanted to know if there's a way to directly save the output of the GRID simulation to my local directory instead of having to copy it each time. I would like to save it to my lxplus or EOS directory such as /afs/cern.ch/user/a/aupreti/ or /eos/experiment/moedal/aditya/. I might be missing something trivial and would be glad if you can point me to it. Thank you. Best Regards Aditya Upreti

2 1

Re: [Gridpp-Dirac-Users] Issue regrading GRID
by Aditya Upreti 27 Oct '21

27 Oct '21

******************* This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Hi Daniela, Daniel, Thanks for your help in the matter, but I'm still experiencing issues with running simulations on GRID. The permissions issue isn't resolved yet. I'm still getting the following error message when I try to upload a file on UKI-LT2-QMUL2-disk. 2021-10-06 22:18:18 UTC dirac-dms-add-file/DataManager/putAndRegister [140605462013760] DEBUG: Failed to put file to Storage Element. dummy1.txt: Permission denied ( 13 : Failed to copy file dummy1.txt to destination url srm://se03.esc.qmul.ac.uk:8444/srm/managerv2?SFN=/vo.moedal.org/vo.moedal.o…: [13] [gfalt_copy_file][perform_copy][srm_plugin_filecopy][srm_do_transfer][gfalt_copy_file][perform_copy][perform_local_copy] Could not open destination: [streamed_copy][gfal_plugin_openG][gfal_gridftp_openG][gfal_gridftp_openG] globus_ftp_client: the server responded with an error 530 530-Login incorrect. : globus_gss_assist: Error invoking callout 530-globus_callout_module: The callout returned an error 530-an unknown error occurred 530 End. ) 2021-10-06 22:18:18 UTC dirac-dms-add-file [140605462013760] ERROR: Error: failed to upload /vo.moedal.org/user/a/aditya.upreti/dummy1.txt to UKI-LT2-QMUL2-disk The job fails with the same permissions issue when I use the following code (DiracFile to get the output). I tried this approach as an alternative to submitting it via a JDL script as I described earlier. j = Job() j.name = job_name j.application = Executable() j.application.exe = File(sh_run_ganga_name) j.application.args = [] j.inputfiles = [LocalFile(cfg_path), LocalFile(cfg_ganga_pgun_name), LocalFile(input3Dpath+input3Dhist)] j.outputfiles =[DiracFile(outputfile)] j.backend = Dirac() j.submit() ('/vo.moedal.org/user/a/aditya.upreti/32164/32164451/MonopoleData_2_100_default_0.root','/scratch/condor/dir_11177/WcfLDmo4Uszn8FVDjqQVj3jqav4PzpABFKDm9FCSDmABFKDmtftwXo/DIRAC_YjF9xbpilot/32164451/MonopoleData_2_100_default_0.root','UKI-LT2-QMUL2-disk',guid='F11FBC28-DC8A-C4ED-2292-AF1995B2A826',catalog='[]', checksum = 'b8149d64') dm.putAndRegister failed with message Failed to put file to Storage Element. Permission denied ( 13 : Failed to copy file Then, I tried to get the output files locally using LocalFile instead of DiracFile, using the following lines of code j = Job() j.name = job_name j.application = Executable() j.application.exe = File(sh_run_ganga_name) j.application.args = [] j.inputfiles = [LocalFile(cfg_path), LocalFile(cfg_ganga_pgun_name), LocalFile(input3Dpath+input3Dhist)] j.outputfiles =[LocalFile('/eos/experiment/moedal/aditya/GRID_outputs/test/'+outputfile)] j.backend = Dirac() j.submit() and it gives me the following error message in std.out. The simulation stops and job fails halfway. UTC dirac-jobexec/Subprocess ERROR: Maximum output buffer length reached 2021-10-05 22:30:19 UTC dirac-jobexec/Script ERROR: System call execution failed: Reached maximum allowed length (52428800 bytes) for called function return value for '['/scratch/condor/dir_7759/OGNNDmQ46rznOOVDjqUTj3jq6xrg1pABFKDm2f6LDmABFKDmuey6Zn/DIRAC__a2iHspilot/32155611/exe-script.py']' call 2021-10-05 22:30:19 UTC dirac-jobexec/Script ERROR: Non-zero status while executing /scratch/condor/dir_7759/OGNNDmQ46rznOOVDjqUTj3jq6xrg1pABFKDm2f6LDmABFKDmuey6Zn/DIRAC__a2iHspilot/32155611/exe-script.py exited with status 9 Please let me know if there's anything else I can provide to help us debug these errors. Best Regards Aditya Upreti | Ph.D. Candidate / Research Assistant [Divider line] Department of Physics The University of Alabama<https://www.ua.edu/> 102 Gallalee Hall Tuscaloosa, AL 35404 Phone 205-886-2914 aupreti(a)crimson.ua.edu [Divider line] [The University of Alabama box A with stacked words logo]<https://www.ua.edu/> ________________________________ From: Daniela Bauer <daniela.bauer.grid(a)googlemail.com> Sent: Monday, September 27, 2021 4:37 AM To: Aditya Upreti <aupreti(a)crimson.ua.edu> Cc: Daniel Traynor <d.traynor(a)qmul.ac.uk>; Simon Fayer <simon.fayer05(a)imperial.ac.uk> Subject: Re: Issue regrading GRID Hi Aditya, I don't know Ganga, but in DIRAC there is the concept of an OutputSandbox: This is for small files, and you can retrieve them via dirac-wms-job-get-output. For the actual data, you should use the various data handling mechanism within DIRAC which will upload your data to an SE. There is some documentation here: https://www.gridpp.ac.uk/wiki/DIRAC_Data_Handling_within_a_Job<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gridp…> Regards, Daniela On Mon, 27 Sept 2021 at 05:54, Aditya Upreti <aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu>> wrote: Hi Daniela, Sorry for the late reply. Okay, I can try writing to RALPP. Do I have to mention RALPP in the OutputSandbox instead of UKI-LT2-QMUL2-disk? Also, I am able to submit jobs via the Ganga interface using a python submit script and getting the output file locally using "j = Job() j.outputfiles = [LocalFile(outputfile)]" which outputs the file locally, but I'm not sure why I'm failing to do that with a JDL script directly, bypassing Ganga. (as with Ganga, I get some python dependency errors like 'no module named six'. etc, when submitting the jobs"). Best Regards Aditya Upreti | Ph.D. Candidate / Research Assistant [Divider line] Department of Physics The University of Alabama<https://www.ua.edu/> 102 Gallalee Hall Tuscaloosa, AL 35404 Phone 205-886-2914 aupreti(a)crimson.ua.edu [Divider line] [The University of Alabama box A with stacked words logo]<https://www.ua.edu/> ________________________________ From: Daniela Bauer <daniela.bauer.grid(a)googlemail.com<mailto:daniela.bauer.grid@googlemail.com>> Sent: Thursday, September 23, 2021 4:20 AM To: Daniel Traynor <d.traynor(a)qmul.ac.uk<mailto:d.traynor@qmul.ac.uk>> Cc: Aditya Upreti <aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu>>; Simon Fayer <simon.fayer05(a)imperial.ac.uk<mailto:simon.fayer05@imperial.ac.uk>> Subject: Re: Issue regrading GRID @Aditya Upreti<mailto:aupreti@crimson.ua.edu> : In the meantime, do you want to try and write to RALPP ? You should be able to copy the data later if needed. Regards, Daniela On Wed, 22 Sept 2021 at 18:38, Daniel Traynor <d.traynor(a)qmul.ac.uk<mailto:d.traynor@qmul.ac.uk>> wrote: not yet. * Dr Daniel Traynor, Grid cluster system manager * Tel +44(0)20 7882 6560, Particle Physics,QMUL ________________________________________ From: Daniela Bauer <daniela.bauer.grid(a)googlemail.com<mailto:daniela.bauer.grid@googlemail.com>> Sent: 22 September 2021 18:33 To: Aditya Upreti Cc: Daniel Traynor; Simon Fayer Subject: Re: Issue regrading GRID This is a question for Dan - we need to work out where the permission denied comes from. @Dan: Any idea ? Cheers, Daniela On Tue, 21 Sept 2021 at 21:59, Aditya Upreti <aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu><mailto:aupreti@crimson.ua.edu<mailto:aupreti@crimson.ua.edu>>> wrote: Hi all, Any resolution on this issue? Thanks! Best Regards Aditya Upreti | Ph.D. Candidate / Research Assistant [Divider line] Department of Physics The University of Alabama<https://www.ua.edu/> 102 Gallalee Hall Tuscaloosa, AL 35404 Phone 205-886-2914 aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu> [Divider line] [The University of Alabama box A with stacked words logo]<https://www.ua.edu/> ________________________________ From: Aditya Upreti <aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu><mailto:aupreti@crimson.ua.edu<mailto:aupreti@crimson.ua.edu>>> Sent: Monday, September 20, 2021 10:53 AM To: Daniela Bauer <daniela.bauer.grid(a)googlemail.com<mailto:daniela.bauer.grid@googlemail.com><mailto:daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>>> Cc: Daniel Traynor <d.traynor(a)qmul.ac.uk<mailto:d.traynor@qmul.ac.uk><mailto:d.traynor@qmul.ac.uk<mailto:d.traynor@qmul.ac.uk>>>; Simon Fayer <simon.fayer05(a)imperial.ac.uk<mailto:simon.fayer05@imperial.ac.uk><mailto:simon.fayer05@imperial.ac.uk<mailto:simon.fayer05@imperial.ac.uk>>> Subject: Re: Issue regrading GRID Hi Daniela, I tried those commands and it still gives me the same error messages (attached). Best Regards Aditya Upreti | Ph.D. Candidate / Research Assistant [Divider line] Department of Physics The University of Alabama<https://www.ua.edu/> 102 Gallalee Hall Tuscaloosa, AL 35404 Phone 205-886-2914 aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu> [Divider line] [The University of Alabama box A with stacked words logo]<https://www.ua.edu/> ________________________________ From: Daniela Bauer <daniela.bauer.grid(a)googlemail.com<mailto:daniela.bauer.grid@googlemail.com><mailto:daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>>> Sent: Monday, September 20, 2021 10:42 AM To: Aditya Upreti <aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu><mailto:aupreti@crimson.ua.edu<mailto:aupreti@crimson.ua.edu>>> Cc: Daniel Traynor <d.traynor(a)qmul.ac.uk<mailto:d.traynor@qmul.ac.uk><mailto:d.traynor@qmul.ac.uk<mailto:d.traynor@qmul.ac.uk>>>; Simon Fayer <simon.fayer05(a)imperial.ac.uk<mailto:simon.fayer05@imperial.ac.uk><mailto:simon.fayer05@imperial.ac.uk<mailto:simon.fayer05@imperial.ac.uk>>> Subject: Re: Issue regrading GRID Hi Aditya, This looks like a straight forward permissions error, so Dan needs to have a look to see why you wouldn't be allowed to access the disk. Could you please run one last test ? In a clean window (no ganga setup) can you please run: export VOMS_USERCONF=/cvmfs/grid.cern.ch/etc/grid-security/vomses<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgrid.cern.…><https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgrid.cern.…<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgrid.cern.…>> export X509_VOMSES=/cvmfs/grid.cern.ch/etc/grid-security/vomses<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgrid.cern.…><https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgrid.cern.…<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgrid.cern.…>> source /cvmfs/dirac.egi.eu/dirac/bashrc_gridpp<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdirac.egi.…><https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdirac.egi.…<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdirac.egi.…>> dirac-proxy-init -g vo.moedal.org_user and the copy command again (maybe with a slightly different file name to avoid any potential override conflicts). The ganga DIRAC version is very old, and while I don't think it matters in this case, I want to make sure. Regards, Daniela On Mon, 20 Sept 2021 at 16:20, Aditya Upreti <aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu><mailto:aupreti@crimson.ua.edu<mailto:aupreti@crimson.ua.edu>>> wrote: Hi Daniela, I used the command dirac-dms-add-file and I'm still unable to upload a file. Attached is the output in a text file. Best Regards Aditya Upreti | Ph.D. Candidate / Research Assistant [Divider line] Department of Physics The University of Alabama<https://www.ua.edu/> 102 Gallalee Hall Tuscaloosa, AL 35404 Phone 205-886-2914 aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu> [Divider line] [The University of Alabama box A with stacked words logo]<https://www.ua.edu/> ________________________________ From: Daniela Bauer <daniela.bauer.grid(a)googlemail.com<mailto:daniela.bauer.grid@googlemail.com><mailto:daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>>> Sent: Monday, September 20, 2021 9:58 AM To: Daniel Traynor <d.traynor(a)qmul.ac.uk<mailto:d.traynor@qmul.ac.uk><mailto:d.traynor@qmul.ac.uk<mailto:d.traynor@qmul.ac.uk>>> Cc: Aditya Upreti <aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu><mailto:aupreti@crimson.ua.edu<mailto:aupreti@crimson.ua.edu>>>; Simon Fayer <simon.fayer05(a)imperial.ac.uk<mailto:simon.fayer05@imperial.ac.uk><mailto:simon.fayer05@imperial.ac.uk<mailto:simon.fayer05@imperial.ac.uk>>> Subject: Re: Issue regrading GRID Hi Dan, Aditya, @Aditya Upreti<mailto:aupreti@crimson.ua.edu<mailto:aupreti@crimson.ua.edu>> Could you please try to upload a file using: dirac-proxy-info dirac-dms-file-add -ddd /vo.moedal.org/user/a/aditya.upreti/dummy1.txt<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…><https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…>> dummy.txt UKI-LT2-QMUL2-disk and email the output back ? Just renewing your certificate should not make any difference. @Dan: Can you see a permissions error for this user somewhere ? Regards, Daniela On Mon, 20 Sept 2021 at 15:28, Daniel Traynor <d.traynor(a)qmul.ac.uk<mailto:d.traynor@qmul.ac.uk><mailto:d.traynor@qmul.ac.uk<mailto:d.traynor@qmul.ac.uk>>> wrote: We have user directories for moedal and i see attempts to writes the jobs output on disk there for several users e.g. ls /mnt/lustre_3/storm_3/vo.moedal.org/vo.moedal.org/user/a/aditya.upreti/<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…><https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…>> 30272 30348 31778 31780 31781 31783 31784 31793 31798 31805 31829 31861 GRID tmp but recent directories are empty. The last successful wite was on the 13th July (directory 30348) dan * Dr Daniel Traynor, Grid cluster system manager * Tel +44(0)20 7882 6560, Particle Physics,QMUL ________________________________________ From: Daniela Bauer <daniela.bauer.grid(a)googlemail.com<mailto:daniela.bauer.grid@googlemail.com><mailto:daniela.bauer.grid@googlemail.com<mailto:daniela.bauer.grid@googlemail.com>>> Sent: 20 September 2021 14:21 To: Aditya Upreti Cc: Simon Fayer; Daniel Traynor Subject: Re: Issue regrading GRID Hi Aditya, I'll try to disentangle this. Looking at the JDL I can see on the server you seem to have your output files specified both in the OutputData and the OutputSandbox field. Listing them in OutputData means DIRAC will try to write it to a storage element (SE), which you need to specify. I think you initially specified QMUL. I've cc'ed the QMUL admin to check if moedal users are meant to use this SE (@Dan: Should they ?). If yes, you'd need to debug with him to see why you can't write there. If all you want to do is ship a couple of log files back, then just use OutputSandbox (but never in combination with OutputData), which you can retrieve with dirac-wms-job-get-output. Just be aware that output sandboxes are limited in size (< 10MB) and tend not to scale. If you have any question wrt DIRAC, I would encourage you to use the DIRAC mailing list: gridpp-dirac-users(a)imperial.ac.uk<mailto:gridpp-dirac-users@imperial.ac.uk><mailto:gridpp-dirac-users@imperial.ac.uk<mailto:gridpp-dirac-users@imperial.ac.uk>><mailto:gridpp-dirac-users@imperial.ac.uk<mailto:gridpp-dirac-users@imperial.ac.uk><mailto:gridpp-dirac-users@imperial.ac.uk<mailto:gridpp-dirac-users@imperial.ac.uk>>> as I am not always online and (as you will have seen), there can be quite a delay between you sending and me seeing this email. Hope that helps, Daiela On Fri, 17 Sept 2021 at 17:53, Aditya Upreti <aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu><mailto:aupreti@crimson.ua.edu<mailto:aupreti@crimson.ua.edu>><mailto:aupreti@crimson.ua.edu<mailto:aupreti@crimson.ua.edu><mailto:aupreti@crimson.ua.edu<mailto:aupreti@crimson.ua.edu>>>> wrote: Hi Daniela, Hope you are doing well. I am getting the following error message after my simulation completes running on Grid. Failed to upload output data file Encountered 1 errors Could not putAndRegister file std.out with LFN /vo.moedal.org/user/a/aditya.upreti/31829/31829313/std.out<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…><https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…>><http://vo.moedal.org/user/a/aditya.upreti/31829/31829313/std.out<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…><https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fvo.moedal.…>>> to UKI-LT2-QMUL2-disk with GUID E7D2E680-3F6A-B9AB-6969-CF91C330F037 trying failover storage No failover SEs defined for JobWrapper, cannot try to upload output file std.out anywhere else. Failed to upload OutputData JobWrapper failed to process output files Traceback (most recent call last): File "/scratch/tmp/OD6MDmdLVlzn5Wq3smovVnomg01fWmABFKDmqGGKDmABFKDmTORfJm/DIRAC_ZJLEU2pilot/job/Wrapper/Wrapper_31829313", line 197, in execute raise JobWrapperError(result['Message']) JobWrapperError: Failed to upload OutputData The output sandbox only contains the std.out and std.err files and not the output root files. Would you be able to help me resolve this error? Please let me know if you need more information/input files. Thank you! Best Regards Aditya Upreti | Ph.D. Candidate / Research Assistant [Divider line] Department of Physics The University of Alabama<https://www.ua.edu/> 102 Gallalee Hall Tuscaloosa, AL 35404 Phone 205-886-2914 aupreti(a)crimson.ua.edu<mailto:aupreti@crimson.ua.edu><mailto:aupreti@crimson.ua.edu<mailto:aupreti@crimson.ua.edu>> [Divider line] [The University of Alabama box A with stacked words logo]<https://www.ua.edu/> -- Sent from my guinea pig enhanced living room ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk><mailto:daniela.bauer@imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk>><mailto:daniela.bauer@imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk><mailto:daniela.bauer@imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk>>> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…><https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…>> -- Sent from my guinea pig enhanced living room ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk><mailto:daniela.bauer@imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk>> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…><https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…>> -- Sent from my guinea pig enhanced living room ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk><mailto:daniela.bauer@imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk>> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…><https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…>> -- Sent from my guinea pig enhanced living room ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk><mailto:daniela.bauer@imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk>> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…> -- Sent from my guinea pig enhanced living room ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…> -- Sent from my guinea pig enhanced living room ----------------------------------------------------------- daniela.bauer(a)imperial.ac.uk<mailto:daniela.bauer@imperial.ac.uk> HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: Working from home, please use email. http://www.hep.ph.ic.ac.uk/~dbauer/<https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.hep.ph…>

4 4