On Thu, 6 Jul 2017, Raul Lopes wrote:
I have not discussed this with Ivan yet, but I believe he is considering any of the Brunel ArcCEs. I could it ready quickly. Maybe defining one for target (dc2-grid-25) would make it easier for debugging.
We might have some memory requirements, too. I've been debugging with the single-thread option and finally got enough bugs out that the programme actually ran for a while. However, it then gave this message and stopped (running on CLOUD.UKI-GridPP-Cloud-IC.uk): "The reads contain too many k-mers to fit into available memory. You need approx. 2.07591GB of free RAM to assemble your datase" Now I was checking memory usage when I was running my test jobs and pion never got below 126 GB free (normally >127 free), so I suspect that was on the limit. I've dropped down to only processing one k-mer instead of four and it's been running at LCG.UKI-LT2-QMUL.uk for 20 minutes now -- previously it died after 4 mins.
Important points:
- the gridpp VO seems to be bag with many communities using it. They would all be entitled to 8 cores jobs...
Arshad agrees with me that 4 cores would actually be the best option. 8 is quicker but uses disproportionately more resources.
- I'll inform Peter that I have opened 8 cores to all gridpp. He will not oppose if we can deal with the above.
I had a chat to Peter when he dropped by, and in principle he's happy with whatever you suggest.
Thanks, Raul
Cheers, ivan
____________________________________________________________________________ From: Daniela Bauer <daniela.bauer.grid@googlemail.com> Sent: 06 July 2017 11:32:14 To: Ivan Reid Cc: Raul Lopes; gridpp-dirac-users@imperial.ac.uk Subject: Re: [Gridpp-Dirac-Users] Multi-core jobs in ganga/dirac You can't -- this is the bit we need to work out within dirac, so that it reads the JDL correctly and then matches the queue.
Which queue is it ?
Regards, Daniela
-- Ivan Reid (ivan.reid@[brunel.ac.uk|cern.ch]) Engineering, Design & Physical Sciences CMS Collaboration, Brunel University London. Room TOWD405 CERN, Room 40-1-B12