Hi Mark,

Quick one, are you running these on the login nodes or are you submitting through your clusters scheduler/queuing system? 

If you aren't, would suggest trying through a job submission. MPI libraries aren't always available on the login nodes as a protection even if you load as a module. 

Thanks,
James. 


Sent from Outlook for iOS

From: nektar-users-bounces@imperial.ac.uk <nektar-users-bounces@imperial.ac.uk> on behalf of Sherwin, Spencer J <s.sherwin@imperial.ac.uk>
Sent: Thursday, July 25, 2024 4:37:43 PM
To: Mark Dixon <mark.c.dixon@durham.ac.uk>
Cc: nektar-users <nektar-users@imperial.ac.uk>
Subject: Re: [Nektar-users] Some parallel ctests hang
 
Hi Mark,

As far as I am aware these tests typically pass. We have a got lab CI system you can check to see what builds we typically run under gitlab.nektar.info

Best,
Spencer

Sent from my iPhone

> On 24 Jul 2024, at 17:10, Mark Dixon <mark.c.dixon@durham.ac.uk> wrote:
>
> 
> *******************
> This email originates from outside Imperial. Do not click on links and attachments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic.ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address.
> *******************
> Hi there,
>
> We're trying to install nektar++ 5.6.0 from source on our HPC system and are having trouble passing two parallel tests:
>
>  MultiRegions_Helmholtz2D_CG_P7_Modes_AllBCs_iter_ml_par3
>  MultiRegions_Helmholtz3D_CG_Hex_AllBCs_iter_ml_par3
>
> In both cases they hang. Have tried openmpi, intelmpi and mvapich2. Attaching strace to the processes reveals a lot of polling and not much else.
>
> To simplify, I've reproduced this on a separate Rocky 8.10 system + EPEL packages and building against master (7b1aa23bb) in case it has already been fixed. openmpi is 4.1.1:
>
>  git clone http://gitlab.nektar.info/nektar/nektar.git
>  mkdir build
>  cd build
>  cmake -D NEKTAR_USE_MPI=ON ../nektar
>  make -j24
>  ctest
>
> Are these tests known to be problematic, please?
>
> Thanks,
>
> Mark
>
> _______________________________________________
> Nektar-users mailing list
> Nektar-users@imperial.ac.uk
> https://mailman.ic.ac.uk/mailman/listinfo/nektar-users
_______________________________________________
Nektar-users mailing list
Nektar-users@imperial.ac.uk
https://mailman.ic.ac.uk/mailman/listinfo/nektar-users