Dear all,

with Lawrence's fix it now works with 10 levels (20,971,520 cells) on two full nodes. If I increase both the number of cells and the number of nodes by a factor of 4 (i.e. same #dof/core) I get a crash again. However, the position in the code where it crashes varies, here are two example:

https://gist.github.com/eikehmueller/a07007af72b34a57efff

In the 1st and 3rd run, I had cleared the PyOP2/firedrake cashes, whereas in the second case I'm not entirely sure what the state of the cache was.

In the 3rd run I also set PYOP2_DEBUG=1, whereas it was 0 in the first two runs.

The weird thing is also that the 3rd run seems to complete, but still generates the dreaded PETSc seg fault.

Thanks,

Eike

--

Dr Eike Hermann Mueller
Research Associate (PostDoc)

Department of Mathematical Sciences
University of Bath
Bath BA2 7AY, United Kingdom

+44 1225 38 5803
e.mueller@bath.ac.uk
http://people.bath.ac.uk/em459/

On 13 Oct 2014, at 11:22, Eike Mueller <E.Mueller@bath.ac.uk> wrote:

Dear all,

I rebuilt 'my' PETSc with debugging enabled, and then also rebuilt petsc4py and firedrake. I could run on 48 cores with 7 levels once, but this was not reproducible. When I tried again it crashed with a PETSc error.

Is there any chance that the branches below help? Do I need mlange/plex-distributed-overlap or can I use the PETSc master now?

Thanks a lot,

Eike

firedrake: multigrid-parallel
pyop2: local-par_loop
petsc4py: bitbucket.org/mapdes/petsc4py branch moar-plex
petsc: mlange/plex-distributed-overlap


Functionality similar to the latter should hopefully arrive in petsc master this week

Lawrence
_______________________________________________
firedrake mailing list
firedrake@imperial.ac.uk
https://mailman.ic.ac.uk/mailman/listinfo/firedrake

--
Dr Eike Hermann Mueller
Research Associate (PostDoc)

Department of Mathematical Sciences
University of Bath
Bath BA2 7AY, United Kingdom

+44 1225 38 5803
e.mueller@bath.ac.uk
http://people.bath.ac.uk/em459/


_______________________________________________
firedrake mailing list
firedrake@imperial.ac.uk
https://mailman.ic.ac.uk/mailman/listinfo/firedrake