Hi Justin,

I can't remember if this was ever resolved, and it clearly dropped off my radar.

> On 2 Oct 2015, at 09:22, Justin Chang <jychang48@gmail.com> wrote:
>
> Hi Lawrence,
>
> Coming back to this.
>
> I have managed to install Firedrake on LANL’s Mustang Machine (Intel Xeon E5-2670) through the firedrake-install script (w/ —developer —no_package_manager —disable_ssh), and it works great on a single compute node (16 cores). However, I am still running into the same issue: the program freezes when I use two or more compute nodes.


The just-in-time code generation requires that the generated code is written to a filesystem all the MPI processes can see: on more than one node this can't be a node-local temporary directory.  Maybe things work if you set the environment variables:

FIREDRAKE_FFC_KERNEL_CACHE_DIR

and

PYOP2_CACHE_DIR

To directories that all the processes can see.

Lawrence

_______________________________________________
firedrake mailing list
firedrake@imperial.ac.uk
https://mailman.ic.ac.uk/mailman/listinfo/firedrake