Assuming you have access to a shared filesystem, set the environment variable:
PYOP2_CACHE_DIR
to point to a temporary directory that all ranks can see.
Dear Lawrence, I have set PYOP2_CACHE_DIR. I could verify, that he uses the shared directory in the 1 node case. Unfortunately, in the multi-node case I still get the same error message (see log1): OSError: /work/user/Firedrake/twophase/2pDrake/fine8/tmp/f51f6074c31bf0cd78d85bcb40381923.so: cannot open shared object file: No such file or directory I can verify that the file in question actually exists after running the job. From time to time he seems to reuse exactly the same hash for the *.so file, so I tried to just resubmit the job. Then I get the following error message (see log2): File "/rwthfs/rz/cluster/work/user/Firedrake/firedrake/lib/python2.7/site-packages/pulp/pulp.py", line 1651, in solve status = solver.actualSolve(self, **kwargs) File "/rwthfs/rz/cluster/work/user/Firedrake/firedrake/lib/python2.7/site-packages/pulp/solvers.py", line 385, in actualSolve raise PulpSolverError("PuLP: Error while trying to execute "+self.path) pulp.solvers.PulpSolverError: PuLP: Error while trying to execute glpsol Any ideas what still could be wrong? Thank you! Henrik