installing firedrake on a cluster
Hello, I started trying to install firedrake on a cluster and I have some rather silly problems. First, it won't install because PYTHONPATH is installed. That's easy to resolve since I can ask it to honour the python path and then it goes forward. Second, it notices that there is a PETSc directory. I am pretty sure that I won't the install script to build petsc and not use what's there. IS there a way to get it to ignore both of these? I tried PYTHONPATH='' but that didn't seem to help for the first part so I don't imagine it will help much for the second. The good news is that the default python is 2.7.8 Any advice would be greatly appreciated to get by the python and petsc path's already set? Cheers, Francis ------------------ Francis Poulin Associate Professor Department of Applied Mathematics University of Waterloo email: fpoulin@uwaterloo.ca Web: https://uwaterloo.ca/poulin-research-group/ Telephone: +1 519 888 4567 x32637
Francis, Why don't you just unset the PETSC_DIR environment variable when you install firedrake on your cluster? Or do you plan on using the existing PETSc for your firedrake? Justin On Thu, Mar 30, 2017 at 8:47 PM, Francis Poulin <fpoulin@uwaterloo.ca> wrote:
Hello,
I started trying to install firedrake on a cluster and I have some rather silly problems.
First, it won't install because PYTHONPATH is installed. That's easy to resolve since I can ask it to honour the python path and then it goes forward.
Second, it notices that there is a PETSc directory. I am pretty sure that I won't the install script to build petsc and not use what's there.
IS there a way to get it to ignore both of these? I tried
PYTHONPATH=''
but that didn't seem to help for the first part so I don't imagine it will help much for the second.
The good news is that the default python is 2.7.8
Any advice would be greatly appreciated to get by the python and petsc path's already set?
Cheers, Francis
------------------ Francis Poulin Associate Professor Department of Applied Mathematics University of Waterloo
email: fpoulin@uwaterloo.ca Web: https://uwaterloo.ca/poulin-research-group/ Telephone: +1 519 888 4567 x32637 <(519)%20888-4567>
_______________________________________________ firedrake mailing list firedrake@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/firedrake
Justin, Yes, that is a much simpler idea I agree. Thanks. I removed my PETSC_DIR and honour the python path but not get another problem. I am running this on CENTos and it would appear that apt-get is not present. I remember someone saying that you can install firedrake has been installed on Centos. Is it possible to do it without apt-get or is there something I'm missing? $ python firedrake-install --honour-pythonpath Traceback (most recent call last): File "firedrake-install", line 1024, in <module> check_call(["apt-get", "--version"]) File "firedrake-install", line 369, in check_call subprocess.check_call(arguments, env=env) File "/opt/sharcnet/python/2.7.8/intel/lib/python2.7/subprocess.py", line 535, in check_call retcode = call(*popenargs, **kwargs) File "/opt/sharcnet/python/2.7.8/intel/lib/python2.7/subprocess.py", line 522, in call return Popen(*popenargs, **kwargs).wait() File "/opt/sharcnet/python/2.7.8/intel/lib/python2.7/subprocess.py", line 710, in __init__ errread, errwrite) File "/opt/sharcnet/python/2.7.8/intel/lib/python2.7/subprocess.py", line 1327, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory Francis ------------------ Francis Poulin Associate Professor Department of Applied Mathematics University of Waterloo email: fpoulin@uwaterloo.ca Web: https://uwaterloo.ca/poulin-research-group/ Telephone: +1 519 888 4567 x32637 ________________________________ From: firedrake-bounces@imperial.ac.uk [firedrake-bounces@imperial.ac.uk] on behalf of Justin Chang [jychang48@gmail.com] Sent: Thursday, March 30, 2017 9:54 PM To: Firedrake Project Subject: Re: [firedrake] installing firedrake on a cluster Francis, Why don't you just unset the PETSC_DIR environment variable when you install firedrake on your cluster? Or do you plan on using the existing PETSc for your firedrake? Justin On Thu, Mar 30, 2017 at 8:47 PM, Francis Poulin <fpoulin@uwaterloo.ca<mailto:fpoulin@uwaterloo.ca>> wrote: Hello, I started trying to install firedrake on a cluster and I have some rather silly problems. First, it won't install because PYTHONPATH is installed. That's easy to resolve since I can ask it to honour the python path and then it goes forward. Second, it notices that there is a PETSc directory. I am pretty sure that I won't the install script to build petsc and not use what's there. IS there a way to get it to ignore both of these? I tried PYTHONPATH='' but that didn't seem to help for the first part so I don't imagine it will help much for the second. The good news is that the default python is 2.7.8 Any advice would be greatly appreciated to get by the python and petsc path's already set? Cheers, Francis ------------------ Francis Poulin Associate Professor Department of Applied Mathematics University of Waterloo email: fpoulin@uwaterloo.ca<mailto:fpoulin@uwaterloo.ca> Web: https://uwaterloo.ca/poulin-research-group/ Telephone: +1 519 888 4567 x32637<tel:(519)%20888-4567> _______________________________________________ firedrake mailing list firedrake@imperial.ac.uk<mailto:firedrake@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/firedrake
use --no_package_manager With this you'll need to make sure you have all the other libraries and packages installed. The script will spit out a list of everything you need and will return an error if something is missing i believe On Thu, Mar 30, 2017 at 9:08 PM, Francis Poulin <fpoulin@uwaterloo.ca> wrote:
Justin,
Yes, that is a much simpler idea I agree. Thanks.
I removed my PETSC_DIR and honour the python path but not get another problem.
I am running this on CENTos and it would appear that apt-get is not present.
I remember someone saying that you can install firedrake has been installed on Centos. Is it possible to do it without apt-get or is there something I'm missing?
$ python firedrake-install --honour-pythonpath Traceback (most recent call last): File "firedrake-install", line 1024, in <module> check_call(["apt-get", "--version"]) File "firedrake-install", line 369, in check_call subprocess.check_call(arguments, env=env) File "/opt/sharcnet/python/2.7.8/intel/lib/python2.7/subprocess.py", line 535, in check_call retcode = call(*popenargs, **kwargs) File "/opt/sharcnet/python/2.7.8/intel/lib/python2.7/subprocess.py", line 522, in call return Popen(*popenargs, **kwargs).wait() File "/opt/sharcnet/python/2.7.8/intel/lib/python2.7/subprocess.py", line 710, in __init__ errread, errwrite) File "/opt/sharcnet/python/2.7.8/intel/lib/python2.7/subprocess.py", line 1327, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory
Francis
------------------ Francis Poulin Associate Professor Department of Applied Mathematics University of Waterloo
email: fpoulin@uwaterloo.ca Web: https://uwaterloo.ca/poulin-research-group/ Telephone: +1 519 888 4567 x32637 <(519)%20888-4567>
------------------------------ *From:* firedrake-bounces@imperial.ac.uk [firedrake-bounces@imperial.ac.uk] on behalf of Justin Chang [jychang48@gmail.com] *Sent:* Thursday, March 30, 2017 9:54 PM *To:* Firedrake Project *Subject:* Re: [firedrake] installing firedrake on a cluster
Francis,
Why don't you just unset the PETSC_DIR environment variable when you install firedrake on your cluster? Or do you plan on using the existing PETSc for your firedrake?
Justin
On Thu, Mar 30, 2017 at 8:47 PM, Francis Poulin <fpoulin@uwaterloo.ca> wrote:
Hello,
I started trying to install firedrake on a cluster and I have some rather silly problems.
First, it won't install because PYTHONPATH is installed. That's easy to resolve since I can ask it to honour the python path and then it goes forward.
Second, it notices that there is a PETSc directory. I am pretty sure that I won't the install script to build petsc and not use what's there.
IS there a way to get it to ignore both of these? I tried
PYTHONPATH=''
but that didn't seem to help for the first part so I don't imagine it will help much for the second.
The good news is that the default python is 2.7.8
Any advice would be greatly appreciated to get by the python and petsc path's already set?
Cheers, Francis
------------------ Francis Poulin Associate Professor Department of Applied Mathematics University of Waterloo
email: fpoulin@uwaterloo.ca Web: https://uwaterloo.ca/poulin-research-group/ Telephone: +1 519 888 4567 x32637 <(519)%20888-4567>
_______________________________________________ firedrake mailing list firedrake@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/firedrake
_______________________________________________ firedrake mailing list firedrake@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/firedrake
Thanks again. It would appear that I don't have pip installed. (see below) I found instructions on their site on how to do that and of course it doesn't work for some reason. I will get to to him me set up pip and then try again tomorrow and hope I can get a bit further. I will let you know things progress, when they progress that is. Cheers, Francis [fpoulin@orc129 software]$ apt-get --version -bash: apt-get: command not found [fpoulin@orc129 software]$ python firedrake-install --honour-pythonpath --no_package_manager apt-get not found or disabled. Proceeding on the rash assumption that your compiled dependencies are in place. If this is not the case, please install the following and try again: * A C and C++ compiler (for example gcc/g++ or clang), GNU make * A Fortran compiler (for PETSc) * MPI * Blas and Lapack * Git, Mercurial * Python version 2.7 * pip and the Python headers * autoconf, automake, libtool * CMake * zlib Installing virtualenv. Collecting virtualenv Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=3, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=1, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=0, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=3, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=1, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=0, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Could not find a version that satisfies the requirement virtualenv (from versions: ) No matching distribution found for virtualenv Traceback (most recent call last): File "firedrake-install", line 1172, in <module> check_call(["pip", "install", "--user", "virtualenv"]) File "firedrake-install", line 369, in check_call subprocess.check_call(arguments, env=env) File "/opt/sharcnet/python/2.7.8/intel/lib/python2.7/subprocess.py", line 540, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['pip', 'install', '--user', 'virtualenv']' returned non-zero exit status 1
Francis, I assume you tried get-pip.py <https://bootstrap.pypa.io/get-pip.py>? If you simply run the above with system python (e.g., 'python get-pip.py') it will return an error because it is trying to install pip into the root directory which I am assuming you have no access to. What you need to do is install pip locally. I did this on my local cluster through 'python get-pip.py --user' which will install pip into $HOME/.local. I can't remember what I did next but I think I had to ensure that this .local directory was visible through PATH: export PATH=$HOME/.local:$HOME/.local/bin:$PATH and then pip worked. Justin On Thu, Mar 30, 2017 at 9:32 PM, Francis Poulin <fpoulin@uwaterloo.ca> wrote:
Thanks again.
It would appear that I don't have pip installed. (see below)
I found instructions on their site on how to do that and of course it doesn't work for some reason. I will get to to him me set up pip and then try again tomorrow and hope I can get a bit further. I will let you know things progress, when they progress that is.
Cheers, Francis
[fpoulin@orc129 software]$ apt-get --version -bash: apt-get: command not found [fpoulin@orc129 software]$ python firedrake-install --honour-pythonpath --no_package_manager apt-get not found or disabled. Proceeding on the rash assumption that your compiled dependencies are in place. If this is not the case, please install the following and try again: * A C and C++ compiler (for example gcc/g++ or clang), GNU make * A Fortran compiler (for PETSc) * MPI * Blas and Lapack * Git, Mercurial * Python version 2.7 * pip and the Python headers * autoconf, automake, libtool * CMake * zlib Installing virtualenv. Collecting virtualenv Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=3, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=1, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=0, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=3, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=1, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Retrying (Retry(total=0, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', error(101, 'Network is unreachable'))': /simple/virtualenv/ Could not find a version that satisfies the requirement virtualenv (from versions: ) No matching distribution found for virtualenv Traceback (most recent call last): File "firedrake-install", line 1172, in <module> check_call(["pip", "install", "--user", "virtualenv"]) File "firedrake-install", line 369, in check_call subprocess.check_call(arguments, env=env) File "/opt/sharcnet/python/2.7.8/intel/lib/python2.7/subprocess.py", line 540, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['pip', 'install', '--user', 'virtualenv']' returned non-zero exit status 1
_______________________________________________ firedrake mailing list firedrake@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/firedrake
participants (2)
- 
                
                Francis Poulin
- 
                
                Justin Chang