Good morning Darren, 1) At WLCG level there used to be some time ago few repositories replicated every 10 mins (so-called fast replicas), so it can be done for LSST up to an extent (or at least one could give a try with a local repository). 2) Regarding LSST community, it is quite obvious that there is no consistency there with two repositories (opensciencegrid and in2p3). However these two repos are replicated by the Stratum-1 at RAL, so they should be accessible by any client with correct settings. If there is interest, we could work together and make lsst.in2p3.fr available via the CVMFS_CONFIG_REPOSITORY feature. 3) Another option I see is to add git tool to one of the existing lsst repos or to the grid.cern.ch repository (which should be available everywhere), but there might be other implications… Anyway at GridPP level we definitely could work to provide a consistent solution. I just didn’t know anyone involved in LSST from any UK site. But this could be the start. BTW are you attending the GridPP meeting in Lancaster? We could discuss more (or maybe finalise things) then. Regards, Catalin From: gridpp-dirac-users-bounces@imperial.ac.uk [mailto:gridpp-dirac-users-bounces@imperial.ac.uk] On Behalf Of WHITE Darren Sent: 04 September 2017 16:52 To: gridpp-dirac-users@imperial.ac.uk Subject: Re: [Gridpp-Dirac-Users] Sites with git Hi Catalin, Even before this project got underway, we were warned to not do that for code that is in such active development. The time it takes for CVMFS updates to filter down can take far too much time for testing. I spent the last few days in Southampton last week and we were pushing changes to GitHub several times an hour that could instantly be available for testing. That’s simply not possible from what I understand/was told about CVMFS. Also, the Lyon repo is not available at all sites for LSST folks, as I found out the hard way. The specified repo I was told after many days of failure is apparently /cvmfs/lsst.opensciencegrid.org<http://lsst.opensciencegrid.org>, which we successfully use to set up EUPS, which we then, in turn, use to set up the many packages needed for this specific code (which are also not available on either the LYON or opensciencegrid repos and so packaged into a tarball on an SE). This is another issue for new folks trying to work on GridPP. There’s no real clarity of what CVMFS repos are available, what sites you can run at, what tools they include both at the site or on the repos, etc. Cheers Darren ------------------------------------------------------------------------- Dr Darren J. White Applications Developer EPCC, University of Edinburgh Email: d.white@epcc.ed.ac.uk<mailto:d.white@epcc.ed.ac.uk> Telephone: +44 (0) 131 6513415 Room 2411, James Clerk Maxwell Building, Kings Buildings, Mayfield Road, Edinburgh EH9 3JZ, United Kingdom ------------------------------------------------------------------------- On 4 Sep 2017, at 16:38, catalin.condurache@stfc.ac.uk<mailto:catalin.condurache@stfc.ac.uk> wrote: Hi Darren, Just a question: why you do not stick with the cvmfs repository? There is ‘lsst.in2p3.fr<http://lsst.in2p3.fr/>’ repository (maintained at Lyon and replicated by Stratum1 at RAL) where I’d assume all software should be provisioned from. Is this code you’re talking about only interesting the UK sites? In this case you may want to have another (UK regional) ‘lsst’ CVMFS repository. Anyway we at RAL have the policy to install a minimal distribution on our WNs (and git is not part of it), assuming the VOs are provisioning their software via CVMFS. Regards, Catalin Condurache RAL Tier-1 Services From: gridpp-dirac-users-bounces@imperial.ac.uk<mailto:gridpp-dirac-users-bounces@imperial.ac.uk> [mailto:gridpp-dirac-users-bounces@imperial.ac.uk] On Behalf Of WHITE Darren Sent: 04 September 2017 15:54 To: gridpp-dirac-users@imperial.ac.uk<mailto:gridpp-dirac-users@imperial.ac.uk> Subject: [Gridpp-Dirac-Users] Sites with git Hi there, I’m working with LSST folks in Southampton who have code that is updated quite regularly. A while ago, I tested to see whether git could clone at time of execution (I cannot remember which site this was at), and it was a success. However, RAL does not have git installed, as similar code fails at that site. I’ve asked this before and didn’t really get a full answer. Is there any way of knowing which sites have which software installed? It would save new users a lot of pain when trying to get up and running, or even just testing. Cheers Darren ------------------------------------------------------------------------- Dr Darren J. White Applications Developer EPCC, University of Edinburgh Email: d.white@epcc.ed.ac.uk<mailto:d.white@epcc.ed.ac.uk> Telephone: +44 (0) 131 6513415 Room 2411, James Clerk Maxwell Building, Kings Buildings, Mayfield Road, Edinburgh EH9 3JZ, United Kingdom ------------------------------------------------------------------------- -- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk<mailto:Gridpp-Dirac-Users@imperial.ac.uk> https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users