Replication problems at Glasgow, Edinburgh and RALPP
Hi, I have been trying to replicate some files. The Scottish border seems to be closed to me as both Glasgow and Edinburgh fail. RALPP helpfully reports that the file doesn't exist and then says it fails but then appears to do it! Another file worked OK so it's probably alright. Everywhere else seems to be OK. Cheers +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Steve Lloyd Emeritus Professor, School of Physics and Astronomy Queen Mary University of London, Mile End Road, London E1 4NS, UK E-mail: s.l.lloyd@qmul.ac.uk +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Edinburgh: [lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-ECDF-disk XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 getTransportURL: Failed to obtain turls. srm://se03.esc.qmul.ac.uk:8444/srm/managerv2?SFN=/gridpp/gridpp/user/s/steve.lloyd/data_3000MB: [SE][StatusOfGetRequest][SRM_FAILURE] Unable to decide TURL! XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 ERROR Completely failed to replicate file. Failed to replicate with all sources. Glasgow: [lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-GLASGOW-disk SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) RALPP: [lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SOUTHGRID-RALPP-disk File does not exist srm://heplnx204.pp.rl.ac.uk:8443/srm/managerv2?SFN=/pnfs/pp.rl.ac.uk/data/gridpp/gridpp/user/s/steve.lloyd/data_3000MB XROOTStorage.__putSingleFile: Completely failed to create the destination folder. [FATAL] Connection error {'Failed': {}, 'Successful': {'/gridpp/user/s/steve.lloyd/data_3000MB': {'register': 0.14208984375, 'replicate': 674.2078249454498}}} ^
Hi Steve, Glasgow is in downtime due to A/C failure : https://goc.egi.eu/portal/index.php?Page_Type=Downtime&id=24301 Edinburgh : Probably Sam Skipsey needs to fix some permission problem there? Cheers, Raja. On 13/11/17 11:54, Steve Lloyd wrote:
Hi, I have been trying to replicate some files. The Scottish border seems to be closed to me as both Glasgow and Edinburgh fail. RALPP helpfully reports that the file doesn't exist and then says it fails but then appears to do it! Another file worked OK so it's probably alright. Everywhere else seems to be OK. Cheers +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Steve Lloyd Emeritus Professor, School of Physics and Astronomy Queen Mary University of London, Mile End Road, London E1 4NS, UK E-mail: s.l.lloyd@qmul.ac.uk +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Edinburgh:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-ECDF-disk XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 getTransportURL: Failed to obtain turls. srm://se03.esc.qmul.ac.uk:8444/srm/managerv2?SFN=/gridpp/gridpp/user/s/steve.lloyd/data_3000MB: [SE][StatusOfGetRequest][SRM_FAILURE] Unable to decide TURL! XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 ERROR Completely failed to replicate file. Failed to replicate with all sources.
Glasgow:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-GLASGOW-disk SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
)
RALPP:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SOUTHGRID-RALPP-disk File does not exist srm://heplnx204.pp.rl.ac.uk:8443/srm/managerv2?SFN=/pnfs/pp.rl.ac.uk/data/gridpp/gridpp/user/s/steve.lloyd/data_3000MB XROOTStorage.__putSingleFile: Completely failed to create the destination folder. [FATAL] Connection error {'Failed': {}, 'Successful': {'/gridpp/user/s/steve.lloyd/data_3000MB': {'register': 0.14208984375, 'replicate': 674.2078249454498}}}
^
Thanks Raja +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Steve Lloyd Emeritus Professor, School of Physics and Astronomy Queen Mary University of London, Mile End Road, London E1 4NS, UK E-mail: s.l.lloyd@qmul.ac.uk +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
On 13 Nov 2017, at 12:06, Raja Nandakumar <raja.nandakumar@cern.ch> wrote:
Hi Steve,
Glasgow is in downtime due to A/C failure : https://goc.egi.eu/portal/index.php?Page_Type=Downtime&id=24301
Edinburgh : Probably Sam Skipsey needs to fix some permission problem there?
Cheers, Raja.
On 13/11/17 11:54, Steve Lloyd wrote:
Hi, I have been trying to replicate some files. The Scottish border seems to be closed to me as both Glasgow and Edinburgh fail. RALPP helpfully reports that the file doesn't exist and then says it fails but then appears to do it! Another file worked OK so it's probably alright. Everywhere else seems to be OK. Cheers +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Steve Lloyd Emeritus Professor, School of Physics and Astronomy Queen Mary University of London, Mile End Road, London E1 4NS, UK E-mail: s.l.lloyd@qmul.ac.uk +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Edinburgh: [lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-ECDF-disk XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 getTransportURL: Failed to obtain turls. srm://se03.esc.qmul.ac.uk:8444/srm/managerv2?SFN=/gridpp/gridpp/user/s/steve.lloyd/data_3000MB: [SE][StatusOfGetRequest][SRM_FAILURE] Unable to decide TURL! XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 ERROR Completely failed to replicate file. Failed to replicate with all sources. Glasgow: [lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-GLASGOW-disk SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) RALPP: [lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SOUTHGRID-RALPP-disk File does not exist srm://heplnx204.pp.rl.ac.uk:8443/srm/managerv2?SFN=/pnfs/pp.rl.ac.uk/data/gridpp/gridpp/user/s/steve.lloyd/data_3000MB XROOTStorage.__putSingleFile: Completely failed to create the destination folder. [FATAL] Connection error {'Failed': {}, 'Successful': {'/gridpp/user/s/steve.lloyd/data_3000MB': {'register': 0.14208984375, 'replicate': 674.2078249454498}}} ^
Hi Raja, I think that fixing the permission problem likely falls to me I'll have a look at the permissions that already exist as I can run: xrdcp /etc/services root://srm.glite.ecdf.ed.ac.uk://dpm/ecdf.ed.ac.uk/home/gridpp/user/testFile [654.6kB/654.6kB][100%][==================================================][327.3kB/s] Looking at this now so I'll let you know when I think I've fixed it, Rob On 13/11/2017 12:06 PM, Raja Nandakumar wrote:
Hi Steve,
Glasgow is in downtime due to A/C failure : https://goc.egi.eu/portal/index.php?Page_Type=Downtime&id=24301
Edinburgh : Probably Sam Skipsey needs to fix some permission problem there?
Cheers, Raja.
On 13/11/17 11:54, Steve Lloyd wrote:
Hi, I have been trying to replicate some files. The Scottish border seems to be closed to me as both Glasgow and Edinburgh fail. RALPP helpfully reports that the file doesn't exist and then says it fails but then appears to do it! Another file worked OK so it's probably alright. Everywhere else seems to be OK. Cheers +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Steve Lloyd Emeritus Professor, School of Physics and Astronomy Queen Mary University of London, Mile End Road, London E1 4NS, UK E-mail: s.l.lloyd@qmul.ac.uk +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Edinburgh:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-ECDF-disk XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 getTransportURL: Failed to obtain turls. srm://se03.esc.qmul.ac.uk:8444/srm/managerv2?SFN=/gridpp/gridpp/user/s/steve.lloyd/data_3000MB: [SE][StatusOfGetRequest][SRM_FAILURE] Unable to decide TURL! XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 ERROR Completely failed to replicate file. Failed to replicate with all sources.
Glasgow:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-GLASGOW-disk SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
)
RALPP:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SOUTHGRID-RALPP-disk File does not exist srm://heplnx204.pp.rl.ac.uk:8443/srm/managerv2?SFN=/pnfs/pp.rl.ac.uk/data/gridpp/gridpp/user/s/steve.lloyd/data_3000MB XROOTStorage.__putSingleFile: Completely failed to create the destination folder. [FATAL] Connection error {'Failed': {}, 'Successful': {'/gridpp/user/s/steve.lloyd/data_3000MB': {'register': 0.14208984375,
'replicate': 674.2078249454498}}}
^
-- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
Hi, Think I've fixed it, Steve can you have another try? Somehow the folder was created and owned by Daniela: [root@srm ~]# dpns-getacl /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user # file: /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user # owner: /C=UK/O=eScience/OU=Imperial/L=Physics/CN=daniela bauer # group: gridpp user::rwx group::r-x #effective:r-x other::--- default:user::rwx default:group::rwx default:other::r-x I've reset the permissions so that the folder is group writable by users within the gridpp VO so hopefully that should fix the permissions problems [root@srm ~]# dpns-setacl -m g:gridpp:rwx,m:rwx /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user I'm a little surprised by the 'gridpp/gridpp/' part of the PFN but not enough to go away and try to fix it. Thanks, Rob On 13/11/2017 12:15 PM, Robert Currie wrote:
Hi Raja,
I think that fixing the permission problem likely falls to me
I'll have a look at the permissions that already exist as I can run:
xrdcp /etc/services root://srm.glite.ecdf.ed.ac.uk://dpm/ecdf.ed.ac.uk/home/gridpp/user/testFile [654.6kB/654.6kB][100%][==================================================][327.3kB/s]
Looking at this now so I'll let you know when I think I've fixed it,
Rob
On 13/11/2017 12:06 PM, Raja Nandakumar wrote:
Hi Steve,
Glasgow is in downtime due to A/C failure : https://goc.egi.eu/portal/index.php?Page_Type=Downtime&id=24301
Edinburgh : Probably Sam Skipsey needs to fix some permission problem there?
Cheers, Raja.
On 13/11/17 11:54, Steve Lloyd wrote:
Hi, I have been trying to replicate some files. The Scottish border seems to be closed to me as both Glasgow and Edinburgh fail. RALPP helpfully reports that the file doesn't exist and then says it fails but then appears to do it! Another file worked OK so it's probably alright. Everywhere else seems to be OK. Cheers +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Steve Lloyd Emeritus Professor, School of Physics and Astronomy Queen Mary University of London, Mile End Road, London E1 4NS, UK E-mail: s.l.lloyd@qmul.ac.uk +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Edinburgh:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-ECDF-disk XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 getTransportURL: Failed to obtain turls. srm://se03.esc.qmul.ac.uk:8444/srm/managerv2?SFN=/gridpp/gridpp/user/s/steve.lloyd/data_3000MB: [SE][StatusOfGetRequest][SRM_FAILURE] Unable to decide TURL! XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 ERROR Completely failed to replicate file. Failed to replicate with all sources.
Glasgow:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-GLASGOW-disk SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
)
RALPP:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SOUTHGRID-RALPP-disk File does not exist srm://heplnx204.pp.rl.ac.uk:8443/srm/managerv2?SFN=/pnfs/pp.rl.ac.uk/data/gridpp/gridpp/user/s/steve.lloyd/data_3000MB XROOTStorage.__putSingleFile: Completely failed to create the destination folder. [FATAL] Connection error {'Failed': {}, 'Successful': {'/gridpp/user/s/steve.lloyd/data_3000MB': {'register': 0.14208984375,
'replicate': 674.2078249454498}}}
^
-- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
-- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
Hi Robert, the /gridpp/gridpp is there on purpose: DIRAC requires /voname at the start of the LFN path (that way it ensures that files from different VOs don't get mixed up) and that gets attached to the VO path which already ends in gridpp. As the users usually only see the LFN, there's no point making ti more elegant. Regards, Daniela On 13 November 2017 at 12:26, Robert Currie <rob.currie@ed.ac.uk> wrote:
Hi,
Think I've fixed it, Steve can you have another try?
Somehow the folder was created and owned by Daniela:
[root@srm ~]# dpns-getacl /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user # file: /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user # owner: /C=UK/O=eScience/OU=Imperial/L=Physics/CN=daniela bauer # group: gridpp user::rwx group::r-x #effective:r-x other::--- default:user::rwx default:group::rwx default:other::r-x
I've reset the permissions so that the folder is group writable by users within the gridpp VO so hopefully that should fix the permissions problems [root@srm ~]# dpns-setacl -m g:gridpp:rwx,m:rwx /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user
I'm a little surprised by the 'gridpp/gridpp/' part of the PFN but not enough to go away and try to fix it.
Thanks,
Rob
On 13/11/2017 12:15 PM, Robert Currie wrote:
Hi Raja,
I think that fixing the permission problem likely falls to me
I'll have a look at the permissions that already exist as I can run:
xrdcp /etc/services root://srm.glite.ecdf.ed.ac.uk://dpm/ecdf.ed.ac.uk/home/grid pp/user/testFile [654.6kB/654.6kB][100%][==================================== ==============][327.3kB/s]
Looking at this now so I'll let you know when I think I've fixed it,
Rob
On 13/11/2017 12:06 PM, Raja Nandakumar wrote:
Hi Steve,
Glasgow is in downtime due to A/C failure : https://goc.egi.eu/portal/index.php?Page_Type=Downtime&id=24301
Edinburgh : Probably Sam Skipsey needs to fix some permission problem there?
Cheers, Raja.
On 13/11/17 11:54, Steve Lloyd wrote:
Hi, I have been trying to replicate some files. The Scottish border seems to be closed to me as both Glasgow and Edinburgh fail. RALPP helpfully reports that the file doesn't exist and then says it fails but then appears to do it! Another file worked OK so it's probably alright. Everywhere else seems to be OK. Cheers +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Steve Lloyd Emeritus Professor, School of Physics and Astronomy Queen Mary University of London, Mile End Road, London E1 4NS, UK E-mail: s.l.lloyd@qmul.ac.uk +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Edinburgh:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-ECDF-disk XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 getTransportURL: Failed to obtain turls. srm://se03.esc.qmul.ac.uk:8444 /srm/managerv2?SFN=/gridpp/gridpp/user/s/steve.lloyd/data_3000MB: [SE][StatusOfGetRequest][SRM_FAILURE] Unable to decide TURL! XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 ERROR Completely failed to replicate file. Failed to replicate with all sources.
Glasgow:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-GLASGOW-disk SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg:// svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/ gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg:// svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg:// svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/ gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg:// svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg:// svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/ gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg:// svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg:// svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/ gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg:// svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446
)
RALPP:
[lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SOUTHGRID-RALPP-disk File does not exist srm://heplnx204.pp.rl.ac.uk:84 43/srm/managerv2?SFN=/pnfs/pp.rl.ac.uk/data/gridpp/gridpp/ user/s/steve.lloyd/data_3000MB XROOTStorage.__putSingleFile: Completely failed to create the destination folder. [FATAL] Connection error {'Failed': {}, 'Successful': {'/gridpp/user/s/steve.lloyd/data_3000MB': {'register': 0.14208984375,
'replicate': 674.2078249454498}}}
^
-- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
-- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
-- Sent from the pit of despair ----------------------------------------------------------- daniela.bauer@imperial.ac.uk HEP Group/Physics Dep Imperial College London, SW7 2BW Tel: +44-(0)20-75947810 http://www.hep.ph.ic.ac.uk/~dbauer/
Hi Rob, Yes works fine now. Thanks for the quick response. Cheers +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Steve Lloyd Emeritus Professor, School of Physics and Astronomy Queen Mary University of London, Mile End Road, London E1 4NS, UK E-mail: s.l.lloyd@qmul.ac.uk +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
On 13 Nov 2017, at 12:26, Robert Currie <rob.currie@ed.ac.uk> wrote:
Hi,
Think I've fixed it, Steve can you have another try?
Somehow the folder was created and owned by Daniela:
[root@srm ~]# dpns-getacl /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user # file: /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user # owner: /C=UK/O=eScience/OU=Imperial/L=Physics/CN=daniela bauer # group: gridpp user::rwx group::r-x #effective:r-x other::--- default:user::rwx default:group::rwx default:other::r-x
I've reset the permissions so that the folder is group writable by users within the gridpp VO so hopefully that should fix the permissions problems [root@srm ~]# dpns-setacl -m g:gridpp:rwx,m:rwx /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user
I'm a little surprised by the 'gridpp/gridpp/' part of the PFN but not enough to go away and try to fix it.
Thanks,
Rob
On 13/11/2017 12:15 PM, Robert Currie wrote:
Hi Raja, I think that fixing the permission problem likely falls to me I'll have a look at the permissions that already exist as I can run: xrdcp /etc/services root://srm.glite.ecdf.ed.ac.uk://dpm/ecdf.ed.ac.uk/home/gridpp/user/testFile [654.6kB/654.6kB][100%][==================================================][327.3kB/s] Looking at this now so I'll let you know when I think I've fixed it, Rob On 13/11/2017 12:06 PM, Raja Nandakumar wrote:
Hi Steve, Glasgow is in downtime due to A/C failure : https://goc.egi.eu/portal/index.php?Page_Type=Downtime&id=24301 Edinburgh : Probably Sam Skipsey needs to fix some permission problem there? Cheers, Raja. On 13/11/17 11:54, Steve Lloyd wrote:
Hi, I have been trying to replicate some files. The Scottish border seems to be closed to me as both Glasgow and Edinburgh fail. RALPP helpfully reports that the file doesn't exist and then says it fails but then appears to do it! Another file worked OK so it's probably alright. Everywhere else seems to be OK. Cheers +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Steve Lloyd Emeritus Professor, School of Physics and Astronomy Queen Mary University of London, Mile End Road, London E1 4NS, UK E-mail: s.l.lloyd@qmul.ac.uk +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Edinburgh: [lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-ECDF-disk XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 getTransportURL: Failed to obtain turls. srm://se03.esc.qmul.ac.uk:8444/srm/managerv2?SFN=/gridpp/gridpp/user/s/steve.lloyd/data_3000MB: [SE][StatusOfGetRequest][SRM_FAILURE] Unable to decide TURL! XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 XROOTStorage.__putSingleFile: Failed to put file on storage. [ERROR] Server responded with an error: [3010] Unable to create /dpm/ecdf.ed.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd/data_3000MB; Permission denied 3010 ERROR Completely failed to replicate file. Failed to replicate with all sources. Glasgow: [lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SCOTGRID-GLASGOW-disk SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) SRM2Storage.__gfal_exec(gfal_ls): Execution failed. [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 createDirectory: Failed to create directory on storage. srm://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2?SFN=/dpm/gla.scotgrid.ac.uk/home/gridpp/gridpp/user/s/steve.lloyd: Unknown error 18446744073709551615 ( -1 : [SE][Ls][] httpg://svr018.gla.scotgrid.ac.uk:8446/srm/managerv2: CGSI-gSOAP running on atlastest1.ph.qmul.ac.uk reports could not open connection to svr018.gla.scotgrid.ac.uk:8446 ) RALPP: [lloyd@atlastest1 gridtests]$ dirac-dms-replicate-lfn /gridpp/user/s/steve.lloyd/data_3000MB UKI-SOUTHGRID-RALPP-disk File does not exist srm://heplnx204.pp.rl.ac.uk:8443/srm/managerv2?SFN=/pnfs/pp.rl.ac.uk/data/gridpp/gridpp/user/s/steve.lloyd/data_3000MB XROOTStorage.__putSingleFile: Completely failed to create the destination folder. [FATAL] Connection error {'Failed': {}, 'Successful': {'/gridpp/user/s/steve.lloyd/data_3000MB': {'register': 0.14208984375, 'replicate': 674.2078249454498}}} ^ -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
-- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
-- _______________________________________________ Gridpp-Dirac-Users mailing list Gridpp-Dirac-Users@imperial.ac.uk https://mailman.ic.ac.uk/mailman/listinfo/gridpp-dirac-users
participants (4)
-
Daniela Bauer
-
Raja Nandakumar
-
Robert Currie
-
Steve Lloyd