Hi Giuseppe,

You can generally get more details information about why a job failed from
the web interface at: https://dirac.gridpp.ac.uk
(Although you have to have your grid certificate installed in your browser
to access this).

In this case your jobs have the Application Status of "Input data not
available", which as you correctly surmised indicates a problem with the
inputfiles.

I've had a look at the JDL which Ganga generated and you have three LFN
based files in the sandbox:

"LFN:/gridpp/user/giuseppe.congedo/sim/image_0_details.fits",
"LFN:/gridpp/user/giuseppe.congedo/PSF/simssbc_cb2004a_001.fits_0.000_0.804_1.00.fits",
"LFN:/gridpp/user/giuseppe.congedo/sim/.lensmc_cache",

If I look in the catalogue (using the dirac-dms-filecatalog-cli tool), it
seems like you used a slightly different path for these files when you
uploaded them:

/gridpp/user/giuseppe.congedo/sim/sim/image_0_details.fits
/gridpp/user/giuseppe.congedo/sim/PSF/simssbc_cb2004a_001.fits_0.000_0.804_1.00.fits
/gridpp/user/giuseppe.congedo/sim/.lensmc_cache

(Note the extra "sim/" directory in the first two paths). It should simply
be a case of adjusting the paths in your ganga script to match the file
catalogue.

It also looks like you may have put these as inputdata as well... There is
no need to do this, just specifying them in the inputfiles is
sufficient (if you set inputdata, the jobs have to run at a site with those
files, whereas inputfiles can be downloaded at any site).

Please let us know if that doesn't work or if you run into any further
problems.

Regards,
Simon


On Sat, Mar 18, 2017 at 11:21:56AM +0000, Giuseppe Congedo wrote:

Hello all,

I am trying to move my workflow on gridpp, but the problem is, I am a
newbie! Andrew Lahiff has been very helpful in giving me good advice along
the way - thanks. I hope you too could help me with this.

I set up code, software environment, and data, and it works fine locally on
Ganga. To move things on the grid, I put code & environment on cvmfs (thanks
Catalin Condurache), and uploaded data on DFC. After submission, I got the
error attached below. It looks like the job could not see the input data,
and also some output sandbox was not properly initialised.

My submission scripts looks like the example in the userguide. I suspect I
might be doing something wrong perhaps here?

j.inputfiles = [
DiracFile('LFN:/gridpp/user/giuseppe.congedo/my_folder/my_file'),

Please note that the job fails no matter if I set DiracLFNBase or not in
.gangarc.

I look forward to hearing from you, and thanks so much for your help.

Giuseppe

---
ERROR    Unable to finalise job after 36 retries due to error:
GangaDiracError: No Output sandbox registered for job 2335379
INFO     job 36 status changed to "failed"
WARNING  An error occured finalising job: 36
WARNING  Attemting again (2 of 5) after 2.5-sec delay
INFO     job 36 status changed to "submitted"
INFO     job 36 status changed to "running"
INFO     job 36 status changed to "failed"
WARNING  An error occured finalising job: 36
WARNING  Attemting again (3 of 5) after 2.5-sec delay
INFO     job 36 status changed to "submitted"
INFO     job 36 status changed to "running"
INFO     job 36 status changed to "failed"
WARNING  An error occured finalising job: 36
WARNING  Attemting again (4 of 5) after 2.5-sec delay
INFO     job 36 status changed to "submitted"
INFO     job 36 status changed to "running"
INFO     job 36 status changed to "failed"
WARNING  An error occured finalising job: 36
WARNING  Attemting again (5 of 5) after 2.5-sec delay
ERROR    GangaDiracError: No Output sandbox registered for job 2335379
---