How to upload your output data for ISI-MIP


Posted by Lila Warszawski on June 11, 2012

Below you will find information on how to upload your model output to the DKRZ server in Hamburg, where it will be available for download for all ISI-MIP participants. Please follow the three steps below; we recommend you begin even before you have output data ready, as obtaining the DKRZ account (step no.1) will take a little while.

1) Get an account

First, in order to be able to upload files, you will need to get an individual user account at DKRZ. The account that you have been using for downloading input data is not sufficient for this.
Please go to https://luv.dkrz.de and click on create a new website account. Fill in the form, and when being asked whether to add your account to an existing project, please add it to the Project ISI-MIP, project number 820.
DKRZ will then set up a user account for you, which may take up to a few days (though usually it should be done within one day).
After you have obtained your username and password, you can log in to your account at https://luv.dkrz.de e.g. to change your password and see your account settings.

2) Find the proper directory

The upload area is located on the same server machine (vre1) as the input data. You can log on to the server using 
ssh <username>@vre1.dkrz.de
and providing your password when prompted. Then change to the following directory:
cd /gpfs_750/projects/ISI_MIP/data/upload_area/
There you will find a subdirectory tree which is structured as follows:
Impact_Model
→ Climate_Model
→ Climate_Scenario
→ SocioEcon_Scenario
→ CO2_Scenario
→ Irrigation_Scenario
→ Crops
(only for agricultural models)

All data files should be stored on the lowest level of this directory structure. Some of the categories do not apply to all sectors and models (e.g. the biomes sector does not consider SocioEcon_Scenarios). For these cases, there is a subdirectory called NOT_APPLICABLE on the same level.

If your files have the correct naming according to the simulation protocol, it will be easy to find the proper directory for storing them.
Example 1:
A file called magpie_hadgem2-es_rcp8p5_ssp2_noco2_default_Xprr_whe_decadal_2006_2010.nc should be stored under MAgPIE/HadGEM2-ES/rcp8p5/ssp2/noco2/default/wheat/.
Example 2:
A file called macpdm_hadgem2-es_hist_nosoc_potevap_monthly_1971_1980.nc should be stored under MacPDM/HadGEM2-ES/hist/nosoc/NOT_APPLICABLE/NOT_APPLICABLE/.

(Note that on the Climate_Model level, only the HadGEM2-ES subdirectory is available at the moment; as input data for additional climate models will be made available, we will also add the respective directories.)

3) Upload your files

Once you have identified the appropriate directory, you can upload your files e.g. using
scp <output_file> <username>@vre1.dkrz.de:/gpfs_750/projects/ISI_MIP/data/upload_area/<target_path>
where <target_path> is the path to the target directory starting with the name of your impact model, as in the examples above.

Once files are uploaded, they will be accessible via the internet in the same way as the input data; use the link on www.isimip.org > Output data.

Please let us know if you have any questions or encounter any problems.  The above information can also be found on www.isimip.org > Output data.