Difference between revisions of "CESM & NorESM users on Triolith: changing to the new centre storage (/proj/) system"
(4 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
The new centre storage system at NSC became operational in October 2014 ([https://www.nsc.liu.se/storage/snic-centrestorage/ NSC Centre Storage]). Because the storage environment was changed from a 'user' based systen (/nobackup/global/${USER}) to a 'project' based system (/proj/project_name), this requires a change in the way the CESM and NorESM models are configured on Triolith. | The new centre storage system at NSC became operational in October 2014 ([https://www.nsc.liu.se/storage/snic-centrestorage/ NSC Centre Storage]). Because the storage environment was changed from a 'user' based systen (/nobackup/global/${USER}) to a 'project' based system (/proj/project_name), this requires a change in the way the CESM and NorESM models are configured on Triolith. | ||
− | |||
− | |||
− | 1. Change the EXEROOT variable in the 'env_build.xml' file from: | + | '''CESM 1.1 and later versions''' |
+ | |||
+ | ''1. Existing Cases'' | ||
+ | |||
+ | i. Change the EXEROOT variable in the 'env_build.xml' file from: | ||
+ | |||
+ | :<code>value="/nobackup/global/$CCSMUSER/$CASE/bld"</code> | ||
+ | |||
+ | to e.g. | ||
+ | |||
+ | :<code>value="/proj/<project-name>/users/$CCSMUSER/$CASE/bld"</code> | ||
+ | |||
+ | where <code><project-name></code> is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'. | ||
+ | |||
+ | ii. Change the DOUT_S_ROOT variable in the 'env_run.xml' file from: | ||
+ | |||
+ | :<code>value="/nobackup/global/$CCSMUSER/archive/$CASE"</code> | ||
+ | |||
+ | to e.g. | ||
+ | |||
+ | :<code>value="/proj/<project-name>/users/$CCSMUSER/cesm1.1.1/archive/$CASE"</code> | ||
+ | |||
+ | iii. Change the RUNDIR variable in the 'env_run.xml' file from: | ||
+ | |||
+ | :<code>value="/nobackup/global/$CCSMUSER/$CASE/run"</code> | ||
+ | |||
+ | to e.g. | ||
+ | |||
+ | :<code>value="/proj/<project-name>/users/$CCSMUSER/cesm1.1.1/$CASE/run"</code> | ||
+ | |||
+ | iii. Clean case and reconfigure: | ||
+ | |||
+ | :<code>./cesm_setup</code> | ||
+ | |||
+ | iv. Clean then rebuild the model: | ||
+ | |||
+ | :<code><mycase>.clean_build</code> | ||
+ | :<code><mycase>.build</code> | ||
+ | |||
+ | |||
+ | ''2. New Cases, Existing Code'' | ||
+ | |||
+ | i. Copy new config. files, e.g. for vn 1.1.1. | ||
+ | |||
+ | :<code>cd <CESM-base-dir>/scripts</code> | ||
+ | :<code>cp /proj/cesm_input-data/triolith_config_cesm1.1.1/create_newcase .</code> | ||
+ | |||
+ | :<code>cd <CESM-base-dir>/scripts/ccsm_utils/Case.template</code> | ||
+ | :<code>cp /proj/cesm_input-data/triolith_config_cesm1.1.1/config_definition.xml .</code> | ||
+ | |||
+ | :<code>cd <CESM-base-dir>/scripts/ccsm_utils/Machines</code> | ||
+ | :<code>cp /proj/cesm_input-data/triolith_config_cesm1.1.1/config_machines.xml .</code> | ||
+ | |||
+ | ii. Create new case. '''Note''': when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g. | ||
+ | |||
+ | :<code><CESM-base-dir>/scripts/create_newcase -case mycase1 -res f19_g16 -compset B1850CN -mach triolith -ccsm_out /proj/bolinc/users/$USER/cesm1.1.1</code> | ||
+ | |||
+ | |||
+ | ''3. Completely new download'' | ||
+ | |||
+ | See: [[Building CESM models on the NSC triolith system]] | ||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | '''CESM 1.0.x''' | ||
+ | |||
+ | ''1. Existing Cases'' | ||
+ | |||
+ | i. Change the EXEROOT variable in the 'env_build.xml' file from: | ||
:<code>value="/nobackup/global/$CCSMUSER/$CASE"</code> | :<code>value="/nobackup/global/$CCSMUSER/$CASE"</code> | ||
Line 15: | Line 83: | ||
where <code><project-name></code> is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'. | where <code><project-name></code> is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'. | ||
− | + | ii. Change the DOUT_S_ROOT variable in the 'env_run.xml' file from: | |
+ | |||
+ | :<code>value="/nobackup/global/$CCSMUSER/archive/$CASE"</code> | ||
+ | |||
+ | to e.g. | ||
+ | |||
+ | :<code>value="/proj/<project-name>/users/$CCSMUSER/cesm1.0.3/archive/$CASE"</code> | ||
+ | |||
+ | iii. Clean case and reconfigure: | ||
+ | |||
+ | :<code>./configure -cleanall</code> | ||
+ | :<code>./configure -case</code> | ||
+ | |||
+ | iv. Clean then rebuild the model: | ||
+ | |||
+ | :<code><mycase>.clean_build</code> | ||
+ | :<code><mycase>.build</code> | ||
+ | |||
+ | |||
+ | ''2. New Cases, Existing Code'' | ||
+ | |||
+ | i. Copy new config. files. | ||
+ | |||
+ | :<code>cd <CESM-base-dir>/scripts</code> | ||
+ | :<code>cp /proj/cesm_input-data/triolith_config_cesm1.0.3/create_newcase .</code> | ||
+ | |||
+ | :<code>cd <CESM-base-dir>/scripts/ccsm_utils/Case.template</code> | ||
+ | :<code>cp /proj/cesm_input-data/triolith_config_cesm1.0.3/config_definition.xml .</code> | ||
+ | |||
+ | :<code>cd <CESM-base-dir>/scripts/ccsm_utils/Machines</code> | ||
+ | :<code>cp /proj/cesm_input-data/triolith_config_cesm1.0.3/config_machines.xml .</code> | ||
+ | |||
+ | ii. Create new case. '''Note''': when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g. | ||
+ | |||
+ | :<code><CESM-base-dir>/scripts/create_newcase -case mycase1 -res f19_g16 -compset B1850CN -mach triolith -ccsm_out /proj/bolinc/users/$USER/cesm1.0.3</code> | ||
+ | |||
+ | |||
+ | ''3. Completely new download'' | ||
+ | |||
+ | See: [[Building CESM models on the NSC triolith system]] | ||
+ | |||
Line 59: | Line 167: | ||
i. Copy new config. files. | i. Copy new config. files. | ||
− | :<code>cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/create_newcase <NorESM-base-dir>/scripts</code> | + | :<code>cd <NorESM-base-dir>/scripts</code> |
− | :<code>cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/config_definition.xml <NorESM-base-dir>/scripts/ccsm_utils/ | + | :<code>cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/create_newcase .</code> |
− | :<code>cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/config_machines.xml | + | |
+ | :<code>cd <NorESM-base-dir>/scripts/ccsm_utils/Case.template</code> | ||
+ | :<code>cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/config_definition.xml .</code> | ||
+ | |||
+ | :<code>cd <NorESM-base-dir>/scripts/ccsm_utils/Machines</code> | ||
+ | :<code>cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/config_machines.xml .</code> | ||
ii. Create new case. '''Note''': when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g. | ii. Create new case. '''Note''': when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g. | ||
:<code><NorESM-base-dir>/scripts/create_newcase -case ../cases/triolithTest -mach triolith -res f19_g16 -compset N2000AERL -pecount S -ccsm_out /proj/bolinc/users/${USER}/NorESM</code> | :<code><NorESM-base-dir>/scripts/create_newcase -case ../cases/triolithTest -mach triolith -res f19_g16 -compset N2000AERL -pecount S -ccsm_out /proj/bolinc/users/${USER}/NorESM</code> | ||
+ | |||
+ | |||
+ | ''3. Completely new model'' | ||
+ | |||
+ | See: [[Building NorESM (CMIP5) on the NSC triolith system]] | ||
{{set category list|field|Climate research}} | {{set category list|field|Climate research}} |
Latest revision as of 15:21, 25 November 2014
The new centre storage system at NSC became operational in October 2014 (NSC Centre Storage). Because the storage environment was changed from a 'user' based systen (/nobackup/global/${USER}) to a 'project' based system (/proj/project_name), this requires a change in the way the CESM and NorESM models are configured on Triolith.
CESM 1.1 and later versions
1. Existing Cases
i. Change the EXEROOT variable in the 'env_build.xml' file from:
value="/nobackup/global/$CCSMUSER/$CASE/bld"
to e.g.
value="/proj/<project-name>/users/$CCSMUSER/$CASE/bld"
where <project-name>
is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'.
ii. Change the DOUT_S_ROOT variable in the 'env_run.xml' file from:
value="/nobackup/global/$CCSMUSER/archive/$CASE"
to e.g.
value="/proj/<project-name>/users/$CCSMUSER/cesm1.1.1/archive/$CASE"
iii. Change the RUNDIR variable in the 'env_run.xml' file from:
value="/nobackup/global/$CCSMUSER/$CASE/run"
to e.g.
value="/proj/<project-name>/users/$CCSMUSER/cesm1.1.1/$CASE/run"
iii. Clean case and reconfigure:
./cesm_setup
iv. Clean then rebuild the model:
<mycase>.clean_build
<mycase>.build
2. New Cases, Existing Code
i. Copy new config. files, e.g. for vn 1.1.1.
cd <CESM-base-dir>/scripts
cp /proj/cesm_input-data/triolith_config_cesm1.1.1/create_newcase .
cd <CESM-base-dir>/scripts/ccsm_utils/Case.template
cp /proj/cesm_input-data/triolith_config_cesm1.1.1/config_definition.xml .
cd <CESM-base-dir>/scripts/ccsm_utils/Machines
cp /proj/cesm_input-data/triolith_config_cesm1.1.1/config_machines.xml .
ii. Create new case. Note: when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g.
<CESM-base-dir>/scripts/create_newcase -case mycase1 -res f19_g16 -compset B1850CN -mach triolith -ccsm_out /proj/bolinc/users/$USER/cesm1.1.1
3. Completely new download
See: Building CESM models on the NSC triolith system
CESM 1.0.x
1. Existing Cases
i. Change the EXEROOT variable in the 'env_build.xml' file from:
value="/nobackup/global/$CCSMUSER/$CASE"
to e.g.
value="/proj/<project-name>/users/$CCSMUSER/$CASE"
where <project-name>
is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'.
ii. Change the DOUT_S_ROOT variable in the 'env_run.xml' file from:
value="/nobackup/global/$CCSMUSER/archive/$CASE"
to e.g.
value="/proj/<project-name>/users/$CCSMUSER/cesm1.0.3/archive/$CASE"
iii. Clean case and reconfigure:
./configure -cleanall
./configure -case
iv. Clean then rebuild the model:
<mycase>.clean_build
<mycase>.build
2. New Cases, Existing Code
i. Copy new config. files.
cd <CESM-base-dir>/scripts
cp /proj/cesm_input-data/triolith_config_cesm1.0.3/create_newcase .
cd <CESM-base-dir>/scripts/ccsm_utils/Case.template
cp /proj/cesm_input-data/triolith_config_cesm1.0.3/config_definition.xml .
cd <CESM-base-dir>/scripts/ccsm_utils/Machines
cp /proj/cesm_input-data/triolith_config_cesm1.0.3/config_machines.xml .
ii. Create new case. Note: when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g.
<CESM-base-dir>/scripts/create_newcase -case mycase1 -res f19_g16 -compset B1850CN -mach triolith -ccsm_out /proj/bolinc/users/$USER/cesm1.0.3
3. Completely new download
See: Building CESM models on the NSC triolith system
NorESM (& CCSM4)
1. Existing Cases
i. Change the EXEROOT variable in the 'env_build.xml' file from:
value="/nobackup/global/$CCSMUSER/$CASE"
to e.g.
value="/proj/<project-name>/users/$CCSMUSER/NorESM/$CASE"
where <project-name>
is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'.
ii. Change the DOUT_S_ROOT variable in the 'env_run.xml' file from:
value="/nobackup/global/$CCSMUSER/archive/$CASE"
to e.g.
value="/proj/<project-name>/users/$CCSMUSER/NorESM/archive/$CASE"
where <project-name>
is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'.
iii. Clean case and reconfigure:
./configure -cleanall
./configure -case
iv. Clean then rebuild the model:
<mycase>.clean_build
<mycase>.build
2. New Cases, Existing Code
i. Copy new config. files.
cd <NorESM-base-dir>/scripts
cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/create_newcase .
cd <NorESM-base-dir>/scripts/ccsm_utils/Case.template
cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/config_definition.xml .
cd <NorESM-base-dir>/scripts/ccsm_utils/Machines
cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/config_machines.xml .
ii. Create new case. Note: when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g.
<NorESM-base-dir>/scripts/create_newcase -case ../cases/triolithTest -mach triolith -res f19_g16 -compset N2000AERL -pecount S -ccsm_out /proj/bolinc/users/${USER}/NorESM
3. Completely new model