Building CESM models on the NSC triolith system
This page describes the building of the CESM1 (CESM1.1) model on NSC's triolith system (triolith). Triolith consists of 1200 HP SL230s compute nodes is equipped with two Intel E5-2660 (2.2 GHz Sandybridge) processors with 8 cores each, i.e 16 cores per node. Triolith is equipped with a fast interconnect (Infiniband from Mellanox (FDR IB, 56 Gb/s) in a 2:1 blocking configuration) for high performance for parallel applications.
Triolith is a SNIC-funded system, and computing time on Triolith is exclusively allocated to SNIC projects (Large, Medium and Small). See [1] and [2] for information on how to apply for a SNIC project. Contact: support@nsc.liu.se.
- CESM1 unix group on triolith
If you are going to run the CESM1 model on triolith, you should join the 'cesm1' unix group on triolith. This is not absolutely necessary but being a member allows access to shared storage space on /nobackup/global where pre-downloaded initial data and ancillary files are stored. Email support@nsc.liu.se to request membership to the cesm1 unix group.
- CESM1 - Getting the source code
CEMS1 is a free, open source model, but a short registeration is required before access to the subversion repository is granted. The source code, build and run scripts can be downloaded as described in the CESM1 user guide. The files should be downloaded into the /home file system. This ensures that your code, and configuration files are backed up. To create a CESM1.1.1 version in /home/$USER/Projects/cesm1.1.1:
1) Change to the appropriate folder
- cd Projects
2) List available model versions:
3) Checkout version 1.1.1
- svn co https://svn-ccsm-release.cgd.ucar.edu/model_versions/cesm1_1_1 cesm1.1.1
4) Files containing triolith specific machine environment variables have been created and are stored in the folder /nobackup/global/proj/cesm1/triolith_config_cesm1.1.1 (triolith_config_cesm1.0.4 config files also available). These files should be copied to the appropriate location in your local distribution. Based on the steps above:
- cd /home/$USER/Projects/cesm1.1.1/scripts/ccsm_utils/Machines
- cp /nobackup/global/proj/cesm1/triolith_config_cesm1.1.1/* .
5) CESM1 can now be built in the usual way as described in the CESM1 users guide (see Creating and Setting Up A Case) using 'triolith' for the machine designation. For example, to create a new 'f19_g16' resolution case using the 'B' compset:
- cd /home/$USER/Projects/cesm1.1.1/scripts/
- ./create_newcase -case ../cases/lbtest-f19_g16-B -res f19_g16 -compset B -mach triolith
6) Configure, build and run your model:
- cd /home/$USER/Projects/cesm1.1.1/cases/lbtest-f19_g16-B
- ./cesm_setup
- ./lbtest-f19_g16-B.build
Edit the env_run.xml file for the particular simulation you wish to make, then submit your job:
- sbatch ./lbtest-f19_g16-B.run
