View source for Building and testing WRF on Triolith

This page describes the compiling and testing of the [http://www.wrf-model.org/index.php WRF] v371 model on NSC's triolith system ([http://www.nsc.liu.se/systems/triolith/ Triolith]). Source code can be downloaded from the WRF page ([http://www2.mmm.ucar.edu/wrf/users/download/get_source.html]) after filling in a registration form.

The notes below refer to compiling and testing version 3.7.1 of the model.

1. Ensure the correct intel compiler, HDF5 and netcdf modules are loaded using:

:<code>module load buildenv-intel/2015-1</code>
:<code>module load hdf5/1.8.14-i1403-impi-5.0.2.044</code>
:<code>module load netcdf/4.3.2-i1403-impi-5.0.2.044-hdf5-1.8.14</code>

2. Set appropriate HDF5 and netcdf environment variables:

:<code>export PHDF5=/software/apps/hdf5/1.8.14/i1403-impi-5.0.2.044</code>
:<code>export NETCDF=/software/apps/netcdf/4.3.2/i1403-impi-5.0.2.044-hdf5-1.8.14</code>

3. Configure the model. In the WRF base folder (WRF3):

:<code>./configure</code>

If you are using/testing the 3D version of the model, choose option 16

If you are using/testing the 2D version of the model, choose option 13 (serial). For the 2D case, at this point the <code>configure.wrf</code> file also needs to be edited - lines 241-244 should appear as:

:<code>
 LIB_EXTERNAL    = \
                      -L$(WRF_SRC_ROOT_DIR)/external/io_netcdf -lwrfio_nf -L/software/apps/netcdf/4.3.2/i1403-impi-5.0.2.044-hdf5-1.8.14/lib -lnetcdff -lnetcdf   \
                      -L/software/apps/intel/composer_xe_2015.1.133/compiler/lib/intel64 -liomp5
</code>

4. Compile the model:

:<code>./compile -j 4 wrf</code>

5. Compile test case (see README_test_cases), e.g. 3D quarter-circle sheer supercell

:<code>./compile em_quarter_ss</code>

6. After a successful build, go to the specific test directory, e.g.:

:<code>cd test/em_quarter_ss</code>

and run the initialization (<code>ideal.exe</code>) followed by the simulation (<code>wrf.exe</code>). 

* 3D case 

The model should be launched using NSC's [https://www.nsc.liu.se/systems/triolith/software/triolith-software-apps-mpprun.html mpprun] MPI launch application. The model can be tested using an interactive session e.g.

:<code>interactive -N 1 -A <your-SNCI-project-code> -t 01:00:00</code>
:<code>mpprun ideal.exe</code>
:<code>mpprun wrf.exe</code>

or by submitting a run script to the batch queue system on Triolith e.g. run script:

:<code>
 #!/bin/csh
 #SBATCH -t 01:00:00
 #SBATCH -A <your-SNCI-project-code>
 #SBATCH -N 1
 mpprun ideal.exe
 mpprun wrf.exe
</code>

More information regarding [https://www.nsc.liu.se/support/running-applications/ running applications] on Triolith.

* 2D case

For the 2D case, the serial code can be launched directly e.g. <code>./ideal.exe</code> however note that you should still run jobs within an interactive session:

:<code>interactive -n 1 -A <your-SNCI-project-code> -t 01:00:00</code>
:<code>./ideal.exe</code>
:<code>./wrf.exe</code>

or through Triolith's batch system.


;Building WPS

1. Ensure the correct intel compiler, HDF5 and netcdf modules are loaded:

:<code>module load buildenv-intel/2015-1</code>
:<code>module load hdf5/1.8.14-i1403-impi-5.0.2.044</code>
:<code>module load netcdf/4.3.2-i1403-impi-5.0.2.044-hdf5-1.8.14</code>

When compiling WPS, assumes you have already compiled WRF and the location/name of the WRF folder is <code>../WRFV3</code> relative to the main WPS folder.

2. Set appropriate HDF5 and netcdf environment variables:

:<code>export PHDF5=/software/apps/hdf5/1.8.14/i1403-impi-5.0.2.044</code>
:<code>export NETCDF=/software/apps/netcdf/4.3.2/i1403-impi-5.0.2.044-hdf5-1.8.14</code>

3. Configure WPS:

:<code>./configure</code>

Either option 17 or 20 should work.

At this point the <code>configure.wps</code> file needs to be edited - line 48 should appear as:

:<code>
 WRF_LIB         =      -L$(WRF_DIR)/external/io_grib1 -lio_grib1 \
                        -L$(WRF_DIR)/external/io_grib_share -lio_grib_share \
                        -L$(WRF_DIR)/external/io_int -lwrfio_int \
                        -L$(WRF_DIR)/external/io_netcdf -lwrfio_nf \
                        -L$(NETCDF)/lib -lnetcdff -lnetcdf \
                        -L/software/apps/intel/composer_xe_2015.1.133/compiler/lib/intel64 -liomp5
</code>

4. Finally, compile WPS:

:<code>./compile</code>