|
|
| (8 intermediate revisions by one other user not shown) |
| Line 1: |
Line 1: |
| − | == Generic examples ==
| + | #REDIRECT[[Swestore Documentation Moved]] |
| − | | |
| − | === Example 1 ===
| |
| − | | |
| − | This job just sends a script to a grid resource which writes "Hello, grid!" to standard output. The scripts stores standard input and output to the files stdout.txt och stderr.txt. All output is collected upon retrieval using the directive "/" in the outputFiles attribute. Walltime is set to 5 minutes. The executable is also added to the input files section.
| |
| − | | |
| − | '''XRSL job description (ex1.xrsl):'''
| |
| − | | |
| − | <pre>&(executable=run.sh)
| |
| − | (wallTime="5 minutes")
| |
| − | (stdout="stdout.txt")
| |
| − | (stderr="stderr.txt")
| |
| − | (inputFiles=("run.sh" ""))
| |
| − | (outputFiles=("/" ""))
| |
| − | </pre>
| |
| − | | |
| − | '''Executable shell script (run.sh):'''
| |
| − | | |
| − | <pre>#!/bin/sh
| |
| − | echo "Hello, grid"
| |
| − | </pre>
| |
| − | | |
| − | '''Usage:'''
| |
| − | | |
| − | <pre>arcsub ex1.xrsl</pre>
| |
| − | | |
| − | More verbose output is achieved with:
| |
| − | | |
| − | <pre>arcsub --debug=INFO ex1.xrsl</pre>
| |
| − | | |
| − | === Example 2 ===
| |
| − | | |
| − | Debug information from the used resources can be retrieved using the "gmlog" attribute. The value of the attribute specifies the name of the directory to store the debug information.
| |
| − | | |
| − | '''XRSL job description (ex2.xrsl):'''
| |
| − | | |
| − | <pre>&(executable=run.sh)
| |
| − | (cpuTime="5 minutes")
| |
| − | (stdout="stdout.txt")
| |
| − | (stderr="stderr.txt")
| |
| − | (inputFiles=("run.sh" ""))
| |
| − | (outputFiles=("/" ""))
| |
| − | (gmlog="grid.debug")
| |
| − | </pre>
| |
| − | | |
| − | '''Executable shell script (run.sh):'''
| |
| − | | |
| − | <pre>#!/bin/sh
| |
| − | echo "Hello, grid"
| |
| − | </pre>
| |
| − | | |
| − | '''Usage:'''
| |
| − | | |
| − | <pre>arcsub ex2.xrsl</pre>
| |
| − | | |
| − | === Example 3 - Job sweep ===
| |
| − | | |
| − | This example illustrates how to do a simple job sweep and manage the sweep using ARC job lists. The implementation of the the job sweep will be done using Python, but could also easily be implemented using bash-scripts or any other scripting language.
| |
| − | | |
| − | To enable dynamic generation of XRSL description a template XRSL is defined in the jobDescription string variable.
| |
| − | | |
| − | <pre>#!/usr/bin/python
| |
| − | | |
| − | import os, sys
| |
| − | | |
| − | jobDescription = '''&(executable=run.sh)
| |
| − | (cpuTime='5 minutes')
| |
| − | (stdout=stdout.txt)
| |
| − | (stderr=stderr.txt)
| |
| − | (inputFiles=('run.sh' ''))
| |
| − | (jobName=job%04d)'''
| |
| − | </pre>
| |
| − | | |
| − | In the string template, "job%04d" will be substituted with an integer value and the job names will have the format "job0000"-"job000n-1".
| |
| − | | |
| − | Next, a variable totalJobs is set to the total number of jobs to be submitted. We implement a job submission loop:
| |
| − | | |
| − | <pre>totalJobs = 4
| |
| − | | |
| − | for i in range(totalJobs):
| |
| − | </pre>
| |
| − | | |
| − | In the job submission we are going to pass the XRSL as a string to the arcsub command. To do this we have to remove the line breaks in the template. This is done using the following statement:
| |
| − | | |
| − | <pre>
| |
| − | jobDescriptionString = "".join(jobDescription.split("\n"))
| |
| − | </pre>
| |
| − | | |
| − | <pre>
| |
| − | os.system('arcsub --joblist=ex3.list --jobdescrstring="%s"' % (jobDescriptionString % i))
| |
| − | </pre>
| |
| − | | |
| − | == Octave / MATLAB examples ==
| |
| − | | |
| − | == SciPy / Numpy examples ==
| |
| − | | |
| − | == ARC Python API examples ==
| |
