Quickstart/sbatch - Revision history

Pysdlb at 14:24, 9 November 2022

2022-11-09T14:24:25Z

Chris.collins: Created page with "TOC == Introduction == Having been introduced to the Slurm scheduler in Quickstart/Slurm and then one of the ways of using Viper with Interactive sessions in Quickst..."

2022-11-09T14:22:39Z

Created page with "__TOC__ == Introduction == Having been introduced to the Slurm scheduler in Quickstart/Slurm and then one of the ways of using Viper with Interactive sessions in Quickst..."

New page

__TOC__
== Introduction ==
Having been introduced to the Slurm scheduler in [[Quickstart/Slurm]] and then one of the ways of using Viper with Interactive sessions in [[Quickstart/Interactive]] the next way of making use of a HPC system like Viper is by submitting jobs to run automatically without interaction when resource becomes available. We call these '''batch jobs'''.

In order to run a batch job, we need to provide Slurm with information about what we want to do. We do this via a job submission script, which is sort of like a recipe for the job. The submission script is a text file that provides information to Slurm about the task you are running so that it can be allocated to the appropriate resource, sets up the environment so the task can run. A minimal submission script has three main components:

* A set of directives that provides Slurm some high level information such as what resource is required, a job name, how long the task should run for and where to log any output that would normally be shown on the screen.
* Information about how the job environment should be set up, for example, what application [[Quickstart/Modules]] should be loaded.
* The actual command(s) that need to be run.

<nowiki>#</nowiki>!/bin/bash
<nowiki>#</nowiki>SBATCH -J
<nowiki>#</nowiki>SBATCH -n 1
<nowiki>#</nowiki>SBATCH -o slurm-%j.log
<nowiki>#</nowiki>SBATCH -e slurm-%j.err
<nowiki>#</nowiki>SBATCH -p compute
<nowiki>#</nowiki>SBATCH --time=0-01:00:00

module purge
module add MODULENAME

command


=== Simple Example Job Submissions Scripts ===
==== Matlab ====
<pre class="mw-collapsible mw-collapsed" >
#!/bin/bash
#SBATCH -J myjob
#SBATCH -n 1
#SBATCH -o slurm-%j.out
#SBATCH -e slurm-%j.out
#SBATCH -p compute
#SBATCH --time=0-01:00:00

module purge
module add MODULENAME

COMMAND SCRIPT
</pre>

==== R ====
<pre class="mw-collapsible mw-collapsed" >
#!/bin/bash
#SBATCH -J myjob
#SBATCH -n 1
#SBATCH -o slurm-%j.out
#SBATCH -e slurm-%j.out
#SBATCH -p compute
#SBATCH --time=0-01:00:00

module purge
module add MODULENAME

COMMAND SCRIPT
</pre>

@@ Line 1: / Line 1: @@
 __TOC__
 == Introduction ==
-Having been introduced to the Slurm scheduler in [[Quickstart/Slurm]] and then one of the ways of using Viper with Interactive sessions in [[Quickstart/Interactive]] the next way of making use of a HPC system like Viper is by submitting jobs to run automatically without interaction when resource becomes available. We call these '''batch jobs'''.
+Having been introduced to the Slurm scheduler in [[Quickstart/Slurm]] and then one of the ways of using Viper with Interactive sessions in [[Quickstart/Interactive]] the next way of making use of an HPC system like Viper is by submitting jobs to run automatically without interaction when the resource becomes available. We call these '''batch jobs'''.
-In order to run a batch job, we need to provide Slurm with information about what we want to do. We do this via a job submission script, which is sort of like a recipe for the job. The submission script is a text file that provides information to Slurm about the task you are running so that it can be allocated to the appropriate resource, sets up the environment so the task can run. A minimal submission script has three main components:
+In order to run a batch job, we need to provide Slurm with information about what we want to do. We do this via a job submission script, which is sort of like a recipe for the job. The submission script is a text file that provides information to Slurm about the task you are running so that it can be allocated to the appropriate resource, and sets up the environment so the task can run. A minimal submission script has three main components:
-* A set of directives that provides Slurm some high level information such as what resource is required, a job name, how long the task should run for and where to log any output that would normally be shown on the screen.
+* A set of directives that provides Slurm with some high-level information such as what resource is required, a job name, how long the task should run for and where to log any output that would normally be shown on the screen.
 * Information about how the job environment should be set up, for example, what application [[Quickstart/Modules]] should be loaded.
 * The actual command(s) that need to be run.

Quickstart/sbatch - Revision history

Pysdlb at 14:24, 9 November 2022

Chris.collins: Created page with "__TOC__ == Introduction == Having been introduced to the Slurm scheduler in Quickstart/Slurm and then one of the ways of using Viper with Interactive sessions in Quickst..."

Chris.collins: Created page with "TOC == Introduction == Having been introduced to the Slurm scheduler in Quickstart/Slurm and then one of the ways of using Viper with Interactive sessions in Quickst..."