Difference between revisions of "Applications/Utilities"
From HPC
m (Pysdlb moved page Utilities to Applications/Utilities without leaving a redirect) |
m (→Further information) |
||
| (20 intermediate revisions by 2 users not shown) | |||
| Line 5: | Line 5: | ||
* Versions : Various | * Versions : Various | ||
* Module names : utilities/multi | * Module names : utilities/multi | ||
| − | * License: GNU license | + | * License: GNU license(s) |
| − | |||
| − | == | + | == Usage Examples == |
| + | |||
| + | The following utilities are loaded as part of this module: | ||
| + | |||
| + | * bzip2 (& bunzip2) | ||
| + | * git | ||
| + | * zip (& unzip) | ||
| + | * wget | ||
| − | |||
| − | == | + | ===Special Consideration=== |
| + | |||
| + | * There is an issue with with using '''https://''' addresses with git, this is easily resolved with replacing the operator '''git://''' rather than '''https://''' | ||
| + | |||
| + | <pre style="background-color: #C8C8C8; color: black; border: 2px solid #C8C8C8; font-family: monospace, sans-serif;"> | ||
| + | |||
| + | [root@c025 ~]# module add utilities/multi | ||
| + | [root@c025 ~]# git clone git://github.com/Tomas-M/linux-live | ||
| + | Cloning into 'linux-live'... | ||
| + | warning: templates not found /usr/share/git-core/templates | ||
| + | remote: Counting objects: 2945, done. | ||
| + | remote: Compressing objects: 100% (267/267), done. | ||
| + | remote: Total 2945 (delta 171), reused 362 (delta 124), pack-reused 2519 | ||
| + | Receiving objects: 100% (2945/2945), 5.82 MiB | 5.77 MiB/s, done. | ||
| + | Resolving deltas: 100% (1304/1304), done. | ||
| + | |||
| + | </pre> | ||
| + | |||
=== Batch Submission === | === Batch Submission === | ||
| − | <pre style="background-color: #C8C8C8; color: black; border: 2px solid | + | <pre style="background-color: #C8C8C8; color: black; border: 2px solid #C8C8C8; font-family: monospace, sans-serif;"> |
#!/bin/bash | #!/bin/bash | ||
| Line 26: | Line 48: | ||
#SBATCH --ntasks-per-node=20 | #SBATCH --ntasks-per-node=20 | ||
| − | |||
#SBATCH -o test.out | #SBATCH -o test.out | ||
#SBATCH -e test.err | #SBATCH -e test.err | ||
| Line 38: | Line 59: | ||
module purge | module purge | ||
| − | module | + | module add utilities/multi |
wget http://www.example.com/somedatatodownload.zip | wget http://www.example.com/somedatatodownload.zip | ||
unzip somedatatodownload.zip | unzip somedatatodownload.zip | ||
/home/user/processthisdata mydatadownloaded | /home/user/processthisdata mydatadownloaded | ||
| − | |||
</pre> | </pre> | ||
| − | <pre style="background-color: | + | <pre style="background-color: black; color: white; border: 2px solid black; font-family: monospace, sans-serif;"> |
[username@login01 ~]$ sbatch downloadprocess.job | [username@login01 ~]$ sbatch downloadprocess.job | ||
Submitted batch job 389511 | Submitted batch job 389511 | ||
</pre> | </pre> | ||
| − | [ | + | == Further information == |
| + | |||
| + | * [http://www.gnu.org/ http://www.gnu.org/] | ||
| + | |||
| + | {{Modulepagenav}} | ||
Latest revision as of 11:00, 16 November 2022
Contents
Application Details
- Description : Utilities is a collection, including zip, unzip, bzip2, bunzip2, git, and wget
- Versions : Various
- Module names : utilities/multi
- License: GNU license(s)
Usage Examples
The following utilities are loaded as part of this module:
- bzip2 (& bunzip2)
- git
- zip (& unzip)
- wget
Special Consideration
- There is an issue with with using https:// addresses with git, this is easily resolved with replacing the operator git:// rather than https://
[root@c025 ~]# module add utilities/multi [root@c025 ~]# git clone git://github.com/Tomas-M/linux-live Cloning into 'linux-live'... warning: templates not found /usr/share/git-core/templates remote: Counting objects: 2945, done. remote: Compressing objects: 100% (267/267), done. remote: Total 2945 (delta 171), reused 362 (delta 124), pack-reused 2519 Receiving objects: 100% (2945/2945), 5.82 MiB | 5.77 MiB/s, done. Resolving deltas: 100% (1304/1304), done.
Batch Submission
#!/bin/bash #SBATCH -J -20 #SBATCH -N 1 #SBATCH --ntasks-per-node=20 #SBATCH -o test.out #SBATCH -e test.err #SBATCH -p compute #SBATCH --exclusive #SBATCH --time=2-00:00:00 echo $SLURM_NTASKS echo $SLURM_JOB_NODELIST echo $SLURM_HOSTS module purge module add utilities/multi wget http://www.example.com/somedatatodownload.zip unzip somedatatodownload.zip /home/user/processthisdata mydatadownloaded
[username@login01 ~]$ sbatch downloadprocess.job Submitted batch job 389511