Difference between revisions of "Applications/Utilities"

From HPC
Jump to: navigation , search
(Created page with " == Application Details == * Description : Utilities is a collection, including zip, unzip, bzip2, bunzip2, git, and wget * Versions : Various * Module names : utilities/mult...")
 
(19 intermediate revisions by 2 users not shown)
Line 5: Line 5:
 
* Versions : Various
 
* Versions : Various
 
* Module names : utilities/multi
 
* Module names : utilities/multi
* License: GNU license  
+
* License: GNU license(s)
* Further information:
 
  
  
== Toolboxes ==
+
== Usage Examples ==
 +
 
 +
The following utilities are loaded as part of this module:
 +
 
 +
* bzip2 (& bunzip2)
 +
* git
 +
* zip (& unzip)
 +
* wget
 +
 
 +
 
 +
===Special Consideration===
 +
 
 +
* There is an issue with with using '''https://''' addresses with git, this is easily resolved with replacing the operator '''git://''' rather than '''https://'''
 +
 
 +
<pre style="background-color: #C8C8C8; color: black; border: 2px solid #C8C8C8; font-family: monospace, sans-serif;">
  
Toolboxes do not apply here
+
[root@c025 ~]# module add utilities/multi
 +
[root@c025 ~]# git clone git://github.com/Tomas-M/linux-live
 +
Cloning into 'linux-live'...
 +
warning: templates not found /usr/share/git-core/templates
 +
remote: Counting objects: 2945, done.
 +
remote: Compressing objects: 100% (267/267), done.
 +
remote: Total 2945 (delta 171), reused 362 (delta 124), pack-reused 2519
 +
Receiving objects: 100% (2945/2945), 5.82 MiB | 5.77 MiB/s, done.
 +
Resolving deltas: 100% (1304/1304), done.
 +
 
 +
</pre>
  
== Usage Examples ==
 
  
  
 
=== Batch Submission ===
 
=== Batch Submission ===
  
<pre style="background-color: #C8C8C8; color: black; border: 2px solid blue; font-family: monospace, sans-serif;">
+
<pre style="background-color: #C8C8C8; color: black; border: 2px solid #C8C8C8; font-family: monospace, sans-serif;">
  
 
#!/bin/bash
 
#!/bin/bash
Line 26: Line 48:
 
#SBATCH --ntasks-per-node=20
 
#SBATCH --ntasks-per-node=20
  
#SBATCH -D /home/user/
 
 
#SBATCH -o test.out
 
#SBATCH -o test.out
 
#SBATCH -e test.err
 
#SBATCH -e test.err
Line 38: Line 59:
  
 
module purge
 
module purge
module load utilities/multi
+
module add utilities/multi
  
 
wget http://www.example.com/somedatatodownload.zip
 
wget http://www.example.com/somedatatodownload.zip
 
unzip somedatatodownload.zip
 
unzip somedatatodownload.zip
 
/home/user/processthisdata mydatadownloaded
 
/home/user/processthisdata mydatadownloaded
 
 
</pre>
 
</pre>
  
  
<pre style="background-color: #C8C8C8; color: black; border: 2px solid black; font-family: monospace, sans-serif;">
+
<pre style="background-color: black; color: white; border: 2px solid black; font-family: monospace, sans-serif;">
 
[username@login01 ~]$ sbatch downloadprocess.job
 
[username@login01 ~]$ sbatch downloadprocess.job
 
Submitted batch job 389511
 
Submitted batch job 389511
 
</pre>
 
</pre>
  
[[Category:Applications]]
+
== Further information ==
 +
 
 +
* [http://www.gnu.org/ http://www.gnu.org/]
 +
 
 +
 
 +
==Navigation==
 +
 
 +
* [[Main_Page|Home]]
 +
* [[Applications|Application support]] *
 +
* [[General|General]]
 +
* [[Programming|Programming support]]

Revision as of 13:48, 24 May 2019

Application Details

  • Description : Utilities is a collection, including zip, unzip, bzip2, bunzip2, git, and wget
  • Versions : Various
  • Module names : utilities/multi
  • License: GNU license(s)


Usage Examples

The following utilities are loaded as part of this module:

  • bzip2 (& bunzip2)
  • git
  • zip (& unzip)
  • wget


Special Consideration

  • There is an issue with with using https:// addresses with git, this is easily resolved with replacing the operator git:// rather than https://

[root@c025 ~]# module add utilities/multi
[root@c025 ~]# git clone git://github.com/Tomas-M/linux-live
Cloning into 'linux-live'...
warning: templates not found /usr/share/git-core/templates
remote: Counting objects: 2945, done.
remote: Compressing objects: 100% (267/267), done.
remote: Total 2945 (delta 171), reused 362 (delta 124), pack-reused 2519
Receiving objects: 100% (2945/2945), 5.82 MiB | 5.77 MiB/s, done.
Resolving deltas: 100% (1304/1304), done.


Batch Submission


#!/bin/bash

#SBATCH -J -20
#SBATCH -N 1
#SBATCH --ntasks-per-node=20

#SBATCH -o test.out
#SBATCH -e test.err
#SBATCH -p compute
#SBATCH --exclusive
#SBATCH --time=2-00:00:00

echo $SLURM_NTASKS
echo $SLURM_JOB_NODELIST
echo $SLURM_HOSTS

module purge
module add utilities/multi

wget http://www.example.com/somedatatodownload.zip
unzip somedatatodownload.zip
/home/user/processthisdata mydatadownloaded


[username@login01 ~]$ sbatch downloadprocess.job
Submitted batch job 389511

Further information


Navigation