HPC

DAIM Guide

From HPC
Revision as of 11:52, 26 June 2023 by Chris.collins (talk | contribs)

Jump to: navigation , search
  • Page currently under construction

Introduction

Viper, the University of Hull’s High Performance Computing facility, is used by research staff and students in many disciplines across the University and is a potentially significant tool for those with any sort of computational element to their research. Viper is a ‘cluster’ of approximately 200 computes built into a cluster, and features more than 6000 compute cores, high memory systems and GPU technology together with dedicated high performance storage and fast interconnect between systems to meet the needs of the most computationally demanding tasks. Some notes about

  • Viper runs Linux, though to make use of Viper you do not need to be a Linux expert – being familiar with just a few commands is enough to get started.
  • Viper runs a scheduler, a piece of software which manages access to the computers across the cluster, monitoring what is running and how resources such as memory, cpu processors and GPU cards are being used.
  • Users run ‘jobs’ some of which are interactive (like Jupyter Notebook sessions) but many of which are submitted to run automatically without user interaction. Jobs usually have a batch script, a text file containing recipe for the job, for example what resource is needed and what the job should do.

Available Resource

Important While Viper has a range of GPU resources available, including Nvidia A40 and Nvidia P100 based systems, such resource is in high demand and as such at times there may be many people competing for GPU resource meaning long pend (queuing) times.

We would advise reviewing available resource options, and where possible use appropriate resource, in particular during development.

The DAIM lab machines are each equipped with Nvidia GeForce RTX 3070 GPU cards, with 5888 CUDA cores and 8GB of VRAM.

Prerequisites

Using Viper

A guide is available for step by step instructions for DAIM students to make use of Viper: Guide to Jupyter Notebooks on Viper


Pilot web access

We are currently testing a web route to provide Jupyter access via our pilot Viper OnDemand web portal - see http://hpc.mediawiki.hull.ac.uk/General/OOD

If you connect to the web portal, you will see a number of DAIM prefixed apps, which can be used to connect:

  • DAIM Jupyter - this will launch a Jupyter lab session in your browser tab
  • DAIM Jupyter Desktop - similarly, this will launch a Jupyter session but with the web browser running on Viper OnDemand. This means you should be able to disconnect and reconnect with cells remaining active.

Please note:

  • The DAIM Jupyter apps are in testing and there may be issues which have yet to be resolved.
  • The web portal is also testing GPU 'sharding' which is a way of sharing GPU resource among multiple jobs. Please consider other users when trying to access resource.

Note that you still need VPN access to connect to this.

Retrieved from ‘http://hpc.mediawiki.hull.ac.uk/index.php?title=DAIM_Guide&oldid=41605’