Difference between revisions of "Training/Transferring Data"
m (→Linux) |
m (→Linux) |
||
| Line 134: | Line 134: | ||
| | | | ||
*Enter the Host: viperlogin.hpc.hull.ac.uk, username, password, and port: 22, using an SFTP connection. | *Enter the Host: viperlogin.hpc.hull.ac.uk, username, password, and port: 22, using an SFTP connection. | ||
| − | + | ||
* A pop-up will appear informing that the server host key is unknown. Click Always trust this host and click ok. In the remote site box, your Viper directory will appear. | * A pop-up will appear informing that the server host key is unknown. Click Always trust this host and click ok. In the remote site box, your Viper directory will appear. | ||
* To transfer files click and drag the file/folder from either your pc to Viper (left to right) or from Viper to your pc (right to left). The transfer will start depending on transfer speed and file size this may take some time. | * To transfer files click and drag the file/folder from either your pc to Viper (left to right) or from Viper to your pc (right to left). The transfer will start depending on transfer speed and file size this may take some time. | ||
Revision as of 15:57, 22 August 2024
Contents
Methods
Small to medium amounts of data
This can be carried out using a number of SFTP-styled packages such as sftp, scp, rsync, and Filezilla to name a few. Filezilla can be downloaded as a Windows application and may be more suitable for people who prefer a Windows environment, rather than the command line.
Note FTP (insecure) is disabled on viper.hull.ac.uk and SFTP (secure FTP) is the recommended method.
Large to a huge amount of data (100GB +)
To avoid excessive network congestion and the long period to transfer such data please raise a support ticket for further details. This may typically involve connecting a USB data drive directly to VIPER to copy the data quickly into your user area.
OneDrive to Viper
With the University using MS OneDrive, it is possible to copy files to Viper. For multiple files, zip your files up on OneDrive first (considerably easier), as shown here:
| From OneDrive to Viper |
Remember to un-share the file on OneDrive and use unzip (if required) on Linux to restore the file structure. |
Universal
The following can only be performed on Windows after installing MobaXterm or PuTTY.
The example user is user1; you will need to enter your username here:
| * To Viper from local computer |
| scp myfile user1@viperlogin.hpc.hull.ac.uk:myfile |
| rsync -av my-directory viper.hull.ac.uk:/data/users/YourID |
| * From Viper to your local computer |
| scp user1@viperlogin.hpc.hull.ac.uk:bio/YourUCInetID/hpc-file |
| rsync -av viper.hull.ac.uk:/data/users/YourID/mydatadirectory |
Windows
The following example uses MobaXterm, for transferring large files it is recommended to use FileZilla. For instructions on how to use FileZilla view the Linux section. follow the instruction in the Getting Connected section for installing MobaXterm.
| * Uploading Files |
* To upload files to Viper, navigate to the directory you wish to upload files to use the MobaXterm file browser.
|
| * Downloading Files |
| * To download files from Viper, navigate to the directory using the MobaXterm file browser.
|
MacOS
The following example uses Cyberduck, you can download Cyberduck from https://cyberduck.io macOS also supports FileZilla for an example of how to use FileZilla please view the Linux section.
| Connecting |
|
| Uploading Files |
|
| Downloading Files |
|
Linux
The following example uses FileZilla, you can download FileZilla from https://filezilla-project.org/ (Windows/Linux and MacOS).
- Note: the FileZilla installer sometimes comes with additional trial software packages. We would advise against installing these
| Using FileZilla |
|