Accessing the Cluster

From HPC

(Difference between revisions)
Jump to: navigation, search
 
(8 intermediate revisions not shown)
Line 1: Line 1:
-
You need to have your LSHTM account added to the list of valid users of the cluster. Firstly join the HPC mailing list and then email Steven Whitbread or Dan Johnson with your username, department and a brief description of what you plan to user the cluster for and software requirements.
 
-
 
=To Join=
=To Join=
-
Firstly join the HPC mailing list https://lists.lshtm.ac.uk/sympa/info/hpc
+
Complete the access request form via servicedesk - https://lshtm.topdesk.net/tas/public/ssp/content/serviceflow?unid=3e416b785a594b66a31c075a8b6119d0 
-
Secondly, send an email to Steven Whitbread or Dan Johnson containing the following information
+
Your account will then be enabled for access to the HPC and the mailing list https://lists.lshtm.ac.uk/sympa/info/hpc
-
* Name
+
=Once you have a valid user account on the cluster=
-
* Username
+
-
* Department
+
-
* A brief description of what you plan to use the cluster for.
+
-
* Software requirements
+
-
You will then have an account set up for you.
+
Your username and password will be the same as your normal LSHTM network user details. You will have a seperate home directory, you will not be able to directly access your H:\ drive.
-
=Once you have a valid user account on the cluster=
+
Access to the cluster is via SSH (secure shell) and to copy files to and from the cluster you will need to use SFTP or SCP. It is also possible to access GUI applications on the cluster, i.e. Editors, Netbeans, Stata. It is important to note that the gui apps are only there to help you make modifications, etc. to your jobs, not to actually run the job.
-
You username and password will be the same as you normal LSHTM network user details. You will have a seperate home directory, you will not be able to directly access your H:\ drive.
+
The server you need to connect to for all the above is
-
Access to the cluster is via SSH (secure shell) and to copy files to and from the cluster you will need to use SFTP or SCP. It is also possible to access GUI applications on the cluster  i.e. Editors, Netbeans, Stata. It is important to note that the gui apps are only there to help you make modifications, etc. to your jobs, not to actually run the job.
+
'''hpclogin.lshtm.ac.uk'''
-
The server you need to connect to for all the above is head.gecko.lshtm.ac.uk. Please below for more specific instructions.
+
Please below for more specific instructions.
==SSH==
==SSH==
Line 35: Line 29:
Start putty
Start putty
-
In the box labeled hostname type: head.gecko.lshtm.ac.uk
+
In the box labeled hostname type: '''hpclogin.lshtm.ac.uk'''
Make sure the ssh radio button is selected.
Make sure the ssh radio button is selected.
-
[[Image:Putty-hostname.gif|Specify hostname: head.gecko.lshtm.ac.uk]]
+
[[Image:hpc-putty.png|Specify hostname: hpclogin.lshtm.ac.uk]]
Now if you want to save these settings, type a suitable name in Saved sessions box (hcpc, cluster or gecko for example) and click save. From now on it will appear in the list of saved sessions. If you want to amend the saved session, highlight it, click load, make your changes and then click save.
Now if you want to save these settings, type a suitable name in Saved sessions box (hcpc, cluster or gecko for example) and click save. From now on it will appear in the list of saved sessions. If you want to amend the saved session, highlight it, click load, make your changes and then click save.
-
[[Image:Putty-save-session.gif|Save session]]
+
[[Image:hpc-putty-save.png|Save session]]
Press connect to start your ssh session.
Press connect to start your ssh session.
Line 49: Line 43:
'''Note:''' If this is the first time you have connected to the cluster you will have to confirm that you trust the servers host key. The host key is to unique to each server. You should only have to do this once.
'''Note:''' If this is the first time you have connected to the cluster you will have to confirm that you trust the servers host key. The host key is to unique to each server. You should only have to do this once.
-
[[Image:Putty-confirm-host-key.gif|Prompt to trust key]]
+
[[Image:hpc-putty-host-key.png|Prompt to trust key]]
-
When prompted enter you username and password.
+
When prompted enter your username and password.
You will now be in your home directory.
You will now be in your home directory.
Line 61: Line 55:
Enter the following (replace username with your actual username)
Enter the following (replace username with your actual username)
-
  ssh username@head.gecko.lshtm.ac.uk
+
  ssh username@hpclogin.lshtm.ac.uk
Enter your password.
Enter your password.
Line 77: Line 71:
Open WinSCP
Open WinSCP
-
Enter the hostname: head.gecko.lshtm.ac.uk, username and password.
+
Enter the hostname: '''hpclogin.lshtm.ac.uk''', username and password.
-
[[Image:Winscp-connect.gif|WinSCP Connection details]]
+
[[Image:Hpc-winscp.png|WinSCP Connection details]]
Click connect.
Click connect.
Line 93: Line 87:
===Mac OS X===
===Mac OS X===
-
I would recommend you use either CyberDuck ( http://cyberduck.ch/ ) or Fugu ( http://rsug.itd.umich.edu/software/fugu/ ) to access your files on the cluster.
+
I would recommend you use CyberDuck ( http://cyberduck.ch/ ) to access your files on the cluster.
-
'''Fugu'''  
+
'''Cyberduck'''  
-
Open fugu
+
Open Cyberduck
-
Enter the hostname, head.gecko.lshtm.ac.uk and your username.
+
Select Open Connection, then choose SFTP (SSH File Transfer Protocol) from the drop down selection box
-
[[Image:Fugu-connect.gif|Fugu connection settings]]
+
Set the Server field to hpclogin.lshtm.ac.uk, enter your username and password then click Connect
-
Enter you password.
+
[[File:Hpc-cyberduck.png]]
-
 
+
-
[[Image:Fugu-password.gif|Fugu password request]]
+
-
 
+
-
Your local files will be on the left side and your files on the cluster will be on the right side. You can now drag and drop files between the two panels.
+
===Linux===
===Linux===
-
If you are using KDE or GNOME, you can open the file browser and in the address bar type sftp://head.gecko.lshtm.ac.uk
+
If you are using KDE or GNOME, you can open the file browser and in the address bar type '''sftp://hpclogin.lshtm.ac.uk'''
You should then be asked for you username and password.
You should then be asked for you username and password.

Current revision as of 12:36, 16 July 2021

Contents

To Join

Complete the access request form via servicedesk - https://lshtm.topdesk.net/tas/public/ssp/content/serviceflow?unid=3e416b785a594b66a31c075a8b6119d0

Your account will then be enabled for access to the HPC and the mailing list https://lists.lshtm.ac.uk/sympa/info/hpc

Once you have a valid user account on the cluster

Your username and password will be the same as your normal LSHTM network user details. You will have a seperate home directory, you will not be able to directly access your H:\ drive.

Access to the cluster is via SSH (secure shell) and to copy files to and from the cluster you will need to use SFTP or SCP. It is also possible to access GUI applications on the cluster, i.e. Editors, Netbeans, Stata. It is important to note that the gui apps are only there to help you make modifications, etc. to your jobs, not to actually run the job.

The server you need to connect to for all the above is

hpclogin.lshtm.ac.uk

Please below for more specific instructions.

SSH

Windows

On windows you will use a piece of software called putty. This will provide you remote terminal access to the cluster.

Putty is available under the communications folder in "Novell Delivered Apps" or you can download it from http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html

Novell Delivered Apps

Start putty

In the box labeled hostname type: hpclogin.lshtm.ac.uk

Make sure the ssh radio button is selected.

Specify hostname: hpclogin.lshtm.ac.uk

Now if you want to save these settings, type a suitable name in Saved sessions box (hcpc, cluster or gecko for example) and click save. From now on it will appear in the list of saved sessions. If you want to amend the saved session, highlight it, click load, make your changes and then click save.

Save session

Press connect to start your ssh session.

Note: If this is the first time you have connected to the cluster you will have to confirm that you trust the servers host key. The host key is to unique to each server. You should only have to do this once.

Prompt to trust key

When prompted enter your username and password.

You will now be in your home directory.

Linux and Mac OS X

Open a terminal.

Enter the following (replace username with your actual username)

ssh username@hpclogin.lshtm.ac.uk

Enter your password.

Moving files to and from the cluster

Two methods are available: SFTP and SCP

Windows

I recommend WinSCP for managing your files if you are using windows. It is available in communications folder in "Novell Delivered Apps" window or can be downloaded here http://winscp.net/

Novell Delivered Apps

Open WinSCP

Enter the hostname: hpclogin.lshtm.ac.uk, username and password.

WinSCP Connection details

Click connect.

Note: If this is the first time you have connected to the cluster you will have to confirm that you trust the servers host key. The host key is to unique to each server. You should only have to do this once.

Confirm host key

Your local files will be on the left side and your files on the cluster will be on the right side. You can now drag and drop files between the two panels.

WinSCP connected

Mac OS X

I would recommend you use CyberDuck ( http://cyberduck.ch/ ) to access your files on the cluster.

Cyberduck

Open Cyberduck

Select Open Connection, then choose SFTP (SSH File Transfer Protocol) from the drop down selection box

Set the Server field to hpclogin.lshtm.ac.uk, enter your username and password then click Connect

File:Hpc-cyberduck.png

Linux

If you are using KDE or GNOME, you can open the file browser and in the address bar type sftp://hpclogin.lshtm.ac.uk

You should then be asked for you username and password.

Personal tools