From Documentation
Jump to: navigation, search
(start page (with paste from SHARCNET community update))
 
 
(7 intermediate revisions by 4 users not shown)
Line 1: Line 1:
SHARCNET has recently introduced a data transfer node (dtn.sharcnet.ca) designed for high throughput access to (nearly) all Sharcnet filesystems without having to use a cluster’s login node.  Unlike the login nodes, file transfer apps are not hindered by cpu time limits. To encourage higher throughput beyond normal scp/sftp, the following file transfer tools are also available: HPN-SSH, Gridftp (if you have a Gridcanada certificate) and BBCP.
+
{{System
 +
|cluster_name=dtn
 +
|target_usage=Data Transfer
 +
|system_idnumber=94
 +
}}
 +
{{Template:LegacyPage}}
 +
 
 +
The SHARCNET data transfer node (dtn.sharcnet.ca) is designed for high throughput access to Sharcnet filesystems without having to use a cluster's login node. Currently, the dtn has direct access to the following sharcnet filesystems:
 +
 
 +
  /home/username
 +
/work/username
 +
/freezer/username
 +
/scratch/goblin/username
 +
/scratch/monk/username
 +
/scratch/bul/username
 +
/scratch/nar/username
 +
/scratch/brown/username
 +
/scratch/orca/scratch/username
 +
/scratch/saw/scratch/username
 +
/scratch/angel/scratch/username
 +
 
 +
We are working to bring requin's scratch online as well. Unlike the login nodes, file transfer apps are not limited by cpu time limits. To encourage higher throughput beyond normal scp/sftp, the following file transfer tools are available:
 +
 
 +
#HPN-SSH
 +
#*PSC's modified ssh server and client that will transfer files up to 1Gb/s. You must be running hpn-ssh on the client side to make use of its extended features.
 +
#Gridftp
 +
#*If you have a Gridcanada certificate from Westgrid, then dtn.sharcnet.ca can be used directly by as a file target, or by setting up an endpoint in your Globus online account. See the detailed instructions here: https://www.sharcnet.ca/help/index.php/Globus_/_Gridftp .
 +
#BBCP client
 +
#*high throughput transfer tool from Stanford.
 +
 
 +
Any question on the use of dtn.sharcnet.ca can be directed to help@sharcnet.ca.
  
 
[[Category:Systems]]
 
[[Category:Systems]]

Latest revision as of 15:10, 17 July 2017

dtn
Hostname: dtn.sharcnet.ca
Target usage: Data Transfer
System information: see dtn system page in web portal
System status: see dtn status page
Real time system data: see Ganglia monitoring page
Full list of SHARCNET systems


Note: This page's content only applies to the SHARCNET's legacy systems; it does not apply to Graham.


The SHARCNET data transfer node (dtn.sharcnet.ca) is designed for high throughput access to Sharcnet filesystems without having to use a cluster's login node. Currently, the dtn has direct access to the following sharcnet filesystems:

/home/username
/work/username
/freezer/username
/scratch/goblin/username
/scratch/monk/username
/scratch/bul/username
/scratch/nar/username
/scratch/brown/username
/scratch/orca/scratch/username
/scratch/saw/scratch/username
/scratch/angel/scratch/username

We are working to bring requin's scratch online as well. Unlike the login nodes, file transfer apps are not limited by cpu time limits. To encourage higher throughput beyond normal scp/sftp, the following file transfer tools are available:

  1. HPN-SSH
    • PSC's modified ssh server and client that will transfer files up to 1Gb/s. You must be running hpn-ssh on the client side to make use of its extended features.
  2. Gridftp
  3. BBCP client
    • high throughput transfer tool from Stanford.

Any question on the use of dtn.sharcnet.ca can be directed to help@sharcnet.ca.