User Tools

Site Tools


services:cluster:localstorage

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
services:cluster:localstorage [2013/11/08 10:03] – [Use local storage on the computer nodes] dregerservices:cluster:localstorage [2013/11/08 10:26] (current) dreger
Line 1: Line 1:
-====== Use local storage on the computer nodes ======+====== Use local storage on the compute nodes ======
  
 If many jobs write to or read from the NFS server for the cluster home at the same time, the server can get very slow and even crash. Therefore it's very important that all users try to use local storage available to the nodes if possible. In most cases this will also speed up your jobs. In order to do so you have to tell the queuing system the amount of local disk space you want to reserve for your job. The queuing system will create a directory named ''/local_scratch/$PBS_JOBID'' on the nodes. After the computation has finished you must copy the results you want to keep from the local disks back to your home directory. Please try to copy only input and output files you really need, refrain from using ''*'' everywhere. If many jobs write to or read from the NFS server for the cluster home at the same time, the server can get very slow and even crash. Therefore it's very important that all users try to use local storage available to the nodes if possible. In most cases this will also speed up your jobs. In order to do so you have to tell the queuing system the amount of local disk space you want to reserve for your job. The queuing system will create a directory named ''/local_scratch/$PBS_JOBID'' on the nodes. After the computation has finished you must copy the results you want to keep from the local disks back to your home directory. Please try to copy only input and output files you really need, refrain from using ''*'' everywhere.
services/cluster/localstorage.1383905035.txt.gz · Last modified: 2013/11/08 10:03 by dreger

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki