Jobs that do a lot of I/O operations on a shared cluster filesystem like /scratch
can severely slow down the whole system. If your job does not use multiple nodes and is not reading and writing very large files, it might be a good idea to move input and output files to the /tmp
folder on the compute node itself. /tmp
is a RAM based filesystem, meaning that anything you store there is actually stored in memory. So space is quite limited. Currently you can use at most 24GB of /tmp
space. Since /tmp
uses RAM, usage also counts towards the allocated memory limit (e.g. –mem or –mem-per-cpu settings). So the memory that the process uses during calculation plus the amount of data stored in files below /tmp can not exceed the total amount of RAM installed in the compute node. Let's look at some examples…
<xterm>
</xterm>