Lmod is automatically replacing "intelmpi/2018.2" with "openmpi/3.1.0". Due to MODULEPATH changes, the following have been reloaded: 1) fftw-mpi/3.3.7 mv: cannot stat ‘outputs/restart.0’: No such file or directory mv: cannot stat ‘outputs/restart.1’: No such file or directory mv: cannot stat ‘outputs/restart.2’: No such file or directory mv: cannot stat ‘outputs/restart.3’: No such file or directory mv: cannot stat ‘outputs/restart.4’: No such file or directory mv: cannot stat ‘outputs/restart.5’: No such file or directory mv: cannot stat ‘outputs/restart.6’: No such file or directory mv: cannot stat ‘outputs/restart.7’: No such file or directory mv: cannot stat ‘outputs/restart.8’: No such file or directory mv: cannot stat ‘outputs/restart.9’: No such file or directory mv: cannot stat ‘outputs/restart.10’: No such file or directory mv: cannot stat ‘outputs/restart.11’: No such file or directory mv: cannot stat ‘outputs/restart.12’: No such file or directory mv: cannot stat ‘outputs/restart.13’: No such file or directory mv: cannot stat ‘outputs/restart.14’: No such file or directory mv: cannot stat ‘outputs/restart.15’: No such file or directory mv: cannot stat ‘outputs/restart.16’: No such file or directory mv: cannot stat ‘outputs/restart.17’: No such file or directory mv: cannot stat ‘outputs/restart.18’: No such file or directory mv: cannot stat ‘outputs/restart.19’: No such file or directory mv: cannot stat ‘outputs/restart.20’: No such file or directory mv: cannot stat ‘outputs/restart.21’: No such file or directory mv: cannot stat ‘outputs/restart.22’: No such file or directory mv: cannot stat ‘outputs/restart.23’: No such file or directory mv: cannot stat ‘outputs/restart.24’: No such file or directory mv: cannot stat ‘outputs/restart.25’: No such file or directory mv: cannot stat ‘outputs/restart.26’: No such file or directory mv: cannot stat ‘outputs/restart.27’: No such file or directory mv: cannot stat ‘outputs/restart.28’: No such file or directory mv: cannot stat ‘outputs/restart.29’: No such file or directory mv: cannot stat ‘outputs/restart.30’: No such file or directory mv: cannot stat ‘outputs/restart.31’: No such file or directory mv: cannot stat ‘outputs/restart.32’: No such file or directory mv: cannot stat ‘outputs/restart.33’: No such file or directory mv: cannot stat ‘outputs/restart.34’: No such file or directory mv: cannot stat ‘outputs/restart.35’: No such file or directory mv: cannot stat ‘outputs/restart.36’: No such file or directory mv: cannot stat ‘outputs/restart.37’: No such file or directory mv: cannot stat ‘outputs/restart.38’: No such file or directory mv: cannot stat ‘outputs/restart.39’: No such file or directory mv: cannot stat ‘outputs/restart.40’: No such file or directory mv: cannot stat ‘outputs/restart.41’: No such file or directory mv: cannot stat ‘outputs/restart.42’: No such file or directory mv: cannot stat ‘outputs/restart.43’: No such file or directory mv: cannot stat ‘outputs/restart.44’: No such file or directory mv: cannot stat ‘outputs/restart.45’: No such file or directory mv: cannot stat ‘outputs/restart.46’: No such file or directory mv: cannot stat ‘outputs/restart.47’: No such file or directory mv: cannot stat ‘outputs/restart.48’: No such file or directory mv: cannot stat ‘outputs/restart.49’: No such file or directory mv: cannot stat ‘outputs/restart.50’: No such file or directory mv: cannot stat ‘outputs/restart.51’: No such file or directory mv: cannot stat ‘outputs/restart.52’: No such file or directory mv: cannot stat ‘outputs/restart.53’: No such file or directory mv: cannot stat ‘outputs/restart.54’: No such file or directory mv: cannot stat ‘outputs/restart.55’: No such file or directory mv: cannot stat ‘outputs/restart.56’: No such file or directory mv: cannot stat ‘outputs/restart.57’: No such file or directory mv: cannot stat ‘outputs/restart.58’: No such file or directory mv: cannot stat ‘outputs/restart.59’: No such file or directory mv: cannot stat ‘outputs/restart.60’: No such file or directory mv: cannot stat ‘outputs/restart.61’: No such file or directory mv: cannot stat ‘outputs/restart.62’: No such file or directory mv: cannot stat ‘outputs/restart.63’: No such file or directory mv: cannot stat ‘outputs/restart.64’: No such file or directory mv: cannot stat ‘outputs/restart.65’: No such file or directory mv: cannot stat ‘outputs/restart.66’: No such file or directory mv: cannot stat ‘outputs/restart.67’: No such file or directory mv: cannot stat ‘outputs/restart.68’: No such file or directory mv: cannot stat ‘outputs/restart.69’: No such file or directory mv: cannot stat ‘outputs/restart.70’: No such file or directory mv: cannot stat ‘outputs/restart.71’: No such file or directory mv: cannot stat ‘outputs/restart.72’: No such file or directory mv: cannot stat ‘outputs/restart.73’: No such file or directory mv: cannot stat ‘outputs/restart.74’: No such file or directory mv: cannot stat ‘outputs/restart.75’: No such file or directory mv: cannot stat ‘outputs/restart.76’: No such file or directory mv: cannot stat ‘outputs/restart.77’: No such file or directory mv: cannot stat ‘outputs/restart.78’: No such file or directory mv: cannot stat ‘outputs/restart.79’: No such file or directory mv: cannot stat ‘outputs/restart.80’: No such file or directory mv: cannot stat ‘outputs/restart.81’: No such file or directory mv: cannot stat ‘outputs/restart.82’: No such file or directory mv: cannot stat ‘outputs/restart.83’: No such file or directory mv: cannot stat ‘outputs/restart.84’: No such file or directory mv: cannot stat ‘outputs/restart.85’: No such file or directory mv: cannot stat ‘outputs/restart.86’: No such file or directory mv: cannot stat ‘outputs/restart.87’: No such file or directory mv: cannot stat ‘outputs/restart.88’: No such file or directory mv: cannot stat ‘outputs/restart.89’: No such file or directory mv: cannot stat ‘outputs/restart.90’: No such file or directory mv: cannot stat ‘outputs/restart.91’: No such file or directory mv: cannot stat ‘outputs/restart.92’: No such file or directory mv: cannot stat ‘outputs/restart.93’: No such file or directory mv: cannot stat ‘outputs/restart.94’: No such file or directory mv: cannot stat ‘outputs/restart.95’: No such file or directory mv: cannot stat ‘outputs/restart.96’: No such file or directory mv: cannot stat ‘outputs/restart.97’: No such file or directory mv: cannot stat ‘outputs/restart.98’: No such file or directory mv: cannot stat ‘outputs/restart.99’: No such file or directory mv: cannot stat ‘outputs/restart.100’: No such file or directory mv: cannot stat ‘outputs/restart.101’: No such file or directory mv: cannot stat ‘outputs/restart.102’: No such file or directory mv: cannot stat ‘outputs/restart.103’: No such file or directory mv: cannot stat ‘outputs/restart.104’: No such file or directory mv: cannot stat ‘outputs/restart.105’: No such file or directory mv: cannot stat ‘outputs/restart.106’: No such file or directory mv: cannot stat ‘outputs/restart.107’: No such file or directory mv: cannot stat ‘outputs/restart.108’: No such file or directory mv: cannot stat ‘outputs/restart.109’: No such file or directory mv: cannot stat ‘outputs/restart.110’: No such file or directory mv: cannot stat ‘outputs/restart.111’: No such file or directory mv: cannot stat ‘outputs/restart.112’: No such file or directory mv: cannot stat ‘outputs/restart.113’: No such file or directory mv: cannot stat ‘outputs/restart.114’: No such file or directory mv: cannot stat ‘outputs/restart.115’: No such file or directory mv: cannot stat ‘outputs/restart.116’: No such file or directory mv: cannot stat ‘outputs/restart.117’: No such file or directory mv: cannot stat ‘outputs/restart.118’: No such file or directory mv: cannot stat ‘outputs/restart.119’: No such file or directory mv: cannot stat ‘outputs/restart.120’: No such file or directory mv: cannot stat ‘outputs/restart.121’: No such file or directory mv: cannot stat ‘outputs/restart.122’: No such file or directory mv: cannot stat ‘outputs/restart.123’: No such file or directory mv: cannot stat ‘outputs/restart.124’: No such file or directory mv: cannot stat ‘outputs/restart.125’: No such file or directory mv: cannot stat ‘outputs/restart.126’: No such file or directory mv: cannot stat ‘outputs/restart.127’: No such file or directory mv: cannot stat ‘outputs/restart.128’: No such file or directory mv: cannot stat ‘outputs/restart.129’: No such file or directory mv: cannot stat ‘outputs/restart.130’: No such file or directory mv: cannot stat ‘outputs/restart.131’: No such file or directory mv: cannot stat ‘outputs/restart.132’: No such file or directory mv: cannot stat ‘outputs/restart.133’: No such file or directory mv: cannot stat ‘outputs/restart.134’: No such file or directory mv: cannot stat ‘outputs/restart.135’: No such file or directory mv: cannot stat ‘outputs/restart.136’: No such file or directory mv: cannot stat ‘outputs/restart.137’: No such file or directory mv: cannot stat ‘outputs/restart.138’: No such file or directory mv: cannot stat ‘outputs/restart.139’: No such file or directory mv: cannot stat ‘outputs/restart.140’: No such file or directory mv: cannot stat ‘outputs/restart.141’: No such file or directory mv: cannot stat ‘outputs/restart.142’: No such file or directory mv: cannot stat ‘outputs/restart.143’: No such file or directory mv: cannot stat ‘outputs/restart.144’: No such file or directory mv: cannot stat ‘outputs/restart.145’: No such file or directory mv: cannot stat ‘outputs/restart.146’: No such file or directory mv: cannot stat ‘outputs/restart.147’: No such file or directory mv: cannot stat ‘outputs/restart.148’: No such file or directory mv: cannot stat ‘outputs/restart.149’: No such file or directory mv: cannot stat ‘outputs/restart.150’: No such file or directory mv: cannot stat ‘outputs/restart.151’: No such file or directory mv: cannot stat ‘outputs/restart.152’: No such file or directory mv: cannot stat ‘outputs/restart.153’: No such file or directory mv: cannot stat ‘outputs/restart.154’: No such file or directory mv: cannot stat ‘outputs/restart.155’: No such file or directory mv: cannot stat ‘outputs/restart.156’: No such file or directory mv: cannot stat ‘outputs/restart.157’: No such file or directory mv: cannot stat ‘outputs/restart.158’: No such file or directory mv: cannot stat ‘outputs/restart.159’: No such file or directory mv: cannot stat ‘outputs/restart.160’: No such file or directory mv: cannot stat ‘outputs/restart.161’: No such file or directory mv: cannot stat ‘outputs/restart.162’: No such file or directory mv: cannot stat ‘outputs/restart.163’: No such file or directory mv: cannot stat ‘outputs/restart.164’: No such file or directory mv: cannot stat ‘outputs/restart.165’: No such file or directory mv: cannot stat ‘outputs/restart.166’: No such file or directory mv: cannot stat ‘outputs/restart.167’: No such file or directory mv: cannot stat ‘outputs/restart.168’: No such file or directory mv: cannot stat ‘outputs/restart.169’: No such file or directory mv: cannot stat ‘outputs/restart.170’: No such file or directory mv: cannot stat ‘outputs/restart.171’: No such file or directory mv: cannot stat ‘outputs/restart.172’: No such file or directory mv: cannot stat ‘outputs/restart.173’: No such file or directory mv: cannot stat ‘outputs/restart.174’: No such file or directory mv: cannot stat ‘outputs/restart.175’: No such file or directory mv: cannot stat ‘outputs/restart.176’: No such file or directory mv: cannot stat ‘outputs/restart.177’: No such file or directory mv: cannot stat ‘outputs/restart.178’: No such file or directory mv: cannot stat ‘outputs/restart.179’: No such file or directory mv: cannot stat ‘outputs/restart.180’: No such file or directory mv: cannot stat ‘outputs/restart.181’: No such file or directory mv: cannot stat ‘outputs/restart.182’: No such file or directory mv: cannot stat ‘outputs/restart.183’: No such file or directory mv: cannot stat ‘outputs/restart.184’: No such file or directory mv: cannot stat ‘outputs/restart.185’: No such file or directory mv: cannot stat ‘outputs/restart.186’: No such file or directory mv: cannot stat ‘outputs/restart.187’: No such file or directory mv: cannot stat ‘outputs/restart.188’: No such file or directory mv: cannot stat ‘outputs/restart.189’: No such file or directory mv: cannot stat ‘outputs/restart.190’: No such file or directory mv: cannot stat ‘outputs/restart.191’: No such file or directory mv: cannot stat ‘outputs/restart.192’: No such file or directory mv: cannot stat ‘outputs/restart.193’: No such file or directory mv: cannot stat ‘outputs/restart.194’: No such file or directory mv: cannot stat ‘outputs/restart.195’: No such file or directory mv: cannot stat ‘outputs/restart.196’: No such file or directory mv: cannot stat ‘outputs/restart.197’: No such file or directory mv: cannot stat ‘outputs/restart.198’: No such file or directory mv: cannot stat ‘outputs/restart.199’: No such file or directory scontrol show jobid 836937 JobId=836937 JobName=gadget2 UserId=gstein(3015769) GroupId=rbond(6000076) MCS_label=N/A Priority=819993 Nice=0 Account=rrg-rbond-ac QOS=normal JobState=COMPLETED Reason=None Dependency=(null) Requeue=0 Restarts=0 BatchFlag=1 Reboot=0 ExitCode=0:0 RunTime=11:58:19 TimeLimit=1-00:00:00 TimeMin=N/A SubmitTime=2019-01-19T12:37:29 EligibleTime=2019-01-19T12:37:29 StartTime=2019-01-19T13:05:03 EndTime=2019-01-20T01:03:22 Deadline=N/A PreemptTime=None SuspendTime=None SecsPreSuspend=0 LastSchedEval=2019-01-19T13:05:03 Partition=compute AllocNode:Sid=nia-login07:201495 ReqNodeList=(null) ExcNodeList=(null) NodeList=nia[0548-0552] BatchHost=nia0548 NumNodes=5 NumCPUs=400 NumTasks=200 CPUs/Task=1 ReqB:S:C:T=0:0:*:* TRES=cpu=400,node=5,billing=200 Socks/Node=* NtasksPerN:B:S:C=0:0:*:* CoreSpec=* MinCPUsNode=1 MinMemoryNode=0 MinTmpDiskNode=0 Features=(null) DelayBoot=00:00:00 Gres=(null) Reservation=(null) OverSubscribe=NO Contiguous=0 Licenses=(null) Network=(null) Command=/gpfs/fs0/scratch/r/rbond/gstein/Gadget_runs/runs/cosmo1/n512_512Mpc_cosmo1_seed28/submit_run.sh WorkDir=/gpfs/fs0/scratch/r/rbond/gstein/Gadget_runs/runs/cosmo1/n512_512Mpc_cosmo1_seed28 StdErr=/gpfs/fs0/scratch/r/rbond/gstein/Gadget_runs/runs/cosmo1/n512_512Mpc_cosmo1_seed28/gadget2_836937.txt StdIn=/dev/null StdOut=/gpfs/fs0/scratch/r/rbond/gstein/Gadget_runs/runs/cosmo1/n512_512Mpc_cosmo1_seed28/gadget2_836937.txt Power= sacct -j 836937 JobID JobName Account Elapsed MaxVMSize MaxRSS SystemCPU UserCPU ExitCode ------------ ---------- ---------- ---------- ---------- ---------- ---------- ---------- -------- 836937 gadget2 rrg-rbond+ 11:58:19 04:25:10 99-08:07:+ 0:0 836937.batch batch rrg-rbond+ 11:58:19 64438528K 25334332K 51:54.991 19-20:50:+ 0:0 836937.0 orted rrg-rbond+ 11:58:16 63717572K 24715828K 03:33:15 79-11:16:+ 0:0