Warning: no access to tty (Bad file descriptor). Thus no job control in this shell. mpirun: WARNING: unable to determine OpenMPI version of python2.6, runtime version may be incompatible Running in parallel on 8 processors ABOUT to Start Simulation:- Importing Modules Running in parallel on 8 processors Running in parallel on 8 processors Running in parallel on 8 processors Running simulation on 8 processors min estimated number of triangles 1561264 Running in parallel on 8 processors Running in parallel on 8 processors Running in parallel on 8 processors Running in parallel on 8 processors Loading domain fragment from cpu 1 Loading domain fragment from cpu 3 Loading domain fragment from cpu 2 Loading domain fragments from the last restore point: 3600 Loading domain fragment from cpu 0 Loading domain fragment from cpu 6 Loading domain fragment from cpu 7 Loading domain fragment from cpu 4 Loading domain fragment from cpu 5 Starting from time: 3600 Time = 3600.0000, steps=0 (45139s) 2012-06-16 18:41:34.687599 Time = 4320.0000, delta t in [0.03697163, 0.03741393], steps=19329 (5660s) 2012-06-16 20:15:55.612864 Time = 5040.0000, delta t in [0.03657817, 0.03697162], steps=19587 (5762s) 2012-06-16 21:51:57.835772 Time = 5760.0000, delta t in [0.03657360, 0.03666571], steps=19663 (5805s) 2012-06-16 23:28:43.472171 Time = 6480.0000, delta t in [0.03478264, 0.03683916], steps=19872 (5890s) 2012-06-17 01:06:54.002182 Time = 7200.0000, delta t in [0.03247368, 0.03478262], steps=21528 (6400s) 2012-06-17 02:53:34.443345 Saving restore point at time: 7200 All domain fragments fully written Time = 7920.0000, steps=0 (183s) 2012-06-17 02:56:37.540948 Time = 8640.0000, delta t in [0.03006648, 0.03247374], steps=23033 (6867s) 2012-06-17 04:51:05.182977 Time = 9360.0000, delta t in [0.02861458, 0.03006647], steps=24597 (7352s) 2012-06-17 06:53:37.387897 Time = 10080.0000, delta t in [0.02760740, 0.02861453], steps=25632 (7688s) 2012-06-17 09:01:46.076940 IOError: [Errno 5] Input/output error Traceback (most recent call last): File "/home/547/sfm547/Busselton/BP7Hydro/run_model_parallel.py", line 358, in cPickle.dump(domain, open(restorePointFile, 'wb')) SystemError: error return without exception set IOError: [Errno 5] Input/output error Traceback (most recent call last): File "/home/547/sfm547/Busselton/BP7Hydro/run_model_parallel.py", line 358, in cPickle.dump(domain, open(restorePointFile, 'wb')) SystemError: error return without exception set ============================================================================= Resource usage: CPU time: 132:06:46 JobId: 566851.vu-pbs Elapsed time: 16:33:57 Project: w85 Requested time: 17:00:00 Service Units: 132.53 Max physical memory: 18089MB Max virtual memory: 19487MB Requested memory: 24576MB Number of cpus: 8 Max jobfs disk use: 0.0GB Requested jobfs: 0.4GB =============================================================================