id,summary,reporter,owner,description,type,status,priority,milestone,component,version,severity,resolution,keywords,cc 272,Write blocking csv2pts script,ole,nariman,"ted Rigby has shown that ANUGA isn't performing very well if one wants to convert 18 million points in a csv file to the pts netcdf format. Currently, we do this by creating a Geospatial data object from the csv file and then exporting it to the pts format. The problem is that all data is stored in memory and this causes thrashing for large datasets. This problem is holding Ted back in running a validation against the Macquarie-Rivulaet catchment. One solution would be to make use of blocking so that the csv file isn't read until the export code is run - and then only in blocks. Another, and perhaps simpler, approach would be to write a conversion script, csv2pts, which does the conversion without ever having to store all data in memory. ",enhancement,new,low,,Efficiency and optimisation,,normal,,,