writing .csv

[davidorsini]

I am currently running a script that writes to a .csv file in batch. It writes 30 lines, then the page refreshes and writes 30 more. I go on in this fassion until the file is done (sometimes 60 lines, sometimes 1000). I have been experiencing some page timeouts with this script though. I notice this happening once the file gets a bit bigger. The page is timing out on the cffile append statement. Does anyone know if takes longer to write a line to a file with 400 lines than it does to a file with 0? Does anyone have any suggestions on a better way to do this?

I am currently hosting with Crystal Tech and they have a 30 second CF timeout.

[davidorsini]

Well, the original script did a cffile append for each line... i am now appending a variable with the linebreak char(10) and appending my file only once per page load. This seems to be working a lot better. I have succesfully completed a 4751 line file. It is still taking forever but I think the bottleneck now is the actual query.

[creole]

I suspect that if your file gets too much longer, you might consider dropping into Java to work with it.

There was a discussion about this on the CF-Talk mailing list a month or two ago:
http://www.houseoffusion.com/groups/cf-talk/

Give it a look.