file listing, scalability, optimization question.

[micron]

wondering how scalable a script i made is. it basically reads the entire contents of a directory (ei: 001.jpg, 002.jpg, 003.jpg), determines the last file uploaded (ei: 003.jpg), adds one to the name (ei: 004.jpg), and creates the file.

does it take a significant amount of time to process if there are to be 10000 files in that directory? if so, is there a more effecient way to achieve the same outcome?

thanks in advance.

[Chris82]

Going through 10,000 files will certainly take a lot of time.

Another approach would be to store the name of the last uploaded file in a file. You can then open the file get its contents (the newest file's name).

// upload here;

$name = 'name of the uploaded file';

// storing the name of the last uploaded file
$fp = fopen('lastuploaded', 'w');
fwrite($fp, $name);
fclose($fp);

// get the name
$fp = fopen('lastuploaded', 'r');
$data = fread($fp, filesize('lastuploaded'));
fclose ($fp);

echo 'last uploaded file was: ', $data; 

Another way would be to store the name in a database.

[lieut_data]

An even better way would be to store the image in a database, and let it handle the inidices :-)

[Icheb]

Having 10.000 files in one directory will always be a performance issue, some file systems get very slow with that amount. Try to put 10.000 files into one directory on your Windows PC and load that directory in Windows Explorer (I am speaking from experience, I once had 16.000 files in one directory here on Windows XP).

It would be better to use subdirectories and store the paths to the images in a database, so you can manage them with simple queries.

[Dr Livingston]

I have 213 Folders in My Documents and from that I have a total of 3000 Folders and 3.12Gb. Takes Windows an (ice) age for me to look through them, even just a few folders down from the root...

[seanf]

An even better way would be to store the image in a database, and let it handle the inidices :-)

Storing the image itself in the database would be very inefficient

Sean

[Dr Livingston]

Yer Put the IMGs to a folder and put the URL link to the database...

[micron]

wow thanks everyone for the tips! =)

[Dr Livingston]

Okay, own up - who knocked 1 point of my reputations huh ?

I have 213 Folders in My Documents and from that I have a total of 3000 Folders and 3.12Gb. Takes Windows an (ice) age for me to look through them, even just a few folders down from the root...

I posted the above quote more out of a sense of humour than anything else... What, has Site Point Forums become this devoid of a laugh and a joke ? If that is the case, then I'm off mate

[micron]

im sorry to hear that. i wasnt even aware of the new rating feature until i read your post, i went and gave everyone a helpful rating, including you, if it may be any consolidation to you.

[Dr Livingston]

Cheers Micron I don't really know what the end point of the reputations is myself though the more the better I suppose ? Still think though it's a bit unfair sometimes on how anyone can knock you down for next to no reason at all...