Large file uploads

I have an idea for a website that involves users being able to upload very large files.

The files are a lot of scientific data.

Users will need to be able to upload files of up to 5gb.

What is the best way to facilitate this via a web form?

The best way is to not upload files of that size using a form at all. Use FTP for files of that size so a user can resume uploads whenever they fail (which would be likely for an upload of that duration)

For large file uploads I use an ajax application to give the user a readout of upload speed and a progress meter. I usually do files in the 50mb-100mb range so I cannot vouch for files in the 5gb range but as long as you have your timeouts and file size limits set up on the server side it should work.

Your options are allowing users to have FTP access or use a PHP script that allows you to set parameters. For the latter process, you can set the file size parameters and file type parameters.

ie. 5GB file size limit and .rar only

Hi,

I wouldn’t want to try doing a 5GB file via PHP - that’s going to consume a lot of memory, and hold up a web server process for quite a long time, which if you’ve got a few uploads going on and normal visits as well on the same server is going to cause you a world of pain in terms of the number of connections you need to have open at once.

Thanks,

Uploading backup on server is not safe because wherever you will go you have to access your server which is time consuming, insecure and it depends on that how much faster your Internet speed.

maybe you should use .NET?

web forms are generally a bad idea for this kind of thing. you might try looking for a java upload applet. Some of these will support uploading really large files, possibly with the ability to resume.

I think FTP is going to be the way to go here. Thanks for the contributions

I believe once you chose web application for that you will be able to set the limit. How to do that I believe will depend on the web application which you are going to use there.

Really ftp is going to be your best choice.

you can do it with the ftp access whatever the person in second post reply