Sirmadsen Posted April 10, 2018 Posted April 10, 2018 Add option to allow chunked file uploads with the HTML5 file api. This would allow users to bypass file sizes set and limited by php.ini. Very useful on shared hosting.
Colonel_mortis Posted April 10, 2018 Posted April 10, 2018 They already do use chunked uploads. On this site you can't test it because they're using S3, which I believe doesn't support chunks, but if you are using the file system and you try to upload a large file, it will chunk it. On my site, the chunk limit is 30MB (I'm not sure off the top of my head where that limit was pulled from though), and I was able to upload an 83MB file without issue, with 3 requests being made to the server to upload it.
MMXII Posted April 10, 2018 Posted April 10, 2018 11 minutes ago, Colonel_mortis said: They already do use chunked uploads. Are you sure? On my test installation (4.2.8) I can't upload let's say a file of 800 MB if I don't edit the php.ini accordingly (and set up the group permissions correctly, of course).
Colonel_mortis Posted April 10, 2018 Posted April 10, 2018 3 minutes ago, MMXII said: Are you sure? On my test installation (4.2.8) I can't upload let's say a file of 800 MB if I don't edit the php.ini accordingly (and set up the group permissions correctly, of course). In downloads on my site, we have files of 2GB+, and I don't think we had to do anything special to support that. There is a 4GB limit because the file size is stored as a 32bit integer in the DB, but that was the only limitation that I'm aware of.
bfarber Posted April 10, 2018 Posted April 10, 2018 We use plupload which supports chunked uploading, which we in turn support when the file storage method is capable of handling it (presently that is only the local file system storage method).
Sirmadsen Posted April 11, 2018 Author Posted April 11, 2018 @bfarber So you are saying that if I use system as storage it uploads in chunks? I just tried this, setting my php.ini to allow max size of 2MB and setting memory limit to php default. Managed to upload a 242 MB file to the file system. Might try bigger files later. Note: Amazon S3 supports chunked uploading though (multipart upload), any chance of implementing that? Would be great to use on systems with limited file storage on hosting server. @bfarber Off topic question: When choosing to go back to file system from Amazon S3 does the files get moved from my S3 storage to the system? Copied? Or do I have to move them manually to the corresponding folder in system?.
bfarber Posted April 11, 2018 Posted April 11, 2018 Files will be moved back to the file system automatically, although you can also manually move them if you prefer. We will investigate chunked uploading to S3 in a future release.
SJ77 Posted April 11, 2018 Posted April 11, 2018 2 hours ago, bfarber said: We will investigate chunked uploading to S3 in a future release. PLEASE! and also to second server. Having 2 servers should be an option.
SJ77 Posted June 12, 2018 Posted June 12, 2018 On 4/11/2018 at 6:34 AM, bfarber said: Files will be moved back to the file system automatically, although you can also manually move them if you prefer. We will investigate chunked uploading to S3 in a future release. IS this part of 4.3.3?
SJ77 Posted January 4, 2019 Posted January 4, 2019 How do we control the chunk size of plupload? According to this, using chunks we should be able to bypass the 100MB cloudflare limitations. @bfarber https://support.cloudflare.com/hc/en-us/articles/201303340-How-can-I-change-the-client-maximum-upload-size-
bfarber Posted January 4, 2019 Posted January 4, 2019 You don't, it's handled automatically based upon your php upload_max_filesize when a file storage engine supports chunks. If you require assistance I would encourage you to submit a ticket for technical support.
Recommended Posts
Archived
This topic is now archived and is closed to further replies.