Hi everyone…

I’m working on a site that has a lot of video.  I’m considering tying in Amazon S3 to the PUBLISH form.  Basically, a web form that would upload to that service.  I actually already have a prototype on my local install that would do this.

Now, here is where my lopsided PHP/server knowledge come into play…

Am I right in assuming that the size of the file that will be uploaded is still bound by the server’s PHP upload and memory limits?

I’m using this class for uploading to S3.

Hi Arun,

I could be completely wrong on this but when I looked into Amazon S3 I’m pretty sure that there aren’t really any limits at all on size of file that can be uploaded to them. I saw a form on their developer site some time back which allowed you to upload as much as you wanted all at one time. This may have changed now though so I’m not totally sure but if you were to ask in their support forum I’m sure someone would know the correct answer there.

Would love to see this though if possible when you have it all working though.

Best wishes,

Mark

I think the current max upload size is 5 GB (which is probably fine for most uses).

Hmm…thanks for the thoughts guys.  I’ve been reading up at the Amazon S3 forums, and I’m pretty sure now that my initial hunch was right.  My server would still be the one processing the upload.  It just saves it to another place.  So, I’m pretty sure that the upload_max_filesize setting sticks.  It not a limit imposed by Amazon, it’s just the capability of the uploading server.

I did a few tests with changing my PHP settings, and it seems like that is the case.

I’m thinking of a solution with coupling Amazon S3, Google Gears and EE for uploading large files.  I saw an extension yesterday in the Extension forums that used the new version of Google Gears to split large files into chunks and then process them.  Perhaps (and I have no idea if this is possible at all), I would be able to split a file, reassemble it on my server and then send it off to Amazon S3 and delete whatever local assets are left over. 

If nothing else, it’ll be a learning experience.  I’ll 100% be posting about this as I make any progress.

If anyone has any hints, tips or wants to double team this thing, I’d of course welcome the help.

I think the only way you could bypass your server processing the request would be to use an approach referenced below, posting directly to S3 (the article doesn’t use PHP, but the concept could certainly be ported to PHP).  You may of course hit a brick wall if trying to integrate the approach with EE.

http://developer.amazonwebservices.com/connect/entry.jspa?externalID=1434&categoryID=55

You may want to check out Amazon CloudFront for delivering the files to your user.

Jason, thank you very much for the reply.  I didn’t know that it was possible to process the upload through Amazon S3.

A little bit of searching brought me to this. 

On the surface, this looks very promising.  I’ll have to play around with it and see what I can come up with.

Awesome…it would be amazing, if I can get this to work.

Yep, referencing my last post I thought that I had seen something where you completely bypassed your own server and you were able to upload as much as you liked to the S3 account. Not sure how easy that would be to integrate but would be an excellent addition if it could be figured out.

I wish I had the brains to be able to help you out on this one but alas I’m still stuck on smaller plugins at the moment

Hope you do get something together though, would love to see what you come up with.

Best wishes,

Mark

Come on, Mark.  You can’t help me out every other time and then not do it this time.  Grab that PHP manual! :-p I jest, of course. 

Hopefully, I can come with something.  Apparently, copying and pasting a link into EE is too complicated for this client (that’s the current workflow) 

I apologise. I really am naughty aren’t I?

I suppose I’ll just have to have even less sleep to help out on this one then

Mark Bowen - 19 November 2008 10:35 AM

I apologise. I really am naughty aren’t I?

I suppose I’ll just have to have even less sleep to help out on this one then

That’s the spirit!