Jump to content

Community

All Astronauts

S3 Compatible Downloads

Recommended Posts

Non-Amazon S3 storage services do work with IPS 4.1x. Add your endpoint, key, secret, and sub-directory and custom url if needed, assign to some file category such as attachments or Gallery images and off you go!

However, these Non-Amazon S3 services are NOT officially supported by IPS - that's because some of the internal methods have not been altered to handle them. These methods are hard-coded for Amazon S3 exclusively.

If you are merely displaying images and the like on the front end, none of this is a problem. It becomes a problem if your end-users are going to download these files - that is when you hit the exclusively Amazon S3 code and the downloads will fail. For example, if you assign non-Amazon S3 storage to save IPS Downloads files, those files will not be downloadable. When the system attempts to make the download URL, it crafts that URL as if you were using Amazon S3, not some other S3-Compatible storage service.

The two major areas that this will impact are IPS Downloads files and Attachments (this is what the file storage is called in the Files list in the ACP - it encompasses all attachments such as those you would have anywhere the full editor is used and there is an attachment dropzone.)

This plugin intercepts the URL creation method called on Amazon S3 file storage objects, checks to see if it is an actual Amazon S3 request, and then just passes it on through as usual. If it is NOT an Amazon S3 request, it must be an S3 compatible method, in which case I provide a rudimentary URL to patch this up. It isn't anything fancy: just enough headers to push out the actual file name and trigger your browser to download it. If the attachment or file in question is an image your browser might just pop it up in a new tab, in which case just right click and download it there. This has been tested with the usual modern browsers (minus Safari), and various file-types. All testing was successful.

BTW, as an aside, external FTP storage for files is NOT COMPATIBLE with IPS Community in the Cloud. Might want to note that...

Free, support through the IPS Marketplace topic for now. Free also means lay off the instantaneous demands for support. I use this too so it's in my interest to keep this going. Support, and this plugin's existence, continues until IPS gets around to actually officially supporting Non-Amazon S3 storage.

WARNING!

The only item in the entire IPS Suite that marks files as private is IPS Downloads. This plugin will flag them as public. This means a few things:

1) If you are monetizing or otherwise require to fully control access to IPS Downloads files this is probably not the plugin for you. You will need to wait for complete 3rd Party S3 support, or at least specific mods to support obj.space, Digital Oceans Spaces, and so on. It really is just some hump work on getting the signatures correct (and it might be a V2 vs. V4 dance with varying providers as well - IPS just has a hard-coded-to-Amazon V4 method). Give it time, it will happen.

2) If you are using this plugin on an already existing bucket with Downloads files, those files will need to be flagged as public-read for them to download correctly. Again, this plugin is just getting rid of the signatures to allow public files to download correctly from 3rd-party S3 providers. 

3) IPS Downloads users on IPS Community in the Cloud may need to wait forever and ever before the plugin will work correctly (forever and ever being defined as more than handful of minutes) as CIC caching takes some time to get things working. You *will* need to be infinitely patient. Like, install and then go drink something for awhile, read a book, etc. Then test. Don't yell at me saying this is broken., It isn't. Tested and verified on both own-hosting and CIC.

Enjoy, good luck, etc...

 

 

Edited by All Astronauts

Share this post


Link to post
Share on other sites

this is exactley what im looking for but it does not seem to work :(

i use s3for.me and its still messing up the urls 

 

*url its providing*
http://rest.s3for.me/xxxxx.com/monthly_2017_10/59ef1ceb256b2_S3CompatibleDownloads1.xml.6eb52243c7570e0ed901a2d7adb20c20.xml?X-Amz-Expires=1200&response-content-disposition=attachment;%20filename*=UTF-8%27%27S3%2520Compatible%2520Downloads%25201.xml

*url needed*

http://rest.s3for.me/xxxxx.com/monthly_2017_10/59ef1ceb256b2_S3CompatibleDownloads1.xml.6eb52243c7570e0ed901a2d7adb20c20.xml?AWSAccessKeyId=F38875120BB8864941CEC54647DC1A87&Expires=1508929708&Signature=X9jnTXp7Em0wShFnavr1IFJEjDQ%3D

not sure if it needs an update or if im in the wrong somehow .

thanks

Share this post


Link to post
Share on other sites

This only works if your file doesn't require a signature to grab it. It's just a hack too get around the hard coded Amazon v4 signature automatically used by IPS. If you can spin me up a bucket with this service and pm me that, key, and secret I can test here locally.

Also, what isn't downloading? Attachments? Downloads? Something else?

Share this post


Link to post
Share on other sites

attachments,downloads and musicbox files 

none will download i moved to dreamhost until i can get it sorted.

thanks for the help

Share this post


Link to post
Share on other sites

Your service appears to *require* a signature for downloads, even if the file is public-read. If the attachment is an image it displays fine of course, and you can open the image in a new tab and download it directly like that, but if something is being downloaded via URL, it seems to want a signature no matter what.

I guess I can get about the business of writing out a real S3 compatibility mod but it will be a paid app.

For now I'll just keep a running list of compatible services on the Marketplace page and in this support topic.

Thanks!

Share this post


Link to post
Share on other sites

CURRENT KNOWN COMPATIBLE SERVICES

Delimiter obj.space
Digital Oceans Spaces

 

IN-COMPATIBLE SERVICES
If a service REQUIRES a signature for download URLs, even for public-read files, this plugin will not help you. The following services are known to require signatures for all download URLs.

S3for.me

Share this post


Link to post
Share on other sites

Timing. Blame Joel who tagged me on Slack a few hours back.

Actually, this was working with Wasabi months ago, I just never updated the description. Took some time to get Joel squared away today and made a little tweak to the file. And updated the file description.

Caveats as stated in the file description still apply.

Share this post


Link to post
Share on other sites
On 6/14/2019 at 4:52 AM, beats23 said:

Any solution for downloads paid files to work?

Yes, with caveats as of right now.

1) Will be a seperate paid mod.

2) I've a got line out to Wasabi support (I've been an account holder for nearly a year now) on this one singular hitch and I want to wait until I hear back from them first. I could launch now but it's juuuusssst a slightly messy small thing which may put off some people. Rather wait and see if I can get this cleared first.

Edited by All Astronauts

Share this post


Link to post
Share on other sites
8 minutes ago, All Astronauts said:

Yes, with caveats as of right now.

1) Will be a seperate paid mod.

2) I've a got line out to Wasabi support (I've been an account holder for nearly a year now) on this one singular hitch and I want to wait until I hear back from them first. I could launch now but it's juuuusssst a slightly messy small thing which may put off some people. Rather wait and see if I can get this cleared first.

Great

Share this post


Link to post
Share on other sites
On 6/17/2019 at 4:46 PM, All Astronauts said:

Yes, with caveats as of right now.

1) Will be a seperate paid mod.

2) I've a got line out to Wasabi support (I've been an account holder for nearly a year now) on this one singular hitch and I want to wait until I hear back from them first. I could launch now but it's juuuusssst a slightly messy small thing which may put off some people. Rather wait and see if I can get this cleared first.

Any news on this? Did Wasabi get back to you?

Share this post


Link to post
Share on other sites

  • Recently Browsing   0 members

    No registered users viewing this page.

×
×
  • Create New...

Important Information

We use technologies, such as cookies, to customise content and advertising, to provide social media features and to analyse traffic to the site. We also share information about your use of our site with our trusted social media, advertising and analytics partners. See more about cookies and our Privacy Policy