Jump to content

ASTRAPI

Members
  • Posts

    1,638
  • Joined

  • Last visited

  • Days Won

    6

Reputation Activity

  1. Like
    ASTRAPI reacted to Circo in Community Guide on Setting Up Wasabi and CloudFlare   
    I did not see this mentioned in any of the posts but what about cloudflares 100mb file upload limitation.  I need this to host my downloads section of which most everything is above that size. On the S3 Compatible downloads plugin it says that it does not support chunking to wasabi. It states that the author isn't interested in making the changes to make it compatible with wasabi chunking. Am I alone that I would pay just about any amount of money to get that working?
    EDIT: So I got it all set up and it seems regardless of what the plugin says chunking files to wasabi is no issue.  PHP limits set at 50mb and just uploaded a 1.4gb file to wasibi no problem through the downloads app.  I did attach a card to wasabi account and downloading the file gives me a permission denied notice but I am assuming it just needs some time.
    EDIT2: Seems to be working just fine, It seemed to take an hour to start working right or adding another non root user fixed the issue, not sure which.  Moving files to wasabi manually using CyberDuck to avoid paying S3 to move 700gb and I had a local backup. Download speeds seem about 10x faster than my S3 test getting about 20MB/s so that's a huge win. I had to turn off "Prevent Direct File Linking" in the downloads settings to get file names from garbling, with normal (self hosted & s3) ipb adds a bunch of characters to file name but it looks fine on listing and when you download. With wasabi on NEW uploads, the new file name with the extra characters shows in the file listing and downloads with the extra characters (turning off the prevent direct linking solved this issue).  However preexisting files work as expected.  Other big note, cloudflare so far is beating the snot out of stackpath, which was my previous cdn.
     
     
  2. Thanks
    ASTRAPI got a reaction from Clover13 in Community Guide on Setting Up Wasabi and CloudFlare   
    Hello
    (This is a community guide on how to setup Wasabi and Cloudflare, as a significantly cheaper replacement for Amazon S3 and Cloudfront.  The author has no affiliate arrangement with any of the companies listed in the guide and offers the guide as a free community resource.  You should consult with your hosting provider and / or server administrator before proceeding with the guide.)
    BACKGROUND:
    Invision Communities contain rich content, from forum attachments to gallery images to download files.  These resources add up over time. 
    Here are real examples of communities that I provide server administration for:
    - Website A: 400 GB of total storage and 1.2 TB of total monthly bandwidth 
    - Website B: 800 GB of total storage and 14 TB of total bandwidth
    Invision Community allows a file storage configuration with Amazon S3 and a content distribution network (CDN) of your choice:
     
    WHAT IS WASABI?
    Wasabi Cloud  is faster and cheaper than Amazon S3 for object storage, offers unlimited egress for bandwidth, and compatible with Cloudflare.  One of the biggest hidden expenses of using Amazon S3 is not the cost of storage itself, but the bandwidth to deliver objects in and out.  Wasabi does not charge for egress bandwidth, which can save on the majority of the true cost of Amazon S3. It also provides an S3-compliant interface, which means it can be used as a perfect drop-in replacement for Amazon S3 storage and immediately usable on all Invision Communities.   

    Wasabi is 80% cheaper and 6x faster than Amazon S3, with 100% data immutability protection, and no data egress fees or API charges. Created by Carbonite co-founders and cloud storage pioneers David Friend and Jeff Flowers, Wasabi is on a mission to commoditize the storage industry. Wasabi is a privately held company based in Boston, MA.
    In March of 2018, Wasabi pioneered the cloud storage industry’s first ‘unlimited free egress’ pricing plan. We are excited to join forces with Cloudflare and the Bandwidth Alliance, validating that the early business models of Cloud 1.0 vendors no longer applies in a world that expects unlimited everything.  What this means in practice is that you can use Cloudflare services (including the free plan) like blazing-fast DNS, WAF firewall, performance improvements on the fly, and much more.  Forums users will request a topic, and all static content can be picked up from Cloudflare's optimized services that will connect to Wasabi.

     
    At the moment, Wasabi offers three Datacenters:
    1)US-WEST
    2)US-EAST
    3)EU-CENTRAL 

    One price. Lightning fast speed. No hidden fees.

    You can check and compare the prices above.
     
    GUIDE:
    BEFORE PROCEEDING, PLEASE BACKUP YOUR DATA FIRST!
    YOUR FILES WILL BE IN PRIVATE MODE AND WILL NOT BE ACCESSIBLE ON YOUR FORUM !
    YOU MUST GET A PAID PLAN TO BE ABLE TO ACTIVATE THE INVISION FILE PERMISSIONS AND GET YOUR FILES ACCESSIBLE AT YOUR FORUMS.
    JUST ADD YOUR CREDIT CARD NOW (AT YOUR PROFILE PAGE) AND THEY WILL CHARGE YOU 5,99$ FOR A MONTH FOR 1TB STORAGE AND UNLIMITED BANDWIDTH.
    THE FREE TRIAL WILL NOT WORK FOR INVISION !
     
    Step 1: Create a CName at CloudFlare
    We start by creating a cname at Cloudflare:
    cname -> cdn -> cdn.yourdomain.com.s3.eu-central-1.wasabisys.com  <--For Europe datacenter
    or
    cname -> cdn -> cdn.yourdomain.com.s3.us-west-1.wasabisys.com  <--For US-WEST datacenter
    or
    cname -> cdn -> cdn.yourdomain.com.s3.wasabisys.com  <--For US-EAST datacenter
    Like this:

     
    Step 2: Create a bucket on Wasabi
    First we sign up for a free account at Wasabi Cloud: https://wasabi.com/sign-up/
    Then we create a bucket:

     
    It is important to name it as: cdn.yourdomain.com
     

     
    Then keep default suspend Versioning and Suspend Logging:

    Then click CREATE BUCKET:
     

     
    Step 3: Retrieve your Access Keys
    Go to the menu on top left and click Access keys on the left. Click on "Create New Access Key."

     
    Copy / save the access key and the secret key:

    Step 4: Setting up a new file storage in ACP
    Login to Admin Control Panel and navigate to Overview at the Files category and then click at the right side at Storage settings:

     
    Then we click at Configurations and at the right side at Create New:
     

    We select Amazon s3 and we add the following info:

    Save it.
    Step 5: Set the new storage at storage settings
    Navigate to Storage settings and select from the drop down menu the new Amazon s3 bucket.

     
    Keep only at your server your theme resources:

    *Attachments and Downloads doesn't work out of the box as it seems there is some hardcoded code at Invision related to S3...
    To make them work you just need to install the addon bellow: (tested with Invision 4.4.4).
     
    Then wait for any Invision background tasks to finish and check.
    I hope that you will benefit from this tutorial and get better performance while saving a lot of money 🙂
    Enjoy!
    OTHER NOTES:
    If you are already using S3 then it is very easy to move straight to Wasabi by following the above tutorial as it is NOT needed to move back your files to server and then to Wasabi.
    CREDITS
    Credits to @Joel R for giving me the motivation to write this tutorial and providing screenshots from his Wasabi account and for editing the topic.
    Thank you
  3. Agree
    ASTRAPI got a reaction from AlexJ in Archiving - Database reduction size   
    Hello 🙂
    In my opinion it will be better to optimize and scale as a solution rather than archiving.
    It will be better to have a proper solution so when the database increase later to be ready for it and not start archiving again.
    Archiving is limiting your users interaction...
  4. Like
    ASTRAPI got a reaction from sobrenome in MySQL 5.7 vs MariaDB 10.3   
    I prefer also MariaDB 🙂
  5. Thanks
    ASTRAPI reacted to Joel R in Move IPB 3.4 server to new server, or upgrade, or...   
    You can contact third party migration people like @ASTRAPI @Makoto or @DawPiwho can probably help you migrate and upgrade.  
  6. Thanks
    ASTRAPI reacted to Joel R in Alternative to Amazon S3   
    There's a community guide on setting up Backblaze by @ASTRAPI
    Two notes that you will soon discover: 
    - IPS devs love to drink the iOS koolaid
    - IPS as a company loves to drink the AWS kool aid
     
  7. Thanks
    ASTRAPI reacted to Joel R in Hiring Someone to Optimize Our Site   
    Are you wanting someone to get you a better Google Pagespeed score?  Contact @Adlago
    Are you wanting to actually improve your site's actual interaction with users?  Contact someone like @ASTRAPI or @Makoto.  
  8. Like
    ASTRAPI got a reaction from SeNioR- in Alternative to Amazon S3   
    And this one for Wasabi and Cloudflare 🙂
     
     
  9. Like
    ASTRAPI got a reaction from Clover13 in Community Guide on Setting Up Backblaze and CloudFlare   
    Hello 🙂
    (This is a community guide on how to setup Backblaze and Cloudflare, as a significantly cheaper replacement for Amazon S3 and Cloudfront.  The author has no affiliate arrangement with any of the companies listed in the guide and offers the guide as a free community resource.  You should consult with your hosting provider and / or server administrator before proceeding with the guide.)
    The tutorial is tested with the latest version of Invision 4.5.4 !

    Invision Community allows a file storage configuration with Amazon S3 and a content distribution network (CDN) of your choice:
     
    WHAT IS BACKBLAZE?
     

     
    Backblaze is an infinitely Scalable B2 Cloud Storage. Backblaze B2 is enterprise-grade, S3 compatible storage that companies around the world use to store and serve data. Backblaze's service works with native APIs, CLI, and GUI; you can move and manage data with minimal coding. Their service provides fast access all the time; there is no need to accept delays or pay speed surcharges. It can also support HIPAA compliant storage with their Business Associates Agreement (BAA). B2 is compatible at ¼ the cost of AWS S3 with no hidden fees or minimums.
     
    Backblaze is an award winning cloud storage provider for 2020 !
     

     
    Pricing:
     

    Based on their latest pricing, it is very cheap at around 5$ per 1TB storage per month! There is a cost for direct downloads (bandwidth) at 0.01$ per GB but it will not affect us as we will use Cloudflare and all files will be served from Backblaze to Cloudflare and then to users that is totally free 🙂
    Be careful if you have any custom direct downloads that bypass Cloudflare. If you link to custom downloads directly, you will be charged for bandwidth. All default Invision files should go through Cloudflare. I am using Backblaze for a few of my clients and they never charged anything extra as all Invision files are going through Cloudflare as expected. Please monitor your balance after a few days just to be sure!
     
    GUIDE:
    BEFORE PROCEEDING, PLEASE BACKUP YOUR DATA FIRST!
     
    STEP 1: Create a bucket on Backblaze
    First we need to sign up at Backblaze Cloud: https://www.backblaze.com/b2/sign-up.html
    You will need a phone number to activate your account:

    After the activation of the account we will need to create a bucket that will host our files.
     
    On the Buckets sections we click on Create a Bucket:

     
    Then we add a name for our bucket. Recommendation: avoid dots (.) in the bucket name.
     
    On the next screen we type a Bucket name and we select Public and then we click at Create a Bucket.

     
     
    After that under the Create a Bucket we should have our Bucket.
     
    Now we must keep a note of the ENDPOINT:

     
     
    Now we need to get our Bucket access keys from the App Keys menu. At the bottom we click at Add a New Application Key:

     
     
    At the new screen we select a anything as a key name and we keep selected the Read and Write access and wee click at Create New Key:

     
     
    Then you will see there only once the KeyID and the Application Key that we must keep a note of them as we will need them later !

     
    As a last step we need to go to our bucket that we just created and upload an image. From the menu on the left we click on Browse Files and then we click on our bucket:

     
    Then we click on upload and we upload a simple file like an image...

     
    On the right side of the uploaded image we have to click at the info icon:

     
    At the pop up screen we need to keep a note for that part so copy it with the other notes that wee have already:

     
    That's it ! We created our bucket and we got the access info that we will need !
     
    STEP 2: Create a CNAME dns record at Cloudflare
     
    Now you have to login to Cloudflare and go to your DNS tab from the top menu and then click Add record:
     

     
    We use as Type the Cname and as Name the cdn and as Target the info that we got from the pop on the previous step in the tutorial above:

     
    After saving that DNS record we should have that:

     
    Now for security reasons we have to go to the page Rules on the top menu and create two rules:

    RULE 1:
    Just replace your domain and the bucket name that you create:

     
    RULE 2:
    Just replace your domain:

     
    The final result should be like this:

     
    Keep in mind the order of the rules as if you set the second rule as 1 it will not work and your forum images will not work as page rules uses priority. This is important!
    That's it for the Cloudflare part!
     
    STEP 3: Configure Invision to use the Backblaze Cloud
    From Invision Admin Control Panel, go to System -> Files -> Storage Settings

     
    Then we click on Configurations:

     
    and then on Create New on the right side.
    Then we select Amazon S3 and we fill the needed info as:

     
    When you click Save if you get any warnings or errors then you have to check again the tutorial as you may forgot something or may have a typo somewhere...
    If you save it without any issues then you are ready to use it by going to: System -> Files -> Storage Settings
    and select a category with not many images for example Icons & Logos or anything else with a few images and from the drop down options the: Amazon S3:superbucket
     

     
    Then wait for the automated task to transfer your files to the Cloud and check if all are ok !
    If yes then you can proceed with the rest categories.
     
    *Keep only at your server your theme resources:

     
    Keep in mind that if you have a lot of GB of files it may take a long time for the transfer !
     
    It may help to go to the Dashboard and run manually the process to get the files transferred faster.

    *Attachments and Downloads may not work out of the box (don't use them on my test forum and i don't know for sure) and you may need to use the addon S3 Compatible Downloads:
     
    I hope that you will benefit from this tutorial and get better performance while saving space on your main server and a lot of money 🙂
    Backblaze is much more stable than Wasabi!
    It also includes up to 10GB free storage, so you can test it easily !
    Credits to: @Joel R and @Martin A.
    Enjoy !
  10. Thanks
    ASTRAPI got a reaction from MEVi in Alternative to Amazon S3   
    And this one for Wasabi and Cloudflare 🙂
     
     
  11. Like
    ASTRAPI got a reaction from Interferon in Alternative to Amazon S3   
    And this one for Wasabi and Cloudflare 🙂
     
     
  12. Like
    ASTRAPI reacted to CoffeeCake in Alternative to Amazon S3   
    This reminded me that I've seen others use alternatives to Amazon.  Here's a link to how to use Backblaze:
     
  13. Like
    ASTRAPI reacted to Makoto in ⇓ Sendfile support   
    Sendfile is an IPS plugin that implements server X-Sendfile support into the software suite. Use this to improve server performance on large communities that handle a lot of attachment and/or IDM file downloads.
    What is X-Sendfile?
    In short, it gives PHP a way to tell your web server to deliver files to the client after proper permission checks and other actions have been performed by IPS. This way, you are not relying on PHP itself to deliver the files to the client.
    The reason you don't want PHP to handle file transfers is simple: PHP is really inefficient at it. This is particularly important if you run IPS in a self-hosted environment and your community makes heavy use of attachments or IP.Downloads file submissions.
    When you have a lot of users trying to download files concurrently, PHP will rapidly consume your servers available memory pool and, assuming your server makes use PHP-FPM or fastCGI, it will lock up your available PHP processes that are used to serve pages to your other users. This means basic topics and other pages will not load until another users download has completed.
    By utilizing X-Sendfile, you are able to pass the workload back off to the web-server. This is immensely more memory efficient, faster, and will keep your PHP processes free. This overall makes IPS significantly more scalable, especially in a self-hosted environment.
    Configuration
    Assuming you were able to run the test script provided in the plugin description without error, all you will have to do after installing this plugin is enable it and ensure you have the correct web server selected. After that, that's it! The plugin will hook into all local file download requests processed by IPS and pass them off directly to the web server using X-Sendfile.

       
    1. Plugins
    Sendfile can be installed and configured directly from the Plugins page in your AdminCP.
    2. Settings
    To configure Sendfile, just click the pencil icon in the plugins list.
    3. Enable
    Make sure the "Enable Sendfile" option is toggled
    4. Web server selection
    Sendfile will attempt to automatically detect the web-server you are using and populate this field accordingly. All you need to do is make sure it is correct and click "Save"! If you are not sure, just ask your hosting provider.
     
    ---
    That's it! If you have any issues, please let me know here, or submit a bug to my Issues tracker.
     
    ☕ Found this useful? Want more free plugins and guides like this one? Show your support by buying me a coffee!
    - https://ko-fi.com/makoto_dev
  14. Like
    ASTRAPI reacted to xtech in Server side OS choice   
    AqWhat's wrong with centOS? I also use it and i prefer it over Ubuntu. It is amazingly stable, reliable, and doesn't give me any headache. Enough to be my #1 choice...
  15. Like
    ASTRAPI got a reaction from Steve Bullman in Server core vs speed for concurrency   
    It is a plan that you must do or your server admin or both 🙂
    Installing Centos 7 for the next 4 years and then when things are more mature you can migrate.
    You may be able to adjust your existing installation and start using it following another Centos like distribution.... so no need to reinstall 🙂
    Or you can go ahead with Ubuntu for example. But check first that your control panel (if you use any) to support it and check also any scripts that you will use to be compatible also.
    IPS don't care if it is on top of Centos or Ubuntu... It just needs the web server, php, mysql, and other related software like Redis or Elastic search to work.
    IPS will perform better on the most minimal installation of the OS and to the better optimized Network, kernel, software e.t.c
  16. Thanks
    ASTRAPI got a reaction from Gauravk in Server core vs speed for concurrency   
    It is a plan that you must do or your server admin or both 🙂
    Installing Centos 7 for the next 4 years and then when things are more mature you can migrate.
    You may be able to adjust your existing installation and start using it following another Centos like distribution.... so no need to reinstall 🙂
    Or you can go ahead with Ubuntu for example. But check first that your control panel (if you use any) to support it and check also any scripts that you will use to be compatible also.
    IPS don't care if it is on top of Centos or Ubuntu... It just needs the web server, php, mysql, and other related software like Redis or Elastic search to work.
    IPS will perform better on the most minimal installation of the OS and to the better optimized Network, kernel, software e.t.c
  17. Thanks
    ASTRAPI got a reaction from Gauravk in Server core vs speed for concurrency   
    Yes this is the best option:
    Intel Xeon-E 2288G - 8 c / 16 t - 3.7 GHz / 5 GHz
     
    But adding a better cpu is one part of the performance results in general .....
    Optimizing the OS, network, software like Nginx, Phpfpm, Mysql, Redis e.t.c
    must be done to improve in general your server performance.
    If you have already optimize them then adding resources will help 🙂
  18. Thanks
    ASTRAPI got a reaction from Gauravk in Server core vs speed for concurrency   
    Hello Gauravk
    Centos 8 is dead ! To be more specific it will be dead in 1 year from now.
    Centos 7 has 4 years before the end also.
    We are in the process that a new Centos like system will take over like Rocky Linux or the Cloudlinux option.
    In the next few months we will see.
    You can wait a bit or get an alternative like Ubuntu or Debian e.t.c Or get Centos 7 and take your time to decide (4 years) and then migrate.
     
    Centos stream rolling doesn't seem to be the best and more stable option for server environments.
     
    As i prefer Centos personally i will pick up the most supported alternative that at the moment seems to be the Rocky linux that the owner of it is one of the owners of the original Centos... The name is coming from his partner that both build Centos that is not in life anymore 😞
     
    For the cpu it is a combination of both. A core with high clock will help on single core tasks like backing up a database if you use the traditional way to backup the database but it depends also how new is the Cpu and the instruction sets that it has.
     
    Let us know the exact cpu models and we will let you know which one is better 🙂
  19. Like
    ASTRAPI got a reaction from Haku2 in Adding a server disk space check and S3 Cloud files size che   
    Hello
    I think it is very important to add a check for server free disk space and check also the files size from S3 Cloud before starting the transfering from S3 back to server.
    If the available free disk space on the server is not enough for the files that coming from the S3 cloud back then the server will be full and the server will die.
    Nothing will work with 0 free space and the user will be in a case that he will not be able to revert that task and the only solution will be to request from the data center extra hard disks to added on the server.
    Until then the forum will be down ....
    Doesn't seem hard to add that very useful info for the user when he will try to run that task and from a quick check i found:
    https://www.php.net/manual/en/function.disk-free-space.php
    For Linux hosts:
    $df = round(disk_free_space("/") / 1024 / 1024 / 1024);
    print("Free space: $df GB");
    Or in your case it sounds like you're running on Windows so:
    $df = round(disk_free_space("C:") / 1024 / 1024 / 1024);
    print("Free space: $df GB");
     
    Some related info on how to get the size of the bucket also:
    https://stackoverflow.com/questions/3910071/check-file-size-on-s3-without-downloading
    https://www.cloudsavvyit.com/1755/how-to-get-the-size-of-an-amazon-s3-bucket/
    https://serverfault.com/questions/84815/how-can-i-get-the-size-of-an-amazon-s3-bucket
    But i think that you know how to do it anyway 🙂
     
    Thanks !!!!
    Please add this asap as it is very important !
  20. Like
    ASTRAPI got a reaction from AlexWright in Adding a server disk space check and S3 Cloud files size che   
    Hello
    I think it is very important to add a check for server free disk space and check also the files size from S3 Cloud before starting the transfering from S3 back to server.
    If the available free disk space on the server is not enough for the files that coming from the S3 cloud back then the server will be full and the server will die.
    Nothing will work with 0 free space and the user will be in a case that he will not be able to revert that task and the only solution will be to request from the data center extra hard disks to added on the server.
    Until then the forum will be down ....
    Doesn't seem hard to add that very useful info for the user when he will try to run that task and from a quick check i found:
    https://www.php.net/manual/en/function.disk-free-space.php
    For Linux hosts:
    $df = round(disk_free_space("/") / 1024 / 1024 / 1024);
    print("Free space: $df GB");
    Or in your case it sounds like you're running on Windows so:
    $df = round(disk_free_space("C:") / 1024 / 1024 / 1024);
    print("Free space: $df GB");
     
    Some related info on how to get the size of the bucket also:
    https://stackoverflow.com/questions/3910071/check-file-size-on-s3-without-downloading
    https://www.cloudsavvyit.com/1755/how-to-get-the-size-of-an-amazon-s3-bucket/
    https://serverfault.com/questions/84815/how-can-i-get-the-size-of-an-amazon-s3-bucket
    But i think that you know how to do it anyway 🙂
     
    Thanks !!!!
    Please add this asap as it is very important !
  21. Like
    ASTRAPI got a reaction from catbreadbat in Community Guide on Setting Up Backblaze and CloudFlare   
    Hello 🙂
    (This is a community guide on how to setup Backblaze and Cloudflare, as a significantly cheaper replacement for Amazon S3 and Cloudfront.  The author has no affiliate arrangement with any of the companies listed in the guide and offers the guide as a free community resource.  You should consult with your hosting provider and / or server administrator before proceeding with the guide.)
    The tutorial is tested with the latest version of Invision 4.5.4 !

    Invision Community allows a file storage configuration with Amazon S3 and a content distribution network (CDN) of your choice:
     
    WHAT IS BACKBLAZE?
     

     
    Backblaze is an infinitely Scalable B2 Cloud Storage. Backblaze B2 is enterprise-grade, S3 compatible storage that companies around the world use to store and serve data. Backblaze's service works with native APIs, CLI, and GUI; you can move and manage data with minimal coding. Their service provides fast access all the time; there is no need to accept delays or pay speed surcharges. It can also support HIPAA compliant storage with their Business Associates Agreement (BAA). B2 is compatible at ¼ the cost of AWS S3 with no hidden fees or minimums.
     
    Backblaze is an award winning cloud storage provider for 2020 !
     

     
    Pricing:
     

    Based on their latest pricing, it is very cheap at around 5$ per 1TB storage per month! There is a cost for direct downloads (bandwidth) at 0.01$ per GB but it will not affect us as we will use Cloudflare and all files will be served from Backblaze to Cloudflare and then to users that is totally free 🙂
    Be careful if you have any custom direct downloads that bypass Cloudflare. If you link to custom downloads directly, you will be charged for bandwidth. All default Invision files should go through Cloudflare. I am using Backblaze for a few of my clients and they never charged anything extra as all Invision files are going through Cloudflare as expected. Please monitor your balance after a few days just to be sure!
     
    GUIDE:
    BEFORE PROCEEDING, PLEASE BACKUP YOUR DATA FIRST!
     
    STEP 1: Create a bucket on Backblaze
    First we need to sign up at Backblaze Cloud: https://www.backblaze.com/b2/sign-up.html
    You will need a phone number to activate your account:

    After the activation of the account we will need to create a bucket that will host our files.
     
    On the Buckets sections we click on Create a Bucket:

     
    Then we add a name for our bucket. Recommendation: avoid dots (.) in the bucket name.
     
    On the next screen we type a Bucket name and we select Public and then we click at Create a Bucket.

     
     
    After that under the Create a Bucket we should have our Bucket.
     
    Now we must keep a note of the ENDPOINT:

     
     
    Now we need to get our Bucket access keys from the App Keys menu. At the bottom we click at Add a New Application Key:

     
     
    At the new screen we select a anything as a key name and we keep selected the Read and Write access and wee click at Create New Key:

     
     
    Then you will see there only once the KeyID and the Application Key that we must keep a note of them as we will need them later !

     
    As a last step we need to go to our bucket that we just created and upload an image. From the menu on the left we click on Browse Files and then we click on our bucket:

     
    Then we click on upload and we upload a simple file like an image...

     
    On the right side of the uploaded image we have to click at the info icon:

     
    At the pop up screen we need to keep a note for that part so copy it with the other notes that wee have already:

     
    That's it ! We created our bucket and we got the access info that we will need !
     
    STEP 2: Create a CNAME dns record at Cloudflare
     
    Now you have to login to Cloudflare and go to your DNS tab from the top menu and then click Add record:
     

     
    We use as Type the Cname and as Name the cdn and as Target the info that we got from the pop on the previous step in the tutorial above:

     
    After saving that DNS record we should have that:

     
    Now for security reasons we have to go to the page Rules on the top menu and create two rules:

    RULE 1:
    Just replace your domain and the bucket name that you create:

     
    RULE 2:
    Just replace your domain:

     
    The final result should be like this:

     
    Keep in mind the order of the rules as if you set the second rule as 1 it will not work and your forum images will not work as page rules uses priority. This is important!
    That's it for the Cloudflare part!
     
    STEP 3: Configure Invision to use the Backblaze Cloud
    From Invision Admin Control Panel, go to System -> Files -> Storage Settings

     
    Then we click on Configurations:

     
    and then on Create New on the right side.
    Then we select Amazon S3 and we fill the needed info as:

     
    When you click Save if you get any warnings or errors then you have to check again the tutorial as you may forgot something or may have a typo somewhere...
    If you save it without any issues then you are ready to use it by going to: System -> Files -> Storage Settings
    and select a category with not many images for example Icons & Logos or anything else with a few images and from the drop down options the: Amazon S3:superbucket
     

     
    Then wait for the automated task to transfer your files to the Cloud and check if all are ok !
    If yes then you can proceed with the rest categories.
     
    *Keep only at your server your theme resources:

     
    Keep in mind that if you have a lot of GB of files it may take a long time for the transfer !
     
    It may help to go to the Dashboard and run manually the process to get the files transferred faster.

    *Attachments and Downloads may not work out of the box (don't use them on my test forum and i don't know for sure) and you may need to use the addon S3 Compatible Downloads:
     
    I hope that you will benefit from this tutorial and get better performance while saving space on your main server and a lot of money 🙂
    Backblaze is much more stable than Wasabi!
    It also includes up to 10GB free storage, so you can test it easily !
    Credits to: @Joel R and @Martin A.
    Enjoy !
  22. Like
    ASTRAPI got a reaction from sobrenome in Recommend Usage of Amazon S3?   
    True. It is expensive !!!
    $250 for a VPS?
    For 250$ i can get this dedicated server:
    2x Intel® Xeon® E5 2640 v4
    192 GB DDR4 ECC
    5x 500 GB SSD - Hardware Raid
     
  23. Thanks
    ASTRAPI got a reaction from Gauravk in Recommended Server OS for IPB   
    Hello Gauravk
    Invision will work on any system that can run a Web server, Php, Mysql e.t.c so it will work on all 🙂
    My recommendation is to use Centos as you will find a lot of info online if you need any help and it is very stable and well known as recommended OS for web servers.
    A lot of scripts also are developed for Centos. If you are using a ready to use solution like a control panel just check which version it supports. Centos 7 or 8.
    If you are using a custom Installation then you may prefer to go with Centos 8 as it will be a bit faster due to the newer gcc and a few more libraries that will help in performance.
    Centos 7 is fine and i use it also....
    Have a nice day 🙂
  24. Like
    ASTRAPI got a reaction from FabioPaz in What's the best approach to migrate a IPB minimal downtime?   
    You can use Cloudflare that will help a lot your forums as a CDN and has also some nice one click optimizations and they offer a free plan or you can use it only for the DNS records.
    Dns records changes are getting active in seconds.
  25. Like
    ASTRAPI got a reaction from Urfe in Community Guide on Setting Up Backblaze and CloudFlare   
    Hello 🙂
    (This is a community guide on how to setup Backblaze and Cloudflare, as a significantly cheaper replacement for Amazon S3 and Cloudfront.  The author has no affiliate arrangement with any of the companies listed in the guide and offers the guide as a free community resource.  You should consult with your hosting provider and / or server administrator before proceeding with the guide.)
    The tutorial is tested with the latest version of Invision 4.5.4 !

    Invision Community allows a file storage configuration with Amazon S3 and a content distribution network (CDN) of your choice:
     
    WHAT IS BACKBLAZE?
     

     
    Backblaze is an infinitely Scalable B2 Cloud Storage. Backblaze B2 is enterprise-grade, S3 compatible storage that companies around the world use to store and serve data. Backblaze's service works with native APIs, CLI, and GUI; you can move and manage data with minimal coding. Their service provides fast access all the time; there is no need to accept delays or pay speed surcharges. It can also support HIPAA compliant storage with their Business Associates Agreement (BAA). B2 is compatible at ¼ the cost of AWS S3 with no hidden fees or minimums.
     
    Backblaze is an award winning cloud storage provider for 2020 !
     

     
    Pricing:
     

    Based on their latest pricing, it is very cheap at around 5$ per 1TB storage per month! There is a cost for direct downloads (bandwidth) at 0.01$ per GB but it will not affect us as we will use Cloudflare and all files will be served from Backblaze to Cloudflare and then to users that is totally free 🙂
    Be careful if you have any custom direct downloads that bypass Cloudflare. If you link to custom downloads directly, you will be charged for bandwidth. All default Invision files should go through Cloudflare. I am using Backblaze for a few of my clients and they never charged anything extra as all Invision files are going through Cloudflare as expected. Please monitor your balance after a few days just to be sure!
     
    GUIDE:
    BEFORE PROCEEDING, PLEASE BACKUP YOUR DATA FIRST!
     
    STEP 1: Create a bucket on Backblaze
    First we need to sign up at Backblaze Cloud: https://www.backblaze.com/b2/sign-up.html
    You will need a phone number to activate your account:

    After the activation of the account we will need to create a bucket that will host our files.
     
    On the Buckets sections we click on Create a Bucket:

     
    Then we add a name for our bucket. Recommendation: avoid dots (.) in the bucket name.
     
    On the next screen we type a Bucket name and we select Public and then we click at Create a Bucket.

     
     
    After that under the Create a Bucket we should have our Bucket.
     
    Now we must keep a note of the ENDPOINT:

     
     
    Now we need to get our Bucket access keys from the App Keys menu. At the bottom we click at Add a New Application Key:

     
     
    At the new screen we select a anything as a key name and we keep selected the Read and Write access and wee click at Create New Key:

     
     
    Then you will see there only once the KeyID and the Application Key that we must keep a note of them as we will need them later !

     
    As a last step we need to go to our bucket that we just created and upload an image. From the menu on the left we click on Browse Files and then we click on our bucket:

     
    Then we click on upload and we upload a simple file like an image...

     
    On the right side of the uploaded image we have to click at the info icon:

     
    At the pop up screen we need to keep a note for that part so copy it with the other notes that wee have already:

     
    That's it ! We created our bucket and we got the access info that we will need !
     
    STEP 2: Create a CNAME dns record at Cloudflare
     
    Now you have to login to Cloudflare and go to your DNS tab from the top menu and then click Add record:
     

     
    We use as Type the Cname and as Name the cdn and as Target the info that we got from the pop on the previous step in the tutorial above:

     
    After saving that DNS record we should have that:

     
    Now for security reasons we have to go to the page Rules on the top menu and create two rules:

    RULE 1:
    Just replace your domain and the bucket name that you create:

     
    RULE 2:
    Just replace your domain:

     
    The final result should be like this:

     
    Keep in mind the order of the rules as if you set the second rule as 1 it will not work and your forum images will not work as page rules uses priority. This is important!
    That's it for the Cloudflare part!
     
    STEP 3: Configure Invision to use the Backblaze Cloud
    From Invision Admin Control Panel, go to System -> Files -> Storage Settings

     
    Then we click on Configurations:

     
    and then on Create New on the right side.
    Then we select Amazon S3 and we fill the needed info as:

     
    When you click Save if you get any warnings or errors then you have to check again the tutorial as you may forgot something or may have a typo somewhere...
    If you save it without any issues then you are ready to use it by going to: System -> Files -> Storage Settings
    and select a category with not many images for example Icons & Logos or anything else with a few images and from the drop down options the: Amazon S3:superbucket
     

     
    Then wait for the automated task to transfer your files to the Cloud and check if all are ok !
    If yes then you can proceed with the rest categories.
     
    *Keep only at your server your theme resources:

     
    Keep in mind that if you have a lot of GB of files it may take a long time for the transfer !
     
    It may help to go to the Dashboard and run manually the process to get the files transferred faster.

    *Attachments and Downloads may not work out of the box (don't use them on my test forum and i don't know for sure) and you may need to use the addon S3 Compatible Downloads:
     
    I hope that you will benefit from this tutorial and get better performance while saving space on your main server and a lot of money 🙂
    Backblaze is much more stable than Wasabi!
    It also includes up to 10GB free storage, so you can test it easily !
    Credits to: @Joel R and @Martin A.
    Enjoy !
×
×
  • Create New...