AlexWright Posted December 6, 2020 Share Posted December 6, 2020 Is there a way to run the background processes at server level? Run Manually takes too long to start and runs into a php limit. We're moving about 152,000 image files from the s3 back onto the server. Any help appreciated! Thanks, Alex Link to comment Share on other sites More sharing options...
Nathan Explosion Posted December 6, 2020 Share Posted December 6, 2020 Set up a CRON job, as per settings in the ACP Link to comment Share on other sites More sharing options...
AlexWright Posted December 6, 2020 Author Share Posted December 6, 2020 20 minutes ago, Nathan Explosion said: Set up a CRON job, as per settings in the ACP The problem is the cron job just isn't fast enough. We're already using CRON to run tasks, which includes the Queue task, which handles the background processes. I'm wondering if there's a way to speed this up without using the web interface's Run Manually. Link to comment Share on other sites More sharing options...
VR6Pete Posted December 6, 2020 Share Posted December 6, 2020 What’s the reason for moving them back to local server storage ? Link to comment Share on other sites More sharing options...
AlexWright Posted December 7, 2020 Author Share Posted December 7, 2020 5 hours ago, VR6Pete said: What’s the reason for moving them back to local server storage ? Conversion to XenForo. Which, unfortunately, requires the files to be localhosted. VR6Pete 1 Link to comment Share on other sites More sharing options...
VR6Pete Posted December 7, 2020 Share Posted December 7, 2020 6 hours ago, AlexWright said: Conversion to XenForo. Which, unfortunately, requires the files to be localhosted. ahhh I see - Yes I had same issue as you with PHP memory being exhausted when running the job manually (moving localhost > S3) and I was able to set PHP limit to 512MB and completed pretty quickly after that. Link to comment Share on other sites More sharing options...
AlexWright Posted December 7, 2020 Author Share Posted December 7, 2020 5 hours ago, VR6Pete said: ahhh I see - Yes I had same issue as you with PHP memory being exhausted when running the job manually (moving localhost > S3) and I was able to set PHP limit to 512MB and completed pretty quickly after that. Yeah. Turned out not to matter anyways. Not enough space on the server. Invision's ACP showed 212 GB of space used for gallery...really it's more like 800 GB with the double copies of every item (small and large version plus original). I'm still wondering why the Invision widget showed total of 212 GB of gallery disk space, unless that's just originals? Seems kind of pointless to list just that if in fact the size is much larger. Link to comment Share on other sites More sharing options...
Recommended Posts