Posted May 25, 200718 yr Caching of ALL logs will lower resources and free up space on people's serversModerator LogsAdmin LogsAdmin Login LogsEmail Error LogsEmail LogsBot Logs Task Manager Logsand also to make sure the cache is always updatedadd a spot in the cache manager for each logI just tested this with Bot Logs on an IPB 2.2.2 dev forum and it freed up 2 queries and freed up 1MB fo space so if each log is 2 Queries then this will save 14 total queries maybe Matt or Brandon can comfirm as to total queries it takes to add those 7 logs to the DB
May 25, 200718 yr Huh - how would you cache logs? o.O Cache is meant to be used to store commonly accessed/requested data. Logs are not commonly accessed (as in, retrieved) data.Our spider logs yesterday, before we pruned them, were over 1 GB in size. Could you imagine trying to "cache" 1 GB of data.I'm not even sure what kind of cache you are referring to. memcache/alternative cache? If so, we couldn't feasibly store that much data in memcache, and it wouldn't help a single thing. A shutdown insert query to store a spider log isn't going to affect your site's speed in any way. And at most you might have 2-3 log insertions on a given page load, not 7. You aren't going to have a moderator log and an email log on the same page (it's just not possible with the code flow), nor will you ever have any of those with an admin log (other than possibly an email error log if an email was supposed to be sent, however even then an error is generally returned and the admin log wouldn't be inserted).All said and done, storing this data in an alternative cache wouldn't help speed in any way, and would very likely cause problems and corrupted logs.
May 25, 200718 yr o well I got it done no problems unless I am stupid and know nothingbut how can you saay caching 1GB it would not cache it like that if you set it up the way I think should be done it would cache it each visit per day likeMSN BOT.THEDATEit would never cache all at once it would cache per visit per bot per dayso saying 1GB is true but not caching the entire 1GB at 1 time it be over timein essence all I am doing is storing raw logs into a cached php file for later grabbing similar to how you cache the errors into a .cgi file
May 25, 200718 yr If you cache it into PHP files, you aren't saving any space. You are just moving it from the database to your disk storage space.
May 25, 200718 yr o well I got it done no problems unless I am stupid and know nothingbut how can you saay caching 1GB it would not cache it like that if you set it up the way I think should be done it would cache it each visit per day likeMSN BOT.THEDATEit would never cache all at once it would cache per visit per bot per dayso saying 1GB is true but not caching the entire 1GB at 1 time it be over timein essence all I am doing is storing raw logs into a cached php file for later grabbing similar to how you cache the errors into a .cgi fileOk, so you're talking about archiving then, not caching?If so, that could potentially be added as an extension to the current pruning settings we have (archive logs before pruning) however as Keith said it wouldn't save any space, it would be offloading it from MySQL to disk.It could help some areas, like loading the spider log pages in the ACP, if the data was moved to disk, however you wouldn't have access to the full spider logs - only the last x days or whatever it was set to.
Archived
This topic is now archived and is closed to further replies.