Search index 4.8 gig, reputation index 1.1 gig - too big?

[Sheffielder]

My search index table is 4.8 gig

My reputation index is currently 1.1 gig

Are these too large?

What's everyone elses looking like?

[bfarber]

Define "too large".

If you have a large site, then those tables may be large. If you do not have a large site, then those sizes seem excessive to me. It's all contextually dependent upon details about your site which you haven't shared.

[Sheffielder]

Ah fair enough.

I have a fairly large site but just saw the sizes and wondered if something was set wrong in the site settings as that's happened to me before with things like error logs running up gigs worth of space

[Makoto]

No, it's normal for those tables to grow in size according to the size of your community. They're not logging tables, they contain actual data.

Your search index will grow according to how much content you have on your site, not much you can do about that other than move to Elasticsearch and have all your search data stored there. But you'll still end up needing to store about the same amount of data in memory when going that route.

Reputation index is just records of who has given reputation on your site. That is rather large, but that likely just means the reputation system is very heavily used in your community.

[Sheffielder]

That’s great and easy to understand so thank you I really appreciate that and thanks for the reply!

[Sheffielder]

That’s great and easy to understand so thank you I really appreciate that and thanks for the reply!

[bfarber]

For the search index if the size is a concern, you can configure your site to only store the last X days in the search index (e.g. you could limit to the last 365 days of data, but note that you won't be able to search for content older than this if you do).