Invision Community 4: SEO, prepare for v5 and dormant account notifications By Matt Yesterday at 02:04 PM
AtariAge Posted December 7, 2009 Posted December 7, 2009 I ask Invision (Matt!): Can you please add an ACP option to the search system so that search terms are AND'ed together instead of using OR? I have nearly 2 million posts on my forum. Many searches simply return too many search results because of this default behavior, and I bet 98% of my users have no idea they need to prefix search terms with "+" in order to AND them together. I modified 2.3 in order to make this AND behavior the default default, but the more complex search system in 3.0 frightens me a bit in terms of making modifications. I already made one modification (to add a "My Posts" query that shows any threads you have posted in, returning titles only, something still missing from IP.Board) and I had to step very carefully to get that to work. Thanks for your consideration, it would make me and my users very happy. :) ..Al
Luke Posted December 8, 2009 Posted December 8, 2009 I ask Invision (Matt!): Can you please add an ACP option to the search system so that search terms are AND'ed together instead of using OR? I have nearly 2 million posts on my forum. Many searches simply return too many search results because of this default behavior, and I bet 98% of my users have no idea they need to prefix search terms with "+" in order to AND them together. I modified 2.3 in order to make this AND behavior the default default, but the more complex search system in 3.0 frightens me a bit in terms of making modifications. I already made one modification (to add a "My Posts" query that shows any threads you have posted in, returning titles only, something still missing from IP.Board) and I had to step very carefully to get that to work. Thanks for your consideration, it would make me and my users very happy. :) ..Al I may be wrong in this, but the only way you can do this is by modifying the search term before it's used. And that in itself can be a bit difficult considering you have any combination of > < ~ - + that can preceded a word, words can be wrapped in quotes (the character would come before the quote) and then you can have parenthesis for a sub expression. And I'm not really sure how you should treat other characters like periods, etc... I think any non-letter character is treated as space (which it depends on the language). So even if you could assume for a moment that the language is English and correctly add a "+" before each word that does not have something in-front of it already, you have to consider that other languages work differently, and IPS could not implement something that was language dependent. Also something else to consider: Fulltext has a 3 character limit, and really isn't that efficient anyway (it is compared to col LIKE '%blah%'). On top of that, there is a long list of stop words that are ignored. Your best bet is to use something like spynx if you want more accurate results. There may or may not be a MySQL setting to change the default behavior. I haven't found it (yet). If there is, you may be able to set it on a per-connection basis.
AtariAge Posted December 10, 2009 Author Posted December 10, 2009 I am using Sphinx, which gives me better results than MySQL's fulltext search, but still not ideal. I need to spend some additional time testing it, but I have many users complaining about the search right now, compared to my 2.3.6 forum (where I was also using Sphinx). At some point when I was running 2.x I modified the forum to default search terms to AND together, and I believe this was before I moved to Sphinx. This provided much better results and made the search more user friendly, which is what we all want, right? With Sphinx I'm running a 2-character minimum search term, which is great. Not sure how many stop words there are relative to MySQL, but it's not something I've run into on my forum. I run into it all the time here, though, which is annoying (don't get me started on how aggravating it is to do searches on this forum). ..Al
Management Matt Posted December 10, 2009 Management Posted December 10, 2009 It's on my list for 3.1. We did this for 2.3.6 if I recall correctly.
AtariAge Posted December 10, 2009 Author Posted December 10, 2009 It's on my list for 3.1. We did this for 2.3.6 if I recall correctly. Sounds good, thanks. I know you previously mentioned wanting to make some improvements to the search system, glad to hear this will be one of the changes. ..Al
windowssecrets.com Posted December 11, 2009 Posted December 11, 2009 Is there a tutorial on installing and using Sphinx with 3.0.x?
Andy Millne Posted December 11, 2009 Posted December 11, 2009 http://community.invisionpower.com/resources/official.html?record=181
windowssecrets.com Posted December 11, 2009 Posted December 11, 2009 http://community.invisionpower.com/resources/official.html?record=181 Perfect! Thank you.
akiy Posted January 13, 2010 Posted January 13, 2010 Hi Matt, It's on my list for 3.1. We did this for 2.3.6 if I recall correctly. How high is this feature (to provide an automatic "AND" to the search terms) for 3.1? I'm finding that using the current search engine here on community.invisionpower.com to be quite cumbersome at best, and find myself using "site:community.invisionpower.com" plus the search terms on Google a lot more often. I'm afraid the same sort of problems will exist under my IP.B installation and users will find using its search to be cumbersome as well, especially coming from vB. I believe that having a default "AND" operation for the search terms would alleviate some of the problems that I foresee... Thank you!
AtariAge Posted January 13, 2010 Author Posted January 13, 2010 I'm finding that using the current search engine here on community.invisionpower.com to be quite cumbersome at best, and find myself using "site:community.invisionpower.com" plus the search terms on Google a lot more often. I'm afraid the same sort of problems will exist under my IP.B installation and users will find using its search to be cumbersome as well, especially coming from vB. I believe that having a default "AND" operation for the search terms would alleviate some of the problems that I foresee... Unfortunately, using an external search does not help when you need to search forums that only customers have access to. I'm hoping we see a Blog post in the near future about the planned search improvements for 3.1. :) ..Al
dr. Jekyll Posted January 13, 2010 Posted January 13, 2010 Unfortunately, using an external search does not help when you need to search forums that only customers have access to. Infact, that's the limit :)
Recommended Posts
Archived
This topic is now archived and is closed to further replies.