SecondSight Posted July 13, 2017 Share Posted July 13, 2017 Hello ! On my community, Pages' articles can be accessed by guests, but not by Google and other search bots... Search engines are part of a group, so I've had a look at the group's permissions but found nothing regarding Pages (I only found Forums, Gallery, Downloads, Calendar). How should I proceed to allow Pages access to search bots ? Thank you. Link to comment Share on other sites More sharing options...
opentype Posted July 13, 2017 Share Posted July 13, 2017 2 minutes ago, SecondSight said: On my community, Pages' articles can be accessed by guests, but not by Google and other search bots... Says who? Crawlers act like guests and see exactly the same things as guests. (Unless you disallow things in the robots.txt) Link to comment Share on other sites More sharing options...
SecondSight Posted July 13, 2017 Author Share Posted July 13, 2017 All board's topics, blogs' entries, images in my Gallery can be found in Google. But the content in Pages, which can be read as a guest, can't be found in search engines... I've checked the permissions for search engines and guests , in the ACP groups section and in the Pages' pages section and they are ok... This is my robots.txt content : Quote User-agent: * Disallow: /admin/ Disallow: /cache/ Disallow: /converge_local/ Disallow: /hooks/ Disallow: /ips_kernel/ Disallow: /retail/ Disallow: /public/style_captcha/ Disallow: /index.php?app=core&module=task Disallow: /index.php?app=forums&module=moderate§ion=moderate Disallow: /index.php?app=forums&module=extras§ion=forward Disallow: /index.php?app=members&module=chat Disallow: /index.php?&unlockUserAgent=1 Disallow: /*&module=search Allow: /*&search_tags= Disallow: /*app=core&module=global§ion=reputation Disallow: /*app=core&module=usercp Disallow: /*app=members&module=messaging Disallow: /*&p= Disallow: /*&pid= Disallow: /*&hl= Disallow: /*&start= Disallow: /*view__getnewpost$ Disallow: /*view__getlastpost$ Disallow: /*view__old$ Disallow: /*view__new$ Disallow: /*view__getfirst$ Disallow: /*view__getprevious$ Disallow: /*view__getnext$ Disallow: /*view__getlast$ Disallow: /*&view=getnewpost$ Disallow: /*&view=getlastpost$ Disallow: /*&view=old$ Disallow: /*&view=new$ Disallow: /*&view=getfirst$ Disallow: /*&view=getprevious$ Disallow: /*&view=getnext$ Disallow: /*&view=getlast$ Disallow: /*?s= Disallow: /*&s= Disallow: /index.php?app=core&module=global§ion=login&do=deleteCookies Disallow: /index.php?app=forums&module=extras§ion=rating Disallow: /index.php?app=forums&module=forums§ion=markasread Disallow: /*&do=who Disallow: /*§ion=dname Is there something wrong in it ? Thank you ! Link to comment Share on other sites More sharing options...
opentype Posted July 13, 2017 Share Posted July 13, 2017 Please post your site and a Pages URL that is missing. Link to comment Share on other sites More sharing options...
SecondSight Posted July 13, 2017 Author Share Posted July 13, 2017 Here is my board : http://forums-enseignants-du-primaire.com/ All articles in Pages are here : http://forums-enseignants-du-primaire.com/index.html/ Thank you. Link to comment Share on other sites More sharing options...
opentype Posted July 13, 2017 Share Posted July 13, 2017 3 hours ago, SecondSight said: All articles in Pages are here : http://forums-enseignants-du-primaire.com/index.html/ I am getting around 70 indexed results in Google from your Pages database – so I guess everything is working fine. P.S. Where do you got that robots.txt from? You don’t need 95% of all these rules. Link to comment Share on other sites More sharing options...
SecondSight Posted July 13, 2017 Author Share Posted July 13, 2017 Yes, I've checked and crawlers have indexed my articles. But I have to write my web site's domain name to make the articles appear... otherwise the articles don't show in the results. As for my board, the posts appear in the first position in the results. I'm going to make a search for robots.txt file and find the latest one. Thank you. Link to comment Share on other sites More sharing options...
opentype Posted July 13, 2017 Share Posted July 13, 2017 2 minutes ago, SecondSight said: But I have to write my web site's domain name to make the articles appear... otherwise the articles don't show in the results. Well that’s just low ranking, which has more to do with the actual content than any technical problems. That’s very different from what you claimed originally. Link to comment Share on other sites More sharing options...
SecondSight Posted July 13, 2017 Author Share Posted July 13, 2017 Ok. Thank you ! Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.