Jump to content

Google, etc. : Allowing access to Pages ?


SecondSight

Recommended Posts

Posted

Hello ! :)

On my community, Pages' articles can be accessed by guests, but not by Google and other search bots...

Search engines are part of a group, so I've had a look at the group's permissions but found nothing regarding Pages (I only found Forums, Gallery, Downloads, Calendar).

How should I proceed to allow Pages access to search bots ?

Thank you. :)

Posted
2 minutes ago, SecondSight said:

On my community, Pages' articles can be accessed by guests, but not by Google and other search bots...

Says who?

Crawlers act like guests and see exactly the same things as guests. (Unless you disallow things in the robots.txt)

Posted

All board's topics, blogs' entries, images in my Gallery can be found in Google. But the content in Pages, which can be read as a guest, can't be found in search engines...

I've checked the permissions for search engines and guests , in the ACP groups section and in the Pages' pages section and they are ok...

This is my robots.txt content :

Quote

User-agent: *
Disallow: /admin/
Disallow: /cache/
Disallow: /converge_local/
Disallow: /hooks/
Disallow: /ips_kernel/
Disallow: /retail/
Disallow: /public/style_captcha/
Disallow: /index.php?app=core&module=task
Disallow: /index.php?app=forums&module=moderate&section=moderate
Disallow: /index.php?app=forums&module=extras&section=forward
Disallow: /index.php?app=members&module=chat
Disallow: /index.php?&unlockUserAgent=1
Disallow: /*&module=search
Allow:      /*&search_tags=
Disallow: /*app=core&module=global&section=reputation
Disallow: /*app=core&module=usercp
Disallow: /*app=members&module=messaging
Disallow: /*&p=
Disallow: /*&pid=
Disallow: /*&hl=
Disallow: /*&start=
Disallow: /*view__getnewpost$
Disallow: /*view__getlastpost$
Disallow: /*view__old$
Disallow: /*view__new$
Disallow: /*view__getfirst$
Disallow: /*view__getprevious$
Disallow: /*view__getnext$
Disallow: /*view__getlast$
Disallow: /*&view=getnewpost$
Disallow: /*&view=getlastpost$
Disallow: /*&view=old$
Disallow: /*&view=new$
Disallow: /*&view=getfirst$
Disallow: /*&view=getprevious$
Disallow: /*&view=getnext$
Disallow: /*&view=getlast$
Disallow: /*?s=
Disallow: /*&s=
Disallow: /index.php?app=core&module=global&section=login&do=deleteCookies
Disallow: /index.php?app=forums&module=extras&section=rating
Disallow: /index.php?app=forums&module=forums&section=markasread
Disallow: /*&do=who
Disallow: /*&section=dname

Is there something wrong in it ?

Thank you ! :)

Posted

Yes, I've checked and crawlers have indexed my articles. :)

But I have to write my web site's domain name to make the articles appear... otherwise the articles don't show in the results. As for my board, the posts appear in the first position in the results.

I'm going to make a search for robots.txt file and find the latest one.

Thank you. :)

Posted
2 minutes ago, SecondSight said:

But I have to write my web site's domain name to make the articles appear... otherwise the articles don't show in the results.

Well that’s just low ranking, which has more to do with the actual content than any technical problems. That’s very different from what you claimed originally. 

 

Archived

This topic is now archived and is closed to further replies.

  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...