Invision Community 4: SEO, prepare for v5 and dormant account notifications By Matt Monday at 02:04 PM
Donkerrood Posted August 29, 2012 Posted August 29, 2012 You might be aware of this already, but it is a request that would be highly appreciated by myself and I think by the rest of the community as well. On my forums, I have specific forums which are not accessible for guests and also not for the google search crawler, because I prefer this forums not to be searchable through google. However, it would be great if we could set separate access (f.i. as a separate user group) for the AdSense crawler, because irrespective of whether you can google these private forums, I want the ads on these forums to be as relevant as possible. The login feature of the adsense crawler doesn't work with IPB, as far as I know. Please IPS, could you include code that recognizes the AdSense crawler and assign it to a specific user group? Thanks! The Old Man, SeNioR-, Aussie Cable and 2 others 5
lordi Posted August 29, 2012 Posted August 29, 2012 yeah, I have the exact condition, waiting respond Donkerrood 1
Christopher Stanley Posted March 8, 2013 Posted March 8, 2013 I would like this feature aswell. I am getting arounf 1000 failed crawls a day from google.
Donkerrood Posted October 15, 2013 Author Posted October 15, 2013 Bumping this topic to check whether anything like this will be included in the 4.0 Suite (A)
Michael Posted October 15, 2013 Posted October 15, 2013 More of an AdSense issue as opposed to an IP.Board issue: https://support.google.com/adsense/answer/161351?ctx=as2&rd=1 Mikey B 1
bfarber Posted October 16, 2013 Posted October 16, 2013 You can already give Adsense login credentials for your forum to account for forums that can't be accessed by a guest. 4.0 will also allow you to restrict where ads show, which can be used to disable ads in non-guest forums if you prefer. MADMAN32395, Donkerrood, rjbuzzing and 3 others 6
Marius Posted October 16, 2013 Posted October 16, 2013 4.0 will also allow you to restrict where ads show, which can be used to disable ads in non-guest forums if you prefer. A good thing! :thumbsup:
Donkerrood Posted October 16, 2013 Author Posted October 16, 2013 You can already give Adsense login credentials for your forum to account for forums that can't be accessed by a guest. 4.0 will also allow you to restrict where ads show, which can be used to disable ads in non-guest forums if you prefer. I tried it in all possible ways I could think of, but apparently AdSense is not able to crawl those pages (or I'm doing something wrong - most probable). Any how-to would be really appreciated! Thanks!
bfarber Posted October 17, 2013 Posted October 17, 2013 Unfortunately, that would likely require contacting Adsense to find out why they are unable to crawl your site once you have followed their instructions on supporting logins. https://support.google.com/adsense/answer/161351?hl=en&ref_topic=1348129
bluejag Posted October 25, 2013 Posted October 25, 2013 It would help if the instructions here identified login page, method and parameters concept. Wolfsider, Donkerrood and lordi 3
Wolfsider Posted November 22, 2013 Posted November 22, 2013 It would help if the instructions here identified login page, method and parameters concept. Month passed out! Today i get a same Crawler issues. I set index.php?app=core&module=global§ion=login&do=process as login url and ips_username ips_passowrd as parameters auth still doesent work, "test login" in adsense ui showing blank page please, provide us your support, we wait for it a whole month lordi 1
bfarber Posted November 22, 2013 Posted November 22, 2013 Unfortunately, that would likely require contacting Adsense to find out why they are unable to crawl your site once you have followed their instructions on supporting logins. https://support.google.com/adsense/answer/161351?hl=en&ref_topic=1348129 I have already said, if they are getting a blank white page, you will likely need to check your error logs and/or contact adsense to find out why. This is a feature that THEY have built (for the purpose discussed in this topic, as well as others), it's not something *we* support. If you copied and pasted your form fields, I can say off the top of my head "passowrd" is misspelled, however I wouldn't expect that to throw a blank white page at adsense. Unfortunately, this is not something we can provide much support on. If the feature Adsense provides is not working correctly, you should let them know. MADMAN32395 1
Wolfsider Posted November 25, 2013 Posted November 25, 2013 Adsense send simple POST request with parameters and values. We don't want ip staff to debug or support adsense for us, we want to know: URL to send POST request Parameters names and their values That's all. And that's a thing, that you must know.
Martin A. Posted November 25, 2013 Posted November 25, 2013 Try using index.php?app=core&module=global§ion=login instead.
Dmacleo Posted November 26, 2013 Posted November 26, 2013 Try using index.php?app=core&module=global§ion=login instead. wouldn't it be I thought I had read somewheres that ending &do=login was important but you would know better than I.
Martin A. Posted November 26, 2013 Posted November 26, 2013 Both of them shows the same form. I just think you need to point the crawler to the form, not the page that processes it, as there is one vital parameter needed to process it which you can't predict, a unique hash key.
Wolfsider Posted November 26, 2013 Posted November 26, 2013 It is really seems to be google bug, because i made some modifications in han_login, so auth_key is not being cheked while authentifications and any post request with http://www.mysite.com/index.php?ips_username=GoogleCrawler&ips_password=password&app=core&module=global§ion=login&do=process ends up with successful authorisation but google is still shows blank page in authorisation test anyone knows, where i must post my issue for google? in google groups? InvisionDevTest 1
Dmacleo Posted November 26, 2013 Posted November 26, 2013 Both of them shows the same form. I just think you need to point the crawler to the form, not the page that processes it, as there is one vital parameter needed to process it which you can't predict, a unique hash key. ok thanks for explain :)
Joriz Posted March 19, 2014 Posted March 19, 2014 Sorry for the bump. But I think the following works. I'm currently testing it. https://board-url/index.php?app=core&module=global§ion=login&do=process POST ips_username=GoogleBot ips_password=the password you set for the bot auth_key=880ea6a14ea49e853634fbdc5015a024 rememberMe=1 As far I understand the auth_key is always 880ea6a14ea49e853634fbdc5015a024 for guests. Donkerrood 1
Donkerrood Posted March 19, 2014 Author Posted March 19, 2014 As far I understand the auth_key is always 880ea6a14ea49e853634fbdc5015a024 for guests. Can someone from IPS confirm this? InvisionDevTest 1
AnonymousDev Posted June 27, 2014 Posted June 27, 2014 When running the "Test login" from the AdSense Crawler Login setup does it actually show the page signifying a successful login? I can't get it to display. I believe all settings are correct according to the above comments. I've tried the login url "index.php?app=core&module=global§ion=login" as "index.php?app=core&module=global§ion=login&do=process" and "index.php?app=core&module=global§ion=login" haven't worked either.
xtech Posted August 22, 2014 Posted August 22, 2014 Was anyone able to get this working and can share the settings? I have set the crawler access, it can access the site properly, nevertheless it says i have to have my site verified with Webmaster Tools, which i do have (with all methods). Despite that it says it failed to verify site ownership. Scratching my head about this...
Recommended Posts