Sonya* Posted July 27, 2019 Posted July 27, 2019 @bfarber, it is not about how forums are set and visible to guests. There is a feature in Adsense, where you can provide access credentials, so that adsense crawler can login and see the content in the login-protected area. But this does not work in IPS. Even providing right credentials, login attempts of adsense crawler fail in IPS. Stormlilly 1
bfarber Posted July 29, 2019 Posted July 29, 2019 On 7/27/2019 at 5:38 AM, Sonya* said: @bfarber, it is not about how forums are set and visible to guests. There is a feature in Adsense, where you can provide access credentials, so that adsense crawler can login and see the content in the login-protected area. But this does not work in IPS. Even providing right credentials, login attempts of adsense crawler fail in IPS. I understand that....but that's not what the previous post said, so I responded to clarify. sobrenome 1
LemonGrenade Posted July 30, 2019 Posted July 30, 2019 A possible answer? I'm not sure if 'mediapartners' is included in the bots. DawPi and sobrenome 2
Sonya* Posted July 30, 2019 Posted July 30, 2019 1 hour ago, LemonGrenade said: A possible answer? I'm not sure if 'mediapartners' is included in the bots. I am afraid, this app changes just display of the bots group. It does not log in the bots as if it were real members. To get rid of Adsense warning, the adsense bot should be really logged in. Or it still cannot see the content beyond login. I am not sure, if login via REST can solve the issue 🤔
LemonGrenade Posted July 30, 2019 Posted July 30, 2019 2 minutes ago, Sonya* said: I am afraid, this app changes just display of the bots group. It does not log in the bots as if it were real members. Ah thanks Sonya, I was on the belief that this would do just that, I wondered why it wasn't that popular 😐
Daniel F Posted July 30, 2019 Posted July 30, 2019 No, it can't login via REST, but it's really not that hard. There are AFAIK 2 MP developers who accomplished this (I'm also using a similar way by having an extra login form for the bot without CSRF protection) but we're unfortunately not allowing such resources in our marketplace, because they're literally adding a "backdoor" to your installation 😉
LemonGrenade Posted July 30, 2019 Posted July 30, 2019 Doesn't seem to be working anymore by looking at that topic.
Nathan Explosion Posted July 30, 2019 Posted July 30, 2019 1 hour ago, LemonGrenade said: Doesn't seem to be working anymore by looking at that topic. It works fine for its purpose, which is to allow your Google Adsense configured login to bypass csrf protection.
LemonGrenade Posted July 30, 2019 Posted July 30, 2019 Ah I didn't realise it still works. Does it work okay on discover/unread to your knowledge?
Stormlilly Posted August 2, 2019 Posted August 2, 2019 (edited) On 7/27/2019 at 12:24 AM, bfarber said: You can display ads to logged in members, however if Adsense requires that a page be guest-viewable in order for ads to display there, then any pages which guests are unable to view would not be able to display ads. Some sites lock everything down and only logged in users can access basically anything. Some sites are pretty much wide open, guests just can't post. There's a lot of variation in how a site can be configured, so it's hard to give a one size fits all answer. In order to display ads to logged in members the Adsense Crawler needs authentication (the crawler needs access via a login as explained in Adsense tutorials). To clarify, is IPS Forums setup to allow Google Adsense Crawler, thus does it have the ability to allow adsense to show to logged in members? Having the ability to show Adsense ads to our members should be out of the box, wouldn't everyone agree? On 7/27/2019 at 7:38 PM, Sonya* said: @bfarber, it is not about how forums are set and visible to guests. There is a feature in Adsense, where you can provide access credentials, so that adsense crawler can login and see the content in the login-protected area. But this does not work in IPS. Even providing right credentials, login attempts of adsense crawler fail in IPS. @Sonya* explains this further. Edited August 2, 2019 by Stormlilly
Sonya* Posted August 2, 2019 Posted August 2, 2019 (edited) On 7/30/2019 at 12:15 PM, Daniel F said: No, it can't login via REST, but it's really not that hard. There are AFAIK 2 MP developers who accomplished this (I'm also using a similar way by having an extra login form for the bot without CSRF protection) but we're unfortunately not allowing such resources in our marketplace, because they're literally adding a "backdoor" to your installation 😉 I have tried it this way, but the account for the Crawler has been blocked by IPS after three false login. Is it really only login, where CSRF is checked or the session as well? Is it sufficient to bypass CSRF for the login only? Edited August 2, 2019 by Sonya*
LemonGrenade Posted August 2, 2019 Posted August 2, 2019 13 hours ago, Stormlilly said: Having the ability to show Adsense ads to our members should be out of the box, wouldn't everyone agree? Very true. It's been built into phpBB for years. While IPB is far superior now, this is a let-down. Stormlilly 1
TheWorldNewsMedia.org Posted August 3, 2019 Posted August 3, 2019 @IPS can we get some eyes on this issue. Your forum owners need to make $ to keep you in business over the long term. Which brings up another question..... How much of IPS total revenue is really dependent on Google Adsense? Guesses anyone? 90%? Stormlilly 1
newbie LAC Posted August 3, 2019 Posted August 3, 2019 18 hours ago, Sonya* said: Is it really only login, where CSRF is checked or the session as well? Is it sufficient to bypass CSRF for the login only? Yes.
bfarber Posted August 3, 2019 Posted August 3, 2019 On 8/1/2019 at 8:28 PM, Stormlilly said: In order to display ads to logged in members the Adsense Crawler needs authentication (the crawler needs access via a login as explained in Adsense tutorials). To clarify, is IPS Forums setup to allow Google Adsense Crawler, thus does it have the ability to allow adsense to show to logged in members? Having the ability to show Adsense ads to our members should be out of the box, wouldn't everyone agree? @Sonya* explains this further. But that's not what was asked, and the post is very misleading. Either way, the status of the original inquiry has not changed. But many clients do in fact use Adsense. I'll leave you to draw your own conclusions, however adsense does not need to log in to your site to display ads to logged in users - it needs to log in to your site if you display ads in areas where only logged in users can access. That is an important and material difference to the discussion. In other words, if you only display ads in areas that are accessible to guests (whether you display ads to guests, logged in members, or both), then you do not need to try to get the adsense crawler to log in to your site. Stormlilly 1
LittleFang Posted October 27, 2019 Posted October 27, 2019 Any word on getting adsense to crawl logged in pages? I've tried all previous ideas.
MSUKForum Posted November 24, 2019 Posted November 24, 2019 I would also like to know how to setup Adsense Crawler for login required areas. or... a way of disabling adverts in login areas so I don't have Adsense creating an empty box.
Pescao6 Posted March 27, 2020 Posted March 27, 2020 On 3/8/2013 at 1:04 AM, Christopher Stanley said: I would like this feature as well. I am getting around 1000 failed crawls a day from google. This explains so much. 😲 Support for this feature to be added. 👍 On 12/17/2015 at 3:04 AM, Markus Jung said: Can you tell me the settings for IPS 4? I tried: Site URL: http://www.site.de/ Login URL: http://www.site.de/login/ Method: POST Parameter auth = username I created for the AdSense bot password = password I created for the AdSense bot But this is not working. IPS 4 currently does not support any authenticated methods for Google to use to login. ☹️
Jirinex Posted March 31, 2020 Posted March 31, 2020 On 3/27/2020 at 11:59 PM, Pescao6 said: IPS 4 currently does not support any authenticated methods for Google to use to login. ☹️ Any update on this? Still there no support for authentication method for Google's crawler?
CoffeeCake Posted March 31, 2020 Posted March 31, 2020 2 hours ago, Jirinex said: Any update on this? Still there no support for authentication method for Google's crawler? Yes, that would be good. Who are these developers that have made such a plugin?
My Sharona Posted February 11, 2021 Posted February 11, 2021 On 12/27/2018 at 7:15 AM, Nathan Explosion said: I've put together a plugin which handles this in a different location, making it hookable - have sent a new copy of it to @Mopar1973Man to try it out. If anyone would like a copy then please PM me directly. I won't be releasing it to the MarketPlace, as it does circumvent the security which IPS has built in to the product (albeit for only one configured account) - all I ask is you chuck me a beer 😉 Just wanted to give Nathan a little bit of love here and tell anyone that may need this, that it does indeed work. Nathan Explosion and balazsp 2
Redmak Posted May 4, 2023 Posted May 4, 2023 On 1/11/2019 at 10:01 AM, Nathan Explosion said: In the same way - give the url that they can access (you can add more, not just one) with the credentials they are allowed to use (and make sure that the account has the access to view those areas) Do you still have this plugin and does it still work on the latest IPB? I would like the AdSense Crawler plugin if possible.
Nathan Explosion Posted May 4, 2023 Posted May 4, 2023 Pretty sure I sent it to you previously and we had a discussion about all that. Anyway... Do I still have it? Yep, somewhere on a backup. Does it still work on the latest? No idea - I don't use it, and several years ago it became difficult to test it on the adsense site to confirm it was working "AdSense Crawler plugin" - it's not an adsense crawler plugin. It's a security-weakening plugin that removes CSRF check on a specific account that is then used by you to configure a Adsense to login. Someone who still uses can comment on no.2 above and advise if it still works - if it does, then I'll dig it out when I've got time to look through backups and send it over. Redmak and SeNioR- 2
Recommended Posts