Invision Community 4: SEO, prepare for v5 and dormant account notifications By Matt Monday at 02:04 PM
Mopar1973Man Posted July 17, 2018 Posted July 17, 2018 On 6/2/2018 at 8:28 AM, Morgin said: It would be ideal given Adsense has to be one of the most popular revenue generators for forums. Absolutely correct. Adsense produces way more profit than Viglink does. To me, Viglink is a joke. I know it would help my income a ton load if I could get Google Adsense logged into my site.
bpn Posted July 22, 2018 Posted July 22, 2018 As far as I can tell it's working on our forum. http:// is our domain (domain.com) Might not be necessary, stems from before we used https. But as long as it's working I do not dare to remove it... https:// is our forum folder (domain.com/forums)
Sergey_SV Posted July 23, 2018 Posted July 23, 2018 8 hours ago, bpn said: As far as I can tell it's working on our forum. http:// is our domain (domain.com) Might not be necessary, stems from before we used https. But as long as it's working I do not dare to remove it... https:// is our forum folder (domain.com/forums) Unfortunately this "crawling" sign is not guarantiing that crawler can access the site. I got this green mark too, but still crawler not accessing the site. Can you see the crawler in your login logs? Mopar1973Man 1
bpn Posted July 23, 2018 Posted July 23, 2018 (edited) You're sure right Sergey. Tried to build a new login, copied from the one that appears working. This gets status "Not crawling". So that green mark is misleading. I tried to build logins to SMS and VB-forums, same problem there. Quote Unfortuantely this will mean that you cannot use the AdSense login functionality unless it can read the CSRF from the page and supply it (I'm not familiar enough with AdSense to know if it can do this). Kind Regards, Stuart Silvester Invision Power Services, Inc. This is such an important issue that I think IPS should investigate it further. Edited July 23, 2018 by bpn Mopar1973Man 1
Sergey_SV Posted August 13, 2018 Posted August 13, 2018 Any updeate/promisses on this issue? It really a pity not to able to monetize the noticable part of the traffic. And really strange that IPB is not fuly compatible with most popular Adsystem ) Jaymez and Mopar1973Man 2
Mopar1973Man Posted August 21, 2018 Posted August 21, 2018 I'm just coming back to reply showing support for the need of this to be researched and solution provided for us. I know I'm losing income over this and would like to see a fix to this in the near future.
Sergey_SV Posted September 11, 2018 Posted September 11, 2018 Since there is no update on this topic from IPS, recently I found a small workaround, unfortunatelly it is not bringing the Adsensecrawler to locked forums, but allowing not to loose this part of the traffic completely and serve the static/other ads instead But I sill hop IPS will resolve this issue with Google. ))
Mopar1973Man Posted September 12, 2018 Posted September 12, 2018 I'd rather have a true fix instead of a band-aid that might fail...
Sergey_SV Posted September 13, 2018 Posted September 13, 2018 9 hours ago, Mopar1973Man said: I'd rather have a true fix instead of a band-aid that might fail... Fully agree, but I with given absence of ture fix and no promisses of it, I would rather not loose money)))
Owdy Posted October 2, 2018 Posted October 2, 2018 On 3/19/2014 at 2:02 PM, Joriz said: As far I understand the auth_key is always 880ea6a14ea49e853634fbdc5015a024 for guests. Seems its csrfKey now and its changes everytime? <input type="hidden" name="csrfKey" value="c5044f27fd3b835d14ab3f0bfe91fe90">
Mopar1973Man Posted October 8, 2018 Posted October 8, 2018 It would be nice if someone from the staff could comment on this and say if there will be a solution to this or not... Markus Jung and Owdy 2
Management Matt Posted October 9, 2018 Management Posted October 9, 2018 We use a CSFR key to prevent bots attempting to log in as you. Which is specifically what AdSense are trying to do. I'll speak to the team to see if there's something we can do, but we'd be looking to remove or mitigate protection designed to keep your accounts safe. SeNioR-, Owdy, Markus Jung and 2 others 3 2
Mike Gholson Posted November 9, 2018 Posted November 9, 2018 (edited) I'm seeing a lot of crawler errors as well, in relation to the pages that require a login. Features like /discover/unread and private forums mostly. Anyway, I don't want crawlers accessing our data behind logins, so, it looks like I need a directive to do this. Here's what Google says about it https://support.google.com/webmasters/answer/6062608?visit_id=636773196575520711-1843243888&rd=1: "You should not use robots.txt as a means to hide your web pages from Google Search results. This is because, if other pages point to your page with descriptive text, your page could still be indexed without visiting the page. If you want to block your page from search results, use another method such as password protection or a noindex directive." I then click on the noindex directive and get this page: https://developers.google.com/search/reference/robots_meta_tag It looks like the best way to hide pages is through a HTTP noindex directive. Do we have more information on how to add this 'noindex directive' to the areas we want to hide from crawlers? PS: I already have these pages in my robots.txt file, but, it seems Google is showing them anyway. Edited November 9, 2018 by Mike Gholson lordi 1
lordi Posted November 9, 2018 Posted November 9, 2018 I have the same problem with you @Mike Gholson i would like to see the solution also
bfarber Posted November 9, 2018 Posted November 9, 2018 13 hours ago, Mike Gholson said: I'm seeing a lot of crawler errors as well, in relation to the pages that require a login. Features like /discover/unread and private forums mostly. Anyway, I don't want crawlers accessing our data behind logins, so, it looks like I need a directive to do this. Here's what Google says about it https://support.google.com/webmasters/answer/6062608?visit_id=636773196575520711-1843243888&rd=1: "You should not use robots.txt as a means to hide your web pages from Google Search results. This is because, if other pages point to your page with descriptive text, your page could still be indexed without visiting the page. If you want to block your page from search results, use another method such as password protection or a noindex directive." I then click on the noindex directive and get this page: https://developers.google.com/search/reference/robots_meta_tag It looks like the best way to hide pages is through a HTTP noindex directive. Do we have more information on how to add this 'noindex directive' to the areas we want to hide from crawlers? PS: I already have these pages in my robots.txt file, but, it seems Google is showing them anyway. You can use the live meta tag editor to do this. From the AdminCP visit System > Site Promotion > Search Engine Optimization > Meta Tags (tab) lordi 1
Mike Gholson Posted November 20, 2018 Posted November 20, 2018 On 11/9/2018 at 6:21 AM, bfarber said: You can use the live meta tag editor to do this. From the AdminCP visit System > Site Promotion > Search Engine Optimization > Meta Tags (tab) Thanks @bfarber, I found that page. Do you know what I need to do so it doesn't show anything in /discover ? I do have an entry for it, so do I just remove it?
bfarber Posted November 21, 2018 Posted November 21, 2018 If you require support or assistance, I would encourage you to post in the appropriate peer feedback forum or submit a ticket. This area is more intended for suggestions for future changes in the software. 🙂
andavis Posted December 4, 2018 Posted December 4, 2018 Seems that adsense crawler is accessing correctly all the pages today. Can anyone else confirm this?
Unlucky Posted December 7, 2018 Posted December 7, 2018 Coming to this topic late. Has anyone got the solution to get this working? We would really like to add adverts on the messenger pages. Thanks
Recommended Posts