Sonya* Posted May 20 Posted May 20 We have an option not to index a page: If you place a database on such page, it will be still added to the sitemap. At the same time all the records in the database have the meta tag “noindex”. Google will mark the pages as excluded: Desired behavior: do not add a database on the page that should not be indexed to the sitemap.php SeNioR-, SoloInter and aia 1 2
Jim M Posted May 20 Posted May 20 Feel like this may be better utilized as a suggestion, rather than a bug. Technically, this is functioning by design. Just you're also not wanting it to show up in the sitemap file as well and not be indexed. As there are other items which utilize a sitemap file as well, not just search index spiders.
Sonya* Posted May 20 Author Posted May 20 5 minutes ago, Jim M said: As there are other items which utilize a sitemap file as well, not just search index spiders. What items? 5 minutes ago, Jim M said: a suggestion, rather than a bug It is a bug, Jim. You are speaking of crawling efficiency all the time. In this case, you give search engines a suggestion to index something, that they should not index. It is not effective. It spends crawling quota for nothing. 😞 aia, Maxxius, G17 Media and 1 other 2 2
Jim M Posted May 20 Posted May 20 13 minutes ago, Sonya* said: It is a bug, Jim. You are speaking of crawling efficiency all the time. In this case, you give search engines a suggestion to index something, that they should not index. It is not effective. It spends crawling quota for nothing. 😞 Please note, I'm not stating you're wrong that the option shouldn't be there. I'm just stating it is currently working as intended. I have moved this for you to Feedback so it can be evaluated for a new feature addition.
Sonya* Posted May 20 Author Posted May 20 Thank you! If you would like an example on my live site. The database ID=14. It has 102 records that should not be crawled. New records are submitted daily. I do want to show the entries to the guests. But I do not want them to be indexed. That's my dilemma. To avoid crawling waste, I will now remove the guest permission from page and database. It's a pity, as it's a nice feature that helps me to attract new users. 😞 SeNioR- 1
Marc Posted May 21 Posted May 21 I've added this as a bug report for you. As Jim said, technically its working as written at present. However it does make little sense I agree SoloInter and Sonya* 1 1
Recommended Posts