Webmasters Can Now Auto-Discover With Sitemaps

Kide83 · 04-14-2007, 03:44 PM

Since working with Google and Microsoft to support a single format for submission with Sitemaps, we have continued to discuss further enhancements to make it easy for webmasters to get their content to all search engines quickly.

All search crawlers recognize robots.txt, so it seemed like a good idea to use that mechanism to allow webmasters to share their Sitemaps. You agreed and encouraged us to allow robots.txt discovery of Sitemaps on our suggestion board. We took the idea to Google and Microsoft and are happy to announce today that you can now find your sitemaps in a uniform way across all participating engines. To do this, simply add the following line to your robots.txt file:

Sitemap: Please Register or Login to view links

Please provide the complete URL for your Sitemap on this line. We will pick it up wherever you put it in your robots.txt file. This directive is not specific to user-agent. If you have multiple Sitemaps, you can point to your Sitemap index file on this line. Details about the Sitemaps protocol including this addition are available on the protocol website -- Please Register or Login to view links.

If you prefer, you can continue to issue Sitemaps to Yahoo! Search by simply inputting the URL for your Sitemap and submitting. Or add feeds to a site you are already managing under 'My Sites' in Site Explorer. This also allows us to provide more feedback to you about what we are doing with the sitemap.

We're also happy to have some east coasters, Ask and IBM, announce their support for Sitemaps. The more the merrier!

We'll also be sharing more this week at SES NY.

If you have other thoughts about how we can collaborate with other search engines on standards such as robots.txt, we'd love to hear from you -- visit our suggestion board.

Priyank Garg
Product Manager, Yahoo! Search

Please Register or Login to view links

abhinav · 04-14-2007, 08:54 PM

Excellent idea to point the sitemap in robots.txt. I considered to submit my sitemap via an HTTP request but couldn't found

jackbdirty · 04-29-2007, 07:09 AM

yeah.. I installed a sitemap to my site for the alexa and google thing about 2 weeks ago. There was a problem with reading it with there bot.. so, i wrote alexa, and they got back with me in about two days saying that they were looking into the problem. I wrote them back this past Tuesday... still haven't heard back from them and wrote them back this morning.

Don't ever think they will get back to you. Sitemaps are cool.. but they aren't about service of getting back with you. Now,.. don't get me wrong. Go ahead and install a sitemap on your site; but if there is a problem, don't ever think that they will get back with you.

The google Gods..and Alexa have us by the balls in their eyes..lol

Jack

xxx · 05-02-2007, 11:51 AM

great article, thanks for sharing kide83

tonnyx666 · 05-10-2007, 12:52 AM

i'm not using sitemaps anymore - i have read that some webmasters think that using sitemap is red light for google these days

04-14-2007, 03:44 PM	#1
Kide83 Friendly Member :) ABF Member - Gold Join Date: Dec 2005 Location: EU Posts: 4,914 Points: 9,590 Bank: 0 Total Points: 9,590 Donate	Webmasters Can Now Auto-Discover With Sitemaps Since working with Google and Microsoft to support a single format for submission with Sitemaps, we have continued to discuss further enhancements to make it easy for webmasters to get their content to all search engines quickly. All search crawlers recognize robots.txt, so it seemed like a good idea to use that mechanism to allow webmasters to share their Sitemaps. You agreed and encouraged us to allow robots.txt discovery of Sitemaps on our suggestion board. We took the idea to Google and Microsoft and are happy to announce today that you can now find your sitemaps in a uniform way across all participating engines. To do this, simply add the following line to your robots.txt file: Sitemap: Please Register or Login to view links Please provide the complete URL for your Sitemap on this line. We will pick it up wherever you put it in your robots.txt file. This directive is not specific to user-agent. If you have multiple Sitemaps, you can point to your Sitemap index file on this line. Details about the Sitemaps protocol including this addition are available on the protocol website -- Please Register or Login to view links. If you prefer, you can continue to issue Sitemaps to Yahoo! Search by simply inputting the URL for your Sitemap and submitting. Or add feeds to a site you are already managing under 'My Sites' in Site Explorer. This also allows us to provide more feedback to you about what we are doing with the sitemap. We're also happy to have some east coasters, Ask and IBM, announce their support for Sitemaps. The more the merrier! We'll also be sharing more this week at SES NY. If you have other thoughts about how we can collaborate with other search engines on standards such as robots.txt, we'd love to hear from you -- visit our suggestion board. Priyank Garg Product Manager, Yahoo! Search Please Register or Login to view links __________________ ~~~ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. Page - Check out what makes me money & how To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. Submit Your Free Sites and Blogs to To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

04-14-2007, 08:54 PM	#2
abhinav Junior Member AdultBizForum's newbie Join Date: Apr 2007 Posts: 6 Points: 35 Bank: 0 Total Points: 35 Donate	Webmasters Can Now Auto-Discover With Sitemaps Excellent idea to point the sitemap in robots.txt. I considered to submit my sitemap via an HTTP request but couldn't found __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

04-29-2007, 07:09 AM	#3
jackbdirty Junior Member AdultBizForum's newbie Join Date: Mar 2007 Location: Tampa, Florida Posts: 21 Points: 230 Bank: 0 Total Points: 230 Donate	yeah.. I installed a sitemap to my site for the alexa and google thing about 2 weeks ago. There was a problem with reading it with there bot.. so, i wrote alexa, and they got back with me in about two days saying that they were looking into the problem. I wrote them back this past Tuesday... still haven't heard back from them and wrote them back this morning. Don't ever think they will get back to you. Sitemaps are cool.. but they aren't about service of getting back with you. Now,.. don't get me wrong. Go ahead and install a sitemap on your site; but if there is a problem, don't ever think that they will get back with you. The google Gods..and Alexa have us by the balls in their eyes..lol Jack __________________ *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

05-02-2007, 11:51 AM	#4
xxx Member AdultBizForum's newbie Join Date: Jul 2006 Posts: 88 Points: 289 Bank: 0 Total Points: 289 Donate	great article, thanks for sharing kide83 __________________ PM me if you're sick of amateurish web designers To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

05-10-2007, 12:52 AM	#5
tonnyx666 Senior Member ABF Member - Silver Join Date: Dec 2005 Posts: 527 Points: 1,154 Bank: 0 Total Points: 1,154 Donate	i'm not using sitemaps anymore - i have read that some webmasters think that using sitemap is red light for google these days __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. - Get Paid for Every Click You Send To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. - Make Kinky $$$ With Unique Fetish Sites To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. - 30+ High Converting Sites to Promote

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
To all art-nude, softcore & teen webmasters	True Alex	Adult Webmasters	0	11-28-2007 08:54 PM
Free Content For Webmasters	reddeye	Adult Webmasters	1	09-18-2007 09:38 PM
YakBucks serves out $50 to all our webmasters!	Evgenika	Adult Webmasters	4	06-16-2007 08:44 AM
Promote Online Dating Services For Extra Revenue!	growers	Adult Webmasters	0	03-20-2006 12:53 AM