Search for content in message boards

Announcing Web Search

Replies: 31

Re: Announcing Web Search

Posted: 5 Aug 2011 12:53PM GMT
Classification: Query
In the interest of accuracy:
Brian Edwards wrote: "Interestingly, I haven't seen one request to not be crawled in the email so far."

Note the caveat "in the email". That does not mean "no one" has requested their site not be crawled. In fact, those interested may want to read a few posts in this thread
to see that Ancestry had crawled a very large genealogical group site WITHOUT any correspondence. Mr. Edwards admitted to "a few hundred" pages (NOT databases). If I remember correctly, it was 1700...
SubjectAuthorDate Posted
jaws1964 22 May 2011 5:51PM GMT 
jaws1964 22 May 2011 6:04PM GMT 
Brian Edwards 23 May 2011 5:22PM GMT 
jaws64 25 May 2011 12:03PM GMT 
Brian Edwards 27 May 2011 3:34PM GMT 
jaws1964 5 Aug 2011 6:53PM GMT 
WClayton43 10 Jun 2011 7:34PM GMT 
Brian Edwards 10 Jun 2011 10:13PM GMT 
JoMac53 16 Jun 2011 11:18AM GMT 
stonechat 18 Jun 2011 1:20PM GMT 
per page

Find a board about a specific topic