|Spider View Tool:
Find out how Spider bots view your website. This
includes most major search bots including Google, MSN and Yahoo!
Many search engines use programs called robots to gather web
pages for indexing. These programs are not limited to a pre-defined list of
web pages, they can follow links on pages they find, which makes them a form
of intelligent agent. The process of following links is called
spidering, wandering, or gathering.