Spider - Web spider
A spider or Web crawler is a program that exhaustively surfs all the links from a page and returns them to another program for processing. For example, all of the Internet search engine sites rely on spider robots to discover new Web sites and add them to their index. Another typical use of a spider is by a publisher against his or her own site. The spider program makes sure that all of the links function correctly and reports dead links.
Back to the Glossary :: :: Back to Netdigix Computer support
|
|
|
|