Surface Web

Surface Web

The surface Web (also known as the visible Web or indexable Web) is that portion of the World Wide Web that is indexed by conventional search engines. The part of the Web that is not reachable this way is called the deep Web. Search engines construct a database of the Web by using programs called "spiders" or Web crawlers that begin with a list of known Web pages. The spider gets a copy of each page and "indexes" it, storing useful information that will let the page be quickly retrieved again later. Any hyperlinks to new pages are added to the list of pages to be "crawled". Eventually all reachable pages are indexed, unless the spider runs out of time [ [http://www.sitepoint.com/article/indexing-limits-where-bots-stop| Search Engine Indexing Limits] ] or disk space. The collection of reachable pages defines the "surface Web".

For various reasons (e.g., the Robots Exclusion Standard, links generated by JavaScript and Flash, password-protection) some pages can not be reached by the spider. These 'invisible' pages are referred to as the deep Web.

A recent study [ [http://www.cs.uiowa.edu/~asignori/web-size/| Univ. of Iowa study (Jan 2005)] ] queried the Google, MSN, Yahoo!, and Ask Jeeves search engines with search terms from 75 different languages and determined that there were over 11.5 billion web pages in the publicly indexable Web as of January 2005.

As of June 2008, the indexed web contains at least 63 billion pages. [ [http://www.worldwidewebsize.com/ The size of the World Wide Web] ]

References

ee also

*Lightnet


Wikimedia Foundation. 2010.

Игры ⚽ Поможем написать курсовую

Look at other dictionaries:

  • Surface Web — Unter dem Begriff Surface Web oder Visible Web (dt.: „Oberflächen Web“ bzw. „Sichtbares Web“) versteht man denjenigen Teil des World Wide Web, der allgemein zugänglich ist. Es besteht also aus denjenigen Webseiten und Dokumenten, die von… …   Deutsch Wikipedia

  • Surface-Link — Die Begriffe Surface Link und Deep Link (deutsch wörtlich „Oberflächenverknüpfung“ und „tiefe Verknüpfung“) werden verwendet, um Hyperlinks zu kategorisieren: Ein Surface Link verweist auf die Eingangsseite einer Internetpräsenz, ein Deep Link… …   Deutsch Wikipedia

  • Surface Link — Die Begriffe Surface Link und Deep Link (deutsch wörtlich „Oberflächenverknüpfung“ und „tiefe Verknüpfung“) werden verwendet, um Hyperlinks zu kategorisieren: Ein Surface Link verweist auf die Eingangsseite einer Internetpräsenz, ein Deep Link… …   Deutsch Wikipedia

  • Surface Links und Deep Links — Die Begriffe Surface Link und Deep Link (deutsch wörtlich „Oberflächenverknüpfung“ und „tiefe Verknüpfung“) werden verwendet, um Hyperlinks zu kategorisieren: Ein Surface Link verweist auf die Eingangsseite einer Internetpräsenz, ein Deep Link… …   Deutsch Wikipedia

  • Surface mining — is a type of mining in which soil and rock overlying the mineral deposit are removed. It is the opposite of underground mining, in which the overlying rock is left in place, and the mineral removed through shafts or tunnels. Surface mining is… …   Wikipedia

  • Surface science — is the study of physical and chemical phenomena that occur at the interface of two phases, including solid liquid interfaces, solid gas interfaces, solid vacuum interfaces, and liquid gas interfaces. It includes the fields of surface chemistry… …   Wikipedia

  • Surface piercing — Surface piercings are any body piercings that take place on the surface of the body through areas which are not particularly concave or convex, where the piercing canal transverses a surface flap of skin, rather than running completely through a… …   Wikipedia

  • Surface weather observation — Surface weather observations are the fundamental data used for safety as well as climatological reasons to forecast weather and issue warnings worldwide. [Office of the Federal Coordinator of Meteorology. [http://www.ofcm.gov/fmh 1/pdf/B CH2.pdf… …   Wikipedia

  • Web mapping — is the process of designing, implementing, generating and delivering maps on the World Wide Web and its product. While web mapping primarily deals with technological issues, web cartography additionally studies theoretic aspects: the use of web… …   Wikipedia

  • Surface of atlantic — Pays d’origine Montréal,  Québec …   Wikipédia en Français

Share the article and excerpts

Direct link
… Do a right-click on the link above
and select “Copy Link”