Similarity Enhanced Transfer

Similarity Enhanced Transfer

Similarity-Enhanced Transfer (SET) is a technique for improving the speed at which peer-to-peer file sharing and content distribution systems can share data. Similarity-Enhanced Transfer (SET) works by spotting chunks of identical data in files that are an exact or near match to the one needed and transferring this data to the client if the 'exact' data is not present.

Method

SET uses a technique called handprintingcite web|url=http://www.cs.cmu.edu/~dga/papers/nsdi2007-set/|title= Exploiting Similarity for Multi-Source Downloads Using File Handprints|author=Himabindu Pucha, David G. Andersen, Michael Kaminsky|date=April 2007|accessdate=2007-04-15|publisher=Purdue Univ., Carnegie Mellon Univ., Intel Research Pittsburgh] - which is based on earlier techniques known as "Shingling" that have been used to filter junk e-mails - to seek out files that contain some of the data needed by the one a file-sharing program has requested. The SET system computes a handprint for each file, and can take chunks of data from files which are both identical and similar to the one being searched for. The lower similarity ranking that SET searches for, the more sources for that data are likely to be found. The extra overhead of locating these sources does not out-weigh the benefit of using them to help saturate the recipient's available bandwidth. Indeed, exploiting similar sources can significantly improve download time.

In tests, SET improved the transfer time of an MP3 music file by 71% and a 55Mb movie trailer went 30% faster using the researchers' techniques to draw from movie trailers that were 47% similar. SET could help most with less popular files, but it is not believed to improve transfer rates much for popular data, where there is already a huge set of people downloading it. Experiments suggest that in the other cases, SET can help a lot.

History

SET was developed by Professor David Andersen of Carnegie Mellon University, Ph.D student Himabindu Pucha, Purdue University and Dr. Michael Kaminsky, Intel Research Pittsburgh. Andersen believes that this technique could be immediately used by developers and applied to the BitTorrent file sharing system. [cite news |title= Speed boost plan for file-sharing|url= http://news.bbc.co.uk/2/hi/technology/6544919.stm|work= BBC News Online-Technology |publisher= BBC News|date= 2007-04-12 |accessdate=2007-04-13]

Application areas

SET could be used to improve the speed of:
* peer-to-peer file sharing
* content distribution systems
* cooperative web caching
* multicast
* anycast
* domain name services
* instant messaging

ee also

* BitTorrent

References

External links

* [http://www.cs.cmu.edu/~dga/ David Andersen] Prof. David Andersen's Home Page.
* [http://www.technologyreview.com/Infotech/18552/page1/ How to Speed Up Movie Downloads] , Technology Review, 2007-04-19
* [http://www.bittorrent.com/ BitTorrent] BitTorrent website.
* [http://www.flox-network.com Flox] A project that's similar to SET.


Wikimedia Foundation. 2010.

Игры ⚽ Нужно сделать НИР?

Look at other dictionaries:

  • Transfer of training — ; It refers to knowledge or abilities acquired in one area that helps problem solving or knowledge acquisition in other areas. Holding (1991) says that transfer of training occurs whenever the effects of prior learning influence the performance… …   Wikipedia

  • BitTorrent (protocol) — BitTorrent is a peer to peer file sharing protocol used to distribute large amounts of data. The initial distributor of the complete file or collection acts as the first seed . Each peer who downloads the data also uploads them to other peers.… …   Wikipedia

  • Set — has 464 separate definitions in the Oxford English Dictionary, the most of any English word; its full definition comprises 10,000 words making it the longest definition in the OED. Set may refer to:In mathematics and science:*Set (mathematics), a …   Wikipedia

  • SET — Saltar a navegación, búsqueda Las siglas SET pueden referirse a: Transacción electrónica segura (del inglés, Secure Electronic Transaction), un protocolo que se utiliza para el procesamiento de tarjetas de crédito; Transferencia mejorada por… …   Wikipedia Español

  • Life Sciences — ▪ 2009 Introduction Zoology       In 2008 several zoological studies provided new insights into how species life history traits (such as the timing of reproduction or the length of life of adult individuals) are derived in part as responses to… …   Universalium

  • Europe, history of — Introduction       history of European peoples and cultures from prehistoric times to the present. Europe is a more ambiguous term than most geographic expressions. Its etymology is doubtful, as is the physical extent of the area it designates.… …   Universalium

  • India — /in dee euh/, n. 1. Hindi, Bharat. a republic in S Asia: a union comprising 25 states and 7 union territories; formerly a British colony; gained independence Aug. 15, 1947; became a republic within the Commonwealth of Nations Jan. 26, 1950.… …   Universalium

  • climate — /kluy mit/, n. 1. the composite or generally prevailing weather conditions of a region, as temperature, air pressure, humidity, precipitation, sunshine, cloudiness, and winds, throughout the year, averaged over a series of years. 2. a region or… …   Universalium

  • United Kingdom — a kingdom in NW Europe, consisting of Great Britain and Northern Ireland: formerly comprising Great Britain and Ireland 1801 1922. 58,610,182; 94,242 sq. mi. (244,100 sq. km). Cap.: London. Abbr.: U.K. Official name, United Kingdom of Great… …   Universalium

  • Western architecture — Introduction       history of Western architecture from prehistoric Mediterranean cultures to the present.       The history of Western architecture is marked by a series of new solutions to structural problems. During the period from the… …   Universalium

Share the article and excerpts

Direct link
… Do a right-click on the link above
and select “Copy Link”