Frequency list

Frequency list

In computational linguistics, a frequency list is a sorted list of words (word types) together with their frequency, where frequency here usually means the number of occurrences in a given corpus. A short example could be:

the3789654
he 2098762
[...]
king 57897
boy 56975
[...]
outragious 76
[...]
stringyfy 5
[...]
transducionalify 1

It seems that Zipf's law holds for frequency lists drawn from longer texts of any natural language. Frequency lists are a necessary prerequisite for building of an electronic dictionary, which is by itself a prerequisite for a wide range of applications in computational linguistics.

German linguists define the "häufigkeitsklasse" (frequency class) of an item in the list using the base 2 logarithm of the ratio between its frequency and the frequency of the most frequent item. The most common item belongs to frequency class 0 (zero) and any item that is half as frequent belongs in class 1. In the example list above, the misspelled word outragious has a ratio of 76/3789654 and belongs in class 16.:N=0.5-log_2left(frac{ ext{Frequency of this item{ ext{Frequency of most common item ight)

See also

* Letter frequencies
* Most common words in English
* The Long Tail


Wikimedia Foundation. 2010.

Игры ⚽ Нужен реферат?

Look at other dictionaries:

  • List of road accidents — records serious road accidents: those which took a high death toll, occurred in unusual circumstances, or hold some other historical significance. For crashes in which famous people died, please refer to List of people who died in road accidents …   Wikipedia

  • List of FM radio stations in India — List of FM] radio stations in India (according to alphabetic list of cities, and then by frequency (in MHz)). The list is incomplete. Contents 1 Ahmedabad 2 Ahmednagar 3 Ajmer 4 Allahabad …   Wikipedia

  • List of science fiction television programs — List of television shows with significant science fiction elements.Complete alphabetical listing of science fiction television progams* 3rd Rock from the Sun (1996 2001) * 24 (TV series) * 100 Lives of Black Jack Savage (1991) * 1990 (TV series)… …   Wikipedia

  • List of radio stations in Australia — List of Australian radio stations. A list of radio stations that broadcast in Australia.The first digit of the callsign represents the state or territory: 1 ACT, 2 NSW ACT, 3 VIC, 4 QLD, 5 SA, 6 WA, 7 TAS, 8 NT. Australian Capital Territory (ACT) …   Wikipedia

  • joint restricted frequency list — A time and geographically oriented listing of TABOO, PROTECTED, and GUARDED functions, nets, and frequencies. It should be limited to the minimum number of frequencies necessary for friendly forces to accomplish objectives. Also called JRFL. See… …   Military dictionary

  • List of electronics topics — Alphabetization has been neglected in some parts of this article (the b section in particular). You can help by editing it. This is a list of communications, computers, electronic circuits, fiberoptics, microelectronics, medical electronics,… …   Wikipedia

  • List of Intel Core 2 microprocessors — The Core 2 brand refers to Intel s x86/x86 64 microprocessors with the Core microarchitecture targeted at the consumer and business markets (except servers) above Pentium. The Core 2 solo branch covered single core CPUs for notebook computers,… …   Wikipedia

  • List of Tesla patents — Below is a list of Tesla patents. Dr. Nikola Tesla was an inventor who obtained around 300 patents [Snezana Sarbo, [http://www.tesla symp06.org/papers/Tesla Symp06 Sarboh.pdfNikola Tesla s Patents] , Sixth International Symposium Nikola Tesla,… …   Wikipedia

  • List of computing and IT abbreviations — This is a list of computing and IT acronyms and abbreviations. Contents: 0–9 A B C D E F G H I J K L M N O P Q R S T U V W X Y …   Wikipedia

  • List of statistics topics — Please add any Wikipedia articles related to statistics that are not already on this list.The Related changes link in the margin of this page (below search) leads to a list of the most recent changes to the articles listed below. To see the most… …   Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”