complete.tools

Word Frequency Analyzer

Analyze text to find the most frequent words and their density percentage.

What this tool does

Analyze text to find the most frequent words and their density percentage. You fill in these fields: Text, Rows to show, and Shortest word to include. Some fields are optional. It shows total words and different words, plus a table (most frequent words).

Inputs

  • Text: Longer text, up to 100000 characters.
  • Rows to show (words): A whole number. Accepts 1 to 10,000. Starts at 50 words. Optional.
  • Shortest word to include (characters): A whole number. Accepts 1 to 1,000. Starts at 1 characters. Optional. Set to 4 to skip short words such as the, and, of. Percentages are still out of all words.

How to use

  1. Type the text.
  2. Enter the rows to show in words. This one is optional.
  3. Enter the shortest word to include in characters. This one is optional.
  4. Read the result: total words and different words, plus a table (most frequent words). It appears once every required field has a valid value.

Worked examples

Example 1. Inputs:

  • Text: "the cat and the dog and the bird"

Results:

  • Total words: 8
  • Different words: 5 (ignoring case)
  • Most frequent words, row 1 of 5: Word the; Count 3; Share of all words 37.50%
  • Most frequent words, row 2 of 5: Word and; Count 2; Share of all words 25.00%
  • Most frequent words, row 3 of 5: Word bird; Count 1; Share of all words 12.50%

How this is worked out: Eight words: the x3, and x2, cat, dog, bird x1 each, so 5 different. Share = count / 8: the 3/8 = 37.5%, and 2/8 = 25%, each single word 1/8 = 12.5%. Ties are listed alphabetically: bird, cat, dog.

Example 2. Inputs:

  • Text: "Go, go! GO? Don’t go."

Results:

  • Total words: 5
  • Different words: 2 (ignoring case)
  • Most frequent words, row 1 of 2: Word go; Count 4; Share of all words 80.00%
  • Most frequent words, row 2 of 2: Word don't; Count 1; Share of all words 20.00%

How this is worked out: Punctuation at the edges of a word is dropped and case is ignored: Go, go, GO, go are four 'go'; Don’t (curly apostrophe, treated as the straight one) is one. 5 words: go 4/5 = 80%, don't 1/5 = 20%.

Example 3. Inputs:

  • Text: "Well-known, well-known: it's 3.14 or 3.14!"

Results:

  • Total words: 6
  • Different words: 4 (ignoring case)
  • Most frequent words, row 1 of 4: Word 3.14; Count 2; Share of all words 33.33%
  • Most frequent words, row 2 of 4: Word well-known; Count 2; Share of all words 33.33%
  • Most frequent words, row 3 of 4: Word it's; Count 1; Share of all words 16.67%

How this is worked out: Words split at spaces only, with punctuation at the edges dropped: Well-known, well-known, it's, 3.14, or, 3.14 = 6 words. The hyphen, the apostrophe and the decimal point inside a word stay. Ignoring case there are 4 different words: well-known 2, 3.14 2, it's 1, or 1. Share: 2/6 = 33.333% and 1/6 = 16.667%. In a tie digits sort before letters, so 3.14 comes before well-known, and it's before or.

Example 4. Inputs:

  • Text: "... - 7 - !!!"

Results:

  • Total words: 1
  • Different words: 1 (ignoring case)
  • Most frequent words, row 1 of 1: Word 7; Count 1; Share of all words 100.00%

How this is worked out: Edge: a word needs at least one letter or digit, so the dots, the lone dashes and the exclamation marks are not words. The digit 7 is the only word: 1 word, 1 different word, one row with a share of 1/1 = 100%.

Limitations

  • There is no stop word list, so common words appear in the table.
  • Different forms of a word are not merged.
  • Words are split at spaces and line breaks only, so two words joined by a dash or slash with no spaces count as one word.
  • For Chinese, Japanese, Thai and similar scripts the word split comes from the browser's dictionary and is an estimate.
  • Text is limited to 100,000 characters.

FAQs

Q: How are words matched?
A: Case is ignored, so The and the count together. Punctuation at the start or end of a word is dropped. Words such as don't and well-known stay whole, and curly and straight apostrophes are treated alike.
Q: What does the percentage mean?
A: The word's count divided by the total number of words in the text, times 100. It stays out of all words even when you hide short ones.
Q: What order are words with the same count in?
A: Character order: digits first, then the letters a to z, then accented letters.
Q: Does it skip common words like the and of?
A: Not automatically. Raise the shortest word length to leave out short words, or read past them in the table.
Q: Are words with different endings counted together?
A: No. Run and running are separate words, and so are singular and plural forms.

Explore Similar Tools

Explore more tools like this one: