Hermetic Word Frequency Counter Advanced 9.41 is used for scanning a text file, multiple files or text on the clipboard, and counting the number of occurrences of the different words or given phrases. The words which are found and displayed can be ordered alphabetically or by frequency. The program can be told to allow or disallow words with numerals, hyphens, apostrophes, underscores or colons, to ignore words which are short or which occur infrequently, and to ignore words (e.g., common words) contained in a specified file.

Major Features:

1. It can also be told to count only words in a specified list.
2. This software may be used with text in languages other than English, in particular, with French, German, Italian, Spanish and Portuguese text.
3. It can be used with XML files and with files containing program source code, e.g. C.
4. Results can be written to an output file, optionally comma-delimited for use with spreadsheets.

Requirements: A video resolution of 800x600 or better.

WareSeeker Editor

Hermetic Word Frequency Counter Advanced 9.41 is a program used for scanning a text file, multiple text files, or text on the clipboard, which can also count the number of occurrences of the different words (optionally ignoring common words such as this), and the occurrences of any number of specified phrases. The words (and phrases) which are found can be listed alphabetically or by frequency, with rank and frequency displayed for each one.

The program can be told to allow or disallow words with numerals, hyphens, apostrophes, underscores or colons, to ignore words which are short or which occur infrequently, and to ignore words (e.g., common words) contained in a specified file. It can also be told to count only words in a specified list. This software may be used with text in languages other than English, in particular, with French, German, Italian, Spanish and Portuguese text. It can be used with XML files and with files containing program source code, e.g. C. Results can be written to an output file, optionally comma-delimited for use with spreadsheets.

Major Features:

1. The ability to count phrases as well as words.
2. The ability to scan not just one file but all files in a folder, and optionally in all subfolders, and to return a single report on the frequencies of words and phrases in all files scanned.
3. The ability to specify not only a list of words to be ignored (such as common words in a natural language) but also the ability to specify a list of words and phrases which are to be counted, with all words not in this list being ignored.
4. In the latter case to show, for each word or phrase found, the files in which it occurs.
5. The ability to generate data which can be used to test whether a corpus of text conforms to Zipf's Law.
6. Word
   • The term 'word' usually means a word in a natural language such as English or French, but for this software it has an extended meaning:
   • • In the standard version a word is any sequence of characters consisting of letters from a European language plus (optionally) hyphens, numerals, underscores, colons, periods, apostrophes, @-signs, and forward and backward slashes.
     • In the Advanced Version a word may (optionally) also include ampersands, grave accents, commas and parentheses (the last two thus allowing names of chemical compounds to be treated as words).
   • If the parameter settings allow, a word may begin with an underscore or a colon, and may end with an underscore. A word may not begin or end with a hyphen, apostrophe, period, comma, colon or parenthesis.
   • The Advanced Version allows three additional non-alphanumeric characters within names: commas and opening and closing parentheses. This is so that names of chemical compounds can be treated as words, e.g.: 2,5-dimethoxy-4-(N-propyl-thio) benzaldehyde. If you wish to treat the name of a chemical compound as a word then check the boxes for numerals, hyphens, commas and parentheses.
7. Two Modes of Operation: Count-All and Count-Only
   • The standard version has only one mode of operation: count-all. The Advanced Version has two different modes of operation: count-all and count-only.
   • In count-all mode the software scans one or more files, or text on the clipboard, and counts the number of occurrences of all of the different words.
   • • In count-only mode it scans one or more files, or text on the clipboard, and counts only the occurrences of a specified set of words or phrases.
     • The words (and phrases) found can be listed alphabetically or by frequency, with the rank and frequency of each displayed. In count-only mode the names of the files in which the words and phrases are found can be displayed, together with their frequencies of occurrence in each file.
   • Note that in count-only mode:
   • • The settings in the 'Ignore words' section of the 'Set parameters' window are disabled and have no effect except for the 'Ignore words with fewer than n occurrences' parameter.
     • The presence or absence of a words-to-ignore file (or a list of extra words to ignore) makes no difference, since all such words will be ignored anyway, unless they are included among the words to be counted.
8. Multiple Files
   • Unlike the standard version, which acts only on one file at a time , the Advanced Version can act on multiple files in multiple folders.
   • Files to be scanned can have any filename extension (the part of the filename following the last period), but the files must consist almost entirely of text characters (either 8-bit text or 16-bit Unicode text). For more detail see the paragraph Scannable files in the user manual for the standard version.
   • The software allows you to restrict the files which will be scanned to (a) those having a file extension in a specified list and (b) to files not having a specified extension. This is necessary because there may be, e.g., .js and .css text files mixed up with HTML files and you may wish to exclude them in a scan. (If you restrict the file extensions to one or more then there is no need to specify any to be excluded.)
   • The List files to be scanned operation should be run before doing a scan so that you know exactly what files will be processed.
   • Various types of files are automatically excluded from a scan, in particular, any binary file. This includes Microsoft Word .doc files, whose file formats are not made public by Microsoft. Other files which are automatically excluded are files with the extensions .xls, .pdf and .sys, plus the common graphics and executable files.
9. Words-to-Ignore in non-English Text
   • As stated in the user manual for the standard version, this software may be used with text in languages other than English, including German, French, Italian, Spanish and Portuguese.
   • A words-to-ignore file typically contains common words such as 'in' and 'of'. As in the standard version six files are provided containing common words in English (cwds_en.txt), German (cwds_de.txt), French (cwds_fr.txt), Italian (cwds_it.txt), Spanish (cwds_es.txt) and Portuguese (cwds_pt.txt). These files are in the folder containing the program files (created during program installation), and there is a download link in the Windows Explorer program menu after installation. You can add or remove words as you wish, and words do not have to be in alphabetical order or on separate lines (but the file must consist only of text).
   • If you are scanning multiple files, and those files are in more than one (natural) language, then you can ignore the common words by using a words-to-ignore file which includes the common words in all languages used. For example, there is a file supplied with the name cwds_en_de.txt which contains both common words in English and common words in German.
10. Counting Phrases
    • A phrase is a sequence of words, but if all sequences of words were counted then (in any moderately-sized file) there would be a huge number of them (phrases each of 2, 3, 4 and so on, words), most of which would be of little interest. Thus to count phrases (as distinct from words) you must specify which phrases are to be counted.
    • If you are interested in just a few phrases, they can be added to the 'Extra count-only words/phrases' textbox (they should be separated by commas see the example below). If there are many phrases to be counted then they should be placed in a text file, and that file specifed by means of the 'Count-only words/phrases file' button.
11. Extra Possibilities for Displaying Results
    • The Advanced Version has four possibilities for displaying the results of a scan which are not available in the standard version. One of these is Zipf data, which produces logarithms of the rank and frequency values. This is not normally needed, but for more details see Zipf's Law.
    • The other three display possibilities (in the list at right, below 'Zipf data') occur only in count-only mode, that is, when a list of words has been specified in the 'Set Parameters' window (either by reference to a file or by means of a short list) and the software is to count only these words, ignoring all other words. Two examples of this will now be given.

• Improved demo version.

Hermetic Word Frequency Counter 8.21 is an application used for scanning a text file, or text on the clipboard; and counting the number of occurrences of the different words (optionally ignoring common words such as this). The words found can be displayed according to alphabet or frequency, with rank and frequency shown for each word.

The term 'word' usually means a word in a natural language such as English or French, but for this software it has an extended meaning: Any sequence of characters consisting of letters from a European language plus (optionally) hyphens, numerals, underscores, colons, periods, apostrophes, @-signs, and forward and backward slashes. Thus not only can the text being scanned be in a language other than English, it can even be in a computer language such as C. The software even allows you to count words which include @-signs (if you are interested in email addresses).

There is also an Advanced Version which does everything the standard version does and also is able to scan not just one file but all files in a folder, and optionally in all subfolders, and to return a single report on the frequencies of words in all files scanned.

Major Features:

1. Scannable Files
   • The file upon which the program acts can have any filename extension, but it must consist almost entirely of text characters (either 8-bit text or 16-bit Unicode text). More exactly, it must consist only of characters with single-byte values in the range 32 through 255, except for whitespace characters: linefeeds (byte value 10), carriage returns (13), tab characters (9), backspaces (8) and page breaks (12) except that (i) Unicode text has zero bytes and (ii) up to 0.1% of the bytes (other than zero bytes in Unicode text files) are allowed to be "anomalous bytes", that is, bytes with values less than 32 but which are not whitespace characters. This exception is due to rare cases where a large text file will, for some reason or another, contain a few anomalous bytes (which should thus not prevent the program from treating the file as a text file).
   • This program does not work correctly with UTF-8 text files which have non-English letters. These should be read using WordPad and resaved as Unicode text files.
   • The input file would typically consist of natural language text (English, German, Spanish, etc.), but need not; it can consist of program code (e.g., a C++ source file) or can be an HTML or an XML document.
   • Files containing non-displayable characters, such as documents written with MS-Word and Adobe Acrobat, cannot be processed by reading the file directly. For files such as this either (a) save the file as a standard ASCII text file and apply this software to that file or (b) open the document in Word (or whatever is the appropriate application), select all the text and copy it to the clipboard, then Count word frequencies with clipboard selected as the source. (There is a limit on the number of characters in the text on the clipboard 100,000 so for large files (a) must be used, if possible.) The text in the clipboard and can be pasted into the textbox before (or after) the words are counted, but need not be. When clipboard is selected as the source the program counts the words in the text on the clipboard, not the words in the text in the textbox.
   • To repeat (so as to make this clear): The program does not count words in the textbox, only words either in a specified input file or words in text on the clipboard. You may compose text in in the textbox, but to do a word count on this you must first copy it to the clipboard. That's one reason there is a Copy to clipboard button (which is available only after the software has been activated).
2. Setting the Operation Parameters
   • The concept of counting words may seem simple, but is not. What is a word? Is double-click one word or two? Is don't a word? Is cat the same word as Cat? Do you want to count all words? Including common words such as this, with and him? This program allows you to customize its operation so that just the words are counted in which you are interested, and, as noted above, words may (if you wish) include hyphens, apostrophes, etc.
   • The Reinitialize button sets all parameters back to the way they were when the program was first run. If any problem develops in the functioning of the software then reinitializing the program might fix it.
   • If you wish to treat an email address as a word then check the boxes for at-signs, periods, hyphens and underscores. If you wish to treat a URL as a word then check the boxes for colons, forward slashes, periods, hyphens and numerals. (Note that if a word may contain a forward slash then a double forward slash cannot be used as a start-comment marker. The software checks for conflicts such as this.)
   • Parameters set using this screen may be saved at any time (using the Save state button on the main screen) so as to be restored on the next run.
   • You can also save a set of parameters to a parameter file (which must have extension .wfc), and reload it later. This allows you to keep several different parameter sets at hand for working with different kinds of files (e.g., text in different languages).
   • A word cannot begin with a numeral, a hyphen, an apostrophe or a colon, but may begin with an underscore (_).
3. Non-English Text
   • Hermetic Word Frequency Counter may be used with text in languages other than English, including German, French, Italian, Spanish and Portuguese in fact, any language with characters that can be encoded in WinLatin1 a.k.a. Windows 1252. The program also works with text encoded using Unicode. (As noted above, this program does not work correctly with UTF-8 text files which have non-English letters. These should be read using WordPad and resaved as Unicode text files.)
   • The option for dropping a final 's' unless it is preceded by an 's' or a vowel is intended to allow the conflation of single and plural nouns in English (e.g., 'dog' and 'dogs'). This option also helps to conflate German nouns with their genitives, e.g., 'Bewußtsein' and 'Bewußtseins'. But this option may have unintended consequences, so it is better to leave it unchecked unless results of a scan suggest that it should be used.
4. Rank and Frequency Display
   • The 'rank' and 'frequency' values may each be included in, or excluded from, the displayed results.
   • If the output file consists only of words, with no rank or frequency values, then you can get these either as a list (one word per line) or as comma-separated. This is done by making the appropriate selection in the Display format drop-down menu.
5. Ignoring Common Words
   • You can tell the program to ignore common words, such as 'the', 'and', etc. These words are contained in a file of your choice. When this file has been specified and Ignore common words in file is checked the program will ignore any words in the text which it finds in the specified file.
   • If just a few special words are to be ignored then they can be specified in the Ignore these words textbox, as shown above.
   • Six files are provided containing common words in English (cwds_en.txt), German (cwds_de.txt), French (cwds_fr.txt), Italian (cwds_it.txt), Spanish (cwds_es.txt) and Portuguese (cwds_pt.txt). These files are in the folder containing the program files (created during program installation), and there is a download link in the Windows Explorer program menu after installation. You can add or remove words as you wish, and words do not have to be in alphabetical order or on separate lines (but the file must consist only of text).
6. Embedded Comments
   • An input file may contain "comments", which are any parts which are to be skipped over when counting words. The beginning of a comment is marked by start-comment characters specified in the Set parameters screen, and the end is marked by end-comment characters. If the end-comment marker is empty (blank) then the comment ends at the end of the line.
   • The use of start-comment and end-comment markers also makes it possible to exclude sections of the input file from the word-counting process.
   • It is possible to specify two pairs of start-comment and end-comment markers. This allows both single-line comments and multi-line comments in the same input file.
   • If the input file has one of the following extensions: htm, html, shtml, xml and php, then the start-comment and the end-comment markers are automatically set to < and > respectively. This means that HTML, XML and PHP tags are ignored. It also means that /* and */, or other markers, cannot be used as start-comment and end-comment markers in files with these extensions. If the start-comment and end-comment markers were set to something else then the original settings are restored after a file of one of these file types has been processed.
   • C-style comment markers (/* ... */) can be used in the files of common words to temporarily disable sections of those files (so that the words within those sections are not treated as common words, but are counted when they occur within the input file).
7. Input File Size & Output to a File
   • There is no limit on the size of an input file. The program has been tested with text files up to 1 Mb in size, and with files containing over 11,000 different words. In such cases processing of the text may take some time, and for these cases a progress bar is provided.
   • There is, however, a limit on the amount of text which can be held in the output textbox, either by pasting from the clipboard or as a result of listing words found. This does not prevent Hermetic Word Frequency Counter from being able to handle large files. For example, there may be a file on your PC named Win32api.txt. This is about 652 Kb in size and has over 80,000 instances of about 11,000 different words. When the program is run on this file, with the Don't display words as found option unchecked, words found as the program goes through the file will be displayed until 2000 words have been displayed, at which point further words are not displayed so as to avoid a buffer overflow. After the entire file has been processed, the words found will be listed until the capacity of the output textbox buffer is reached. If the words are listed in alphabetical order then (in the case of Win32api.txt) only words beginning with a, b, c or d are listed.
   • In order to obtain a complete listing of the words in this file you have to specify an output file before starting the word count. In this case the complete listing is written to the output file before the listing is given in the output textbox. The displayed listing will still stop with words beginning with d, but the entire listing can be viewed by opening the output file in some text editor such as WordPad.
   • Hermetic Word Frequency Counter has been used successfully with large files with many different words. In one case a 4.12 Mb file with 46,398 different words, and in another a 12.1 MB file with 61,979 different words (and a total of 1,847,893 instances of these words).
8. Transfer of Results to an Excel Spreadsheet
   • The output can easily be transferred to an Excel spreadsheet as follows: If the output has not already been written to an output file then copy the output to the clipboard, paste it into some text editor such as Notepad, and save it as a .txt file. Load this into Excel, which will automatically detect the columns.
   • If you specify an output file then the results will be written to that file. In the Set parameters panel you can specify that the output should be written as comma-delimited, so that the file can be read by some statistical programs that (unlike Excel) cannot detect fixed-width fields.
9. Counting Words in One File Which are Not in Another
   • It is unlikely that many people will wish to make use of this possibility, but if so:
   • If you want to get a list of all the non-common words (subject to the parameters setting) which occur in a file (say, File B) which do not occur in another file (say, File A), then here's how:
   • • Specify File A as the input file.
     • In the Parameters panel select (if not already selected) the usual common words file (for English, cwds_en.txt).
     • Set word order to 'Alphabetical' and display format to 'Word'.
     • Specify an output file (say File C) with a .txt extension.
     • Count word frequencies (this creates File C).
     • Open File C in a text editor and delete the first line, "Word (longest has n characters)".
     • Open the common words file, delete the four comment lines at the top, select all, paste the common words at the end of the words in File C, and save the file under the same name.
     • Back at the program specify File B as the input file.
     • In the Parameters panel select File C as the common words file.
     • Specify an output file (say File D) with a .txt extension.
     • Count word frequencies.
   • File D will then contain all words (except for the usual common words) which occur in File B but which do not occur in File A.
   • File C can then be used with further files B2, B3, etc., to find all non-common words which occur in File B2 but not in File A, in File B3 but not in File A, and so on.
   • Note that the results must be seen in the context of the parameter settings. For example, if hyphens are permitted in words then "comma" may appear in File D (indicating that it occurs in File B but not in File A) even though "comma-separated" occurs in File A. This is correct provided that "comma" occurs by itself (i.e., other than in a hyphenated word) in File B but does not occur by itself in File A.
     

Enhancements:

• Improvements to demo version.

Requirements:

• The minimum screen resolution required is 800x600, but 1024x768 is recommended.

Hermetic Word Frequency Counter 8.21 scans a file and counts the number of occurrences of the different words. The words which are found and displayed can be ordered alphabetically or by frequency. The program can be told to allow or disallow words with numerals, hyphens, apostrophes, underscores or colons, to ignore words which are short or which occur infrequently, and to ignore words (e.g., common words such as this) contained in a specified file.

Major Features:

1. This software may be used with text in languages other than English, in particular, with French, German, Italian, Spanish and Portuguese text.
2. It can be used with XML files and with files containing program source code. Results can be written to an output file, optionally comma-delimited.
3. There is also an Advanced Version which does everything the standard version does and also is able to scan not just one file but all files in a folder, and optionally in all subfolders, and to return a single report on the frequencies of words in all files scanned.

Enhancements: Improvements to demo version.

Requirements: A video resolution of 800x600 or preferably better.

WareSeeker Editor

This software scans a text file, multiple files or text on the clipboard, and counts the number of occurrences of the different words or given phrases. The words which are found and displayed can be ordered alphabetically or by frequency. The program can be told to allow or disallow words with numerals, hyphens, apostrophes, underscores or colons, to ignore words which are short or which occur infrequently, and to ignore words (e.g., common words) contained in a specified file. It can also be told to count only words in a specified list. This software may be used with text in languages other than English, in particular, with French, German, Italian, Spanish and Portuguese text. It can be used with XML files and with files containing program source code, e.g. C. Results can be written to an output file, optionally comma-delimited for use with spreadsheets.

System Requirements: A video resolution of 800x600 or better.

New features in this version:: Added feedback on uninstall.

This software scans a file and counts the number of occurrences of the different words. The words which are found and displayed can be ordered alphabetically or by frequency. The program can be told to allow or disallow words with numerals, hyphens, apostrophes, underscores or colons, to ignore words which are short or which occur infrequently, and to ignore words (e.g., common words such as this) contained in a specified file. This software may be used with text in languages other than English, in particular, with French, German, Italian, Spanish and Portuguese text. It can be used with XML files and with files containing program source code. Results can be written to an output file, optionally comma-delimited. There is also an Advanced Version which does everything the standard version does and also is able to scan not just one file but all files in a folder, and optionally in all subfolders, and to return a single report on the frequencies of words in all files scanned.

System Requirements: A video resolution of 800x600 or preferably better.

New features in this version:: Added feedback on uninstall.

Diese Software untersucht eine Datei oder einen Text aus der Zwischenablage und z hlt die H ufigkeit des Auftretens von verschiedenen Worten. Der Text kann in einer anderen Sprache als Englisch vorliegen und der Text kann auch aus Programmiercode bestehen. Die Worte, die gefunden und angezeigt werden, sind alphabetisch oder nach H ufigkeit geordnet. Es gibt keine Einschr nkungen in bezug auf die Gr sse der Eingangsdatei. Die Art in der die Worte gez hlt werden, l sst sich ver ndern. XML Dateien k nnen verwendet werden. Ergebnisse k nnen in eine Datei geschrieben werden....

Hermetic Word Frequency Counter v8.01 release is Major Update.