CORSIS

I've come across another limitation of WordSmith Tools 4. It can't process large files. And what do you think is 'large' for WST4? Well... it can be a file as small as 9,35 MB depending on the type of data stored. While reading Wikipedia, I stumbled upon the GIMPS Project at http://www.mersenne.org/ and found their 44th Mersenne Prime discovery: http://www.mersenne.org/prime10.txt - a 9,808,358 digits long integer number. I wanted to see how the Wordlister of Tenka Text 0.1.3 performed with such a large single token and in fact I expected it to throw some sort of unexpected exception... to be continued

Tenka Text 0.1.3* on Windows Vista Ultimate (.NET 2.0>) New Update Dialog from Tenka Text 0.1.3* on Windows Vista Ultimate Tenka Text 0.1.3* on Debian 4.0 (Mono 1.2.4 preview 3) SVN267 0.1.3 Release Notes This version of Tenka Text introduces dynamism into Wordlister. It’s the first release that juggles with interface design ideas which have come to prove themselves in professional integrated development environments. The main feature of this release is the explorer control in Wordlister, which is a tree view that performs organizational tasks much like the solution explorer control in Visual Studio. Wordlister explorer has been implemented in such a way that enables you to add, remove or switch between frequency lists dynamically. Because graphical user interfaces of integrated development environments are designed for highly complicated usage scenarios and heavy workloads developers tend to have, they stand as great examples for computational linguists that aim to deliver equally ...

Here is a screenshot from a new feature which is going to be available in the wordlister tool of the next release: study explorer - a tree view of the files you are analyzing which helps you dynamically change between result views back and forth. Close to the alpha or beta, probably all the functionality will have been combined in just one type of window. Things may end up looking like how Visual Studio does since 2003. I hope a fully-portable docking suite becomes available until then to make things easy.

I spent the night implementing the option I mentioned in the previous post and decided to release a new binary after 22 days. (Corresponding SVN revision: 96) Tenka Text WordLister is now more precise than WordSmith Tools WordList. It has an option now through which a user can choose to display in the statistics view for frequency lists either the count of tokens that are a certain number of characters long or the count of types that are a certain number of characters long. *NEW* WordSmith Tools 4 can only display the first but not the latter. Check all three screenshots! Tenka Text WordLister with Length Statistics for Tokens Tenka Text WordLister with Length Statistics for Types WordSmith Tools 4 with Length Statistics for Words(Tokens)

A new pre-alpha binary release is now available for download ! It features the performance of the new frequency list classes and a new statistics view in its WordLister tool. Go download the demo version of the commercially available WordSmith Tools 4 and compare to realize the power of open-source C#!