WordSmith Tools Manual

A tool to go through your corpus and seek out any text files which may have become corrupted. Works in any language. Also, tests for boilerplate text, file-duplication, relevance

See also: detecting corpus corruption