At first, simply press the "Open Document" button and select the document you want to process.
Afterwards, specify in the "Options" menu case sensitive line comparison or not and whether to remove duplicate words and not lines. Also, in the "Sorting" menu select the sort order.
Finally, simply press the "Remove Duplicates" button to remove duplicate lines from the text.
You can also drag-and-drop text, Microsoft Word or RTF documents to import them.
To remove duplicate lines from text simply select "Batch Remove Lines from many files" from the "Tools" menu.
Afterwards, in the new screen that will appear add the files you want, or add entire folders and their contents or import text lists with file paths of files to process.
Moreover, specify the various options from the menu and then press the "Remove Duplicates" button and wait for the application to do its job.
You can also use Remove Duplicate Lines from the command-line. This is useful for inclusion in scripts e.t.c.
Remove duplicate lines or words from Text, RTF, Word Files.
RemoveDuplicateLines.exe [[file|directory]][/sortmode:SORT_MODE]
[/casesensitive]
[/words]
[/list:LIST_FILE]
[/outfolder:OUTPUT FOLDER PATH]
[/?]
file : one or more files to be processed.
directory : one or more directories containing files to be processed.
/sortmode : sort mode. 0 do not sort, 1 sort ascending, 2 sort descending
/casesensitive : case sensitive
/words : remove duplicate words not lines
/list : import files from list. LIST_FILE : list file path
/outfolder : output folder path
/? : show help
For example RemoveDuplicates.exe "c:\text documents\document1.txt" /sortmode:1