Processing text files and their sorting to remove duplicates
Cat file1.txt file2.txt > file3.txt
Sort file3.txt | uniq > newfile.txt
Newfile is the deduplicated file.
Cat file1.txt file2.txt > file3.txt
Sort file3.txt | uniq > newfile.txt
Newfile is the deduplicated file.