Remove duplicate word sentence - duplicates

Question

I have a list of sentences.
I want to deal with duplicates like this:
White shoes women
Shoes women white
Women white shoes
I want to make into this:
White shoes women
Can I do this in Notepad++?
Or maybe some other software?

Answer 1

I don't think you can do such job in Npp.
Here is a way to do the job with perl that keeps the case and order of first line.
(Thanks to #jwpfox for input example).
use Modern::Perl;
my $prev = '';
while(<DATA>) {
chomp;
my $str = join'',sort split' ',lc$_;
say $_ if $str ne $prev;
$prev = $str;
}
__DATA__
White shoes women
Shoes women white
Women white shoes
White shoes women
Shoes women white
Women white shoes
Men black boots
Black boots men
Boots men black
girl yellow shirt
yellow girl shirt
pants blue boy
Output:
White shoes women
Men black boots
girl yellow shirt
pants blue boy
A version in PHP:
$s = array(
'White shoes women',
'Shoes women white',
'Women white shoes',
'White shoes women',
'Shoes women white',
'Women white shoes',
'Men black boots',
'Black boots men',
'Boots men black',
'girl yellow shirt',
'yellow girl shirt',
'pants blue boy');
$prev = '';
foreach($s as $line) {
$list = explode(' ', strtolower($line));
sort($list);
$str = implode('',$list);
if ($str != $prev) echo $line,"\n";
$prev = $str;
}
Output:
White shoes women
Men black boots
girl yellow shirt
pants blue boy

Answer 2

Using the "some other software" option.
Contents of input.txt file:
White shoes women
Shoes women white
Women white shoes
Men black boots
Black boots men
Boots men black
girl yellow shirt
yellow girl shirt
pants blue boy
Python 3:
sentences = []
with open('input.txt', mode='r') as infile:
for line in infile:
wordlist = line.split(' ')
words = []
for word in wordlist:
word = word.strip()
words.append(word.lower())
words.sort()
if words not in sentences:
sentences.append(words)
with open('output.txt', mode='w') as outfile:
for sentence in sentences:
for word in sentence:
outfile.write(word + ' ')
outfile.write('\n')
Contents of output.txt file:
shoes white women
black boots men
girl shirt yellow
blue boy pants