how to remove duplicate files from folder with python

Solutions on MaxInterview for how to remove duplicate files from folder with python by the best coders in the world

Search
showing results for - "how to remove duplicate files from folder with python"
Emily
14 Jan 2017
1def remove_duplicates(dir):
2    unique = []
3    for filename in os.listdir(dir):
4        if os.path.isfile(filename):
5            filehash = md5.md5(file(filename).read()).hexdigest()
6            if filehash not in unique: 
7                unique.append(filehash)
8            else: 
9                os.remove(filename)
10
source
similar questions
rename duplicates in list pythonpython dict remove duplicates where items are not the samepython remove duplicates from listremove duplicate rows in csv file pythontxt file duplicate line remover pythondjango model remove duplicatespython find duplicated zip fileshow to make python remove the duplicates in listremove duplicates from list pythonpython remove duplicates from a listpython 3a remove duplicate in a specific columnpython remove duplicateshow to copy unique files to new directory pythonpython remove duplicate items from the listremove duplicates pythonremoving duplicates from dictionary pythonremove duplicates in sorted array pythonduplicate finder python modulespython duplicate filesort and remove duplicates list pythonpython remove repeated elements from listpython delete duplicate lines in filedelete the duplicates in pythonremove duplicates function pythonremove duplicates from listpython dict remove duplicates where name are not the samedeleting duplicates in list pythonpython remove duplicates from list
queries leading to this page
python remove duplicate files from listduplicate folder with pythonremove duplicate files from directory pythonhow to remove duplicate files from folder with python