I need a small application that will do the following:
1) Import a list of URLs in a .txt file.
2) There will be duplicate domains like:
It must let the user select how many to delete from each UNIQUE domain if we scrape 100 domains the same the user can say only keep X from each domain an delete the rest.
3) Upload the results to a location specified by the user via ftp.