find duplicate entry in a list in bash with sed

2010-06-25 1 min read bash Fedora Learning
Here I will take an example of rss2email list, but I guess I will be able to pass on the concept. Here is example of the output of the r2e list command: 1: http://blog.amit-agarwal.co.in/feed (default: amitag@localhost) 2: http://feeds2.feedburner.com/AllAboutLinux (default: amitag@localhost) 3: http://feeds2.feedburner.com/Command-line-fu (default: amitag@localhost) 4: http://blogs.members.freewebs.com/Members/Blogs/viewBlogRSS.jsp?userid=29731143 (default: amitag@localhost) Target here is to get the list of all duplicate entries if any. So, first we need to remove the numbers from the begining and the email ID from the end. Continue reading