If you want to mirror a <a class="zem_slink freebase/en/website" title="Website" rel="wikipedia" href="http://en.wikipedia.org/wiki/Website">website, the simplest tool I know if is <a class="zem_slink freebase/en/wget" title="Wget" rel="homepage" href="http://www.gnu.org/software/wget/">wget. Once you have used wget, you know the troubles associated with it. You also get added couple of files as search html files, which are useless and wastage of bandwidth for you as well as the <a class="zem_slink freebase/en/web_server" title="Web server" rel="wikipedia" href="http://en.wikipedia.org/wiki/Web_server">webserver.

lftp -e &#8221;mirror -c&#8221; 

This will mirror the website for you and will not leave with all those un-necessary files.<h6 class="zemanta-related-title">Related articles by Zemanta <ul class="zemanta-article-ul"> <li class="zemanta-article-ul-li"><a href="http://www.survivalblog.com/2010/05/two_letters_re_preparedness_di.html">Two Letters Re: Preparedness Digital Archives (survivalblog.com) <li class="zemanta-article-ul-li"><a href="http://www.slideshare.net/yurime/72-questionstoaskyournewwebdesignclients">72 questions-to-ask-your-new-web-design-clients (slideshare.net) <li class="zemanta-article-ul-li"><a href="http://blog.amit-agarwal.co.in/2010/03/08/email-web-statistics-from-the-hosted-website-using-awstats-page/">Email web statistics from the hosted website using awstats page. (amit-agarwal.co.in) <li class="zemanta-article-ul-li"><a href="http://www.ezrasf.com/wplog/2010/03/29/bea-101017/">Bea-101017 (ezrasf.com) <li class="zemanta-article-ul-li"><a href="http://blogs.adobe.com/contribute/2010/05/adobe_contribute_cs5_is_out.html">Adobe Contribute CS5 is out! (blogs.adobe.com) <div class="zemanta-pixie"><a class="zemanta-pixie-a" title="Reblog this post [with Zemanta]" href="http://reblog.zemanta.com/zemified/6b1afb22-cfd8-4855-9e4c-1a5dcad583b4/"><img class="zemanta-pixie-img" src="http://blog.amit-agarwal.co.in/wp-content/uploads/2010/08/reblog_b90.png" alt="Reblog this post [with Zemanta]" /><span class="zem-script more-related more-info pretty-attribution paragraph-reblog">