WWW on Amit Agarwal Linux Blog

get all the urls in html file (local or on server).

Mon, 17 Feb 2014 10:35:53 +0000

To use this, you will need the lynx tool, so install that first.

sudo yum install lynx

Now, to get list of all the URLs in local html file or some URL, just execute this:

lynx -dump -listonly

cgroups – use to control your cpu and memory

Mon, 06 Jan 2014 00:33:23 +0000

cgroups is a kernel feature and with userspace utilities, we can use the feature to control the cpu and memory for per process. So, lets first install the required tools.

sudo yum install libcgroup-tools

Now, we need to enable the service.

sudo systemctl enable cgconfig.service
sudo systemctl enable cgred.service

cgconfig.service is to enable configuration for cgroups and
cgred.service is to enable configuration for cgroups for processes depending on the name.

Apache server stats with small and useful bash script.

Fri, 29 Nov 2013 01:35:36 +0000

Just copy this script to your web-server cgi-bin directory and enjoy.

The script with show the common errors like 404 Error, Internal Server Error and others. It will show the User agent distribution using simple commands like grep, uniq, awk and so on.

You would need to change the tfile – which is temporary file and also the access.log path in the next line.

Just re-direct the output to some file with html extenstion. You could even put this in the cron which re-directs the output to some html in server document root.

Firefox troubleshooting

Mon, 11 Mar 2013 11:25:50 +0000

Here are few quick tips on getting to see what could be wrong with firefox.

Config entries – about:config

Support Information – about:support

Details on config entries – http://kb.mozillazine.org/About:config_entries

Reset firefox profile – https://support.mozilla.org/en-US/kb/reset-firefox-easily-fix-most-problems

Firefox profiles – https://support.mozilla.org/en-US/kb/profiles-where-firefox-stores-user-data

Taking screenshot in firefox.

Sun, 03 Feb 2013 00:33:05 +0000

Couple of days back, I was trying to take screenshot with Firefox. As usual I started out with searching for plugins which could take a screen shot for the whole page and not just the visible portion of the page. Installed couple of them, some did not work. Finally I found something called Development Bar.

So, here is a simple way to take a screenshot. Press “Shift+F12”. This will bring up a bar in the bottom of the firefox window. To take a screenshot, type:

Install the fastest Mozilla browser on your N900

Sat, 02 Jul 2011 20:00:18 +0000

Firefox 7.0 is the browser that I am currently using on my N900. Its pretty fast compared to its predecessors. Its not even in BETA and all you can get is the nightly build. For me, its okay, as I like playing with my systems and mobile. If that is okay with you read on….

Head over to the firefox nightly build website Firefox Nightly Builds. Go to the links for the mobile version and then select Maemo build and download it.. Copy the tar.bz2 file to your N900 or directly download it from the handset 🙂

fork a new process in perl

Thu, 27 Jan 2011 22:32:54 +0000

I was doing something today and found that I require to fork a new process in perl. Now I had never done this earlier, so I did not know how to do this.

First some background :

I was doing some program very similar to http server, where the script accepts some input through a socket and then processes the same. In doing so I was seeing that the script was taking some time in processing the input and thus was not processing the second request until the first one was completed. Simple solution, fork the process.

Browser Conkeror – fast, versatile, easy and configurable

Wed, 20 Oct 2010 00:50:10 +0000

Conkeror is a browser that uses XULRunner and is a highly configurable and programmable browser.

Here is the description of the browser from the homepage:

Conkeror is a keyboard-oriented, highly-customizable, highly-extensible web browser based on Mozilla XULRunner, written mainly in JavaScript, and inspired by exceptional software such as Emacs and vi. Conkeror features a sophisticated keyboard system, allowing users to run commands and interact with content in powerful and novel ways. It is self-documenting, featuring a powerful interactive help system.

Change the firefox theme without restarting.

Mon, 27 Sep 2010 15:00:41 +0000

How often you wished that you could change the theme for firefox without restarting. Well sometime back Mozilla came up with Light weight themes called personna’s but if that is not sufficient for you and you still want to change the theme and do not want to restart then you should install this theme.

Once you install this theme, you will not note any change (Don’t forget to restart after installing the theme.)

Unixmen - Tips to reduce memory usage on Firefox

Wed, 14 Jul 2010 01:06:32 +0000

A nice aritcle on reducing the memory usage of firefox on <a class="zem_slink" title="Linux" rel="wikipedia" href="http://en.wikipedia.org/wiki/Linux">Linux.

There are some things in life everyone is looking for and no one ever finds and there are other things that people keep finding and re-finding and inventing and re-inventing. Reducing memory usage for <a class="zem_slink" title="Firefox" rel="homepage" href="http://www.mozilla.com/firefox/">Firefox and speeding it up is one such thing. So, here is another story to reduce the memory usage of firefox.

find duplicate entry in a list in bash with sed

Fri, 25 Jun 2010 11:46:58 +0000

Here I will take an example of rss2email list, but I guess I will be able to pass on the concept.

Here is example of the output of the r2e list command:

1: http://blog.amit-agarwal.co.in/feed (default: amitag@localhost)
2: http://feeds2.feedburner.com/AllAboutLinux (default: amitag@localhost)
3: http://feeds2.feedburner.com/Command-line-fu (default: amitag@localhost)
4: http://blogs.members.freewebs.com/Members/Blogs/viewBlogRSS.jsp?userid=29731143 (default: amitag@localhost)

Target here is to get the list of all duplicate entries if any. So, first we need to remove the numbers from the begining and the email ID from the end.

FastestfoxLite - Disable prefetching and make firefox really fast.

Mon, 14 Jun 2010 14:03:06 +0000

If you are stuck with firefox performance, then you should try this addon:

https://addons.mozilla.org/en-US/firefox/addon/9148/<h6 class="zemanta-related-title">Related articles by Zemanta <ul class="zemanta-article-ul"> <li class="zemanta-article-ul-li"><a href="http://blog.taragana.com/index.php/archive/how-to-make-firefox-blazing-fast-in-a-jiffy-fasterfox-add-on/">How to make Firefox blazing fast in a jiffy: fasterfox add-on (taragana.com) <li class="zemanta-article-ul-li"><a href="http://www.cloudspace.com/blog/2010/06/03/html5-link-prefetching-or-the-most-dangerous-tag/">HTML5 Link Prefetching (or ”The Most Dangerous Tag”) (cloudspace.com) <li class="zemanta-article-ul-li"><a href="http://www.ghacks.net/2010/05/15/configure-prefetch-and-superfetch-with-tweakprefetch/">Configure Prefetch and Superfetch With TweakPrefetch (ghacks.net) <li class="zemanta-article-ul-li"><a href="http://www.ghacks.net/2010/06/10/fix-firefox-with-last-pass-not-responding/">Fix Firefox With Last Pass Not Responding (ghacks.net) <div class="zemanta-pixie"><a class="zemanta-pixie-a" title="Enhanced by Zemanta" href="http://www.zemanta.com/"><img class="zemanta-pixie-img" src="http://blog.amit-agarwal.co.in/wp-content/uploads/2010/08/zemified_c2.gif" alt="Enhanced by Zemanta" /><span class="zem-script more-related more-info pretty-attribution paragraph-reblog">

List all the installed firefox addons from the bash script

Tue, 18 May 2010 16:35:18 +0000

Here is a one-line that would help you get the <a class="zem_slink freebase/en/mozilla_firefox" title="Firefox" rel="homepage" href="http://www.mozilla.com/en-US/firefox/">Firefox addons in the bash script:

grep -hIr \<em:name ~/.mozilla/firefox/*.default/extensions|sed ’s#\s*##’|sed ’s#.*\(>.*<\).*#\1#’|sed ’s/[<\|>]//g’|sort -u<h6 class="zemanta-related-title">Related articles by Zemanta <ul class="zemanta-article-ul"> <li class="zemanta-article-ul-li"><a href="http://www.ghacks.net/2010/05/16/firefox-3-6-4-build-4-released/">Firefox 3.6.4 Build 4 Released (ghacks.net) <li class="zemanta-article-ul-li"><a href="http://www.webmonkey.com/2010/05/first-look-firefox-4-preview-delivers-speed-revamped-interface/">First Look: Firefox 4 Preview Delivers Speed, Revamped Interface (webmonkey.com) <li class="zemanta-article-ul-li"><a href="http://www.ghacks.net/2010/05/15/protect-firefox-bookmarks-with-link-password/">Protect Firefox Bookmarks With Link Password (ghacks.net) <li class="zemanta-article-ul-li"><a href="http://www.huffingtonpost.com/2010/05/12/mozilla-firefox-4-upgrade_n_573062.html">Firefox 4 Upgrade Offers Simpler Design, More Privacy Control (huffingtonpost.com) <li class="zemanta-article-ul-li"><a href="http://www.readwriteweb.com/archives/mozilla_talks_firefox_4_sleeker_interface_better_privacy_controls.php">Mozilla’s Plans for Firefox 4: Faster, Sleeker Interface, Better Privacy Controls (readwriteweb.com) <div class="zemanta-pixie"><a class="zemanta-pixie-a" title="Reblog this post [with Zemanta]" href="http://reblog.zemanta.com/zemified/6a3ffd4a-91cf-47e3-85ff-7dc3b27ffd7d/"><img class="zemanta-pixie-img" src="http://blog.amit-agarwal.co.in/wp-content/uploads/2010/08/reblog_b89.png" alt="Reblog this post [with Zemanta]" /><span class="zem-script more-related more-info pretty-attribution paragraph-reblog">

They own your CPU (and so so in Windows and Mac, too)

Sun, 16 May 2010 15:53:18 +0000

Click: ”I laugh — LAUGH! — when a tech journalist writes something to the effect of, ”for lightweight tasks such as Web browsing,” when you know, and I know, that there ain’t nothing light about using present-day Web browser on present-day Web pages filled with Javascript, Flash and enough CSS to fill a book.”

URL: <a href="http://linuxtoday.com/news_story.php3?ltsn=2009-10-22-030-35-OP-HW-SW">http://linuxtoday.com/news_story.php3?ltsn=2009-10-22-030-35-OP-HW-SW<h6 class="zemanta-related-title" style="font-size: 1em;">Related articles by Zemanta <ul class="zemanta-article-ul"> <li class="zemanta-article-ul-li"><a href="http://www.noupe.com/jquery/35-fresh-useful-jquery-plugins.html">35 Fresh and Useful jQuery Plugins (noupe.com) <li class="zemanta-article-ul-li"><a href="http://lifehacker.com/5376222/firefox-36-beta-scheduled-for-next-week">Firefox 3.6 Beta Scheduled for Next Week [Updates] (lifehacker.com) <li class="zemanta-article-ul-li"><a href="http://www.wisdump.com/web-experience/3-nifty-browsing-features/">3 nifty browsing features that should be on every site (wisdump.com) <div class="zemanta-pixie" style="margin-top: 10px; height: 15px;"><a class="zemanta-pixie-a" title="Reblog this post [with Zemanta]" href="http://reblog.zemanta.com/zemified/4094c4e7-74b7-4826-9095-0306e76f7c8e/"><img class="zemanta-pixie-img" style="border: medium none; float: right;" src="http://blog.amit-agarwal.co.in/wp-content/uploads/2010/08/reblog_e9.png" alt="Reblog this post [with Zemanta]" /><span class="zem-script more-related pretty-attribution">

Extract all urls from the last firefox sessionstore.js file used.

Mon, 29 Mar 2010 07:01:08 +0000

: Image via Wikipedia

Some taken from commandlinefu. What all the below commands are doing is basically that the url: is captured from the sessionstore.js file and then just extract the URL from the line. These are done in various ways using perl, <a class="zem_slink freebase/en/sed" title="Sed" rel="wikipedia" href="http://en.wikipedia.org/wiki/Sed">sed and <a class="zem_slink freebase/en/awk" title="AWK" rel="homepage" href="http://cm.bell-labs.com/cm/cs/awkbook/index.html">awk:

check out http://browsershots.org/

Sat, 19 Dec 2009 07:49:06 +0000

If you are a web developer and are worried about how your <a class="zem_slink" href="http://en.wikipedia.org/wiki/Website" title="Website" rel="wikipedia">website would look like in the various browsers and do not have the resources to test all the browsers, what do you do? Check out the <a class="zem_slink" href="http://en.wikipedia.org/wiki/Web_page" title="Web page" rel="wikipedia">webpage at

<a href="http://browsershots.org/">http://browsershots.org/<h6 class="zemanta-related-title">Related articles by Zemanta <ul class="zemanta-article-ul"> <li class="zemanta-article-ul-li"><a href="http://www.macstories.net/iphone/website-iphone/">Setting Up Your Website to Run on iPhone Browser (macstories.net) <div class="zemanta-pixie"><a class="zemanta-pixie-a" href="http://reblog.zemanta.com/zemified/8d5363f4-7641-40c8-b111-4a4d12d41ba5/" title="Reblog this post [with Zemanta]"><img class="zemanta-pixie-img" src="http://blog.amit-agarwal.co.in/wp-content/uploads/2010/08/reblog_e36.png" alt="Reblog this post [with Zemanta]" /><span class="zem-script more-related more-info pretty-attribution paragraph-reblog">