There is a small nifty utility called xmlwf that can check your xml documents to see if they are well formed.
sudo yum install expat
Once installed, simply use :
xmlwf
Need more details, just check the man page 🙂
There are some commands that take file name and there are some case where you need to give file name. But there are some cases where you want to modify the file before passing it to the command. What do you do in these case’s?
I had a file containing huge amount of data and for some testing I wanted to pass only the first few lines of the file and not the complete file. And since the file only accepted filename and would not take any input from the STDIN so only option was to create a file with the required data in a temporary file. So, I sat back to figure out some way to do it and finally found I can use this:
Continue readingHave you ever wanted to have a quick check on your CPU performance. I know that lot of people will say that this is not the right way to do this, but here is something that you can use to check the CPU speed.
#!/bin/bash -
#===============================================================================
#
# FILE: benchmark.sh
#
# USAGE: ./benchmark.sh
#
# DESCRIPTION: Benchmark the CPU
#
# OPTIONS: ---
# REQUIREMENTS: ---
# BUGS: ---
# NOTES: ---
# AUTHOR: Amit Agarwal (aka), amit.agarwal@roamware.com
# COMPANY: Roamware India Pvt Ltd
# CREATED: 09/21/2011 11:46:03 AM IST
# Last modified: Wed Sep 21, 2011 12:22PM
# REVISION: ---
#===============================================================================
add ()
{
COUNTER=0
exec 2>&1
time=$(exec 2>&1;(time while [[ $COUNTER -lt 100000 ]]; do ((COUNTER++)) \
; done))
echo "Time for 100000 additions is "$time
} # ---------- end of function add ----------
mul ()
{
COUNTER=0
test=2
exec 2>&1
time=$(exec 2>&1;(time while [[ $COUNTER -lt 100000 ]]; do ((COUNTER++)) \
; ((test=test*2));done))
echo "Time for 100000 mul is "$time
} # ---------- end of function add ----------
div ()
{
COUNTER=0
test=1000000000000
exec 2>&1
time=$(exec 2>&1;(time while [[ $COUNTER -lt 100000 ]]; do ((COUNTER++)) \
; (( test=test/2)); done)|tr -d '\n')
echo "Time for 100000 divisions is "${time}
} # ---------- end of function add ----------
time add
time mul
time div
And here is the output :
Continue reading
][1]I was looking for something to monitor few details on the server. I thought about quite a lot of applications, some open source and some scripts developed in house. But my requirements were quite petty and the scripts and applications were quite heavy. So, I thought why not conky :).
Â
So, with some quick work on conky script, I was able to get what I wanted and here it is for all of you.
Continue readingToday we will look at some bash code snippests and the performance issues. Lets first look at the problem and the implemented solution:
Problem: We needed to log the output of the ps command for all the process’s. This was required to be done on per minute basis and the output was required in comma separated files. So, here is what was implemented:
pslog=`ps -e -opid,ppid,user,nlwp,pmem,vsz,rss,s,time,stime,pri,nice,pcp:u,args|grep -v PID|sort -r -k 13,13`
OLD_IFS=$IFS
IFS=$'\n'
logarr=( $pslog )
for LOGLINE in ${logarr[@]}
do
LOGLINE=`echo $LOGLINE|awk '{OFS=",";print $1,$2,$3,$4,$5,$6,$7,:$8,$9,$10,$11,$12,$13,$14}'`
echo $LOGLINE >> output
done
IFS=$OLD_IFS
This was working well and there were no issues. But suddenly we started seeing issues with the reported CPU usages. We would see that whenever this script was running the CPU usage was high, specially if there were too many process’s/thread’s on the system during that time. This code was definitely part of a very large code base, and at this point of time we did not know what was causing the issues.
Continue readingI was working on some scripts and the changes that I was making in the scripts was very dynamic, which I did want to keep backing up in the version control system. But for the peace of my mind, I wanted to keep a copy of the scripts, whenever it was in working state.
Since I had multiple files, so it would make more sense to have a script that could copy all the files in the current directory to “old” directory without over-writing the existing files. So, I wrote a script that would postfix the files with a number. With this approach, finally what I had was the following:
Continue readingHere is one of the scripts that I found on the net while searching for something … Note the URL for the script in the Description.
#!/bin/bash - #=============================================================================== # # FILE: linux_hw.sh # # USAGE: ./linux_hw.sh # # DESCRIPTION: http://www.howtogeek.com/howto/solaris/get-the-processor-type-on-solaris/ # # OPTIONS: --- # REQUIREMENTS: --- # BUGS: --- # NOTES: --- # AUTHOR: Amit Agarwal (aka), amit.agarwal@roamware.com # COMPANY: Roamware India Pvt Ltd # CREATED: 09/13/2011 03:57:34 PM IST # Last modified: Sun Oct 30, 2011 04:59PM # REVISION: --- #=============================================================================== function linux_hw_CPU { typeset num=0 typeset name="" typeset cores="" name="$( cat /proc/cpuinfo | awk -F: ' /vendor_id/ { vendor=$2 } /model name/ { model=$2 } /cpu MHz/ { if( model ~ "Hz" ) {speed=""} else { speed=$2? MHz" }; print vendor, model, speed; } ' | tail -1 )" num=$(if [ -r /proc/vmware/cpuinfo ]; then awk '/pcpu/ { print NF-1 }' /proc/vmware/cpuinfo; else cat /proc/cpuinfo | grep processor| wc -l; fi) # ESX: mas info sobre logical/cores/packages if [ -r /proc/vmware/sched/ncpus ] then cores=$( echo $( cat /proc/vmware/sched/ncpus ) ) fi echo $num $( echo "$name ($cores)" | enclose ) } function enclose { tr -s " " | sed -e "s/^/\"/; s/$/\"/; s/\"\ /\"/; s/\ \"/\"/" } function linux_hw_CPU { typeset num=0 typeset name="" typeset cores="" name="$( cat /proc/cpuinfo | awk -F: ' /vendor_id/ { vendor=$2 } /model name/ { model=$2 } /cpu MHz/ { if( model ~ "Hz" ) {speed=""} else { speed=$2" MHz" }; print vendor, model, speed; } ' | tail -1 )" num=$( if [ -r /proc/vmware/cpuinfo ] then awk '/pcpu/ { print NF-1 }' /proc/vmware/cpuinfo else cat /proc/cpuinfo | grep processor| wc -l fi ) if grep -q "physical id" /proc/cpuinfo || grep "siblings" /proc/cpuinfo then chip_count=$( grep "physical id" /proc/cpuinfo | sort -u | wc -l ) chip_core=$( grep "siblings" /proc/cpuinfo | tail -1 | cut -d: -f2 ) cores="($chip_count chips x $chip_core cores)" fi # Blades HP con if [ -x /sbin/hpasmcli ] then chip_name=$( /sbin/hpasmcli -s "SHOW SERVER" | grep "Name" | head -1 | cut -d: -f2 ) chip_speed=$( /sbin/hpasmcli -s "SHOW SERVER" | grep "Speed" | head -1 | cut -d: -f2 ) chip_core=$( /sbin/hpasmcli -s "SHOW SERVER" | grep "Core" | head -1 | cut -d: -f2 ) fi # ESX: mas info sobre logical/cores/packages if [ -r /proc/vmware/sched/ncpus ] then cores="($( echo $( cat /proc/vmware/sched/ncpus ) ))" fi # Linux Itanium IA64 if grep -q -i itanium /proc/cpuinfo then name="$( grep "vendor" /proc/cpuinfo | cut -d: -f2- | tail -1 ) $( grep "arch " /proc/cpuinfo | cut -d: -f2- | tail -1 ) $( grep "family" /proc/cpuinfo | cut -d: -f2- | tail -1 ) $( grep "cpu MHz" /proc/cpuinfo | cut -d: -f2- | cut -d. -f1 | tail -1 ) Mhz" chip_count=$( grep "physical id" /proc/cpuinfo | sort -u | wc -l ) chip_core=$( grep "siblings" /proc/cpuinfo | tail -1 | cut -d: -f2 ) cores="($chip_count chips x $chip_core cores)" fi echo $num $( echo "$name $cores" | enclose ) } linux_hw_CPU