Metrics and Measurements

Voice on phone: Sir, On a scale of 8-10, how would you rate our service?
Me:                    I would not rate you on a scake of 8-10
Voice:                 Sir Why wouldnt you rate us on a scale of 8-10
Me:                     Because 8-10 is not a scale.
Voice:                  Ok, How would you rate us on a scale of 1-10
Me:                     Sorry I cannot rate since you have confused me completely  now.

This is an actual conversation that happened with a car service station a couple of years back.

I am reminded of this incident because of a recent similar incident with an automobile provider.

There are some issues with my new car and I am getting continious calls from some call center asking me about my "purchase, marketing and delivery experience". When i tell them about my overall unsatisfactory experience which is still unresolved, they get confused and ask me to rate just the marketing and purchase experience. To cut the conversation short, I tell them I am overall unsatisfied but if they want feedback I can give it to them, but ask them to confirm if they really want it since my experience is negative. This normally either scares or confuses  them and they say it is okay and hangup. Unfortunately some checklist somewhere shows that my feedback is not complete so I get periodic phone calls with the same questions and  the cycle will continue till some one finally crosses my name from the checklist.

Ok What has this got to do with metrics and measurements?

This is a malaise that is spreading far and wide and shows how wrong measurements can generate wrong behaviours. In the above example, the person did not know if she should collect negative feedback and took the easy way out by just not collecting the feedback. In the  process the company lost an opportunity to get genuine feedback and worse got a lot of contaminated feedback since it was incomplete. In the first case of the scale of 8-10 it was either fudging at its worst, or a complete defective program intended for self delusion or to fool the world.

Now the fault does not lie with the people who do the surveys but rather the management which is not clear about what and why they are measuring. Take for example a resteraunt. In case you fill in the feedback and mention that something was average, you have delayed your leaving for some time while the staff  keep asking you why your feedback was "average" and not "good" and hinting at the fact that they will get into trouble with such feedback. In such cases I take the easy way out and just mark excellent for everything which again will waste a lot of other peoples time (and saving mine) while they collect, collate and analyze all the incorrect  data and come to wrong conclusions.

The above were very simple and a "Dummies example" but this same  problem is very prevalent in the field of software which is my bread and butter.  Software and more so in the Indian context has some
charecteristics which make measurement very fuzzy. The whole measurement hoopla  started when companies started chasing ISO and CMM and came to the conclusion that it was mandatory to collect metrics without understanding the intent. In the chase to get the coveted ISO certification or CMM assessment (many people confuse certifiation and assessment) , the metrics became the goal. In one of the software process discussion forums I used to frequent, a common question was "We want to start ISO/CMM/Sig sigma...) , so whar metrics should we collect"?  The frivlous answer which I made on occasions was to ask "What are you trying to achieve?". If you are not sure, collect some easy metrics like the temperature, humidity..... If you know what you want to achieve, select measurements that will tell you if you are on track to reching your goals or not. However without knowing what you want to achieve, there is no point in measuring anything.

Collecting metrics for the sake of collecting metrics is a waste of time.

I have thought a lot on why we have still no clarity in the are of software measurements. There are volumes of books and papers on this subject, but for some reason I  have very rarely seen a successful metrics program implemented which really used as a leading indicator for a strategic goal. I dont claim to be an expert or authority but do have considerable exposure to the industry and stand by my belief. I am not sure as to what the reason is for this gap.

Here are the some of the possible reasons:

1) Software is an art and not a science. Imagine if Leonardo Da Vince was managed by metrics. He would be tracking how many square feet of canvas he painted per day?
2) We are a bit fuzzy about what we do (ok this is an exagerration)
3) The whole measurement programs are designed by non practioners without any strong  management sponorship, largely to satisfy some statutory requirement.I think this is the second most most common cause
4) The metrics are used to judge peoples performance. This in my opinion is the most common reason for a metric program failure. This is a very controversial subject with the majority of the view that how do you make people accountable for something unless they are measured. Now I dont have a very convincing answer for this exceppt to fall back on authorities and  the fact that far more knowledablepeople  and gurus say that metrics should not be used to judge people but are a tool to guide you to achieve objectives and
meeting the objectives is what should be used to judge performance. This is actually a whole discussion by itself and I will leave it at this.  What is important to note is that practice of linking improvement metrics to individual performance is what generates wrong behaviours. A dummies example  would be call centers where the employees I presume are measured by the number of calls they close per unit time. What is not measured is the percent of saisfactory resolution which I understand encourages the front end employees to close calls by just transferring to the next link which is normally more expensive. I cant think of crystal clear examples in the soatware arena and will  leave it to another post.

I am looking for a forum to discuss this further but have got a bit rusty in this field. Anyway I hope this post generates some discussion since I am myself curious about this discussion.


What is important to note that measurements, metrics and KPIs are an absolutely invaluable tool for any sort of improvement or tracking and it is important to get this right.

Sanjay Dutt and Italian Marines

Having stopped watching television for a couple of weeks I found that I was not missing anything much. By and large watching the news debate is very interesting to observe people’s opinions on something they know nothing about. It is also interesting or depressing to see politicians views and outlook and the partisan attitude to anything and everything.

It was a misfortune that I got engrossed in the recent two issues of national importance viz the Sanjay Dutt sentencing and the return of the Italian marines.

1)  Sanjay Dutt had all my sympathy. There was no doubt that he had committed a crime and had suffered sufficiently and the sentence seemed a bit excessive. But I did get swayed by an argument on TV where a senior lawyer (Tulsi ?)  did open my eyes by his argument.

I     On reflecting, I think it is clear:

a.       Sanjay Dutt was guilty of a crime of possessing arms illegally. While he has explained his position, the fact remains that he knowingly did something illegal and it is assumed that he knew the consequences of what he did.

b.      He has been acquitted of the more serious charges of terrorism but has been consistently found guilty of illegal possession of arms.

c.       Our constitution is based on the premise of equality of all before law so he should be tried  as any one who does any similar act but does not bear his illustrious named, lineage or connections.

d.      Courts need to act based on law and not on public opinion. The most ridiculous argument is the amount of money locked up in films and that is mentioned as a reason to release him.

What  is  not beeing discussed is that it has taken  20 years since the offense to reach a conclusion. This is not a final conclusion since a review petition can still be filed and it is not known how long this process will take. Why does it take so long to deliver justice ? This is an area which needs urgent reform and which no one is talking about. A lawyer relative had once told me that the law is basically common sense but in India what rules is procedural law viz a viz principles of law.  That is, it is very easy to delay justice by following procedures. As a side note, a common method earlier  of protest used to be “Work to Rule”.  If everyone worked to rule, nothing could be done. When bus drivers and conductors worked to  rule, they did not allow anyone to stand, waited till all tickets been purchased before the bus moved….. So working strictly to rule can cause a near collapse of the system.

Coming back to the Sanjay Dutt case – once again my sympathies are with him. HE has committed a big crime but one can say that he has reformed and the idea of a prison sentence is after all to reform criminals and put the fear of prison as a deterrent for crime.  But to release or pardon him would mean looking at similar cases and not making any exceptions because of his public standing. 

2) Italian Marines

This is also a very strange case. The final result is a credit to firm diplomacy. The facts are clear

1)      The Italians did kill the fishermen. This is not premeditated murder but would be homicide.

2)      There is a dispute about jurisdiction and this needs to be settled fast

3)      They had got bail from the courts and hence has freedom of movement. Chandan Mitra from the BJP was accusing the government of colluding with the Italians pretending to ignore the fact that the govrnment is actually following the law.

4)      The Italians were undoubtedly planning on “pulling a fast one” but did buckle under diplomatic pressure.

5)      There is no point in ranting on intent but it is important to note that the matter is “resolved”.

6)      Credit is due to the government for handling it with the seriousness due. There is no doubt that an aggressive supreme  court did contribute to push for a solution. But for the court the government would have dawdled.

7)      The Italian government  need to keep Italian public interest in mind as much as the Indian government needs to keep Indian public interest in mind. What is said in public is not necessarily said in private. Diplomacy works differently.

What is again not being discussed is the fact that it is 1 year and 2 months since the incident and we are no where near even starting the process of trial. There are 2 straight forward points here, 1) Where is the trial to be conducted given international treaties and laws that we are signatories too  and 2) Are the marines guilty of murder and if so of what degree.  There is justifiable outrage on the part of the public on the behaviour of the Italian government and ambassador but no one seems to be talking about an immediate trial.

Bandhs and L' Affair Robert Vadhra

Most of us in Bangalore have been under house arrest in view of the Bangalore Bandh. This bandh has been different from previous ones in that it seems to have a wide support. As always, I doubt anyone knows what the issues are regarding the dispute except that Karnataka should not release water to Tamil Nadu.  The cable operators have joined the strike and the only channels working are the news channels. This means one can chose between the Bandh and  L’affair Robert Vadhra. Both are equally depressing.

I don’t know anything about the water dispute and will try to educate myself before talking about it. One of the professor types on television seemed to think strongly that Karnataka had a case but I unfortunately watched it towards the end and missed the gist.

The Vadhra episode has been going on repeatedly and makes one more and more depressed. It is difficult to judge which is more ridiculous, the childish rants of Team Arvind or the  defence from the Congress.  My view is  that team Arvind is the more ridiculous and the  Congress frontguard of Salman Khurshid makes a stronger case. The self-righteousness of team Arvind  and substituting analytical thought  with innuendos makes me feel there is not much of a case. The whole affair does look a bit suspicious and might need some investigation but there is just not enough data to prove anything.  Assuming that there is a case,  Robert Vadhra should certainly face the majesty of the law and assuming there is none, so should Arvind and Prashant. However in India, “the law will take its own course” which means irrespective of either scenario it will take 25-30 years to reach a conclusion.

The media actions and inactions show a gradual collapse of one of the pillars of a democracy – the fourth estate.  Indian media seem to have got away from the traditional reporting and commentating to showmanship and pandering to ratings. (This same malaise has hit the health care but that is a different story).

The depressing part which I mentioned earlier is the complete lack of any substance in the debates on television.   Most of the political participants seem to substitute quality with volume and try to shout each other down. We are not seeing anything resembling an idealogy or position and these are substituted by mud-slinging

I keep coming back to thinking around ideology. How many of the partys have a clear ideology which they can declare and stick to if voted to power ?  Arvind Kejriwal  has announced that he would pass the Lokpal bill within 10 days of coming to power. This does indicate that law and civics is not his strong point and he possibly does not know (like most of us) how laws are passed in this country. Prashant Bhushan cannot claim the same ignorance and it is surprising that he is not correcting his political colleague.  He  goes on to assure us that  they will ensure that Petrol (or diesel?) prices will be pegged at Rs. 50 and no one will be allowed to make profits on essential commodities. That shows the same level of ignorance in economics as in civics.

On the subject of debates,  www.csun.edu/~dgw61315/fallacies.html  may look heavy but is very interesting  read and useful.  Unfortunately those who need to read it – don’t.

Update: 9-Oct Corrected link to logical fallicies

Judical Activism - Part 1

The  news channel between 8:00 PM and 9:00 PM seems to be the few watch-worthy channels  surpassed only by National Geographic and The Discovery families. During this time all channels seem to have debates between various panellists most of whom are familiar faces akin to the Page 3 mugshots  one sees in the daily rags.

The low quality of debate never ceases to appal me.  After all most of the panellists are supposed to be “experts” in some fields  and I guess the  low quality come from low quality of thought process and not one of communication, . One  subject which seems to hog the limelight nowdays is that of “Judicial Activism”. This is a subject which has interested me since some time and hence maybe debates around this subject are all the more engaging to me.

What stands out in these discussions is the poor or rather lack of knowledge of elementary civics by participants and panellists.  I have never validated this, but I feel that in a reasonable sample size, 50% of the sample would not know the difference between the roles and responsibilities of the different organs of the government.

What I find surprising is the universal accolade by common citizens to the judicial system in trying to “clean up” administration. In the short term it is no doubt true that the quality of life has increased because of this activism, however if one sees this in the larger perspective  it is a complete break down of constitutional institutes and fraught with danger for the republic.

Let us start by getting a clearer view of the law and the organs. However complex the constitution and the language in it, one must keep in mind that law is basically common sense based around a few principles and  there has hardly  been any  radical innovations in the last many decades.

To give a dummys views,  the laws are based on the constitution which Has created three organs. One to create new laws (Legislate) one to implement the laws (Govern) and one to  interpret the laws,safeguard the constitution  and ensure that justice prevails(Judiciary). The roles of each organ is cleary defined and if any of these organs over step their roles, it is imperative to rectify this immediately. At the end of the day, the people are the ultimate rules and have the power to change anything by their power to vote. This brings a system of checks and balances.

Let us now get into the phenomenon of  judicial activism which seems to be more pronounced in India.

Wikipedia is the first choice of  research and though it can be hardly called an authority has this to say about Judicial Activism . "Judicial activism describes judicial rulings suspected of being based on personal or political considerations rather than on existing law. It is sometimes used as an antonym of judicial restraint"

I would not subscribe to the above view and would define Judicial Activism as a state where the judiciary takes a much broader view of their powers and tries to reach out justice to the people.

Let us try and understand a bit deeper on what is the role of the judiciary as  a prelude to the rest of the article. To put it very simply the judiciary has to:

1. Ensure justice (both in criminal and civil matters) is done according to law
2. Interpret the existing laws when there is a doubt therof
3. Safeguard the structure of the constitution and ensure that the citizens’ rights are protected.

What the judiciary is not supposed to do and would be overstepping their role  if they do is:

1. Create laws or judgements that are perceived as laws
2. Make decisions outside laws
3. Get into policy and administration
4. Be the prosecutor, investigator and judge

A democracy as we were taught in school had 3 pillars as mentioned in the opening paragraph of this article. There is of course the  4^th pillar which is the press. An objective assessment of these pillars would  undoubtedly indicate that all pillars are tottering if not already fallen.

The fact that the legislature has stopped legislating and the  government has stopped governing is well known.  We could argue that the press has played an important role in exposing many institutional misdeeds to the citizens and I will defer my perceptions on breakdown on this front. What is not well known is the breakdown in the judiciary which  will be explained in more detail in the next part of this post.

Trip to Masinagudi

http://www.team-bhp.com/forum/travelogues/118733-chaotic-bangalore-calm-masinagudi.html

Old trip to Goa

http://www.team-bhp.com/forum/travelogues/90629-love-story-sun-surf-sand-sorpotel.html

Experimenting

Blogger had made things far simpler for creating sites for people who are not exactly uptodate with web technology. It was quite easy moving from the old site. Some random posts coming up.