logo
  • Home
  • Blog-Navigation
  • Art
  • About
  • Contact

Wise Models – Analytics Graffiti

· Roopam Upadhyay 3 Comments

A Case for Wise Models

- by Roopam

– by Roopam

Lehman Brothers, a financial services company, filed for bankruptcy on 15th September 2008 – exactly five years from today. A company founded in 1850 disappeared overnight. The chain of events to follow brought the overall financial system across the world to its knees – hence started the biggest economic crisis since the great depression. A fair blame for the crisis was attributed to the financial models used by the rating agencies, banks and financial services. Now exactly half a decade since the meltdown, it seems a good time to ponder about wise analytical and financial models.

Being Wise

Early to bed and early to rise, makes a man healthy, wealthy and wise. I must have been four or five when I heard this phrase. Possibly, at that early age I got a sense of what human beings chase as adults – being healthy, being wealthy and being wise. Later when I grew up a bit, I could make out what being healthy and wealthy meant. However, for the longest time I used to think being wise meant someone who could do a math problem really fast. Today, some 30 years since, I am still pondering about the term – wise. When I see people around me they are all actively chasing health and wealth – but have they given up on being wise? Before this we must ask, what does being wise mean? I may have an answer and yes, there are some concepts of analytics in here too.

Laughing Buddha - by Roopam

Laughing Buddha – by Roopam

Traffic can make the polite use cuss words. What is it about traffic that can perturb us so much? Is it that we want to be somewhere and being stuck is just not acceptable? Awards can make the humble proud. Accolades and appreciation have that kind of influence on all of us. These are just a few examples, in daily life; there are tons of things that ruffle us.

The Buddha

When I think of the wise, say Buddha, they say he was unperturbed in most situations. You praised him and he stayed calm. You offended him and he was unflustered – at least that is what most Buddhist stories say. So was he detached and did not care. Is that the secret of being Buddha? He did leave his family to live the life of ascetic. However, then he did realize that it was useless, stopped running and came back to the world. He was absorbing information, as we do, without getting affected. Rather, he provided solace to the perturbed. Possibly, that is wisdom or being wise.

I think the secret to wisdom or being wise is self-knowledge. Once you know who you are, the external factors would not perturb your inner core.  It is certainly not about knowing it all but knowing what you do not know. Knowing one’s own limitations and accepting them makes a human wise.

The State of Equilibrium

EquilibriumPoise, I have always found this word funny. The sounds of some words tickle your eardrums – poise is one such word for me – not the meaning of the word just its sound. Poise actually means equilibrium, state of balance or composure. Let us consider the adjacent graph. The green zone in the middle is the state of poise. The state you find yourself while reading a good book on Sunday afternoon, or playing with the kids, or staring at the night sky. A manic-depressive often lives in the red zones. Most of us traverse through all the zones in a day’s time – the highs and the lows. Traffic throws us down and awards up.

Wise models

Means

The law of Average

Keeping the above in mind, let us come back to analytics. Recall the most fundamental concept of average. Now, consider two different kinds of averages (a.k.a mean) one with million data points and other with just five. Both have the same value of say 100. Now, you throw in some new information and add 1000 to both these values. The first one will stay mostly unaffected but the second one will jump up 150%. The down side or adding -1000 will have the same impact on the values.

Regression towards the Mean

The following is an example of regression model. The relationship between age of a teenager (in years) and his height (in feet) is displayed in the model. This is most certainly not the best of models but is used for the purpose of illustration.

Height=0.1\times Age+4+\epsilon

Now the beta values or 0.1 and 4 in the above case are the soul of regression models. The beta values are actually average or mean values of the parameters. The ideas we discussed above about averages applies to the beta values as well. Notice, this is not a universal model. It will only hold true for teenagers. For a 100-year-old male, the model will not estimate him to be 14 feet tall. The same applies to logistic regression discussed in a previous article. Genuine models have well defined boundaries for which they will hold true. They don’t pretend to be true universally.

We have already created the foremost requirement for wise models. They do not fluctuate much when some unusual information comes their way. On the contrary, wise models understand the limitations of their knowledge and define the boundary for which they will hold true. This also means that the end users are aware of the zone of uncertainly from the beginning rather discovering it at the time of crisis. The understanding of their lack of knowledge is the golden knowledge all wise models possess and inform to stakeholders. In industry, stress testing is one way to measure how models behave in a state of distress or unusual conditions. However, many times this could be just a mathematical jugglery. The breakdown of financial models during the financial crisis five years ago is a testimony that the models were not wise. They were mostly driven by greed and were not unbiased to begin with. The rating agencies S&P, Fitch and Moody’s were stress testing their models while grossly underestimating the situations to follow.  They either did not have the knowledge of the reality to follow or were scared to reveal the truth – as it would have affected their own balance sheets and client relationships.

Sign-off Note

Are we wise now? I wish I had the answer. Nevertheless, to be wise financial services, analysts and the world as a whole can learn a few lessons from Buddha.

  • Share
  • Twitter
  • Facebook
  • Email
  • LinkedIn

Related

Posted in Analytics Graffiti, Banking Models | Tags: Banking and Insurance Analytics, Business Analytics, Predictive Analytics, Roopam Upadhyay |
« Big Data – Lessons from Genetics and Bio-Statistics
Data Visualization – Banking Case Study Example (Part 1) »

3 thoughts on “Wise Models – Analytics Graffiti”

  1. Chetan Ahuja says:
    March 19, 2014 at 1:43 pm

    100 becomes 250 means 150%, it also means 2.5 times , I had a hard time explaining to most people especially my seniors who are claimed as leaders in media planning in India . Cheers ! great article

    Reply
    • Roopam Upadhyay says:
      March 19, 2014 at 8:15 pm

      I hope you were able to explain the concepts to your seniors at the end of your hard effort. 🙂 Trust me it is a crucial part of job description for data-scientists and analysts to communicate difficult and sometimes obvious to you concepts to colleagues. Keep at it and be patient, all the best.

      Reply
  2. Balaji says:
    September 27, 2017 at 4:26 pm

    Good one!

    Reply

Leave a comment Cancel reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Subscribe to Blog

Provide your email address to receive notifications of new posts

Must Read

Career in Data Science - Interview Preparation - Best Practices

Free Books - Machine Learning - Data Science - Artificial Intelligence

Case-Studies

- Marketing Campaign Management - Revenue Estimation & Optimization

Customer Segmentation - Cluster Analysis - Segment wise Business Strategy

- Risk Management - Credit Scorecards

- Sales Forecasting - Time Series Models

Credit

I must thank my wife, Swati Patankar, for being the editor of this blog.

Pages

  • Blog-Navigation
  • Art
  • About
  • Contact
© Roopam Upadhyay
  • Blog-Navigation
  • Art
  • About
  • Contact
 

Loading Comments...