Importance of exploratory data analysis of dummy variables, logit/probit using eviews

By IMPRI Team
IMPRI Generation Alpha Data Centre (GenAlphaDC) along with IMPRI Impact and Policy Research Institute, New Delhi conducted a Two-Week Immersive Online Hands-On Certificate Training Course on Exploratory Data Analysis with Categorical Variables Regression Models Dummy Variables and Logit/Probit using EViews, on December 10 and 17, 2022. The expert trainer for the course was Professor Nilanjan Banik, Professor at Mahindra University. He is a Visiting Consultant at IMPRI and an Academic Consultant with Geneva Network, United Kingdom, and a Senior Consultant with Hankuk University of Foreign Studies, South Korea.
The convenors for the event were Prof Vibhuti Patel, Visiting Professor at IMPRI and a Former Professor, Tata Institute of Social Sciences (TISS), Mumbai; Dr Soumyadip Chattopadhyay, Associate Professor, Economics, Visva-Bharati, Santiniketan and a Visiting Senior Fellow, IMPRI; Dr Arjun Kumar, Director, IMPRI. The training course had participants from the field of data and policy– including students, professionals, researchers, and many others.

Day 1 | December 10, 2022

The session began by going through the basics of Regression. The first question he pondered upon is what the meaning of a “dummy” is. He stated that in essence, it means a replica. Here, in a regression model, if X is a dummy variable, it means that it is a qualitative variable. He began by laying down some assumptions about the dependent and the independent variables. First, X and the Error Term (e) are not related, if related, there will be a problem of endogeneity. X is not quantitative if it is a dummy variable. He explained how we can constitute various qualitative traits in a dummy variable such as gender, and ethnicity among others in a regression model. It tries to capture the impact of any variable that is qualitative in nature.
Second, he mentioned that a dummy variable can capture any break or shift in data. He used the example of the Indian economic reforms of 1991, which was a breakpoint in terms of per capita GDP levels. After 1991 there was a big jump in GDP growth. In other words, there was a structural break. Dummy variables can capture such structural breaks. Thirdly, he mentioned that dummy variables can also be used to de-seasonalize the data. Using Excel, he showed how to incorporate dummy variables in a regression model and how dropping a dummy variable is important in order to avoid a Dummy Trap. He also showed how to de-seasonalize the data, using Excel. After de-seasonalizing the graph turned out to be more stable than before.
After explaining over Excel, he showcased the same data set on EViews. He selected the variables such as sales figures, trends, etc. He then created the dummy variables out of the four quarters. He ran the regression without the dummy first. Then he showcased a data set where he introduced a dummy and ran the regression. The data set used was US Trends in Gross Personal Income and Gross Personal Savings from 1959 to 2007. The dummy variables reflected the recession points from 1981 to 1984. The regression diagram consequently showed the breaking point due to the recession of 1981. The session ended for the day with this, after which, Professor Banik went on to take questions and clear doubts of the trainees. The next class was saved to learn Logit and Probit Models.

Day 2 | December 17, 2022

The second day of the session conducted by Professor Nilanjan Banik, titled, “Exploratory Data Analysis with Categorical Variables Regression Models: Dummy Variables and Logit/Probit using EViews” was devoted to the concepts of Logit and Probit. Professor Banik started by explaining the basic equation of a regression model, and the components within it. Here, the motive was to explain the concept of dummy variables, and the Probit/Logit model, when the variables X and Y are qualitative respectively. Then with an example of hourly wage rates, he showed how to interpret dummy variables for various categorical variables.
After explaining dummy variables, he followed it up by talking about Logit functions. He mentioned that in Logit functions, the dependent variable, Y, takes values of 1 or 0. The Logit or Probit model describes the odds of an individual meeting the outcome variable, given a certain trait or characteristic. He mentioned the importance of LR tests in Probit models. The Logit/Probit models primarily deal with the dependent variable (Y). He showed that the Y variable takes values between negative infinity to positive infinity. He proved this by showing the method to derive the value of Y using Probability. Since the P value will be between the value of 0 and 1, the Y value will take the value of negative Infinity to positive infinity.
After delving into theory, he started a practical lesson on the above discussions with the help of a data set on EViews. First, he showed how to introduce dummy variables on a set of observations. Then, Professor Banik went on to show how to interpret Logit functions on EViews. For this, he again used the previous US data on Savings and Income to show the recession point. Using other data he showed how smoking is affected by age, income, and education. He explained what the P value shows using the formula for the same. He also showed it practically based on the regression model and the results generated from it. Then he took questions from the trainees which he promptly clarified. With this, the two-day training course ended.

---
Acknowledgement: Aaswash Mahanta is a research intern at IMPRI

Comments

Urgent need to study cause of large number of natural deaths in Gulf countries

By Venkatesh Nayak* According to data tabled in Parliament in April 2018, there are 87.76 lakh (8.77 million) Indians in six Gulf countries, namely Bahrain, Kuwait, Oman, Qatar, Saudi Arabia and the United Arab Emirates (UAE). While replying to an Unstarred Question (#6091) raised in the Lok Sabha, the Union Minister of State for External Affairs said, during the first half of this financial year alone (between April-September 2018), blue-collared Indian workers in these countries had remitted USD 33.47 Billion back home. Not much is known about the human cost of such earnings which swell up the country’s forex reserves quietly. My recent RTI intervention and research of proceedings in Parliament has revealed that between 2012 and mid-2018 more than 24,570 Indian Workers died in these Gulf countries. This works out to an average of more than 10 deaths per day. For every US$ 1 Billion they remitted to India during the same period there were at least 117 deaths of Indian Workers in Gulf ...

A comrade in culture and controversy: Yao Wenyuan’s revolutionary legacy

By Harsh Thakor* This year marks two important anniversaries in Chinese revolutionary history—the 20th death anniversary of Yao Wenyuan, and the 50th anniversary of his seminal essay "On the Social Basis of the Lin Biao Anti-Party Clique". These milestones invite reflection on the man whose pen ignited the first sparks of the Great Proletarian Cultural Revolution and whose sharp ideological interventions left an indelible imprint on the political and cultural landscape of socialist China.

India's health workers have no legal right for their protection, regrets NGO network

Counterview Desk In a letter to Union labour and employment minister Santosh Gangwar, the civil rights group Occupational and Environmental Health Network of India (OEHNI), writing against the backdrop of strike by Bhabha hospital heath care workers, has insisted that they should be given “clear legal right for their protection”.

History, culture and literature of Fatehpur, UP, from where Maulana Hasrat Mohani hailed

By Vidya Bhushan Rawat* Maulana Hasrat Mohani was a member of the Constituent Assembly and an extremely important leader of our freedom movement. Born in Unnao district of Uttar Pradesh, Hasrat Mohani's relationship with nearby district of Fatehpur is interesting and not explored much by biographers and historians. Dr Mohammad Ismail Azad Fatehpuri has written a book on Maulana Hasrat Mohani and Fatehpur. The book is in Urdu. He has just come out with another important book, 'Hindi kee Pratham Rachna: Chandayan' authored by Mulla Daud Dalmai.' During my recent visit to Fatehpur town, I had an opportunity to meet Dr Mohammad Ismail Azad Fatehpuri and recorded a conversation with him on issues of history, culture and literature of Fatehpur. Sharing this conversation here with you. Kindly click this link. --- *Human rights defender. Facebook https://www.facebook.com/vbrawat , X @freetohumanity, Skype @vbrawat

Uttarakhand tunnel disaster: 'Question mark' on rescue plan, appraisal, construction

By Bhim Singh Rawat* As many as 40 workers were trapped inside Barkot-Silkyara tunnel in Uttarkashi after a portion of the 4.5 km long, supposedly completed portion of the tunnel, collapsed early morning on Sunday, Nov 12, 2023. The incident has once again raised several questions over negligence in planning, appraisal and construction, absence of emergency rescue plan, violations of labour laws and environmental norms resulting in this avoidable accident.

Job opportunities decreasing, wages remain low: Delhi construction workers' plight

By Bharat Dogra* It was about 32 years back that a hut colony in posh Prashant Vihar area of Delhi was demolished. It was after a great struggle that the people evicted from here could get alternative plots that were not too far away from their earlier colony. Nirmana, an organization of construction workers, played an important role in helping the evicted people to get this alternative land. At that time it was a big relief to get this alternative land, even though the plots given to them were very small ones of 10X8 feet size. The people worked hard to construct new houses, often constructing two floors so that the family could be accommodated in the small plots. However a recent visit revealed that people are rather disheartened now by a number of adverse factors. They have not been given the proper allotment papers yet. There is still no sewer system here. They have to use public toilets constructed some distance away which can sometimes be quite messy. There is still no...

Women's rights leaders told to negotiate with Muslimness, as India's donor agencies shun the word Muslim

By A Representative Former vice-president Hamid Ansari has sharply criticized donor agencies engaged in nongovernmental development work, saying that they seek to "help out" marginalizes communities with their funds, but shy away from naming Muslims as the target group, something, he insisted, needs to change. Speaking at a book release function in Delhi, he said, since large sections of Muslims are poor, they need political as also social outreach.

Warning bells for India: Tribal exploitation by powerful corporate interests may turn into international issue

By Ashok Shrimali* Warning bells are ringing for India. Even as news drops in from Odisha that Adivasi villages, one after another, are rejecting the top UK-based MNC Vedanta's plea for mining, a recent move by two senior scholars Felix Padel and Samarendra Das suggests the way tribals are being exploited in India by powerful international and national business interests may become an international issue. In fact, one has only to count days when things may be taken up at the United Nations level, with India being pushed to the corner. Padel, it may be recalled, is a major British authority on indigenous peoples across the world, with several scholarly books to his credit.

Gujarat Bitcoin scam worth Rs 5,000 crore "linked" with BJP leaders: Need for Supreme Court monitored probe

By Shaktisinh Gohil* BJP hit a jackpot in the form of demonetisation, which it used as an alibi to convert black money into white in Gujarat. Even as party scrambles for answers of how the Ahmedabad District Cooperative Bank (ADCB), whose director is BJP president Amit Shah, received old currency worth Rs 745.58 crore in just five days, and how Rs 3118.51 crore was deposited in 11 district cooperative banks linked with Gujarat BJP leaders, a new mega Bitcoin scam, worth more than Rs 5,000 crore has been unraveled.

Counterview

Search This Blog