Upper caste bias in methodology behind wrong Bihar exit poll results on TV: Psephologist Yogendra Yadav
Well-known psephologist Yogendra Yadav believes that a major reason why the TV channels have failed to properly predict what would happen in the Bihar elections was a “sampling bias built in the methodology of the exit polls” which failed take into account upper caste bias.
A well-known political scientist who is attached with the Aam Admi Party (AAM) breakaway group Swaraj Samvad, Yadav said in a Facebook post a day before the Bihar polls showed a resounding victory to the Nitish Kumar-led Grand Alliance, this time he did not get into “making a forecast.” Also, he “did not have access to survey data, nor did I travel to Bihar this time.”
Yet, from his “reading”, which is based “purely on electoral commonsense and some experience in reading exit polls over the years”, he believed, the TV channel pollsters were set to go wrong, and the Grand Alliance would head for “a clear, perhaps even comfortable, majority”, and if his reading was correct, “its tally could go well beyond the highest forecast of 130 seats.”
Yadav gave the following reason for his analysis: “Over the last two decades, almost all exit polls have over-estimated the BJP or the alliance favoured by the upper caste. This error could be anything between 2-4 percentage points.”
He said, “This is not due to any upper caste conspiracy (no media house wants to get its exit poll wrong) but due to a sampling bias built in the methodology of exit polls” which counted on what individuals from upper castes said more than those who belonged to the backward castes.
“When you stand outside the polling booth, the voters who agree to be interviewed tend to be more from powerful social groups. Although the situation has changed a lot in the last two decades, the voters from weaker communities are less likely to speak the truth in public”, he said.
“This error could be decisive in a close election like this one. All the polls are reporting that the difference between the two main rivals is around 1-2 per cent votes”, Yadav said.
“They also tell us that this has been a very polarising elections where the upper castes and OBCs (but not SCs) are sharply divided. So the sampling and reporting error would work almost entirely against the Grand Alliance (with the exception of BJP's Dalit allies)”, he added.
“Assuming that the error is around 2 per cent, the findings of all the polls should be adjusted to reduce NDA vote share by 2 per cent points and increase Grand Alliance by 2 per cent. This would dramatically change the balance in favour of the Grand Alliance, which would enjoy a lead of 3-5% over the NDA”, Yadav predicted.
“Only CSDS survey, which uses post-poll and not exit poll, reported in the Indian Express, projected a 4 per cent lead for Grand Alliance”, Yadav said, adding, “I have nothing to do with that survey any more, but continue to trust its methodology and fieldwork more than anything else. In a straight bipolar contest, it could give the Grand Alliance a clear majority.”
CNN-IBN "doubted", withdrew its exit polls
Meanwhile, well-known international news portal Huffington Post revealed ahead of the results that the CNN-IBN strangely decided to withdraw its exit poll results. Shivam Vij, in an incisive report, quoted “multiple sources in the channel” to say that the agency which carried out the exit poll, Axis APM, gave the Nitish Kumar-led Grand Alliance, at 169-183, and the BJP and its allies just about 58-70 seats.
“According to a person familiar with the backroom conversations, the channel asked Axis APM to explain how they were forecasting very high seats particularly for the Congress, 26-30 of the 41 they are contesting, and demanded some other explanations, too”, the portal reported.
The portal said, “Axis APM had also conducted the pre-poll survey for CNN-IBN, which had forecast a comfortable 137 seats for the Grand Alliance”, adding, instead of giving exit poll results, the CNN-IBN “ran a poll of polls, aggregating the five exits polls broadcast by other channels.”
Of five exit polls broadcast on November 5, two predicted a clear majority for the Grand Alliance, but only by a few seats. Given 122 seats as the majority mark, ABP News-Nielsen predicted 130 seats for the Grand Alliance and Times Now-C Voter predicted exactly 122.
Two exit polls said their data showed the result was too close to call. India Today-Cicero forecast 111-123 seats for the Grand Alliance and 113-127 for the NDA. The India TV-C Voter exit poll forecast 112-132 seats for the Grand Alliance and 101-121 seats for the NDA. One exit poll by Today’s Chanakya, broadcast on the News 24 channel, predicted the NDA would get 155 seats, and the Grand Alliance 83.
“According to a person familiar with the backroom conversations, the channel asked Axis APM to explain how they were forecasting very high seats particularly for the Congress, 26-30 of the 41 they are contesting, and demanded some other explanations, too”, the portal reported.
The portal said, “Axis APM had also conducted the pre-poll survey for CNN-IBN, which had forecast a comfortable 137 seats for the Grand Alliance”, adding, instead of giving exit poll results, the CNN-IBN “ran a poll of polls, aggregating the five exits polls broadcast by other channels.”
Of five exit polls broadcast on November 5, two predicted a clear majority for the Grand Alliance, but only by a few seats. Given 122 seats as the majority mark, ABP News-Nielsen predicted 130 seats for the Grand Alliance and Times Now-C Voter predicted exactly 122.
Two exit polls said their data showed the result was too close to call. India Today-Cicero forecast 111-123 seats for the Grand Alliance and 113-127 for the NDA. The India TV-C Voter exit poll forecast 112-132 seats for the Grand Alliance and 101-121 seats for the NDA. One exit poll by Today’s Chanakya, broadcast on the News 24 channel, predicted the NDA would get 155 seats, and the Grand Alliance 83.
Comments