Concluding too much from too little?

BY hoot| IN Media Freedom | 14/12/2007
Fifty-seven percent of Indians give a "good" performance rating to public news organisations in BBC¿s poll, compared with 39 percent globally.
The HOOT takes a closer look at which Indians constituted the sample.(Pix:BBC)

How much credence should one give to world press freedom surveys? The latest comes from the BBC World Service on its 75th anniversary.   It polled  all of 11,344 people in 14 countries and arrived at a variety of conclusions on world opinion about press freedom. These can be summarised as follows:

 

 

 

 

 

 

The survey was conducted for the BBC World Service by the international polling firms GlobeScan Incorporated and Synovate. Fieldwork took place between October 1 and November 21, 2007.  Tbe countries covered were Brazil, Egypt, Germany, Great Britain, India, Kenya, Mexico, Nigeria, Russia, Singapore, South Africa, the United Arab Emirates, the United States, and Venezuela. 

It gets interesting when you look closer at what Indians say. Together with Kenyans, we seem to have the most faith in the freedom of our press.  While 81 per cent in Kenya thought their press was "very free", 72 per cent of Indians did so. In contrast people in the US and Europe gave their countries a rating in the fifties. At the same time Indians said they  valued stability more than freedom.  

Who are these Indians? A little over a thousand people who live in Delhi, Chennai, Kolkata, and Mumbai.  These cities make up around 3 per cent of the population the survey hastens to add, but does metropolitan India constitute a representative sample for the  entire country? On the basis of this sample the survey concludes that  Indians believe stability is more important than press freedom. "Forty-eight percent of Indians (versus 40% globally) put stability first, while 41 percent (56% globally) put freedom first." 

The same Indians also have faith in the news purveyed by Doordarshan and All India Radio. "Indians are more positive about the accuracy and honesty of government or publicly-funded news reporting than any other country surveyed. Fifty-seven percent of Indians give a "good" performance rating to public news organisations, compared with 39 percent globally." But that is, more positive that other nationals. Indians were less positive about public funded news than about private news. Sixty four percent gave a good performance rating to private news. We don¿t of course know what income groups were surveyed, and how much access they had to private news, and surely some of this would have looked different if the sample had taken into account the rural population across the country. 

Sampling is always a tricky business.  While it is accepted wisdom that numbers don¿t matter if the sampling is scientifically done, it is still a bit odd to have a sample size that is roughly the same for India with its billion plus and Singapore with four million people. The US, Great Britain, Germany, Singapore, Nigeria, and India all have a sample size of 1000 or a few more in this survey, Brazil has a sample of 1500, the highest.

 

In six of the surveyed countries including India, the polling  was done by a market research firm called Synovate, which " generates consumer insights that drive competitive marketing solutions."   How did Synovate define concepts such as stability and social harmony for the people it surveyed, we wonder.