Sunday, April 04, 2004

Hypothesis-led Surveys of Influence - on KAP

Today, on my day off, I have read through proposals received from two companies in Bangladesh to do an opinion survey of about 100 people in 20 organisations. The TORs (which I developed) ask a survey company to undertake a two stage survey process:

1. Interview PETRRA (a project) staff about which organisations they think their project has influenced most and least, and in what ways

2. Interview those companies to test out whether PETRRA staff hypotheses about expected influence are supported or not. Using open and closed questions and any other appropriate methods

A hypothesis led impact survey should produced a much more focused bit of evaluation research. The impact of the survey itself should be visible. If it finds the project staff hypotheses not supported by its findings then this should lead to changes, either in how PETRRA understands its influence, or in how the company does such surveys in future.

So far its not looking good. Both proposals have made no mention of the first round of interviews. They are just going to develop some questions of their own and then go out and interview people, and then presumably try to make sense of the results, without the bother of any guiding hypotheses! Oh well... it looks like we will have to provide them with a second round of briefing instructions and hope they get it right this time


No comments:

Post a Comment