Skip to content

Why the right survey method depends on the target population

A survey covering parts of Malawi may be collected on tablets, through interviewer-led calls or through online forms, but these modes do not create equivalent samples automatically. The study team must decide what counts as an eligible respondent, which contact frames exist and which subgroups might be left out. Comparing Lilongwe with Blantyre is useful because an administrative and consumer-services capital contrasts with a southern commercial centre. The final method should follow the research objective, not the other way around.

Before selecting technology, clarify what decision the study will support. A programme assessing actual facility access may require physical observation; a business following up known clients may have usable telephone contacts; a professional survey may rely on verified electronic invitations. Identify the sampling unit, intended geographic coverage, minimum subgroup precision and acceptable burden. Compare modes against these requirements rather than assuming that smartphones make every population equally reachable. A successful data collection method produces valid evidence, not simply a large file.

CAPI: when in-person digital interviewing is strongest

Computer-Assisted Personal Interviewing, or CAPI, uses an interviewer carrying a programmed tablet or smartphone. It is especially useful when selected households, businesses, facilities or physical assets must be visited and verified. A well-programmed form can route questions, enforce reasonable ranges and capture time or location checks where justified. Offline collection can help where mobile data is unreliable, although the team still needs a secure synchronisation plan. Costs include travel, enumerator time, supervision, field permissions and safe access; the highest-cost method may nevertheless provide the strongest coverage.

CATI: when interviewer-led telephone surveys fit

Computer-Assisted Telephone Interviewing, or CATI, permits a trained interviewer to administer questions by voice using a calling system or structured digital form. It can be suitable for beneficiaries with verified contact records, existing customers, business contacts and rapid follow-up studies. The major risks are unreachable numbers, shared phones, unequal ownership and short respondent attention spans. A reliable CATI protocol defines call attempts at different times, dispositions, appointments, refusals and consent for any recording. A random collection of available mobile numbers is not automatically a representative national sample.

CAWI: when self-completed online surveys are credible

Online self-completion can suit employee engagement, service feedback or research with authenticated digital members. It may also be efficient for message and concept tests where participants need to see images. Its central weakness is self-selection or selective coverage when invitations circulate freely. A respondent who never receives the link has no opportunity to join, regardless of sample size. Keep pages light for low-bandwidth devices, test translation and screen-reader readability, and establish fraud controls. The convenience of an automatic dashboard should not be confused with representativeness.

Use the administrative research geography of Malawi

A location frame in Malawi should use the relevant geographic structures, such as districts, traditional authorities and urban wards, rather than importing another country’s local government labels. The frame should distinguish where people live, work and access services from the administrative boundary used for supervision. A district or municipality may help organise field assignments without supplying a complete list of eligible respondents. Verify any boundaries and contact sources with field teams before sampling. These decisions affect who can enter the CAPI sample, which calling lists may be credible for CATI, and whether a CAWI panel covers the intended area.

Build a defensible sample before selecting devices

The clearest question to put before a field manager is: who had no realistic chance to be interviewed? In a household CAPI survey, this may be people in inaccessible segments or buildings omitted from the listing. In a CATI study, it may be households without valid numbers. In CAWI, it may be people who are offline or lack access to the invitation channel. Identify such groups, estimate the likely impact and alter the design when the research question requires them. Large numbers of quick completes do not solve these selection problems.

Applying CAPI, CATI and CAWI in Lilongwe

In Lilongwe, the local research environment includes an administrative and consumer-services capital. A household livelihood or service-access survey might use mapped clusters and CAPI where the team must visit selected addresses, verify assets or record in-person observations. A CATI follow-up could be considered when respondents have willingly provided functioning numbers, while CAWI may suit a separately defined digitally reachable subgroup. These methods must not be substituted casually: each can select a different type of participant. Pilot questions and contact procedures within selected neighbourhoods before calculating the city estimate.

Applying CAPI, CATI and CAWI in Blantyre

In Blantyre, the team should independently assess who can be recruited and how, taking account of its character as a southern commercial centre. Check whether the listed households or users can be visited safely, whether sufficient valid numbers exist and whether online recruitment would exclude relevant communities. If a mode used in Lilongwe proves weak here, an adapted design may be justified, but preserve core indicator definitions. Note that two selected centres do not represent Malawi as a whole; a claim about the entire country would require a wider sampling strategy.

Adapt questionnaire design for each survey mode

Different technologies introduce different respondent burdens. A detailed roster may work with an in-person interviewer but be exhausting on a phone. A large grid may look efficient on a desktop yet become nearly unusable on a small smartphone. Break complex tasks into manageable questions, preserve definitions across versions and test the actual devices or connection speeds respondents will use. If mode-specific skips or response formats change the construct being measured, document the decision and avoid careless comparison. Questionnaire harmonisation is a research task, not only a programming task.

Test the actual languages respondents use

Interviewers and respondents may prefer different languages across the same city. Plan local screening, consent and questionnaire testing in Chichewa, English and relevant local languages, choosing versions based on the actual target group rather than a single presumed national language. CATI needs phrases that are easy to understand by voice and not overly long. CAWI needs instructions that remain clear without an interviewer. CAPI can support spoken clarification, but staff must not explain questions inconsistently. A short glossary, cognitive pilot and version-control register help maintain concept equivalence across languages and modes.

Plan access, travel and connectivity around local conditions

For this country, a practical design consideration is that traditional authority geography should not be confused with municipal ward sampling. Evaluate whether this affects road access for CAPI, call completion for CATI, or digital coverage and completion for CAWI. Conduct a reconnaissance and pilot in each selected centre. Estimate realistic interview duration, interviewer workloads, callback needs, connectivity and secure data transfer rather than applying an unchanged budget from another country. If teams change modes mid-project, document why and test whether the change affects the measured indicators.

Know when mixing modes improves coverage

A mixed-mode design can be sensible if the modes cover complementary groups by design. For example, CAPI might reach selected households lacking reliable numbers, while CATI covers an existing beneficiary list; CAWI might be reserved for digitally active professionals. Do not recruit convenient respondents from all three channels and call the total nationally representative. Agree how invitations will be tracked to prevent duplicates, which questions may be mode-sensitive, and whether final results will be shown separately or weighted into a defined combined population. The reasons for mode allocation should appear in the methods section before results are interpreted.

Apply mode-specific data quality checks

Technology can reduce data-entry mistakes yet leave substantial research error. CAPI interviews may be genuine but sampled conveniently. CATI respondents may be valid but systematically drawn from numbers that answer quickly. CAWI participants may be real people with duplicate links or low attention. Establish mode-specific checks for authenticity, eligibility, consent and completeness. Use supervised observations, callbacks or other permitted verification where appropriate. Report both achieved sample size and data-quality limitations; a clean-looking spreadsheet alone is not a quality certificate.

Treat consent and privacy as part of research design

Ethical practice varies by contact situation even when the same core principles apply. At a household doorstep, consent cannot be assumed because an enumerator has arrived with official-looking identification. On the telephone, the respondent must be able to verify the purpose of an unexpected call. Online, participation should be genuinely voluntary and the invitation should not disguise commercial or research use. Plan safe storage, retention limits and procedures for sensitive responses before any device is deployed. Where legal requirements are uncertain, obtain competent local review rather than guessing.

Analyse mode effects and report coverage limits

Preserve a single harmonised coding structure while retaining whether each interview came from a visit, call or web form. Assess differences in response patterns and completion quality before estimating overall indicators. If the modes recruited distinct populations by design, report segment-level outcomes rather than forcing a combined national statistic. Document the inference limitations clearly and provide actionable conclusions tied to the actual field evidence. Credible research explains not only what respondents said but how they entered the study.

An illustrative survey decision for Malawi

Imagine a research organisation assessing Malawi residents’ experience of health or education services. One component may require direct observation of a facility, which favours CAPI; another may involve checking in with beneficiaries already enrolled on a verified contact list, which can favour CATI. A third component may solicit structured feedback from employees or registered online users, which may fit CAWI. The question is not which technology wins overall, but which population and evidence requirement each technology can legitimately serve. For Lilongwe and Blantyre, set different logistics assumptions while applying the same rules for respondent eligibility and data quality.

A method-selection decision for Malawi should explicitly compare: population coverage; sample-frame defensibility; language and questionnaire fit; respondent privacy; requirements for direct observation; connectivity and travel constraints; consent and data protection; interviewer verification; nonresponse; and cost per valid, usable interview. A simple choice table can rank CAPI, CATI and CAWI against the particular study, rather than using a universal hierarchy. A cheap method that systematically misses core respondents is usually a poor value, while an expensive method with no extra evidence benefit may also be hard to justify.

What a credible survey report should contain

The study protocol should specify sampling units, city boundaries, contact or visit schedules, translated questionnaires, mode-specific recruitment procedures, quality checks, data storage and the rules for excluding or replacing cases. Reporting should provide separate denominator and nonresponse information for Lilongwe and Blantyre when they are compared, with a clear limitation on inference beyond those populations. Good survey research gives programme managers and business leaders evidence they can use, plus enough operational detail to understand its strengths and gaps. It does not disguise coverage problems behind a high response count.

How Surveysphere Africa can support

Surveysphere Africa supports the design and delivery of CAPI, CATI, CAWI and carefully planned mixed-mode studies. For projects in Malawi, including Lilongwe and Blantyre, the team can help define a credible sample, localise instruments, supervise fieldwork, verify data quality and explain which populations the evidence represents. The best method is the one that reaches the intended respondents and yields defensible decisions.

Related guidance

For the continent-wide view, read our guide to CAPI, CATI and CAWI.

Our services for research in Malawi

We run research across African markets. Start with these services for work in Malawi:

We also offer: Monitoring, evaluation and learning, Social and development research, Public health research, Policy, economic and institutional research, Data analytics and insights visualisation.

Talk to our team about your study in Malawi

Planning research in Malawi?

Tell us your audience, method and timeline. We can scope the fieldwork and quality controls.

Discuss your study