Skip to content

Why the right survey method depends on the target population

Researchers planning a survey in Zambia often face a practical choice: should an interviewer visit respondents using CAPI, call them using CATI, or invite them to complete CAWI online? The right answer depends on the eligible population, not on a fashionable technology. Lusaka and Ndola provide two contrasting settings for illustrating these trade-offs: a capital with government, service and consumer markets and a Copperbelt commercial and industrial centre. The comparison can guide a two-city plan, but it must not be presented as evidence for every community in the country.

Choose the survey mode by answering the coverage question first: who belongs to the target population and what realistic chance does each eligible person have of being reached? A household survey, a beneficiary tracking exercise and an online customer poll have different frames. Begin with a table linking each required indicator to its target group, sample source, privacy needs and validation standard. Only then estimate unit costs and interview duration. A lower price per completed interview is not a saving if the cheaper method excludes the intended respondents.

CAPI: when in-person digital interviewing is strongest

The main reason to choose CAPI is not that a tablet looks modern. It is the ability to reach respondents through a controlled in-person frame and, when required, confirm the environment being studied. This suits household enumeration, retailer observation and service-delivery verification. Offline forms, skips and immediate validation improve operations when properly configured. But dense city zones, remote settlements or difficult access can make completion expensive. Teams must document nonresponse and replacements so face-to-face convenience does not silently override the original sampling plan.

CATI: when interviewer-led telephone surveys fit

A telephone survey can be effective when the target group can be contacted lawfully and predictably, but it should never begin with an unchecked list. Clean contact records, verify respondent eligibility and define the appropriate time for calling. Provide a concise purpose statement and respect refusal. Telephone questionnaires generally need shorter sentences and smaller answer lists than face-to-face forms. The reporting should separate dialled numbers, answered calls, screened contacts, eligible contacts and completed interviews. Without that disposition history, high completion totals can conceal selection bias.

CAWI: when self-completed online surveys are credible

Computer-Assisted Web Interviewing, or CAWI, sends eligible respondents to a self-completed online questionnaire. It is effective for digitally reachable users, company staff, verified consumer panels and some professional or student populations. It can lower fieldwork cost and present consistent visual stimuli, but the recruitment source determines the meaning of the results. An open social-media link cannot support a national probability claim. Protect the survey from repeated submissions, fraudulent profiles, inattentive completion and poor mobile display. Accessible wording and a short pilot are essential because no interviewer is present to clarify confusion.

Use the administrative research geography of Zambia

A location frame in Zambia should use the relevant geographic structures, such as provinces, districts and wards, rather than importing another country’s local government labels. The frame should distinguish where people live, work and access services from the administrative boundary used for supervision. A district or municipality may help organise field assignments without supplying a complete list of eligible respondents. Verify any boundaries and contact sources with field teams before sampling. These decisions affect who can enter the CAPI sample, which calling lists may be credible for CATI, and whether a CAWI panel covers the intended area.

Build a defensible sample before selecting devices

The clearest question to put before a field manager is: who had no realistic chance to be interviewed? In a household CAPI survey, this may be people in inaccessible segments or buildings omitted from the listing. In a CATI study, it may be households without valid numbers. In CAWI, it may be people who are offline or lack access to the invitation channel. Identify such groups, estimate the likely impact and alter the design when the research question requires them. Large numbers of quick completes do not solve these selection problems.

Applying CAPI, CATI and CAWI in Lusaka

In Lusaka, the local research environment includes a capital with government, service and consumer markets. A household livelihood or service-access survey might use mapped clusters and CAPI where the team must visit selected addresses, verify assets or record in-person observations. A CATI follow-up could be considered when respondents have willingly provided functioning numbers, while CAWI may suit a separately defined digitally reachable subgroup. These methods must not be substituted casually: each can select a different type of participant. Pilot questions and contact procedures within selected neighbourhoods before calculating the city estimate.

Applying CAPI, CATI and CAWI in Ndola

In Ndola, the team should independently assess who can be recruited and how, taking account of its character as a Copperbelt commercial and industrial centre. Check whether the listed households or users can be visited safely, whether sufficient valid numbers exist and whether online recruitment would exclude relevant communities. If a mode used in Lusaka proves weak here, an adapted design may be justified, but preserve core indicator definitions. Note that two selected centres do not represent Zambia as a whole; a claim about the entire country would require a wider sampling strategy.

Adapt questionnaire design for each survey mode

A single questionnaire copied unchanged into three systems is rarely good design. CAPI can support observations and visual exercises; CATI depends on spoken clarity and manageable call length; CAWI requires self-explanatory layouts and light pages. The team should maintain an indicator master and then create mode-specific presentation versions under change control. Pilot difficult recall questions, response scales and translated terms with the intended audience. In the final dataset, retain a mode variable so analysts can test whether responses differ systematically by collection channel.

Test the actual languages respondents use

Interviewers and respondents may prefer different languages across the same city. Plan local screening, consent and questionnaire testing in English, Nyanja, Bemba and other relevant languages, choosing versions based on the actual target group rather than a single presumed national language. CATI needs phrases that are easy to understand by voice and not overly long. CAWI needs instructions that remain clear without an interviewer. CAPI can support spoken clarification, but staff must not explain questions inconsistently. A short glossary, cognitive pilot and version-control register help maintain concept equivalence across languages and modes.

Plan access, travel and connectivity around local conditions

For this country, a practical design consideration is that language and livelihood mixes differ between the capital and Copperbelt. Evaluate whether this affects road access for CAPI, call completion for CATI, or digital coverage and completion for CAWI. Conduct a reconnaissance and pilot in each selected centre. Estimate realistic interview duration, interviewer workloads, callback needs, connectivity and secure data transfer rather than applying an unchanged budget from another country. If teams change modes mid-project, document why and test whether the change affects the measured indicators.

Know when mixing modes improves coverage

A mixed-mode design can be sensible if the modes cover complementary groups by design. For example, CAPI might reach selected households lacking reliable numbers, while CATI covers an existing beneficiary list; CAWI might be reserved for digitally active professionals. Do not recruit convenient respondents from all three channels and call the total nationally representative. Agree how invitations will be tracked to prevent duplicates, which questions may be mode-sensitive, and whether final results will be shown separately or weighted into a defined combined population. The reasons for mode allocation should appear in the methods section before results are interpreted.

Apply mode-specific data quality checks

Field quality is strongest when it is monitored daily rather than reconstructed after the target has been met. CAPI dashboards may show interview locations and durations, but anomalies need supervisor investigation. CATI supervision can compare contact rates and call outcomes between interviewers. CAWI requires fraud screening and inspection of device or response patterns within privacy limits. A quality flag is a reason to examine a case, not automatic proof of fabrication. Document the decision, resulting exclusions and any replacement interviews so final totals are auditable.

Treat consent and privacy as part of research design

The research plan should minimise data collection that respondents do not expect or need. A tablet may record coordinates, a calling system may log phone numbers, and an online survey may expose device metadata. None of this should be captured reflexively. State the purpose of necessary verification, restrict who can access identifiers and separate contact details from analytical responses whenever possible. Train interviewers to recognise distress and refusal. Digital efficiency is useful only when it protects participants as well as research quality.

Analyse mode effects and report coverage limits

A mixed-mode report should never hide the recruitment route behind a single total. Describe the frame for each mode, successful contacts, exclusions, response outcomes and final denominators. Compare key variables by collection method before pooling. If phone respondents report higher satisfaction than web respondents, investigate whether the groups differ in age, customer history or question interpretation. The most useful analysis distinguishes actual social or market patterns from artefacts of how the study was conducted.

An illustrative survey decision for Zambia

Imagine a research organisation assessing Zambia residents’ experience of health or education services. One component may require direct observation of a facility, which favours CAPI; another may involve checking in with beneficiaries already enrolled on a verified contact list, which can favour CATI. A third component may solicit structured feedback from employees or registered online users, which may fit CAWI. The question is not which technology wins overall, but which population and evidence requirement each technology can legitimately serve. For Lusaka and Ndola, set different logistics assumptions while applying the same rules for respondent eligibility and data quality.

A method-selection decision for Zambia should explicitly compare: population coverage; sample-frame defensibility; language and questionnaire fit; respondent privacy; requirements for direct observation; connectivity and travel constraints; consent and data protection; interviewer verification; nonresponse; and cost per valid, usable interview. A simple choice table can rank CAPI, CATI and CAWI against the particular study, rather than using a universal hierarchy. A cheap method that systematically misses core respondents is usually a poor value, while an expensive method with no extra evidence benefit may also be hard to justify.

What a credible survey report should contain

The study protocol should specify sampling units, city boundaries, contact or visit schedules, translated questionnaires, mode-specific recruitment procedures, quality checks, data storage and the rules for excluding or replacing cases. Reporting should provide separate denominator and nonresponse information for Lusaka and Ndola when they are compared, with a clear limitation on inference beyond those populations. Good survey research gives programme managers and business leaders evidence they can use, plus enough operational detail to understand its strengths and gaps. It does not disguise coverage problems behind a high response count.

How Surveysphere Africa can support

Surveysphere Africa supports the design and delivery of CAPI, CATI, CAWI and carefully planned mixed-mode studies. For projects in Zambia, including Lusaka and Ndola, the team can help define a credible sample, localise instruments, supervise fieldwork, verify data quality and explain which populations the evidence represents. The best method is the one that reaches the intended respondents and yields defensible decisions.

Related guidance

For the continent-wide view, read our guide to CAPI, CATI and CAWI.

Our services for research in Zambia

We run research across African markets. Start with these services for work in Zambia:

We also offer: Monitoring, evaluation and learning, Social and development research, Public health research, Policy, economic and institutional research, Data analytics and insights visualisation.

Talk to our team about your study in Zambia

Planning research in Zambia?

Tell us your audience, method and timeline. We can scope the fieldwork and quality controls.

Discuss your study