Chinese tourism research: questionnaire barriers in Kanas

What the research note examined

Yang, Ryan and Zhang’s 2012 research note examined what happens when questionnaire methods developed elsewhere are used with respondents in China. Drawing on fieldwork in the Kanas Scenic Area, it asked whether standard forms could reliably capture the views of local residents and tourists (Reed, 2012).

The note distinguishes several sources of difficulty: spoken and written language, education, survey familiarity, willingness to disclose opinions and motives for participation. These factors can affect who responds, how questions are understood and whether recorded answers reflect respondents’ intended meaning.

What happened in Kanas

Local-resident questionnaires

The fieldwork described two examples involving Tuva and Kazakh residents. In one case, a questionnaire was translated into Mongolian, the written language used for Tuva respondents, but some residents were reluctant to complete it and were unfamiliar with the idea of a questionnaire. In the second case, the questionnaire was administered through students and interpreters because many local residents could not comfortably use the written Mandarin form. A six-page questionnaire could take 1.5–2 hours and functioned more like an interview, creating uncertainty about how questions and answers were interpreted.

Tourist questionnaires

Tourists were told the questionnaire would take 15–20 minutes, but some participated for reasons unrelated to the research question, including gifts, spare time, complaints or social contact. The sample target rose from 500 to 800, with 650 valid questionnaires retained for analysis.

These observations led the researchers to argue that questionnaire data should not stand alone when the social context may shape participation and response behaviour. In the Kanas work, survey results were therefore supplemented with interviews, oral accounts and observation.

Why the barriers matter methodologically

Language is only one part of cross-cultural survey validity. Even an accurately translated questionnaire can fail if respondents struggle to read it, are unfamiliar with surveys or interpret its purpose differently. Translation can also introduce an intermediary whose choices affect meaning.

The Kanas examples point to five design risks:

• Linguistic equivalence: wording may not carry the same meaning across Mandarin, Tuva and Kazakh.
• Literacy and education: written comprehension can differ even when a respondent can speak the survey language.
• Mode effects: an interpreter-administered form is not equivalent to a self-completed form.
• Participation motives: people may answer to help, complain, receive something or maintain a relationship rather than to report a considered view.
• Trust and disclosure: respondents may be cautious when they are unsure who will see their answers or what consequences could follow.

Cross-cultural survey research stresses adaptation, pretesting and comparability rather than literal translation alone. Sensitive-question research also shows that responses may change when participants anticipate embarrassment, judgment or consequences.

Questionnaires can fail before analysis begins when respondents cannot comfortably read, interpret or trust the instrument.

What the note does and does not show

The note does not show that questionnaires are inherently unreliable in China. It reports one tourism setting involving minority communities in western China and was based on field experience rather than a controlled comparison of survey designs. Its findings therefore identify risks to investigate, not a universal national response style.

The setting also matters. Local Tuva and Kazakh residents faced different language and literacy conditions from many urban Mandarin-speaking respondents, while tourist participants presented another issue: their reasons for completing the questionnaire could differ from the researcher’s assumptions.

The strongest lesson is methodological. Researchers need evidence that a questionnaire is understandable, acceptable and functionally comparable for the population in which it will be used.

Practical lessons for tourism researchers

For multilingual or culturally distinct populations, the note supports piloting questionnaires with target respondents, checking whether concepts translate as intended, observing how people interpret the task and documenting changes in administration mode.

Where literacy or trust is uncertain, interviews and observation can complement questionnaires by showing whether response patterns reflect wording, translation, social expectations or participation conditions. The key point is that questionnaire validity must be demonstrated in context.

Frequently asked questions