3.1 Steps 1 to 6: translation process
The translations of the titles, instructions, answer categories, and items involved in the five short forms from step 1 to step 5 mostly maintained consistent except in few cases where the word choices or sentence structures were changed slightly, while retaining the original meaning of the sentences. Since step 6 was performed in the PSC to ensure consistency with previous translated versions, other languages if applicable, or between items, and proofreading for formatting was required, while other translators in steps 1 to 5 did not need to consider the overall harmonization of various PROMIS measures; therefore, the discrepancies between the final translations from the PSC and the translations generated in steps 1 to 5 were obvious. For example, when compared to the translations of steps 1 to 5 ("躯体功能"), the final translation of the title, "physical function" was "身体功能," which was consistent. Both translations could essentially convey the source meaning; however, that from PSC was considered whether it was consistent with some previous mature translated PROMIS measures. In addition, the PSC made great efforts in performing quality control of translation details. For example, translated versions of the phrase "carrying groceries" (involved in item PFB1 and PFA5 of physical function short form 8b) in steps 1 to 5 included "提超市购物袋" or "提超市袋子," which indicated that the object to be carried was a supermarket shopping bag without laying emphasis on the content. Although the LC took the advice based on the back-translation to change it into "搬运杂货" to convey that the object was some kind of good, the PSC further revised it to "拿进食品杂货," which further defined the groceries as foodstuff, which turned out to be more specific and close to the context of daily life activities.
3.2 Steps 7 to 8: cultural adaptation process
Since our cognitive interview was conducted simultaneously with other studies involving short forms about fatigue, pain intensity, anxiety and depression, etc. that were administered to the same subjects, and to avoid increasing each interviewee's burden, we increased our sample size. This also helped to prevent an early loss of concentration and interest in the interview, given that not merely questions about the physical functioning were asked. Fourteen subjects were interviewed. Each participant was debriefed on 1 to 2 of our
Table 3
Demographic and clinical information of the participants (n=14)
Number
|
Debriefed form(s)
|
Gender
|
Age (years)
|
Level of education
|
Employment status
|
Occupation type
|
Residential area
|
Financial stress
|
Clinical diagnosis
|
1
|
8b
|
Female
|
66
|
①
|
Retired
|
①
|
Urban
|
①
|
Stage IV breast cancer
|
2
|
8b, 8c
|
Female
|
50
|
④
|
In employment
|
①
|
Urban
|
②
|
Stage III colorectal cancer
|
3
|
8b
|
Female
|
33
|
②
|
In employment
|
②
|
Urban
|
②
|
Stage III breast cancer
|
4
|
8b
|
Male
|
42
|
④
|
In employment
|
①
|
Rural
|
③
|
Healthy
|
5
|
8b
|
Male
|
51
|
①
|
In employment
|
③
|
Rural
|
②
|
Healthy
|
6
|
8c
|
Female
|
33
|
②
|
In employment
|
②
|
Urban
|
④
|
Stage IV breast cancer
|
7
|
8c
|
Male
|
25
|
③
|
In employment
|
①
|
Rural
|
②
|
Stage IV rhabdomyosarcoma
|
8
|
8c
|
Female
|
55
|
①
|
In employment
|
③
|
Urban
|
③
|
Healthy
|
9
|
8c
|
Male
|
43
|
①
|
In employment
|
③
|
Rural
|
②
|
Healthy
|
10
|
8c 7-Day
|
Male
|
58
|
②
|
In employment
|
②
|
Rural
|
①
|
Stage III gastric cancer
|
11
|
8c 7-Day
|
Female
|
48
|
①
|
In employment
|
②
|
Urban
|
②
|
Stage II breast cancer
|
12
|
8c 7-Day
|
Male
|
48
|
①
|
In employment
|
④
|
Rural
|
④
|
Stage IV gastric cancer
|
13
|
8c 7-Day
|
Female
|
35
|
③
|
In employment
|
③
|
Urban
|
④
|
Healthy
|
14
|
8c 7-Day
|
Female
|
55
|
①
|
Retired
|
③
|
Urban
|
①
|
Healthy
|
Notes: Level of education: ① Junior high school or below, ② High school / technical secondary school, ③ Higher vocational education, ④ Undergraduate education; Occupation type: ① Administrative staff, ② Workers, ③ Services or commerce, ④ Agriculture; Financial stress: ① None, ② A little, ③ Some, ④ Quite a lot
The results showed that items of the PROMIS PF-SFs 4a, 6b, 8b, 8c, and 8c 7-Day were generally completed quickly by the participants. Participants seldom hesitated when answering the questions, and they answered all questions. However, four respondents changed their answer to an item during the interview; they explained that they did not think more carefully when answering the questions for the first time.
The interview data indicated that most instructions, response options, and items in the target short forms were well understood by most of the participants. For response options or items that needed revisions indispensably, a second cognitive interview was conducted with eight different participants, which involved the preliminary revised versions. A third cognitive interview was conducted with five more participants to help in determining the final revision. Two participants (No. 3 and No. 8) were uncertain about the time frame at the beginning when they responded to SF 8c, which was designed to assess the users' current PF level; participant No. 8 further recommended that some words should be added to remind respondents about the record period. Unlike the English predicate tense that can remind respondents that the questions are focused on the present moment, Chinese verbs do not have this kind of hints; we considered the advice of respondent No. 8 to further clarify the time frame in similar questionnaires (SFs 4a, 6b, 8b, and 8c). One respondent (No. 10) forgot to read the reminder of the recall period of PF-SF 8c 7-Day; this made us to further highlight the related words. After revising or emphasizing the time frame cues, we consulted the second-round interviewees and found that most of them supported the revisions on the time frame as they found them to be more eye catching and helpful. All the aforementioned information pointed to the importance of providing more clarity to the instructions of the translated versions.
As for the answer categories, 6/10 interviewees considered that "有少许困难" (translation for "With a little difficulty") cannot be distinguished from "有一些困难" (translation for "With some difficulty"), which involved SFs 8b and 8c. Considering the proposals of the first-round interviewees, translation team members and a previous study [36] where similar answer categories of PROMIS were translated into Simplified Chinese, we replaced "有少许困难" with "基本没有困难," which means "almost no difficulty," "basically no difficulty," or "with little difficulty" in Chinese. Similarly, "有少许困难" in SF 8c 7-Day was replaced with "基本没有困难," since 2/5 interviewees also commented on it for the same reason. However, in the second cognitive interview, 4/8 participants opposed the revision since they thought that "基本没有困难" was too close to "没有任何困难," which is the translation of the first option, "without any difficulty". We then presented a total of six alternative sets of answer categories for the third-round interviewees to choose from; all the five interviewees agreed that "有一些困难" should be changed to "比较困难," which refers to "relatively difficult".
Item PFA11 ("Are you able to do chores such as vacuuming or yard work?") from SF 8b was considered as not widely applicable for Chinese people; 3/5 participants identified that it had cross-cultural issues. They deemed that "吸尘" ("vacuuming") was uncommon in Chinese families, and they suggested that it should be changed to "扫地" ("sweeping the floor"). One of them also said that not every family in China had a yard and suggested that "整理院子" (the translation of "yard work") should be adapted to "整理房间," which means "to tidy up a room". We considered the participants’ suggestions and presented the revised version to the second-round interviewees, but found that some of them observed a discrepancy between the revisions and original words. We performed a third cognitive interview to offer more alternative activities and further probe the respondents’ perspectives. Similar cleaning activities differed with participants. For example, two respondents thought that sweeping the floor was more tiring than vacuuming, while two had contrary views. Therefore, we replaced "吸尘" with a more general and inclusive concept ("打扫卫生"), which referred to cleaning activities, such as vacuuming, sweeping or mopping the floor, wiping tables, etc. As for "整理房间," 3/5 third-round interviewees suggested that "整理屋子" ("tidy up the house") had a bit more workload than "整理房间" ("tidy up the room") and was closer to "整理院子" ("yard work"). Therefore, we adapted "整理院子" to "整理屋子" for the Chinese population. Revisions of the cultural adaptation process are shown in Table 4.
The items also had some problems that originated from the English source. First, some items were not unidimensional enough, meaning that the examples may have been affected by not only one's PF, but by other factors as well, which may have biased the respondents' answers. For instance, one patient (No. 1) selected her answer as "Unable to do" for "Are you able to run errands and shops?" (Item PFA53) because her white blood cell count was low, showing that she was not suitable for shopping. She also believed that running errands required both a good PF and normal cognitive function. Second, some examples were not concrete enough. For instance, Item PFA5 asked that "Does your health now limit you in lifting or carrying groceries?" and 4/5 deemed that the weight of the groceries was vague and needed clarification. Third, multiple examples in one item were not same-level activities. Specifically, for Item PFA1 ("Does your health now limit you in doing vigorous activities, such as running, lifting heavy objects, participating in strenuous sports?"), two respondents (No. 9 & 11) insisted that running itself is a strenuous sport. Since all the aforementioned problems also exist in the original entry, we did not modify these items.
Table 4
Revisions made after the first-round cognitive interview
Involved short forms
|
Involved parts
|
English source
|
Chinese Version/English Equivalent
|
Final Chinese Version/English Equivalent
|
Reasons for Revision
|
PROMIS physical function 4a, 6b, 8b and 8c
|
Instruction
|
(It hasn't emphasized a time frame for answering items)
|
--
|
(Add a sentence "请根据您目前的健康状况作答…"/"Please respond to the items depending on your current health status..." below the instruction and at the top left of the form and add a black - edged text box to emphasize on it.)
|
Two participants in the first-round interview especially confirmed the time frame to the interviewer when they began answering the items, and one of them suggested adding a relevant reminder. Considering that Chinese verbs do not have tense cues like the English verbs involved in the items, the advice was taken. All the participants of the second-round interview approved the revision.
|
PROMIS physical function 8c 7-Day
|
Instruction
|
Thinking about the past 7 days...
|
请回想在过去的7天中… / Think back to the last seven days..
|
(Add a black - edged text box to emphasize on the text.)
|
One participant missed the reminder of the recall period and that influenced his choices. This revision involved making the reminder more prominent. All the participants of the second-round interview agreed to the revision.
|
PROMIS physical function 4a, 6b, 8b, 8c and 8c 7-Day
|
Answer categories
|
Without any difficulty, With a little difficulty, With some difficulty, With much difficulty, Unable to do
|
没有任何困难、有少许困难、有一些困难、非常困难、无法做到 / With no difficulty, With a little difficulty, With some difficulty, Very difficult, Unable to do
|
没有任何困难、有少许困难、比较困难、非常困难、无法做到 / With no difficulty, With a little difficulty, Relatively difficult, Very difficult, Unable to do
|
Six of 14 participants claimed that there was a little difference between "有少许困难" and "有一些困难". All the participants in third-round interview agreed to the final revision.
|
PROMIS physical function 8c and 8c 7-Day
|
Answer categories
|
No difficulty at all, A little bit of difficulty, Some difficulty, A lot of difficulty, Can't do because of health
|
没有任何困难、有少许困难、有一些困难、非常困难、因为健康状况无法做到 / With no difficulty, With a little difficulty, With some difficulty, Very difficult, Can't do because of health
|
没有任何困难、有少许困难、比较困难、非常困难、因为健康状况无法做到 / With no difficulty, With a little difficulty, Relatively difficult, Very difficult, Can't do because of health
|
Two participants claimed that there was too little difference between "有少许困难" and "有一些困难". Two second-round interviewees thought that the words "因为健康状况" ("because of health") were redundant since the premise was already provided in the item stem, while 5 out of 8 third-round interviewees preferred to reserve them since they could further remind the respondents.
|
PROMIS physical function 8b
|
Item PFA11
|
Are you able to do chores such as vacuuming or yard work?
|
你能够做类似吸尘或者整理院子之类的家务事吗? / Can you do household chores like vacuuming or yard work?
|
你能够做类似打扫卫生或整理屋子之类的家务事吗? / Can you do household chores such as cleaning or tidying up the house?
|
Three participants of the first-round interview deemed that the use of a vacuum cleaner ("吸尘") is not very common in Chinese families, and they suggested that it should be replaced with "扫地" ("sweep the floor"). The second- and third-round interviewees’ opinions on the workload of "扫地" or of other cleaning activities compared to "吸尘" differed. One first-round interviewee thought that not every family in China has a yard ("院子 ") and suggested that it should be changed to "房间" ("a room"). Three out of 5 third-round interviewees thought that "整理屋子" ("tidy up the house") had a bit more workload than "整理房间" ("tidy up the room"), and was closer to "整理院子" ("yard work").
|