Importance: A response shift (RS) is a phenomenon in which there is an individual perceptual gap between pre and post assessments. RS effects were not considered in the Canadian Occupational Performance Measure (COPM) development process.

Objective: To detect the effects of RS on the COPM.

Design: Convergent mixed-methods research.

Setting: Subacute rehabilitation hospital in Japan.

Participants: Nineteen adult patients with a range of neurological and musculoskeletal conditions recruited from a subacute rehabilitation hospital.

Outcomes and Measures: In the qualitative analysis, patients’ perceptions regarding occupation identified by the COPM were compared between the initial assessment (Time 1 [T1]) and a reassessment (Time 2 [T2]). In the quantitative study, patients were asked to re-rate the occupations in which the RS had occurred, giving feedback on their perceptions at T1 (T2′). The difference between T2 and T2′ was calculated to clarify the magnitude of the RS.

Results: Of the 19 patients, 18 had an RS in at least one occupation. The RS effects were classified into five categories: Replacing, Adding, Reducing, Unspecified, and Embodiment. Ninety occupations were extracted from all the patients, and 46 (51.1%) were affected by RS. The percentages of occupations for which the change in score due to RS exceeded the minimal clinically important difference (±2 points) was 26.1% (12 of 46) for COPM–Performance scores and 30.4% (14 of 46) for COPM–Satisfaction scores.

Conclusions and Relevance: Diverse RS effects have been identified in the COPM, which also affect score interpretation.

Plain-Language Summary: The Canadian Occupational Performance Measure has a potential measurement bias that is due to a response shift in which there is an individual perceptual gap between pre and post assessments. The results of this study reveal a need to establish more accurate measurement methods to reduce the impact of response shifts on COPM scores.

The concepts of patient-centered treatment (Stewart, 2001) and patient engagement (Miller, 2016; Murali & Deao, 2019) are gaining in popularity and replacing physician-led health care. Patients are encouraged not only to receive medical care but also to actively participate in their medical care. Therefore, patient-reported outcome measures (PROMs), defined as instruments that address “any aspect of a patient’s health status that comes directly from the patient without the interpretation of the [patient’s] responses by a physician or anyone else” (FDA Center for Drug and Evaluation Research et al., 2006) have become a critical end-point indicator of the effectiveness of medical treatment (Ahmed et al., 2012; Deshpande et al., 2011; Sawatzky et al., 2017).

The Canadian Occupational Performance Measure (COPM) is a well-known PROM commonly used in occupational therapy practice and research worldwide (Law et al., 1990; Law, Baptiste, et al., 1998; McColl et al., 2000). It is based on the Canadian Model of Occupational Performance and has been expanded to include the Canadian Model of Occupational Performance and Engagement, both of which are grounded in client-centered theory (Law et al., 1990). In client-centered theory, emphasis is placed on maintaining a perspective centered around the client throughout the practice process (Kyler, 2008; Law, Darrah, et al., 1998; Townsend et al., 1990). However, clinicians and researchers must be concerned with interpreting COPM results as a PROM. PROMs can be classified into several types on the basis of their measurement of the concept of interest (Deshpande et al., 2011). The COPM is classified as “individualized,” allowing respondents to select their own personal interests, unlike measures that use predetermined personal interests in the list of questionnaire items (Deshpande et al., 2011). In the COPM procedure, the client is first asked about their occupational performance in three areas: self-care, productivity, and leisure (Law et al., 1990). However, clients have the autonomy to freely define specific names for questionnaire items. Thus, there is a potential for the client’s perception to evolve over time. Moreover, the possibility of risks to the accuracy of COPM scoring because of information bias has also been reported in the assessment of temporal points. Sawada et al. (2022) explored the impact of information bias on COPM scores through a qualitative study of subacute rehabilitation hospital inpatients that generated potential information biases in the process of selecting and identifying occupations and accurately quantifying the respondents’ perceptions of scoring. In other words, it is thought that changes in the Internal criteria of respondents’ self-perceptions can easily occur on the COPM because of its structural characteristics, in which questionnaire items are not specified.

To advance evidence-based practice, it is essential for practitioners and researchers to meticulously evaluate the measurement properties of PROMs, including reliability, validity, and responsiveness. The cOnsensus-based Standards for the selection of health Measurement iNstruments (COSMIN) initiative serves as a pivotal guideline in this pursuit (Mokkink et al., 2006, 2010). Of note is that the COSMIN initiative dedicated to refining the assessment of PROMs underwent significant enhancements in 2018, solidifying its status as a cornerstone resource in occupational therapy (Mokkink et al., 2018a, 2018b; Terwee et al., 2018). A systematic review conducted by Ohno, Tomori, Sawada, Seike, et al. (2021) found that none of the measurement properties met the COSMIN criteria for the COPM. In particular, only 2 of 10 studies met the COSMIN criteria for responsiveness (Ohno, Tomori, Sawada, Seike, et al., 2021), defined as “the ability of a PROM to detect change over time in the construct to be measured” (Mokkink et al., 2018b, p. 12; Mokkink et al., 2018a,; Prinsen et al., 2018; Terwee et al., 2018). The longitudinal changes in PROMs are based on the assumption that respondents’ interpretations of constructs are stable over time (Sajobi et al., 2018). Therefore, the COPM may not adequately reflect changes in the respondent’s condition over time.

A person’s self-assessment of their health status and quality of life (QOL) may not be the same at different points in time, and this may affect PROM results (Schwartz et al., 2006; Sprangers & Schwartz, 1999). This is phenomenon is known as a response shift (RS), and it is an evaluation bias specific to PROMs (Schwartz et al., 2006; Sprangers & Schwartz, 1999). Sprangers and Schwartz (1999) identified three types of RS: recalibration, reprioritization, and reconceptualization. Recalibration refers to a change in an individual’s internal standards of measurement, reprioritization refers to a change in the person’s values (changes in the importance of the items or component domains that constitute the QOL concept), and reconceptualization refers to a change in the definition of the targeted construct (redefinition QOL; Sprangers & Schwartz, 1999).

The concept of RS was first proposed in the area of management science in the 1970s (Golembiewski et al., 1976; Howard et al., 1979), followed by a report on RS in the related area of health care in 1991 (Breetvelt & Van Dam, 1991). The theoretical model of RS occurring in response to catalysts was described by Sprangers et al. in 1999. Of note is that the COPM, in its manual (Law, Baptiste, et al., 1998) and development study (Law, 1987, 1994), did not initially address the presence of RS or provide established methods to mitigate its effects. Therefore, this study was positioned as a pilot investigation; we sought to meticulously examine, using a convergent mixed-methods approach, changes in the perceptions of occupational performance over time (i.e., RS) in adult patients with neurological and musculoskeletal disorders who had been admitted to a subacute rehabilitation hospital. The objective of Study 1 was to comprehensively understand the occurrence, classification, and structure of RS in the COPM (QUAL). In Study 2, we aimed to assess the impact of RS on COPM scores (QUAN).

Study Design and Ethics

In this study, we took a convergent mixed-methods research (QUAL + QUAN) approach to qualitatively and quantitatively reveal RS effects in the COPM. The qualitative analysis phase (Study 1) consisted of inductive content analysis using semistructured individual interviews. Study 1 followed the Consolidated Criteria for Reporting Qualitative Research (Tong et al., 2007). The quantitative research phase (Study 2) included the calculation of descriptive statistics of COPM scores before and after RS correction. Ethical approval was obtained from the Tokyo University of Technology Ethics Committee (E19HS-006). All patients were provided with a detailed explanation of the research objectives and procedures before providing their consent. Consent was obtained through the patient’s voluntary signature on the provided consent form. After the research explanation, a period of 1 to 2 days was allowed for the consent-acquisition process. It is important to note that patients had the right to withdraw their consent at any point during the study. All data were stored securely, and patient confidentiality was maintained. To ensure patient comfort, the interviews were conducted in a private setting, such as a private room or ward cafeteria, where there were no other people around. Interviews were recorded using an integrated circuit recorder.

Participants

We enrolled adult inpatients at a 150-bed subacute rehabilitation hospital in Japan between May 2020 and September 2020. In Japanese subacute rehabilitation hospitals, the mean onset-admission interval is 31.5 days (SD = 18.6), the mean length of stay is 75.9 days (SD = 46.1), and 69.1% of inpatients are discharged to their homes (Miyai et al., 2011). The inclusion criteria were as follows: (1) admitted to the subacute rehabilitation hospital because of stroke, orthopedic disease, or disuse syndrome (a condition that is caused by a lack of physical activity, secondary to pneumonia and coronary occlusion); (2) received client-centered occupational therapy from occupational therapists; and (3) age ≥18 yr; and (d) Mini-Mental State Examination (MMSE; Folstein et al., 1975) score ≥20. Patients with severe cognitive deficits due to dementia or aphasia were excluded from the study. In general, an MMSE score <24 indicates the presence of cognitive impairment. However, in rehabilitation practice occupational therapy interviews are conducted even with individuals exhibiting mild cognitive impairments (Dick et al., 1984). Therefore, for the comprehensive criteria of this study we set a minimum MMSE score of 20 and included patients we deemed capable of practical communication.

The inclusion criteria for the occupational therapists were as follows: (1) had a minimum of at least 1 yr of full-time clinical experience as an occupational therapist; (2) had read the COPM manual (Law, Baptiste, et al., 1998); and (3) had completed a total of 15 COPM pre–post administrations with patients. Occupational therapists who met the inclusion criteria received lectures on the Canadian Model of Occupational Performance and Engagement, and scoring and interpretation of the COPM was conducted by Kanta Ohno.

The number of participants was not predetermined; however, sampling was conducted sequentially and purposively until theoretical saturation was reached. In this study, theoretical saturation was defined as a state in which no new codes could be extracted from the interview transcripts when the thematic content (hereafter referred to as “codes”) continued to be examined.

Data Collection: Studies 1 and 2

Ohno interviewed the patients within 24 hr of the completion of the COPM by the occupational therapist in charge of the patients (Time 1 [T1]). For the interviews, we used an interview guide developed with reference to previous studies of goal-setting methodologies (O’Neill & Harris, 1982) and previous studies (Ock et al., 2016) that had aimed to qualitatively capture changes in respondents’ perceptions of the occupations identified in the COPM and to understand respondents’ self-perceptions in detail.

The interview guide consisted of five “Ws” and “How,” which are defined as follows: (1) “What is the name of the occupation (title)?,” (2) “Who does the occupation (respondent)?,” (3) “When do you do the occupation (duration/frequency)?,” (4) “Where do you do the occupation (place)?,” (5) “Why do you do the occupation (reason/purpose)?,” and (6) “How do you perform the occupation (methods/procedure/means)?” (Figure 1). For example, the occupation of shopping (What) is recorded as “I want to go shopping alone (Who) to buy groceries (Why) at a supermarket that is a 10-minute walk from my house (Where), once every two days (When) by bicycle (How).” This interview guide was used to identify patients’ perceptional changes in their occupational performance (RSs). Therefore, it cannot be assumed that all items based on the five Ws and How were documented in the COPM data sheet by the occupational therapist who conducted the assessment. To ensure the interrater reliability of this unique interviewing method, all interviewers received comprehensive training from Ohno regarding the interviewing approach. In addition, interviews were conducted using a sheet that listed the five Ws and How.

Several studies have adopted various RS detection methods, such as the then-test, structural equation modeling (SEM), group-based trajectory analysis of residuals, and relative importance analysis (Sajobi et al., 2018). In particular, SEM is an accurate statistical method for detecting the RS effects of PROMs (Sajobi et al., 2018). However, it is difficult to adapt SEM because the COPM’s items are determined by the respondent (i.e., classified as “individualized”; Deshpande et al., 2011). In the current study, we adapted the original method using the five Ws and How as an interview guide.

At the time of reassessment (Time 2 [T2]), as well as the initial assessment, an interview guide (five Ws and How) was used to confirm the patients’ perceptions of each of the identified occupations. Interviews were conducted twice for each patient in this study (T1 and T2). The same interviewer conducted the initial and reassessment interviews.

We assessed patients’ level of independence in activities of daily living using the FIMTM at the initial assessment (T1).1 The FIM is an 18-item assessment tool designed to quantify an individual’s level of care-related disability. Each item is scored on a scale that ranges from 1 (indicating the need for complete assistance) to 7 (representing complete independence), resulting in a total score ranging from 7 to 126. The FIM yields three distinct scores: (1) a total score (FIM–Total: all 18 items); (2) a motor score (FIM–Motor, covering activities such as eating, grooming, bathing, upper and lower body dressing, toileting, bladder and bowel management, and various transfers); and (3) a cognitive score (FIM–Cognitive, comprising tasks related to auditory comprehension, verbal expression, social interaction, problem solving, and memory; Ottenbacher et al., 1996).

Study 1: Qualitative Analysis Phase

We conducted an inductive content analysis to analyze the data obtained from the interviews (Braun & Clarke, 2006; Salsbury et al., 2018). Verbatim transcripts were prepared from recorded data from the initial assessment (T1) and reassessment interviews (T2).

We compared each of the five Ws and How items for each identified occupation between the initial assessment (T1) and reassessment (T2), and if even one item was changed, we determined that an RS had occurred. For example, during the initial assessment (T1) the patient may have responded to the interview about the occupation of shopping (What) as follows: “I want to go shopping alone (Who) to buy groceries (Why) at a supermarket that is a 10-minute walk from my house (Where), once every two days (When), and by bicycle (How).” When the reassessment interview (T2) response changed to “I want to go shopping with my husband (Who) to buy groceries (Why) at a supermarket that is a 10-minute walk from my house (Where), once a week (When) and walking with a cane (How),” we determined that an RS occurred with the three items of Who, When, and How (T1 vs. T2).

The RSs that occurred were categorized according to the five Ws and How and assigned a code reflecting the content. We then created primary categories by integrating the primary categories on the basis of the intrinsic similarity of the codes. We created secondary categories by integrating primary categories on the basis of semantic content similarity. In the analysis process, semantic content similarity entails integrating primary categories on the basis of their underlying meaning or content while ensuring mutual exclusivity (Pope & Mays, 1995). For example, subcategories such as “Adding walking aid” and “Adding alternative means” may emerge. These subcategories are then consolidated under the overarching category of “Adding (How),” ensuring that each category is distinct and nonoverlapping and collectively addressing the concept of substitution in the rehabilitation process.

Data analysis was conducted independently by Ohno and Tomori, who are faculty members in an occupational therapy education program and have published articles on COPM and goal-setting (Ohno, Tomori, Sawada, & Kobayashi, 2021; Ohno, Tomori, Sawada, Seike, et al., 2021; Saito et al., 2019; Sawada et al., 2020, 2022). The research team critically examined the analysis and made repeated revisions to ensure study validity. In cases where the two authors did not agree, discussions were conducted by three members, including a third party (Sawada) who was neutral but trained in qualitative research methodologies. This additional perspective contributed to a more comprehensive understanding of the data and played a key role in reaching the theoretical saturation (Kreslake et al., 2016).

Study 2: Quantitative Analysis Phase

To calculate the impact of RS on COPM scores, we asked patients to re-rate COPM scores for occupations in which any of the five Ws and How changed between the initial assessment (T1) and the reassessment (T2). Patients were given feedback on their perception of the occupation at the initial assessment (T1) by Ohno and were asked to re-rate the COPM–Performance (COPM–P) and COPM–Satisfaction (COPM–S) scores. We defined the score corrected for RS effects as the T2′ score (i.e., RS–adjusted score).

Hence, the reassessment score (T2) is the patient’s internal criterion score that has changed for whom the researcher has not provided feedback on the patient’s perception at the time of the initial assessment, indicating that a RS has occurred and influenced the measurement score. In Study 2 (QUAN), we analyzed the quantitative change that an RS gives to the COPM by calculating the difference between T2 and T2′ (T2′ minus T2). We performed this analysis for the COPM–P and COPM–S, respectively.

Demographic Data

Nineteen patients were enrolled in this study during the 6-mo recruitment period. Their demographic characteristics are presented in Table 1. Nine patients were male (47.4%), and the mean age was 65.3 yr (SD = 18.9). The diagnostic categories were stroke (n = 7, 36.8%), orthopedic disease (including hip fractures and spinal cord injury; n = 10, 52.6%), and disuse syndrome (a condition caused by a lack of physical activity, secondary to pneumonia and coronary occlusion; n = 2, 10.5%). Their mean score on the MMSE was 26.9 (SD = 3.4), and the average score for the FIM–Total items was 96.6 (SD = 13.8; FIM–Motor items: M = 66.2, SD = 11.9; FIM–Cognitive items: M = 30.4, SD = 5.00). Occupational therapists who implemented the COPM had a mean of 3.9 yr experience (SD = 2.2). The mean period from the initial assessment (T1) to reassessment (T2) was 29.7 days (SD = 10.9, range = 12–52; Table 1).

Study 1: Qualitative Analysis Phase

RS Occurrence

Among the 19 patients, 90 occupational performance problems were identified through the COPM interview at the initial assessment. The distributions of the three dimensions are shown in Table 1. The most frequently identified occupation was related to productivity activities (n = 45, 50.0%). This was followed by self-care (n = 30, 33.3%) and leisure (n = 15, 16.7%). The most dominant occupational category was household arrangement (n = 36, 40.0%). When we compared the initial assessment (T1) and reassessment (T2) of the occupations identified on the COPM, we noted that 46 (51.1%) occupations showed a change in at least one of the five Ws and How items. Of the 19 patients, all five Ws and How items remained unchanged in the occupations identified in the COPM for only 1 patient (5.3%). In other words, 18 of the 19 patients’ perceptions of occupations identified in the COPM were altered by the RS effect. The percentages of RSs occurring for each domain of occupation was 53.3% (16 of 30) for self-care, 51.1% (23 of 45) for productive activities, and 46.7% (7 of 15) for leisure.

Categories of the RSs

A total of 82 codes were extracted from 46 occupations in which the change in perception was due to RS effects. The numbers of codes by item according to the five Ws and How were as follows: 10 for Who (subject), 10 for Why (reason/purpose), 12 for Where (place), 19 for When (duration/frequency), and 31 for How (methods/procedure/means). These codes underwent a process of repeated categorization, ultimately resulting in their classification into five overarching concepts: Replacing, Adding, Reducing, Unspecified, and Embodiment (Table 2). We meticulously examined each of these categories was until we noted they formed mutually exclusive relationships (Table 2). These concepts further encompassed a total of 29 subcategories (Table 2).

Replacing.

Replacing was defined as “a change in which an element is replaced by a different element over time.” It included five subcategories: (1) place (Where), (2) destination (Where), (3) purpose (Why), (4) walking aid (How), and (5) object (How). Some examples are as follows:

  • ▪ “I want to be able to go to the bathroom . . .”

    • □ “. . . at the hospital (T1)” replacing “. . . at home (T2)” (Where: place).

  • ▪ “I want to be able to go to the bathroom. . .”

    • □ “. . . using a wheelchair (T1)” replacing “. . . using a cane (T2)” (How: walking aid).

  • ▪ “I want to be able to change into . . .”

    • □ “. . . my pajamas (T1)” replacing “. . . everyday clothes (T2)” (How: object).

Adding.

Adding was defined as “a change in which an element that was not present at the initial assessment becomes incidental to the reassessment.” There were seven subcategories: (1) caregiver (Who), (2) partner (Who), (3) frequency (When), (4) destination (Where), (5) purpose (Why), (6) walking aid (How), and (7) alternative means (How). Examples of this concept include the following:

  • ▪ “I want to be able to . . .”

    • □ “. . . cook alone (T1)” replacing “. . . cook with home helpers (T2)” (Who: caregiver).

  • ▪ “I want to be able to go out by train . . .”

    • □ “. . . once a month (T1)” replacing “. . . twice a month (T2)” (When: frequency).

  • ▪ “I want to be able to go out to visit . . .”

    • □ “. . . a doctor (T1)” replacing “. . . a doctor and go shopping (T2)” (Why: purpose).

Reducing.

Reducing was defined as “a change in which an element set at the first time is deleted or reduced in the reassessment.” Eight subcategories were included: (1) companion (Who), (2) frequency (When), (3) place (Where), (4) destination (Where), (5) purpose (Why), (6) walking aid (How), (7) equipment (How), and (8) job content (How). Some examples are as follows:

  • ▪ “I want to be able to . . .”

    • □ “. . . go to pharmacies and shopping streets (T1)” replacing “. . . go to a shopping street (T2)” (Where: destination).

  • ▪ “I want to be able to . . .”

    • □ “. . . go to the hospital while walking to maintain my health (T1)” replacing “. . . go to the hospital (T2)” (Why: purpose).

  • ▪ “I want to be able to keep my garden . . .”

    • □ “. . . using a stepladder and a ladder (T1)” replacing “. . . without using a stepladder or a ladder because it is dangerous for me (T2)” (How: equipment).

Unspecified.

Unspecified was defined as “elements that are not specifically identified and self-perception is inconsistent from one measurement period to the next measurement period.” It included four types: (1) companion (Who), (2) frequency (When), (3) destination (Where), and (4) purpose (Why). Some examples are as follows:

  • ▪ “I want to be able to go out . . .”

    • □ “. . . by train with someone in my family (T1)” replacing “. . . by train alone or with someone in my family (T2)” (Who: companion).

  • ▪ “I want to be able to . . .”

    • □ “. . . go shopping about every other day (T1)” replacing “. . . go shopping once every other 3 or 4 days (T2)” (Where: frequency).

  • ▪ “I want to be able to . . .”

    • □ “I have no particular reason, but I want to be able to go out at my own pace (T1)” replacing “If I am forced to say, I want to be able to go out with my wife to maintain my physical strength (T2)” (Why: purpose).

Embodiment.

Embodiment was defined as “a change in which an element that was abstract the first time becomes concrete with reassessment.” The following five subcategories were included: (1) caregiver (Who), (2) frequency (When), (3) place (Where), (4) destination (Where), and (5) purpose (Why). The following are examples:

  • ▪ “I want to be able to . . .”

    • □ “. . . go to the hospital alone or with my son (T1)” replacing “. . . go to the hospital with my wife (T2)” (Who: caregiver).

  • ▪ “I want to be able to . . .”

    • □ “. . . walk around without deciding on my destination (T1)” replacing “. . . go to a park (T2)” (Where: destination).

  • ▪ “I want to be able to . . .”

    • □ “. . . walk[,] because I cannot do anything without walking (T1)” replacing “. . . walk [so I can go] shopping (T2)” (Why: purpose).

Study 2: Quantitative Analysis Phase

Of the 90 occupations identified by all patients, we investigated 46 with a confirmed RS in Study 1 (QUAL) for the extent of the RS effect. At the reassessment (T2), patients were asked to re-rate the COPM scores for occupations in which any of the five Ws and How changed between the initial assessment (T1) and reassessment (T2), that is, the T2′ score. Figure 2 is a histogram of the differences between T2 and T2′ for the COPM–P and COPM–S. The most frequent differences were ±0 points for both the COPM–P and COPM–S, and 21 of 46 (45.7%) and 19 of 46 (41.3%), respectively. The maximum score was –6 points (1 of 46, 2.2%) for the COPM–P, –7 points (1 of 46, 2.2%), and +7 points (1 of 46, 2.2%) for the COPM–S. The percentages of all occupations with a difference of <2 points (+1, ±0, –1 points) and the minimal clinically important difference (MCID) described in the COPM manual (Law, Baptiste, et al., 1998) were 73.6% (34 of 46) for the COPM–P and 69.6% (32 of 46) for the COPM–S. In other words, the percentages of occupations for which the change in score due to correcting the change in perception because of an RS exceeded the MCID (±2 points) were 26.1% (12 of 46) for the COPM–P and 30.4% (14 of 46) for the COPM–S.

In this study, we qualitatively and quantitatively investigated changes in patients’ perceptions of the occupations identified in the COPM over time due to the effects of RS. In Study 1 (QUAL), we classified them into five RS concepts. To rigorously analyze our data, we applied the concept of semantic content similarity. This method involves integrating primary categories on the basis of their underlying meaning or content while ensuring that they are mutually exclusive. This approach enabled us to capture subtle changes in patients’ perspectives throughout the rehabilitation process, ensuring the integrity of our categorization. In Study 2 (QUAN), the extent of the RS effects on the COPM was over the MCID (12 of 46 [26.1%] and 14 of 46 [30.4%] for the COPM–P and COPM–S, respectively). These results indicate that researchers and clinicians should consider the impact of RS effects when using the COPM as an outcome measure. In the following paragraphs, we discuss the occurrence and impact of RSs in the COPM and how to avoid RS effects.

The COPM allows respondents to determine the assessment items according to their personal interests (Deshpande et al., 2011; Fitzpatrick et al., 1998), and this characteristic has led to innovative advancements in client-centered occupational therapy practice and research. However, this feature is considered to put the COPM at risk for changes in internal criteria over time (recalibration) because it is dependent on the values and preferences of the respondent at each assessment point. In fact, Eyssen et al. (2005) reported that the consistency ratio of identified occupations using the COPM, in which two different occupational therapists interviewed the same patient 1 wk apart, was only 66%. Verkerk et al. (2006), who investigated the consistency ratio of occupations using the same method as Eyssen et al., observed a consistency rate of 74.0%. These studies show that patients’ perceptions of occupational performance problems can fluctuate easily and are unstable over time. The COPM also has several concerns regarding its scoring system. Sawada et al. (2022) explored the impact of information bias on COPM scores through a qualitative study of subacute rehabilitation hospital inpatients that generated potential information biases in the process of selecting and identifying occupations and accurately quantifying their perceptions of scoring. Their study showed the changes in internal criteria over time in the COPM. Moreover, the results of the present study provide further evidence that the COPM exhibits various forms of RS effects, suggesting that people’s internal standards for occupational performance can undergo considerable change. Even after identifying and sharing occupational goals, clinicians and researchers must remain vigilant about the potential for shifts in perception. However, to the best of our knowledge this is the first study to examine the effect of RSs on COPM scores between pre- and postintervention.

When interpreting the results of this study, it is important to consider the method used to detect the RS effect. Among the most appropriate methods for detecting RS is PROMs (Sajobi et al., 2018). However, Visser et al. (2005) simultaneously adapted three RS detection methods (the then-test, the anchor-recalibration approach, and SEM) to estimate the presence and extent of RS effects and reported conflicting results regarding the presence of RSs. These discrepancies in RS detection are caused by the fact that each method is based on different statistical assumptions and the robustness of the method with regard to data analysis conditions (Sajobi et al., 2018). In this study, we applied a unique approach using the five Ws and How interview guides, taking advantage of the flexibility in item selection characteristics of the COPM. Hence, it is necessary to consider the fact that in this study we adopted a nongeneralized method, and thus the results may contain statistical bias.

The percentages of occupations in which the effect of RS on the COPM score was greater than the MCID (2 points; Law, Baptiste, et al., 1998) were 26.1% (12 of 46) and 30.4% (14 of 46) for the COPM–P and COPM–S, respectively. As a result, when the COPM is used as an outcome measure there is a risk that the change in scores before and after the intervention are not due to the treatment but are contaminated with assessment bias caused by changes in the respondent’s internal criteria. Therefore, clinicians and researchers should be aware of RS to accurately interpret COPM scores.

Of the five concepts of RSs integrated in this study, Replacing, Adding, and Reducing are all elemental changes in the meaning and form of occupation. This indicates that people may be unable to recall and identify their perceptions of occupations in detail over time. Moreover, Unspecified and Embodiment mean that the internal criteria of occupations are not consistent between the initial assessment and reassessment because of abstract perceptions of the occupations. Rehabilitation patients find it difficult to consider reasonable goals at the start of intervention because of a lack of information and knowledge (Southwell et al., 2022; Stenner et al., 2016). According to client-centered theory (Kyler, 2008; Law et al., 1995; Townsend et al., 1990), it is important for the therapist to accept the uncertainty of perception by RS effects and to work collaboratively in response to change. However, if the COPM is used as an outcome measure to examine the effects of interventions, then clinicians and researchers need to minimize the influence of RS effects on the interpretation of COPM scores.

The Specific, Measurable, Achievable, Relevant, and Time-bound (SMART) framework was developed to establish clients’ systematic and individualized goals (Bovend’Eerdt et al., 2009; Schut & Stam, 1994). Bexelius et al. (2018) evaluated the quality of pediatric rehabilitation goals through a retrospective analysis using SMART criteria. On the one hand, all of the goals (161 goals, extracted from 42 children) were linked to the Activity/Participation domain, and the quality of the Specific and Relevant domains was sufficiently high (Bexelius et al., 2018). On the other hand, the Measurable domain had the highest percentage of inadequacy, with 20% of the goals having unclear scaling and 5% of the goals having no defined scaling (Bexelius et al., 2018). Even if patients and therapists identify their own meaningful occupations through the COPM, there is a risk that the achievement criteria can easily become abstract, because details regarding the occupations are rarely discussed. Therefore, we propose that the use of systematic interview frameworks, such as the five Ws and How and the Goal Attainment Scale (Turner-Stokes, 2009), can enhance the accuracy of COPM measurement (Reedman et al., 2021; Spooren et al., 2011). At the beginning of occupational therapy, clear intention-sharing enables prompt recognition of any changes in the patient’s understanding of occupations or setting goals during the subsequent rehabilitation process. This, in turn, allows for immediate adjustments in occupational therapy practice or length of stay according to the patient’s preferences.

It also is important to recognize that RS may not be limited solely to the COPM or the field of occupational therapy. This phenomenon could potentially be extended to other assessment tools that are based on client-centered care principles. Understanding the implications of RSs across various assessment tools beyond the confines of our study is crucial for advancing client-centered care and ensuring the accuracy of outcomes after treatment interventions.

This study has two limitations. First, it is important to note that this was a pilot study with a small sample size. The limited sample size resulted in restricted variation in personal characteristics or occupational areas, thus constraining the generalizability of our findings. Therefore, further large-scale validations are required. Moreover, we conducted data collection during the early stages of the coronavirus disease 2019 pandemic. The unique circumstances, characterized by stringent societal restrictions on outings and close interactions with others, may have potentially influenced goal-setting behaviors in the context of rehabilitation. It is essential to consider this historical background when interpreting the outcomes of our pilot study.

We investigated the RS effects of the COPM on inpatients in subacute rehabilitation hospitals using convergent mixed-methods research. The primary implications for occupational therapy practice and research are as follows:

  • ▪ The RS effects of the COPM were classified into five categories: Replacing, Adding, Reducing, Unspecified, and Embodiment.

  • ▪ In 18 of the 19 patients in the study, at least one occupation changed in the patient’s perception over time, because of a RS.

  • ▪ To use the COPM as an outcome measure, it is necessary to identify patients’ perceptions of occupation in more detail to reduce the impact of RSs.

These findings have notable implications for the understanding, choice, and use of PROMs. First, the recognition that patients’ internal criteria are changeable underscores the dynamic nature of their experiences and preferences over time. Considering that people may not be fully informed about future developments in occupational therapy, it is possible that this could lead to variations in the scoring outcomes. In light of this, we suggest that conducting goal-setting and scoring after clients have had the opportunity to gain experience with the tasks might enhance the accuracy and meaningfulness of assessment outcomes.

Our aim in this study was to explore the effects of RS on the COPM for adult inpatients. A comparison of patients’ perceptions of the occupations identified in the COPM between the initial assessment and reassessment detected five types of RSs. Moreover, because the risk of RSs affecting COPM scores may exceed that of the MCID, it is important to identify more specific perceptions when using the COPM.

We thank all of the participants for their cooperation in this study.

1

FIMTM is a trademark of the Uniform Data System for Medical Rehabilitation, a division of UB Foundation Activities, Inc.

Ahmed
,
S.
,
Berzon
,
R. A.
,
Revicki
,
D. A.
,
Lenderking
,
W. R.
,
Moinpour
,
C. M.
,
Basch
,
E.
, et al
.
Wu
,
A. W.
;
International Society for Quality of Life Research
. (
2012
).
The use of patient-reported outcomes (PRO) within comparative effectiveness research: Implications for clinical practice and health care policy
.
Medical Care
,
50
,
1060
1070
. https://doi.org/10.1097/MLR.0b013e318268aaff
Bexelius
,
A.
,
Carlberg
,
E. B.
, &
Löwing
,
K.
(
2018
).
Quality of goal setting in pediatric rehabilitation—A SMART approach
.
Child: Care, Health and Development
,
44
,
850
856
. https://doi.org/10.1111/cch.12609
Bovend’Eerdt
,
T. J.
,
Botell
,
R. E.
, &
Wade
,
D. T.
(
2009
).
Writing SMART rehabilitation goals and achieving goal attainment scaling: A practical guide
.
Clinical Rehabilitation
,
23
,
352
361
. https://doi.org/10.1177/0269215508101741
Braun
,
V.
, &
Clarke
,
V.
(
2006
).
Using thematic analysis in psychology
.
Qualitative Research in Psychology
,
3
,
77
101
. https://doi.org/10.1191/1478088706qp063oa
Breetvelt
,
I. S.
, &
Van Dam
,
F. S.
(
1991
).
Underreporting by cancer patients: The case of response-shift
.
Social Science and Medicine
,
32
,
981
987
. https://doi.org/10.1016/0277-9536(91)90156-7
Deshpande
,
P. R.
,
Rajan
,
S.
,
Sudeepthi
,
B. L.
, &
Abdul Nazir
,
C. P.
(
2011
).
Patient-reported outcomes: A new era in clinical research
.
Perspectives in Clinical Research
,
2
,
137
144
. https://doi.org/10.4103/2229-3485.86879
Dick
,
J. P.
,
Guiloff
,
R. J.
,
Stewart
,
A.
,
Blackstock
,
J.
,
Bielawska
,
C.
,
Paul
,
E. A.
, &
Marsden
,
C. D.
(
1984
).
Mini-Mental State Examination in neurological patients
.
Journal of Neurology, Neurosurgery, and Psychiatry
,
47
,
496
499
. https://doi.org/10.1136/jnnp.47.5.496
Eyssen
,
I. C. J. M.
,
Beelen
,
A.
,
Dedding
,
C.
,
Cardol
,
M.
, &
Dekker
,
J.
(
2005
).
The reproducibility of the Canadian Occupational Performance Measure
.
Clinical Rehabilitation
,
19
,
888
894
. https://doi.org/10.1191/0269215505cr883oa
FDA Center for Drug Evaluation and Research, FDA Center for Biologics Evaluation and Research, & FDA Center for Devices and Radiological Health, U.S. Department of Health and Human Services.
(
2006
).
Guidance for industry: Patient-reported outcome measures: Use in medical product development to support labeling claims: Draft guidance
.
Health and Quality of Life Outcomes
,
4
,
79
. https://doi.org/10.1186/1477-7525-4-79
Fitzpatrick
,
R.
,
Davey
,
C.
,
Buxton
,
M. J.
, &
Jones
,
D. R.
(
1998
).
Evaluating patient-based outcome measures for use in clinical trials
.
Health Technology Assessment
,
2
(
14
), i–iv,
1–74.
https://doi.org/10.3310/hta2140
Folstein
,
M. F.
,
Folstein
,
S. E.
, &
McHugh
,
P. R.
(
1975
).
“Mini-Mental State”. A practical method for grading the cognitive state of patients for the clinician
Journal of Psychiatric Research
12
,
189
198
. https://doi.org/10.1016/0022-3956(75)90026-6
Golembiewski
,
R. T.
,
Billingsley
,
K.
, &
Yeager
,
S.
(
1976
).
Measuring change and persistence in human affairs: Types of change generated by OD designs
.
Journal of Applied Behavioral Science
,
12
,
133
157
. https://doi.org/10.1177/002188637601200201
Howard
,
G. S.
,
Ralph
,
K. M.
,
Gulanick
,
N. A.
,
Maxwell
,
S. E.
,
Nance
,
D. W.
, &
Gerber
,
S. K.
(
1979
).
Internal invalidity in pretest–posttest self-report evaluations and a re-evaluation of retrospective pretests
.
Applied Psychological Measurement
,
3
,
1
23
. https://doi.org/10.1177/014662167900300101
Kreslake
,
J. M.
,
Price
,
K. M.
, &
Sarfaty
,
M.
(
2016
).
Developing effective communication materials on the health effects of climate change for vulnerable groups: A mixed methods study
.
BMC Public Health
,
16
,
946
. https://doi.org/10.1186/s12889-016-3546-3
Kyler
,
P. L.
(
2008
).
Client-centered and family-centered care: Refinement of the concepts
.
Occupational Therapy in Mental Health
,
24
,
100
120
. https://doi.org/10.1080/01642120802055150
Law
,
M.
(
1987
).
Measurement in occupational therapy: Scientific criteria for evaluation
.
Canadian Journal of Occupational Therapy
,
54
,
133
138
. https://doi.org/10.1177/000841748705400308
Law
,
M. C.
,
Baptiste
,
S.
,
Carswell
,
A.
,
McColl
,
M. A.
,
Polatajko
,
H.
, &
Pollock
,
N.
(
1998
).
Canadian Occupational Performance Measure.
CAOT
.
Law
,
M.
,
Baptiste
,
S.
,
McColl
,
M.
,
Opzoomer
,
A.
,
Polatajko
,
H.
, &
Pollock
,
N.
(
1990
).
The Canadian Occupational Performance Measure: An outcome measure for occupational therapy
.
Canadian Journal of Occupational Therapy
,
57
,
82
87
. https://doi.org/10.1177/000841749005700207
Law
,
M.
,
Baptiste
,
S.
, &
Mills
,
J.
(
1995
).
Client-centred practice: What does it mean and does it make a difference
?
Canadian Journal of Occupational Therapy
,
62
,
250
257
. https://doi.org/10.1177/000841749506200504
Law
,
M.
,
Darrah
,
J.
,
Pollock
,
N.
,
King
,
G.
,
Rosenbaum
,
P.
,
Russell
,
D.
, et al
.
Watt
,
J.
(
1998
).
Family-centred functional therapy for children with cerebral palsy: An emerging practice model
.
Physical and Occupational Therapy in Pediatrics
,
18
,
83
102
. https://doi.org/10.1300/J006v18n01_06
Law
,
M.
,
Polatajko
,
H.
,
Pollock
,
N.
,
McColl
,
M. A.
,
Carswell
,
A.
, &
Baptiste
,
S.
(
1994
).
Pilot testing of the Canadian Occupational Performance Measure: Clinical and measurement issues
.
Canadian Journal of Occupational Therapy
,
61
,
191
197
. https://doi.org/10.1177/000841749406100403
McColl
,
M. A.
,
Paterson
,
M.
,
Davies
,
D.
,
Doubt
,
L.
, &
Law
,
M.
(
2000
).
Validity and community utility of the Canadian Occupational Performance Measure
.
Canadian Journal of Occupational Therapy
,
67
,
22
30
. https://doi.org/10.1177/000841740006700105
Miller
,
K. L.
(
2016
).
Patient centered care: A path to better health outcomes through engagement and activation
.
NeuroRehabilitation
,
39
,
465
470
. https://doi.org/10.3233/NRE-161378
Miyai
,
I.
,
Sonoda
,
S.
,
Nagai
,
S.
,
Takayama
,
Y.
,
Inoue
,
Y.
,
Kakehi
,
A.
, et al
.
Ishikawa
,
M.
(
2011
).
Results of new policies for inpatient rehabilitation coverage in Japan
.
Neurorehabilitation and Neural Repair
,
25
,
540
547
. https://doi.org/10.1177/1545968311402696
Mokkink
,
L. B.
,
de Vet
,
H. C. W.
,
Prinsen
,
C. A. C.
,
Patrick
,
D. L.
,
Alonso
,
J.
,
Bouter
,
L. M.
, &
Terwee
,
C. B.
(
2018a
).
COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures
.
Quality of Life Research
,
27
,
1171
1179
. https://doi.org/10.1007/s11136-017-1765-4
Mokkink
,
L. B.
,
Prinsen
,
C.
,
Patrick
,
D. L.
,
Alonso
,
J.
,
Bouter
,
L.
,
de Vet
,
H. C.
,
Terwee
,
C. B.
(
2018b
).
COSMIN methodology for systematic reviews of patient-reported outcome measures (PROMs)
User manual
78
(
1
),
60
. https://cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018.pdf
Mokkink
,
L. B.
,
Terwee
,
C. B.
,
Knol
,
D. L.
,
Stratford
,
P. W.
,
Alonso
,
J.
,
Patrick
,
D. L.
, et al
.
de Vet
,
H. C.
(
2006
).
Protocol of the COSMIN study: COnsensus-based Standards for the selection of health Measurement INstruments
.
BMC Medical Research Methodology
,
6
,
2
. https://doi.org/10.1186/1471-2288-6-2
Mokkink
,
L. B.
,
Terwee
,
C. B.
,
Patrick
,
D. L.
,
Alonso
,
J.
,
Stratford
,
P. W.
,
Knol
,
D. L.
, et al
.
de Vet
,
H. C.
(
2010
).
The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study
.
Quality of Life Research
,
19
,
539
549
. https://doi.org/10.1007/s11136-010-9606-8
Murali
,
N. S.
, &
Deao
,
C. E.
(
2019
).
Patient engagement
.
Primary Care
,
46
,
539
547
. https://doi.org/10.1016/j.pop.2019.07.007
Ock
,
M.
,
Kim
,
H. J.
,
Jo
,
M. W.
, &
Lee
,
S. I.
(
2016
).
Perceptions of the general public and physicians regarding open disclosure in Korea: A qualitative study
.
BMC Medical Ethics
,
17
,
50
. https://doi.org/10.1186/s12910-016-0134-0
O’Neill
,
D. L.
, &
Harris
,
S. R.
(
1982
).
Developing goals and objectives for handicapped children
.
Physical Therapy
,
62
,
295
298
. https://doi.org/10.1093/ptj/62.3.295
Ohno
,
K.
,
Tomori
,
K.
,
Sawada
,
T.
, &
Kobayashi
,
R.
(
2021
).
Examining minimal important change of the Canadian Occupational Performance Measure for subacute rehabilitation hospital inpatients
.
Journal of Patient-Reported Outcomes
,
5
,
133
. https://doi.org/10.1186/s41687-021-00405-y
Ohno
,
K.
,
Tomori
,
K.
,
Sawada
,
T.
,
Seike
,
Y.
,
Yaguchi
,
A.
, &
Kobayashi
,
R.
(
2021
).
Measurement properties of the Canadian Occupational Performance Measure: A systematic review
.
American Journal of Occupational Therapy
,
75
,
7506205100
. https://doi.org/10.5014/ajot.2021.041699
Ottenbacher
,
K. J.
,
Hsu
,
Y.
,
Granger
,
C. V.
, &
Fiedler
,
R. C.
(
1996
).
The reliability of the Functional Independence Measure: A quantitative review
.
Archives of Physical Medicine and Rehabilitation
,
77
,
1226
1232
. https://doi.org/10.1016/S0003-9993(96)90184-7
Pope
,
C.
, &
Mays
,
N.
(
1995
).
Reaching the parts other methods cannot reach: An introduction to qualitative methods in health and health services research
.
BMJ
,
311
,
42
45
. https://doi.org/10.1136/bmj.311.6996.42
Prinsen
,
C. A. C.
,
Mokkink
,
L. B.
,
Bouter
,
L. M.
,
Alonso
,
J.
,
Patrick
,
D. L.
,
de Vet
,
H. C. W.
, &
Terwee
,
C. B.
(
2018
).
COSMIN guideline for systematic reviews of patient-reported outcome measures
.
Quality of Life Research
,
27
,
1147
1157
. https://doi.org/10.1007/s11136-018-1798-3
Reedman
,
S. E.
,
Boyd
,
R. N.
,
Ziviani
,
J.
,
Elliott
,
C.
,
Ware
,
R. S.
, &
Sakzewski
,
L.
(
2021
).
Participation predictors for leisure-time physical activity intervention in children with cerebral palsy
.
Developmental Medicine and Child Neurology
,
63
,
566
575
. https://doi.org/10.1111/dmcn.14796
Saito
,
Y.
,
Tomori
,
K.
,
Sawada
,
T.
,
Takahashi
,
S.
,
Nakatsuka
,
S.
,
Sugawara
,
H.
, et al
.
Levack
,
W.
(
2019
).
Determining whether occupational therapy goals match between pairs of occupational therapists and their clients: A cross-sectional study
.
Disability and Rehabilitation
,
43
,
828–833
. https://doi.org/10.1080/09638288.2019.1643417
Sajobi
,
T. T.
,
Brahmbatt
,
R.
,
Lix
,
L. M.
,
Zumbo
,
B. D.
, &
Sawatzky
,
R.
(
2018
).
Scoping review of response shift methods: Current reporting practices and recommendations
.
Quality of Life Research
,
27
,
1133
1146
. https://doi.org/10.1007/s11136-017-1751-x
Salsbury
,
S. A.
,
Vining
,
R. D.
,
Gosselin
,
D.
, &
Goertz
,
C. M.
(
2018
).
Be good, communicate, and collaborate: A qualitative analysis of stakeholder perspectives on adding a chiropractor to the multidisciplinary rehabilitation team
.
Chiropractic and Manual Therapies
,
26
,
29
. https://doi.org/10.1186/s12998-018-0200-4
Sawada
,
T.
,
Tomori
,
K.
,
Kimori
,
Y.
,
Kato
,
M.
,
Wakabayashi
,
M.
,
Ohno
,
K.
, et al
.
Saito
,
Y.
(
2020
).
Routine use proportion and determining factors of the Canadian Occupational Performance Measure in the real-world setting: A retrospective cross-sectional study in Japan
.
British Journal of Occupational Therapy
,
83
,
538
544
. https://doi.org/10.1177/0308022620905444
Sawada
,
T.
,
Tomori
,
K.
,
Ohno
,
K.
,
Takahashi
,
K.
,
Saito
,
Y.
, &
Levack
,
W.
(
2022
).
Information bias in the Canadian Occupational Performance Measure: A qualitative study
.
British Journal of Occupational Therapy
,
85
,
722
732
. https://doi.org/10.1177/03080226221079234
Sawatzky
,
R.
,
Chan
,
E. K. H.
,
Zumbo
,
B. D.
,
Ahmed
,
S.
,
Bartlett
,
S. J.
,
Bingham
,
C. O.
, 3rd
, et al
.
Lix
,
L. M.
(
2017
).
Modern perspectives of measurement validation emphasize justification of inferences based on patient reported outcome scores
.
Journal of Clinical Epidemiology
,
89
,
154
159
. https://doi.org/10.1016/j.jclinepi.2016.12.002
Schut
,
H. A.
, &
Stam
,
H. J.
(
1994
).
Goals in rehabilitation teamwork
.
Disability and Rehabilitation
,
16
,
223
226
. https://doi.org/10.3109/09638289409166616
Schwartz
,
C. E.
,
Bode
,
R.
,
Repucci
,
N.
,
Becker
,
J.
,
Sprangers
,
M. A.
, &
Fayers
,
P. M.
(
2006
).
The clinical significance of adaptation to changing health: A meta-analysis of response shift
.
Quality of Life Research
,
15
,
1533
1550
. https://doi.org/10.1007/s11136-006-0025-9
Southwell
,
J.
,
Potter
,
C.
,
Wyatt
,
D.
,
Sadler
,
E.
, &
Sheehan
,
K. J.
(
2022
).
Older adults’ perceptions of early rehabilitation and recovery after hip fracture surgery: A UK qualitative study
.
Disability and Rehabilitation
,
44
,
939
947
. https://doi.org/10.1080/09638288.2020.1783002
Spooren
,
A. I.
,
Janssen-Potten
,
Y. J.
,
Kerckhofs
,
E.
,
Bongers
,
H. M.
, &
Seelen
,
H. A.
(
2011
).
Evaluation of a task-oriented client-centered upper extremity skilled performance training module in persons with tetraplegia
.
Spinal Cord
,
49
,
1049
1054
. https://doi.org/10.1038/sc.2011.54
Sprangers
,
M. A. G.
, &
Schwartz
,
C. E.
(
1999
).
Integrating response shift into health-related quality of life research: A theoretical model
.
Social Science and Medicine
,
48
,
1507
1515
. https://doi.org/10.1016/S0277-9536(99)00045-3
Stenner
,
R.
,
Swinkels
,
A.
,
Mitchell
,
T.
, &
Palmer
,
S.
(
2016
).
Exercise prescription for patients with non-specific chronic low back pain: A qualitative exploration of decision making in physiotherapy practice
.
Physiotherapy
,
102
,
332
338
. https://doi.org/10.1016/j.physio.2015.05.004
Stewart
,
M.
(
2001
).
Towards a global definition of patient centred care
.
BMJ
,
322
,
444
445
. https://doi.org/10.1136/bmj.322.7284.444
Terwee
,
C. B.
,
Prinsen
,
C. A. C.
,
Chiarotto
,
A.
,
Westerman
,
M. J.
,
Patrick
,
D. L.
,
Alonso
,
J.
, et al
.
Mokkink
,
L. B.
(
2018
).
COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study
.
Quality of Life Research
,
27
,
1159
1170
. https://doi.org/10.1007/s11136-018-1829-0
Tong
,
A.
,
Sainsbury
,
P.
, &
Craig
,
J.
(
2007
).
Consolidated Criteria for Reporting Qualitative Research (COREQ): A 32-item checklist for interviews and focus groups
.
International Journal for Quality in Health Care
,
19
,
349
357
. https://doi.org/10.1093/intqhc/mzm042
Townsend
,
E.
,
Brintnell
,
S.
, &
Staisey
,
N.
(
1990
).
Developing guidelines for client-centred occupational therapy practice
.
Canadian Journal of Occupational Therapy
,
57
,
69
76
. https://doi.org/10.1177/000841749005700205
Turner-Stokes
,
L.
(
2009
).
Goal attainment scaling (GAS) in rehabilitation: A practical guide
.
Clinical Rehabilitation
,
23
,
362
370
. https://doi.org/10.1177/0269215508101742
Verkerk
,
G. J.
,
Wolf
,
M. J.
,
Louwers
,
A. M.
,
Meester-Delver
,
A.
, &
Nollet
,
F.
(
2006
).
The reproducibility and validity of the Canadian Occupational Performance Measure in parents of children with disabilities
.
Clinical Rehabilitation
,
20
,
980
988
. https://doi.org/10.1177/0269215506070703
Visser
,
M. R.
,
Oort
,
F. J.
, &
Sprangers
,
M. A.
(
2005
).
Methods to detect response shift in quality of life data: A convergent validity study
.
Quality of Life Research
,
14
,
629
639
. https://doi.org/10.1007/s11136-004-2577-x