| HOME | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|---|
| ||||||||||||||||||||||||||||||||
a University of Tennessee Health Science Center, College of Nursing and College of Medicine, Memphis
Veronica F. Engle, 877 Madison Avenue, Room 616, Memphis, TN 38163 E-mail: vengle{at}utmem.edu.
Decision Editor: John E. Morley, MB, BCh
| Abstract |
|---|
|
|
|---|
Methods. Data were obtained on the same day directly from residents, LPNs, and NAs by trained interviewers in two safety-net nursing homes. A total of 252 residents were included in this study: 79% were Black, and 60% were men. MDS items J2a and J2b evaluated pain frequency and pain intensity during the last 7 days (weekly pain frequency and weekly pain intensity). A parallel question evaluated pain intensity on the day of the interview (daily pain intensity). MDS data were obtained for the MDS Cognition Scale, the MDS Activities of Daily Living-Long Form Scale, the MDS Depression Rating Scale, and the MDS Disruptive Behavior Scale.
Results. Kappa coefficients documented fair to good residentLPN (K = .70, .56, and .50) and residentNA (K = .72, .58, and .60) agreement for weekly pain frequency, weekly pain intensity, and daily pain intensity ratings. LPNs and NAs underestimated residents' weekly pain frequency (p < .001 for LPNs, and p < .001 for NAs), weekly pain intensity (p < .001 for LPNs, and p < .001 for NAs), and daily pain intensity (p < .001 for LPNs, and p = .002 for NAs). LPNs underestimated weekly and daily pain intensity more than NAs did (p = .016 for weekly pain intensity, and p = .035 for daily pain intensity). LPN and NA pain ratings were not biased by resident race, gender, mental status, function, depression, or disruptive behavior.
Conclusions. Results documented that (i) LPNs and NAs underestimated residents' pain frequency and pain intensity, (ii) NAs were more accurate than LPNs for pain intensity, and (iii) resident characteristics did not bias LPN or NA pain ratings.
ALTHOUGH approximately 80% of nursing home residents can provide meaningful information about their pain (1), pain is frequently undertreated in nursing homes. Undertreatment of nursing home residents' pain has been recognized as a national problem (2), affecting the quality of life of 49% to 83% of residents (3). Inadequate pain treatment is not unique to nursing homes but is pervasive in all health care settings (4), even hospice (5), where pain management is a high priority.
Two studies of nursing home residents' pain using the Minimum Data Set (MDS) for pain rating, with data collected by nursing home staff in their usual manner, identified multivariate predictors for the presence of daily pain: female gender, black race, depression, poorer physical function, being bedridden, or terminal prognosis (2)(6). Predictors of receiving no analgesia in spite of daily pain were male gender, black race, older age, poorer physical function, and cognitive impairment. Studies not using the MDS found that residents' pain was associated with disruptive behaviors (7)(8), but results were equivocal regarding the effects of pain on the ability to perform activities of daily living (ADLs) (9)(10), depression (9)(11)(12), and cognitive status (9)(10).
Nursing staff ratings of resident pain location did not agree with residents' reports (13), and nurses' ratings of residents' pain were not related to their administration of pain medication (14). Physicians likewise failed to detect the presence of residents' pain, particularly the pain of residents with neurological disorders (15). Nursing staff and residents may also discount chronic pain (15).
Undertreatment of nursing home residents' pain may be due, in part, to the nursing home system of care. Most care is provided by nursing assistants (NAs) (16) who may have limited ability to assess residents' pain and to communicate their ratings to the licensed practical nurse (LPN) unit "charge nurse" or to the registered nurse (RN) supervisor. NAs are rarely involved in formal care planning and rarely have knowledge of professional goals for resident care (17), yet NAs are able to accurately assess ADLs (18) and symptoms such as edema and shortness of breath (19). Compared with NAs, RNs are more often involved with administrative and documentation activities (17).
Results are equivocal regarding bias in nursing home staff pain ratings (not using the MDS) compared with residents' self-reports (10)(13)(15)(20). Little attention has been given to the focal role of the NA as a key informant with knowledge and experience vital to MDS pain rating. Despite differences between licensed nursing staff (RN and LPN) and NAs in education and in the amount of direct contact with residents, many studies do not differentiate between types of nursing staff when evaluating nursing home care. RNs, LPNs, and NAs may be studied together as "nursing staff" (13)(21) rather than separately in recognition of their differences. Furthermore, researchers frequently combine pain ratings of RNs, LPNs, and NAs under the rubric of "nursing staff," making it impossible to estimate and compare the accuracy of pain ratings of nursing staff at any given level.
The accuracy of the MDS pain rating provides a foundation for standardized care planning, quality indicators, and reimbursement for the treatment and evaluation of residents' pain (22). Although directions for using the MDS specifically instruct the RN to ask the resident directly about pain, the RN is also instructed to ask NAs and therapists if the resident has had complaints or indicators of pain. In practice, even if the resident is able to respond verbally, the RN may often ask the LPN about the resident's pain because of the RN's limited contact with the resident. It is not feasible, due to time constraints and the limited numbers of RNs in nursing homes, for the RN to assess the resident daily for the 7 days needed to complete the MDS for pain frequency during the last 7 days (MDS item J2a) (22). The recommended MDS pain-rating process is in contrast to the gold standard for pain rating, which is an individual's statement about his or her own pain (23).
Thus, the purposes of this study were to (i) estimate and compare the accuracy of LPNs' and NAs' resident pain ratings using the MDS and (ii) to evaluate the bias effects of resident race, gender, mental status, function, depression, and disruptive behavior on nursing staff pain ratings. This study extends previous research on the pain of nursing home residents assessed with the MDS by obtaining concurrent MDS pain-rating data from LPNs, NAs, and residents, and by using MDS data obtained by trained interviewers rather than relying solely on MDS chart data. We extend previous research on pain ratings by evaluating the bias effects of resident characteristics on LPN and NA pain ratings.
| Methods |
|---|
|
|
|---|
Settings
Participants were recruited from two county-financed safety-net nursing homes that provide indigent care and historically admit both black and white residents in a large city in the midsouth. The homes are dually licensed for intermediate and skilled care and have 250 and 300 beds. The nursing staff is represented by collective bargaining and receives the highest pay in the metropolitan area, ensuring low staff turnover. The majority of the LPNs and NAs were women, approximately 50% of the LPNs were black, and all of the NAs were black. Use of these two sites minimizes potentially confounding effects of gross differences in socioeconomic status (24), limited access to nursing homes by black older adults (25), and region of the country (26) on estimates of race effects. Use of these sites also controls for the effects of staff turnover on resident rating.
Participants
This study was approved by the University's Institutional Review Board. Residents (N = 380) were enrolled sequentially as admitted to the two nursing homes. They met the criteria of not declining to participate in the larger study and remaining in the nursing home for at least 2 weeks. Of the 380 residents admitted, 73% (n = 277) were able to provide pain data verbally or nonverbally. Nursing home staff data were unavailable for 15 otherwise qualified residents, so the study sample numbered 252.
Measurements
Pain.--
Resident pain was evaluated using two MDS pain items and one additional pain question. MDS item J2a evaluated pain frequency during the last 7 days (weekly pain frequency) using a three-point scale: 0 (no pain), 1 (pain less than daily), or 2 (daily pain). MDS item J2b evaluated pain intensity during the last 7 days (weekly pain intensity) using a three-point scale: 1 (mild pain), 2 (moderate pain), or 3 (horrible pain). A parallel question evaluated pain intensity on the day of the interview (daily pain intensity) and was also scored on a three-point scale: 1 (mild pain), 2 (moderate pain), or 3 (horrible pain). Data were obtained concurrently the same day by trained interviewers of the resident, the LPN charge nurse, and the NA who cared for the resident.
Mental Status.-- Mental status was evaluated by the MDS Cognition Scale (MDS-COGS) (27). MDS items (MDS B2a, B2b, B3b, B3d, B3e, B4, C4, G1Ag) were recoded and summed for a score ranging from 0 to 10 (27). Higher scores indicate greater cognitive impairment. The MDS-COGS was developed on 200 residents, race not specified, with sensitivity, specificity, chance-corrected agreement (Kappa), and area under the receiver operating characteristic curve all >0.80 according to data collected by trained research staff (27). When comparing the MDS-COGS with the Cognitive Performance Scale (CPS), which is also composed of MDS items, the MDS-COGS was reported to be more strongly correlated with the Global Deterioration Scale (r = .77) and Mini-Mental State Exam (r = -.75) than the CPS in a sample of 290 residents, race not specified (28). Data were obtained by interviewing and observing the resident and by questioning the NA who cared for the resident.
Function.-- Resident function was evaluated by the MDS ADL-Long Form Scale (29). MDS items (MDS G1Aa, G1Ab, G1Ae, G1Ag, G1Ah, G1Ai, G1Aj) were each scored on a five-point scale: 0 (independent), 1 (supervision), 2 (limited assistance), 3 (extensive assistance), and 4 (total dependence). Items were summed, with scores ranging from 0 to 28 (29). Higher scores indicated greater functional impairment. The MDS ADL-Long Form Scale norms were established using 175,000 MDS ratings in a seven-state area, with a KR20 = 0.94, a flat overall scale distribution, and an overall scale mean of 15.24 (SD 9.25). Trained interviewers obtained data from the NA who cared for the resident to control for source of ADL data (30). NAs are able to assess accurately residents' ADLs (18), and one observation of MDS ADLs during a 7-day period can usually accurately represent ADLs during the previous 7 days (31).
Depression.-- Resident depression was evaluated by the MDS Depression Rating Scale (MDS DRS) (32). MDS items (MDS E1a, E1d, E1f, E1h, E1i, E1l, E1m) were each scored on a three-point scale: 0 (not exhibited in last 30 days), 1 (exhibited up to 5 days a week), 2 (exhibited 6 to 7 days a week). Items were summed for a scale score ranging from 0 to 14. Higher scores indicated more depression. The MDS DRS was developed from 16 MDS mood and behavior items, the Hamilton Depression Rating Scale, and the Cornell Scale for Depression in Dementia using a sample of 108 residents, race unknown. There were five MDS factors: disturbed mood, anxiety, fear, loss of meaning, and affect. The MDS DRS was more sensitive and more specific than the Geriatric Depression Scale (29). The interviewer obtained the data by observing the resident and questioning the NA who cared for the resident.
Disruptive Behavior.-- Resident disruptive behavior was evaluated by summing selected MDS items from section E, Mood and Behavior Patterns (MDS E4Ab, E4Ac, E4Ad, E4Ae). Each item was scored on a four-point scale: 0 (not exhibited in the last 7 days), 1 (occurred 1 to 3 days in the last 7 days), 2 (occurred 4 to 6 days but less than daily), 3 (occurred daily). Items were summed for MDS Disruptive Behavior Scale (MDS DBS) scores ranging from 0 to 12, with higher scores indicating more disruptive behavior. These items were chosen to measure verbally abusive behavior, physically abusive behavior, socially inappropriate behavior, and resisting care. Interviewers obtained the data by observing the resident and interviewing the NA who cared for the resident.
Demographics.-- Resident demographic information included gender (MDS AA2); race (MDS AA4); marital status (MDS A5); age in years, computed from the resident's birthday and date of interview; and education in years.
Procedure
After consent was obtained, each resident's pain was assessed one time during the first 2 weeks after admission by trained interviewers who interviewed the resident directly. To assess each resident's pain, interviewers concurrently interviewed the LPN who was the charge nurse on the unit in which the resident resided and the NA who cared for the resident that day. Mental status, function, depression, disruptive behavior, and demographic data were obtained by interviewing and observing the resident and by questioning the NA who cared for the resident on the day of the interview. Residents were interviewed primarily during the second week after admission to ensure staff familiarity with the resident. Three trained interviewers had an inter-rater reliability
0.85 for this data-collection procedure.
Data Analysis
All statistical data analysis procedures were accomplished using SPSS (33) desktop computer programs. Two-tailed probability of Type I error of .05 or less was the criterion of statistical significance. The Kappa coefficient (K) (34) was used to evaluate the extent to which resident pain ratings agreed with LPN or NA pain ratings. Qualitative rating of Kappa's used the criteria of Fleiss (34): K > .75 = excellent, .40
K
.75 = fair to good, and K < .40 = poor agreement beyond chance. Paired data t tests were used to evaluate within-subject differences in raters' pain ratings. Independent samples t tests evaluated the possible bias of nursing staff pain ratings associated with resident race or gender. Correlation coefficients were used to evaluate possible associations between mental status, function, depression, or disruptive behavior, and LPN or NA underestimation of resident pain.
Variable Specification
For all pain ratings, regardless of source, larger values in raw data represented more frequent or more intense pain, in accordance with the MDS. The residentLPN difference data and residentNA difference data analyzed were the individual resident's pain ratings minus the corresponding LPN or NA pain rating, as appropriate. These variables represented the amount that the LPN or NA underestimated resident pain, because positive values indicated that the resident rated pain worse than the LPN or NA did, zero indicated no difference, and negative values indicated that the LPN or NA rated pain as worse than the resident did. Findings presented in Table 2 , Table 4 , Table 6 , Table 7 , and Table 8 are sample averages of these within-subject residentLPN difference data and residentNA difference data. Findings presented in Table 3 and Table 5 are the difference between residentLPN and residentNA data.
|
|
|
|
|
|
|
| Results |
|---|
|
|
|---|
Pain Variables
Descriptive data for the pain variables by assessor (resident, LPN, or NA) are presented in Table 1 .
|
The K values for residentLPN and residentNA were compared for difference in agreement with resident pain ratings. As shown in Table 3 , there were no statistically significant within-subject differences between residentLPN versus residentNA K values for weekly pain frequency or weekly pain intensity. However, in comparing their K values for daily pain intensity, NA agreement with the resident was significantly better than LPN agreement with the resident (p = .004).
Paired data t tests were used to evaluate possible systematic bias in either LPN or NA pain ratings. Table 4 documents the average within-subject differences between resident and LPN and between resident and NA pain ratings, their 95% CI, and the p values for within-subject paired data t tests comparing resident pain ratings with LPN and NA pain ratings. There were statistically significant differences between resident and LPN pain ratings and between resident and NA pain ratings: all t tests were significant at the .002 level or beyond. On average, both LPN and NA significantly underestimated residents' weekly pain frequency, weekly pain intensity, and daily pain intensity.
Paired data t tests were also used to test for within-subject difference in the residentLPN difference compared with the residentNA difference in pain ratings. Table 5 documents the average difference score for the residentLPN difference minus the residentNA difference, t test statistics, and p values. Significant differences between the amount of difference comparing the residentLPN ratings with the residentNA ratings documented that, on average, the NA was significantly closer to the resident self-assessment of pain intensity than the LPN was. NAs underestimated residents' weekly pain intensity and daily pain intensity less than LPNs underestimated these ratings. The average within-subject difference in weekly pain frequency approached, but did not attain, statistical significance for the comparison of the residentLPN difference with the residentNA difference. Thus, there was no significant difference between LPNs' and NAs' underestimations of residents' weekly pain frequency.
Bias of LPN and NA Pain Ratings by Resident Demographics
Independent samples t tests evaluated if LPN or NA ratings of resident pain were affected or biased by resident race (black or white) or resident gender. The pain data analyzed were residentLPN difference and residentNA difference scores. There was no statistically significant finding of resident race or resident gender bias in LPN and NA weekly pain frequency, weekly pain intensity, or daily pain intensity ratings. Table 6 shows a summary of LPN findings, and Table 7 shows a summary of NA findings.
Correlation coefficients determined the bias effects of resident behavioral or psychological characteristics on LPN or NA ratings of resident pain. Resident mental status, function, depression, and disruptive behavior were the continuous variables included in this analysis. Pain data analyzed were the residentLPN and the residentNA difference scores. There were no statistically significant findings of mental status, function, depression, or disruptive behavior bias of LPN and NA ratings for weekly pain intensity, weekly pain frequency, or daily pain intensity. Table 8 shows summaries of the LPN and NA findings.
| Discussion |
|---|
|
|
|---|
Study results indicated that all residentLPN and residentNA pain ratings had fair to good Kappa coefficients of agreement when using MDS pain items. Although both LPNs and NAs significantly underestimated residents' weekly pain frequency, weekly pain intensity, and daily pain intensity, NAs were more accurate than LPNs when underestimating residents' weekly pain intensity and daily pain intensity. LPN and NA pain ratings were not biased by resident race, gender, mental status, function, depression, or disruptive behavior.
All Kappa coefficients for the residentLPN (range .50.70) and residentNA (range .58.72) pain rating agreement were in the fair to good range, but none attained excellence. Excellent, rather than merely fair to good, Kappa's for residentLPN and residentNA agreement may be required for optimal pain evaluation and treatment.
LPNs and NAs underestimated weekly pain frequency, weekly pain intensity, and daily pain intensity. This bias was in the expected direction because nurses in other health care settings also underestimated pain (36). The nursing home nursing staff were educated primarily in acute-care hospital settings and had acute-care experience. They evidently carried their skills and biases in pain rating and treatment from the hospital into the nursing home.
NAs underestimated both weekly and daily pain intensity less than LPNs did. NAs may be more accurate in their pain intensity ratings because of their prolonged contact with residents when providing daily care compared with LPNs. NAs provide about 60% of resident care, and LPNs provide about 20% of resident care (37). For underestimation of weekly pain frequency the comparison of LPN to NA data approached, but did not attain, statistical significance. This may be due to sampling error or scale scoring for pain intensity. Weekly pain frequency was measured using a three-point scale: 0 (no pain); 1 (pain less than daily); and 2 (daily pain); however, weekly and daily pain intensity was scored using a four-point scale: 0 (no pain), 1 (mild pain), 2 (moderate pain), and 3 (horrible pain). The three-point scale may have attenuated the study results.
Other studies support the findings of underestimation of resident pain by nursing home staff and greater accuracy of pain ratings by people with greater resident contact. Weiner and colleagues (13) found that nursing home nursing staff (RNs, LPNs, and NAs, studied as one group) were more accurate in their pain ratings than family caregivers who visited at least twice a month. Physicians also underestimate resident pain (15), but physician pain ratings were inferred from chart review for progress notes indicating pain or pain medication orders.
The more accurate source of pain frequency data, LPN or NA data, was not established by study data. Also, the relationship of a series of seven daily resident's pain intensity ratings to resident, LPN, and NA MDS weekly pain frequency and MDS weekly pain intensity ratings is not known. Residents may not be able to remember their pain intensity and pain frequency during the previous week, so this is a question for future research. Due to time constraints, it is not feasible for RNs in the nursing home to assess residents' pain daily to accurately complete the MDS. Time constraints may also prevent the NA from reporting resident pain to the LPN (8).
We recommend that if the pain intensity data cannot be obtained directly from mild or moderately cognitively impaired nursing home residents by the RN, daily and weekly pain intensity data should be obtained from the NA and used to complete the MDS. The RN is responsible for ensuring the completeness of the multidisciplinary MDS rating that assesses weekly pain frequency and weekly pain intensity and often relies on the LPN for resident rating data rather than on the NA, whose accuracy may be underrecognized.
For optimal pain management and treatment, additional data on the quality of pain (e.g., burning or aching), the temporal pattern of the pain (e.g., constant or intermittent), and the location of pain (e.g., joint, head, or feet) may be needed by the health care provider writing prescriptions for analgesic and adjuvant pain medications. However, the MDS does not obtain information on the quality or pattern of pain; it obtains information on the location of pain. Additional research is needed to establish the accuracy of LPN and NA ratings of pain quality, pain pattern, and pain location.
We found no literature evaluating the effect of resident characteristics (mental status, function, depression, and disruptive behavior) on the accuracy of nursing home nursing staff pain ratings. Studies have identified that residents who were older, black, cognitively impaired, more functionally able, or less depressed were more likely to have daily pain (2).
Could the race and gender of the LPN and NA also be a source of bias in their ratings of residents with different characteristics? All study NAs were black, approximately one half of the LPNs were black, and the majority of LPNs and NAs were women. We have neither race variance for NAs nor accurate race data for LPNs and are unable to answer this question. However, because there was no resident race or resident gender bias for either LPN or NA ratings, the race and gender of the assessor does not appear to influence pain ratings.
Our results can be generalized to other safety-net nursing homes that provide care to the underserved and indigent. Our sample had more men (60%) and black (80%) and younger (mean age 64 years) residents than the average nursing home. Although the use of safety-net nursing homes allowed us to study race and gender differences, additional studies are needed to replicate our results in other regions of the country and in different types of nursing homes.
Summary
Our results documented that (i) LPNs and NAs underestimated nursing home residents' weekly pain frequency, weekly pain intensity, and daily pain intensity; (ii) NAs underestimated weekly and daily pain intensity less than LPNs did; and (iii) LPN and NA pain ratings were not biased by resident race, gender, mental status, function, depression, or disruptive behavior. There was fair to good Kappa agreement of LPN and NA pain ratings with resident ratings, but consistently excellent Kappa coefficients may be required for optimal pain rating and management.
| Acknowledgments |
|---|
Received October 26, 2000
Accepted October 30, 2000
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. F. Karp, J. W. Shega, N. E. Morone, and D. K. Weiner Advances in understanding the mechanisms and management of persistent pain in older adults Br. J. Anaesth., July 1, 2008; 101(1): 111 - 120. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. E. Fisher, L. D. Burgio, B. E. Thorn, and J. M. Hardin Obtaining self-report data from cognitively impaired elders: methodological issues and clinical implications for nursing home pain assessment. Gerontologist, February 1, 2006; 46(1): 81 - 88. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. Gasquet, S. Dehe, P. Gaudebout, and B. Falissard Regular Visitors Are Not Good Substitutes for Assessment of Elderly Patient Satisfaction With Nursing Home Care and Services J. Gerontol. A Biol. Sci. Med. Sci., November 1, 2003; 58(11): M1036 - 1041. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. E. Morley and J. H. Flaherty Editorial: Putting the "Home" Back in Nursing Home J. Gerontol. A Biol. Sci. Med. Sci., July 1, 2002; 57(7): M419 - 421. [Full Text] |
||||
![]() |
J. H. Flaherty Guest Editorial ""Who's Taking Your 5th Vital Sign?"" J. Gerontol. A Biol. Sci. Med. Sci., July 1, 2001; 56(7): M397 - 399. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||
| HOME | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|---|