With the Hospice CAHPS requirement right around the corner, current FEHC users may be wondering how they can continue using their historical FEHC data. Unfortunately, because so many of the original FEHC questions have been altered for the Hospice CAHPS, a simple fix of mapping one survey instrument to another is not possible. Moreover, while many of the questions on the FEHC are related to questions on the Hospice CAHPS, simply comparing old performance scores to new performance scores may not get you the information that you need to seamlessly continue your improvement efforts.
Why So Many Changes Were Made
When the Hospice CAHPS was being developed, it was based on several survey design principles:
Using a technical expert panel on survey research and hospice care quality, and a multitude of interviews with primary caregivers from across the country and from diverse care settings, Hospice CAHPS survey designers used the gathered information to develop the questions with some clear goals in mind:
Comparing Hospice CAHPS to FEHC
In a comparison between the FEHC and the Hospice CAHPS, only 8 non-demographic questions contain minor changes in wording which are not expected to affect the results. For these questions, trending historical data to new data is possible. That is, if your agency was receiving an 83% favorable score in Q4 2014 on the FEHC D5: How often did the hospice team keep you informed about the patient's condition? (Always, Usually, Sometimes, Never), assuming nothing drastically has changed in your agency, you could still expect to see about an 83% favorable score on the Hospice CAHPS question 9: While your family member was in hospice care, how often did the hospice team keep you informed about your family member's condition? (Never, Sometimes, Usually, Always) in Q1 of 2015. [Although, in full disclosure true survey methodologists may say that something as little as changing the order of the response options may affect results.] None the less, taking a bit of a less conservative approach, there are a total of 11 FEHC questions, including demographic and parent questions, where differences in Hospice CAHPS question wording or response options should not affect trending: B9, C2, D5, E3, E4, F1, G3, G5, H4, I3, I4.
However, another 16 FEHC questions are related to questions on the Hospice CAHPS but changes to the response options have resulted in an inability to compare old with new, which may leave you wondering what to do with that data. Your first thought may be to use your FEHC score as an internal benchmark to set a target for improvement for the Hospice CAHPS on the related question. For questions that are partially mapped (FEHC: D7, H5, H6, I1) meaning that the questions are worded similarly and some of the FEHC response options are similar to that on the Hospice CAHPS, with some reworking, this may be possible. For example, compare FEHC D7: Would you have wanted more information about what to expect while the patient was dying? (Yes, No) to Hospice CAHPS question 31: Did the hospice team give you as much information as you wanted about what to expect while your family member was dying? (Yes, definitely; Yes somewhat; No). To map the responses, you would need to collapse both Yes categories from Hospice CAHPS question 31 into a single Yes category. You then need to compare the percentage of Yes responses from question 31 to the percentage of No responses from FEHC D7 because D7 asks if you WANTED MORE information while Q31 asks if you received AS MUCH AS YOU WANTED - conceptually opposite.
In the cases where questions are related but both question and/or response option wording is different, using your FEHC score or another national benchmark as a basis for comparison for the related Hospice CAHPS questions, is frankly, just wrong. While the change may seem minor, e.g., the addition of a word or two, the way the caregiver responds to the question may be entirely different. For example, both Hospice CAHPS Q19 and FEHC B3 ask about whether the hospice team provided information regarding pain medicine but the Hospice CAHPS question 19 specifically asks about whether information on a pain medicine’s side effects was received while FEHC B3 refers to any information on pain medicine. Therefore, what may have been a positive response on the FEHC (yes, the caregiver received information on pain medication) may now be answered negatively (no, the caregiver was not given information on the side effects of medication). In fact, the specificity of the Hospice CAHPS question may result in lower performance scores at first until any needed performance improvement projects (PIPs) focusing on medication side effects education are initiated. Thus, comparing performance scores from questions with different interpretations may set you up for failure, not improvement.
So, how can you transition from one survey to the other without feeling like you are starting over?
Republished with permission from the Deyta Blog by Becky Van Horst