The results showed that researchers were far more comfortable with patient questionnaires than with caregiver versions, since 69% said they frequently used PROs while only 24% frequently used CROs. Most participants understood the basic qualities that make a questionnaire trustworthy, such as reliability, which reflects how consistent its results are, and validity, which reflects whether it measures what it claims to measure. Far fewer were familiar with more advanced concepts like bias, which describes whether a questionnaire works the same way across different groups of people.
Many researchers said they took language and education level into account when choosing questionnaires, with 70% considering each, while 61% considered race and ethnicity. Characteristics such as income, immigration status, sexual orientation and neurodiversity were considered much less often, even though some of these factors can shape whether people are able to complete a survey online or on a smartphone.
Most researchers collected responses through websites or on paper, while fewer relied on smartphone apps or automated phone systems, with not a single participant reporting the use of text messages. The most common barriers, each reported by about a quarter of respondents, were the time questionnaires take, which can burden both the study participants who complete them and the researchers who administer them, and the licensing fees researchers must pay to use many questionnaires. Researchers also noted that some study participants were uncomfortable with technology or lacked reliable internet access, while others pointed out that no suitable questionnaire existed for the topic or population they wanted to study. “Unsurprisingly, time was a key barrier to using PROs and CROs,” Jones said.
Based on these findings, the authors suggest that funding agencies support the creation of questionnaires that are free or inexpensive for researchers to use, similar to the widely used Patient-Reported Outcomes Measurement Information System (PROMIS), a collection of questionnaires developed with support from the National Institutes of Health. They also recommend education that introduces researchers to caregiver questionnaires, deepens their understanding of advanced concepts like bias and offers practical training in newer ways to collect responses, such as text messaging. When asked how they would prefer to learn, 78% of researchers chose webinars, making them the most popular format by a wide margin.
Offering several ways to complete a questionnaire could also help more patients and caregivers take part in research, according to the authors, since text messages may work better for participants with unreliable internet service while touchscreen tablets may help people with certain disabilities.
Jones plans to build on these findings by making questionnaires dramatically shorter. “As I develop PROs and CROs as part of my research, my research will continue to develop ultra-short (2-3 question) PROs and CROs,” she said. “Creating these ultra-short PROs and CROs will reduce burden for study participants but also researchers.” She added that these brief measures could also ease technology barriers by making it possible to collect responses through methods like texting.
The authors note that the survey had a relatively small number of respondents, most of whom were senior faculty members, so the findings may not reflect the experiences of all cancer researchers. Even so, the study offers a practical roadmap for training that could help scientists more fully capture the experiences of patients and the families who care for them.