Original Research

Self-identified rurality in a nationally representative population in the US

AUTHORS

name here
Dustin C Krutsinger
1 MD, MS, Assistant Professor *

name here
Kuldeep N Yadav
2 MS, Student

name here
Joanna L Hart
3 MD, MS

CORRESPONDENCE

*Asst Prof Dustin C Krutsinger

AFFILIATIONS

1 Division of Pulmonary Critical Care and Sleep Medicine, Department of Medicine, University of Nebraska Medical Center, Omaha, Nebraska, USA

2 Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pennsylvania, USA; and Palliative and Advanced Illness Research Center, Department of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA

3 Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pennsylvania, USA; Palliative and Advanced Illness Research Center, Department of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA; Division of Pulmonary, Allergy, and Critical Care Medicine, Department of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA; and Department of Medical Ethics and Health Policy, University of Pennsylvania, Philadelphia, Pennsylvania, USA

PUBLISHED

8 January 2024 Volume 24 Issue 1

HISTORY

RECEIVED: 1 June 2023

REVISED: 16 August 2023

ACCEPTED: 29 September 2023

CITATION

Krutsinger DC, Yadav KN, Hart JL.  Self-identified rurality in a nationally representative population in the US. Rural and Remote Health 2024; 24: 8483. https://doi.org/10.22605/RRH8483

AUTHOR CONTRIBUTIONSgo to url

This work is licensed under a Creative Commons Attribution 4.0 International Licence


abstract:

Introduction:  In the US, health services research most often relies on Rural–Urban Commuting Area (RUCA) classification codes to measure rurality. This measure is known to misrepresent rurality and does not rely on individual experiences of rurality associated with healthcare inequities. We aimed to determine a patient-centered RUCA-based definition of rurality.
Methods:  In this cross-sectional study, we conducted an online survey asking US residents, ‘Do you live in a rural area?’ and the rationale for their answer. We evaluated the concordance between their self-identified rurality and their ZIP code-derived RUCA designation of rurality by calculating Cohen’s kappa (κ) statistic and percent agreement.
Results:  Of the 774 participants, 456 (58.9%) and 318 (41.1%) individuals had conventional urban and rural RUCA classifications, respectively. There was only moderate agreement between perceived rurality and rural RUCA classification (κ=0.48; 95% confidence interval (CI)=0.42–0.54). Among people living within RUCA 2–3 defined urban areas (n=51), percent agreement was only 19.6%. Discordance was driven by their perception of the population density, proximity to the nearest neighbor, proximity to a metropolitan area, and the number of homes in their area. Based on our results, we reclassified RUCA 2–3 designations as rural, resulting in an increase in overall concordance (κ=0.56; 95%CI=0.50–0.62).
Discussion:  Patient-centered rural–urban classification is required to effectively evaluate the impact of rurality on health disparities. This study presents a more patient-centric RUCA-based classification of rurality that can be easily operationalized in future research in situations in which self-reported rural status is missing or challenging to obtain.
Conclusion:  Reclassification of RUCA 2–3 as rural represents a more patient-centric definition of rurality.

Keywords:

patient-centric, population, RUCA, survey, US.

full article:

Introduction

Rural Americans make up approximately 20% of the US population1 and experience more health disparities than their urban counterparts. Rural residents suffer higher all-cause mortality and are more likely to die of each of the 10 leading causes of death, including heart disease, cancer, accidents, chronic lower respiratory disease, stroke, Alzheimer’s disease, diabetes, kidney disease, influenza and pneumonia, and suicide2. While mortality rates for urban residents have been decreasing over the past 10 years, mortality rates among rural residents remain stagnant, resulting in a widening mortality disparity affecting rural residents2. Rural residents face barriers to healthcare access3, are more likely to be uninsured4, are more likely to live in poverty5, and are exposed to unique occupational and environmental toxicities6. These structural barriers, among others, contribute to higher rates of health-related unemployment, tobacco use, and physical inactivity7.

The ability to identify and address the mechanisms of these disparities is directly dependent on the quality of existing rurality measurements. Even within the US alone, there are multiple definitions and instruments used to determine rurality. These measures demonstrate a lack of agreement in classification of geographic areas as rural versus non-rural. Specific measures of US rurality include Rural–Urban Commuting Area (RUCA) codes, Metropolitan Statistical Areas, Rural–Urban Continuum codes, Urban Influence codes, County Designation, Core Based Statistical Areas and others8-12. Each measure variably defines rurality, relying on population density, commuting patterns, or proximity to key resources. In all cases, the measures are based on geographic characteristics, resulting in groupings of people that do not incorporate or accurately reflect the sociocultural differences in the populations captured by geographic classifications13. The most common measure of US rurality in health services research is the RUCA classification codes12. The US Department of Agriculture (USDA) developed the RUCA system for economic purposes14. RUCA codes are based on population density measures and population-level commuting patterns. The primary RUCA codes range from 1 to 10 and are defined as follows: (1) Metropolitan area core, (2) Metropolitan area high commuting, (3) Metropolitan area low commuting, (4) Micropolitan area core, (5) Micropolitan area high commuting, (6) Micropolitan area low commuting, (7) Small town core, (8) Small town high commuting, (9) Small town low commuting, and (10) Rural areas15. Conventionally primary RUCA codes 1–3 represent urban residences and 4–10 represent rural residences. Most uses of RUCA, including by the US Census and the US Health Resources and Services Administration, dichotomize areas into rural or urban16. Rural is defined as non-urban, or the lack of urbanicity as recognized by proximity to a populous urban core.

The lack of attention to individuals’ and groups’ sociocultural characteristics or identities limits the applicability of these measures to health services research aimed at improving health equity17. Categorizing residences as rural or urban based on commuting or relative proximity to a more populous ‘urban core’ may be appropriate for evaluating some mechanisms of disparities, such as connectivity to areas with healthcare services. Such dichotomization or definition of rurality based on the absence of urbanicity is inadequate for examining potential mechanisms related to health-related behaviors and socioeconomic effects on individuals and groups identifying as rural. For example, consider that a hospital closes in a small town. The hospital’s employees may now commute to a larger town an hour away for work, thereby changing the small town’s RUCA code to reflect this greater connectivity to the large town and decreasing the measured ‘rurality’ of the small town. However, the negative economic and health effects on the residents of the small town are not accurately represented by its new RUCA code. A rurality measure that reflects this multidimensional concept has been elusive due to the need to integrate cultural, demographic, economic, social, and equity factors17,18. A measure of rurality that considers individuals’ perceptions of their community identity while maintaining efficiency for large-scale research is needed to better conduct patient-centered rurality healthcare research. This is particularly true for research focused on behaviorally driven health topics, such as tobacco use, cardiovascular health, and vaccination uptake, or those related to occupational or environmental exposures. Implementation research also relies heavily on constructs such as acceptability, applicability, and relative priorities, necessitating rural measures that reflect social and cultural contexts. Using such patient-centered measures would facilitate the effective and efficient implementation of evidence-based treatments and programs. Additionally, patient-centered measures would better reflect individuals’ and groups’ experiences of potential discrimination based on their rurality, which has been underexplored in rural health but is critical to understanding and overcoming health inequities in other domains19.

Previous research has demonstrated only fair correlation between RUCA codes and individuals’ perceptions of their rurality or urbanicity among New Hampshire and Vermont residents20. However, this study was limited by the sample used, as New Hampshire and Vermont residents are probably not representative of the general US population. Additionally, after the study’s publication, the USDA announced that a programming error within the dataset used (ie RUCA-ZIP 3.10) had resulted in the misclassification of residents21,22. These findings raise concerns about the generalizability and data validity of the previous study. Therefore, we aimed to examine the concordance between people’s self-identification of rurality and their ZIP code-derived RUCA of rurality among a nationally representative sample, and determine patient-centered RUCA-based classifications of rurality and urbanicity.

Methods

We recruited US residents from CloudResearch’s Prime Panels, which is a platform that aggregates several online research panels to enable large-scale data collection with quality sample of respondents that are representative of the US population. Participants eligible for the survey were adults aged more than 18 years, US residents, and active members of the Prime Panels. We oversampled from areas defined as rural by conventional RUCA classifications (RUCA 4–10) based on national statistics that approximately 15–20% of US residents reside in areas defined by RUCA as rural16. All participants enrolled and completed the survey in January 2020.

Using commercially available Qualtrics software (Provo; www.qualtrics.com), we developed and administered a cross-sectional survey asking participants to report the rurality of their residence (ie ‘Do you live in a rural area?’ with the following available responses, ‘yes’, ‘no’, and ‘I do not know’), the rationale for their selection choosing one or more categorial options plus a free text option, ZIP code, and sociodemographic information. The survey was presented only in English and designed to be understandable by the general population based on a Flesch–Kincaid Grade Level23 of 7.3 that reflects seventh and eighth grade level of education in the US. All participants had to provide online informed consent prior to participation and received nominal compensation for successful completion of the survey. We estimated 10 minutes on average for survey completion. We reported frequency distributions of participant demographics.

We recruited 1135 participants, of which we excluded 302 for failing attention checks, two for living outside of the US, and 57 who failed to provide their perception of their rural or urban residence (Fig1). We derived the RUCA code area based on the participants’ provided ZIP code. We determined the concordance between their self-identified rurality and their ZIP code-derived RUCA classification of rurality by calculating an overall Cohen’s kappa (κ) statistic and percent agreement across four RUCA categories (RUCA 1, RUCA 2–3, RUCA 4, RUCA 5–10). We used the USDA’s 2010 RUCA codes, ZIP Code Database, updated in August 202015. In this study, p-values less than 0.05 were considered statistically significant. All analyses were conducted using R v4.2.0 (R Foundation; https://www.r-project.org).

table image Figure 1:  Flow diagram depicting the inclusion of participants in the analytic dataset.

Ethics approval

The University of Pennsylvania Institutional Review Board approved all study procedures and found that the study was exempt from ongoing review (proposal 834506).

Results

We included 774 of 1135 participants, resulting in a successful survey completion rate of 68.2%. The average completion time was 11.9 minutes, and the average age was 46.1 years with a standard deviation of 16.3 years. In addition, 60.6% identified as women, 81.1% as White or Caucasian, 8.4% as Black or African American, 7.1% as multiracial, and 6.7% as Hispanic or Latino. The full demographics of participants is reported in Table 1.

Of 774 participants, 456 (59.0%) lived within RUCA codes 1–3, and 318 (41.1%) lived within RUCA areas 4–10, conventionally categorized as urban and rural, respectively (Table 2). Additionally, 394 (50.9%) participants self-identified as urban, while 380 (49.1%) self-identified as rural (Fig2). The overall Cohen’s kappa statistic indicated moderate agreement between perceived rurality and rural RUCA categorization (κ=0.48, 95%CI=0.42–0.54). Agreement was 77.8% among people living within densely populated RUCA-defined urban areas (RUCA 1; n=405), 63.4% among people living within moderately populated rural areas (RUCA 4; n=134), and highest among people living in sparsely populated RUCA-defined rural areas regarding less of commuting patterns (89.1%, RUCA 5–10; n=184) (Table 2). However, agreement was only 19.6% among people living within proximity of and commuting to RUCA-defined urban areas (RUCA 2–3; n=51). Based on our results, we reclassified RUCA 2–3 designations as rural. Agreement for individuals living in RUCA 2–3 increased to 80.4% and resulted in an increase in overall concordance (κ=0.56; 95%CI=0.50–0.62), using the revised RUCA classification (Fig2).

Among the 51 participants residing in RUCA codes 2–3, 41 (80.4%) their rural self-identification was discordant with conventional urban classification for RUCA 2–3. Among 40 of these 41 respondents, the most frequently reported reasons for this discordance were their perceptions of the population density, their proximity to the nearest neighbor, their proximity to the city or metropolitan area, the number of homes in their area, and their drive distance to work (Fig3).

Table 1:  Participant demographics by conventional RUCA classification of urban and rural designationstable image

Table 2:  Percent agreement between self-identification as urban or rural with conventional RUCA classification by RUCA codetable image

table image Figure 2:  Participants’ self-identification as urban or rural by RUCA classification and proposed revised classification.

table image Figure 3:  Reasons given by 40 respondents for selecting rural residence (RUCA 2 and RUCA 3).

Discussion

Among a national sample of US residents, we found that conventional location and commuting-based definitions of rurality poorly correlate with individuals’ perceptions of their own residential rurality. Concordance between RUCA classification and self-perception was lowest among those living in RUCA codes 2 and 3. Reclassifying RUCA codes 2 and 3 as rural improved the overall concordance and represented a more patient-centric measure of rurality. Our findings have important implications for efforts to identify and address mechanisms of health outcome disparities experienced by rural residents.

Prior work has described both discordance across standardized measures of rurality and between these standardized measures and individuals’ self-perceived rurality of residence8,12,20,24. We found that individuals residing in RUCA codes 2 and 3 self-identify as rural, despite living in an area considered urban by the conventional classification systems. When asked why they identified as rural, they cited reasons that most closely relate to population density. This suggests that population density is important for the shared understanding of ‘rurality’ as a concept. However, other socioecological characteristics such as the availability of infrastructure resources or the types of jobs in the area were also frequently identified as informing their self-classification of living in a rural area. These are inadequately accounted for in existing measures of rurality, which rely heavily on population density and commuting patterns.

Rurality as a concept is complex and lacks a single unifying definition that is widely accepted. While most standardized measures focus on rural versus urban dichotomies, this fails to reflect the heterogeneity in geographic and socioecological experiences of place. Our findings suggest that patient-reported rurality diverges from standardized RUCA classifications, probably reflecting that individuals have nuanced interpretations or connections with a rural identity based on these experiences. While our sample size is insufficient to fully explore this heterogeneity across sociodemographic characteristics, we identify an important area for future work. Critical next steps include further exploration of how individuals’ and groups’ other identities influence and intersect with rural identities. Qualitative work to determine the key components leading to self-identifying as rural would help to refine a patient-centered definition and measure of rurality.

Identifying and addressing the mechanisms of disparities experienced by rural residents requires measuring rurality, even when complex or heterogenous. Our findings provide insight into how to optimize this within ongoing or future research. To the extent possible, measures of rurality should be tailored to the study or need based on the proposed mechanism being evaluated or intervention being tested. The evaluation of mechanisms that may be influenced by an individual’s perception or identity, such as health behaviors or equity, should prioritize using a patient-centered definition. Ideally, collecting participants’ self-identities should be used when feasible, given the only moderate concordance with standardized measures, particularly for research based on health behaviors, implementation of new programs or treatments, or related to disparities in experiences or outcomes. Ongoing comparisons between self-identification of rurality and standardized measures will help with further refinement of these patient-centered definitions, particularly as they relate to key health outcomes. However, when self-identity is not captured or feasible, the development of measures of rurality that better reflect individuals’ perceptions and behaviors is needed. Until such a measure is developed, the use of RUCA codes may be improved by categorizing RUCA 2–3 as rural based on our findings. We suggest investigators consider sensitivity analyses that identify how changing RUCA-based definitions of rurality alter their findings or conclusions. Additionally, because 22% of those living in RUCA 1 (ie a metropolitan area core) self-identify as rural, additional refinement may be possible in the future.

Our study has several limitations to consider. First, the use of an online survey cohort may not be generalizable to the general population, specifically leaving out those who do not have internet access. However, using a national cohort and oversampling rural participants represents an improvement over previous studies. Our sample population may not adequately represent non-White rural residents or those with limited English proficiency, who may have different perspectives on rurality. While our sample demographics approximate the demographics in rural areas, this limited our ability to explore associations between rural self-identification and sociodemographics. Lastly, our reliance on dichotomized rural versus non-rural framing, while aligned with existing standardized definitions, limits our ability to comment on the heterogeneity of geographic identity.

Conclusion

A patient-centered rural–urban classification is required to effectively evaluate the impact of rurality on health, healthcare delivery, and health equity. This study presents a more patient-centric RUCA-based classification of rurality that can be easily operationalized in future research in situations in which self-reported rural status is missing or challenging to obtain. 

Funding

This research project was generously supported by the Patient-Centered Outcomes Research Institute.

Conflicts of interest

The authors have no conflicts of interest to disclose.

references:

1 United States Census Bureau. 2010 Census urban and rural classification and urban area criteria. Available: web link (Accessed 3 August 2022).
2 Curtin SC, Spencer MR. Trends in death rates in urban and rural areas: United States, 1999–2019. NCHS Data Brief. 2021; 417. DOI link
3 Cacari Stone L, Roary MC, Diana A, Grady PA. State health disparities research in rural America: gaps and future directions in an era of COVID‐19. Journal of Rural Health 2021; 37(3): 460-466. DOI link, PMid:33881778
4 Elson LE, Luke AA, Barker AR, McBride TD, Joynt Maddox KE. Trends in hospital mortality for uninsured rural and urban populations, 2012–2016. Journal of Rural Health 2021; 37(2): 318-327. DOI link, PMid:32472709
5 Long AS, Hanlon AL, Pellegrin KL. Socioeconomic variables explain rural disparities in US mortality rates: implications for rural health research and policy. SSM – Population Health 2018; 6: 72-74. DOI link
6 Doney BC, Henneberger PK, Humann MJ, Liang X, Kelly KM, Cox-Ganser JM. Occupational exposure to vapor-gas, dust, and fumes in a cohort of rural adults in Iowa compared with a cohort of urban adults. MMWR Surveillance Summaries 2017; 66(21): 1-5. DOI link, PMid:29095802
7 Weaver KE, Palmer N, Lu L, Case LD, Geiger AM. Rural–urban differences in health behaviors and implications for health status among US cancer survivors. Cancer Causes & Control 2013; 24(8): 1481-90. DOI link, PMid:23677333
8 Cohen SA, Kelley L, Bell AE. Spatiotemporal discordance in five common measures of rurality for US counties and applications for health disparities research in older adults. Frontiers in Public Health 2015; 3. DOI link, PMid:26636064
9 Svynarenko R, Lindley LC. Defining rurality in hospice research: evaluation of common measures. Journal of Health Care for the Poor and Underserved 2021; 32: 2167-2180. DOI link, PMid:34803066
10 Franks JA, Davis ES, Bhatia S, Kenzik KM. Defining rurality: an evaluation of rural definitions and the impact on survival estimates. Journal of the National Cancer Institute 2023; 115(5): 530-538. DOI link, PMid:36762829
11 Long JC, Delamater PL, Holmes GM. Which definition of rurality should I use? The relative performance of 8 federal rural definitions in identifying rural–urban disparities. Medical Care 2021; 59(Suppl 5): S413-S419. DOI link, PMid:34524237
12 Danek R, Blackburn J, Greene M, Mazurenko O, Menachemi N. Measuring rurality in health services research: a scoping review. BMC Health Services Research 2022; 22(1): 1340. DOI link, PMid:36369057
13 Kaneko M, Ohta R, Vingilis E, Mathews M, Freeman TR. Systematic scoping review of factors and measures of rurality: toward the development of a rurality index for health care research in Japan. BMC Health Services Research 2021; 21(1): 9. DOI link, PMid:33397396
14 Rural Health Research Center. Using RUCA data: University of Washington. Available: web link (Accessed 23 December 2022).
15 US Department of Agriculture. Rural–Urban Commuting Area Codes. Available: web link (Accessed 18 April 2023).
16 Health Resources and Services Administration. Defining rural population. Available: web link (Accessed 15 August 2023).
17 Nelson KS, Nguyen TD, Brownstein NA, Garcia D, Walker H, Watson JT, et al. Definitions, measures, and uses of rurality: a systematic review of the empirical and quantitative literature. Journal of Rural Studies 2021; 82: 351-365. DOI link
18 Nelson K, Nguyen T. Community assets and relative rurality index: a multi-dimensional measure of rurality. Journal of Rural Studies 2023; 97: 322-333. DOI link
19 Karvonen KA, Balay-Dustrude E, Do A, Bradford MC, Phipps A, Rosenberg AR. Race, ethnicity, and experienced racism are associated with adverse physical and mental health outcomes among cancer survivors. Cancer 2023; 129(19): 3023-3033. DOI link, PMid:37394987
20 Onega T, Weiss JE, Alford‐Teaster J, Goodrich M, Eliassen MS, Kim SJ. Concordance of rural–urban self‐identity and ZIP code‐derived Rural–Urban Commuting Area (RUCA) designation. Journal of Rural Health 2020; 36(2): 274-280. DOI link, PMid:30913340
21 Onega T, Kim SJ, Weiss J. Response to a Letter to the Editor regarding ‘Concordance of rural identity and ZIP Code‐linked Rural–Urban Commuting Area (RUCA) code’ authored by Timothy Plante, Insu Koh, and Andrew Wilcock. Journal of Rural Health 2020; 36(2): 141-142. DOI link, PMid:32216156
22 Plante TB, Koh I, Wilcock AD. Concordance of rural identity and ZIP code‐linked Rural–Urban Commuting Area (RUCA) code. Journal of Rural Health 2020; 36(2): 143-144. DOI link, PMid:32216155
23 Flesch R. A new readability yardstick. Journal of Applied Psychology 1948; 32(3): 221-233. DOI link, PMid:18867058
24 Castle ME, Tak CR. Self-reported vs RUCA rural–urban classification among North Carolina pharmacists. Pharmacy Practice (Granada) 2021; 19(3): 2406. DOI link, PMid:34522240

You might also be interested in:

2008 - Impact of rurality on optical health: review of the literature and relevant Australian Bureau of Statistics data

2004 - Differences in diabetic co-morbidity between Aboriginal and non-Aboriginal people living in Bella Coola, Canada

2004 - Planning research in rural and remote areas

This PDF has been produced for your convenience. Always refer to the live site https://www.rrh.org.au/journal/article/8483 for the Version of Record.