Estimating climate change and mental health impacts in Canada: A cross-sectional survey protocol

STUDY PROTOCOL Estimating climate change and mental health impacts in Canada: A cross-sectional survey protocol Sherilee L. HarperID1*, Ashlee CunsoloID2, Breanne Aylward1, Susan Clayton3, Kelton Minor4, Madison Cooper1, Rachael Vriezen1 1 School of Public Health, University of Alberta, Edmonton, Canada, 2 School of Arctic & Subarctic Studies, Labrador Campus of Memorial University, Happy Valley-Goose Bay, Canada, 3 College of Wooster, Wooster, Ohio, United States of America, 4 Data Science Institute, Columbia University, New York, New York, United States of America * sherilee@ualberta.ca, sherilee.harper@ualberta.ca Abstract Climate change has severe and sweeping impacts on mental health. Although research is burgeoning on mental health impacts following climate and weather extremes, less is known about how common these impacts are outside of extreme events. Existing research explor- ing the prevalence of psychosocial responses to climate change primarily examines univer- sity students and uses non-random sampling methods. Herein, our protocol outlines an approach to data collection, processing, and analysis to estimate the population prevalence, magnitude, and distribution of mental health responses to climate change in Canada. A cross-sectional survey of youth and adults aged 13 years and older in Canada will be admin- istered over the course of one year. The questionnaire will take approximately 10 minutes to complete orally and will be administered in English, French, and Inuktitut. The survey will

consist of six sections: (1) self-reported past experiences of climate change; (2) self- reported climate-related emotions; (3) self-reported past and current impacts, anticipatory impacts, and vicarious experiences; (4) self-reported subclinical outcomes; (5) self-reported behavioural responses; and (6) demographics. A multi-stage, multi-stratified random proba- bility sampling method will be used to obtain a sample representative of the Canadian popu- lation. We will use two different modes of recruitment: an addressed letter sent by postal mail or a telephone call (landlines and cellular). Population-weighted descriptive statistics, principal component analysis, and weighted multivariable regression will be used to analyse the data. The results of this survey will provide the first national prevalence estimates of sub- clinical mental health responses to climate change outcomes of people living in Canada. Introduction Given the mounting evidence, it is undeniable that climate change affects our mental health and wellness [1]. Directly experiencing slow-onset climate changes (e.g. sea level rise, ocean acidification, permafrost thaw) and/or weather and climate extremes (e.g. wildfires, flooding, PLOS ONE PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 1 / 12 a1111111111 a1111111111 a1111111111 a1111111111 a1111111111 OPEN ACCESS Citation: Harper SL, Cunsolo A, Aylward B, Clayton S, Minor K, Cooper M, et al. (2023) Estimating climate change and mental health impacts in Canada: A cross-sectional survey protocol. PLoS

ONE 18(10): e0291303. https://doi.org/10.1371/ journal.pone.0291303 Editor: Ulysses Paulino Albuquerque, Universidade Federal de Pernambuco, BRAZIL Received: April 6, 2023 Accepted: August 22, 2023 Published: October 11, 2023 Peer Review History: PLOS recognizes the benefits of transparency in the peer review process; therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. The editorial history of this article is available here: https://doi.org/10.1371/journal.pone.0291303 Copyright: © 2023 Harper et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Data Availability Statement: N/A - No results are reported. This is a protocol paper, so there are no data associated with this paper.

drought, extreme heat waves, storms) has been associated with both diagnosable mental disor- ders and subclinical outcomes that disrupt or impair normal functioning [1]. Indirectly or vicariously experiencing climate change (e.g. witnessing climate change impacts on the news, seeing climate change affect friends and family, learning about climate change impacts and (in)actions) or anticipating future climate change risks can also lead to mental health chal- lenges [1]. Given these widespread and complex etiological pathways, climate change is increasingly recognized as a grand and urgent challenge for mental health [1–5]. Although we know that climate change has complex, serious, and diverse impacts on men- tal health, the frequency, magnitude, and distribution of those impacts is less clear. To date, cli- mate change and mental health research has been predominantly quantitative in nature [6– 11], and most often examines mental health after a major climate hazard or disaster [6, 9, 12]. For example, many studies have examined hospital admissions for mental health conditions or suicide following extreme heat waves [13, 14], droughts [15], floods [10, 16, 17], and wildfires [18]. Due to the acute nature of these climate events, the association with excess mental health morbidity and mortality is clear and often striking. However, studies that examine mental health impacts outside of extreme events are less common [6, 9]. Further, previous studies that explored climate change impacts on psychoso-

cial wellbeing have primarily relied on surveys using non-probability sampling with university students and have often used crowdsourcing (e.g. Amazon MTurk) to source participants [19]. Both of these methods can create study-entry selection bias due to non-random sample selec- tion [20], particularly coverage bias and self-selection bias [21], which can result in a study sample that does not represent the target population and compromises the external validity of results. New climate and mental health survey literature seeks to address these potential biases by deploying systematically inclusive national surveys that aim to provide every member of the population with an equal chance of being included [22]. There is also a small but growing body of qualitative research exploring climate change impacts on psychosocial wellbeing. Qualitative research has provided insights into the diverse pathways and mechanisms through which climate change affects mental health [23, 24]. For example, in-depth, predominantly qualitative research has illustrated how climate change has led to ecological grief for Inuit in Arctic Canada and for farmers in the Australian Wheatbelt [25]. A growing number of qualitative studies have also documented experiences of solastalgia, or the pain caused by negative environmental changes to one’s home [26], especially among people in the United States and Australia [27]. Although these studies provide detailed insights into the ways in which climate change affects mental health, they do not provide comprehen-

sive data on how common these climate-mental health experiences are in the general population. Canada is a global leader in advancing our understanding of climate change impacts on mental health. Indeed, a relatively large proportion of published research on this topic has come from Canada [6, 7, 28], particularly qualitative studies [6]. Evidence on the mental health implications of climate change is beginning to inform policy, programs, and decision-making in Canada. For example, mental health has been included—for the first time—in Canada’s national climate change assessments [e.g. 3, 29, 30], in Canada’s first National Adaptation Strategy [31], and in the Chief Public Health Officer’s 2022 annual report [32]. The available evidence clearly suggests that climate change has substantial implications for mental health, and there is increasing recognition of the importance of these impacts in policy decision-making in Canada. However, when sharing this research evidence with decision- makers, policy-makers, and the general public, our research team is often asked about the national prevalence and distribution of climate change impacts on mental health, and about the diverse pathways through which climate change negatively affects mental health across the PLOS ONE Climate change and mental health survey protocol PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 2 / 12 Funding: Funding support was provided by the Canadian Institutes for Health Research (to Harper and Cunsolo), ArcticNet (to Cunsolo), Social

Science and Humanities Research Council Doctoral Fellowship (to Aylward), Izaak Walton Killam Memorial Scholarship (to Aylward), and Alberta Innovates Graduate Student Scholarship (to Aylward). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Competing interests: The authors have declared that no competing interests exist.

country. Currently, we do not have a comprehensive estimate of the distribution and preva- lence of the mental health impacts of climate change in Canada, and little evidence is available globally. Therefore, our team has developed a protocol for a nationally representative cross- sectional survey to estimate the prevalence, magnitude, and distribution of mental health chal- lenges connected to climate change in Canada. Herein, we describe the protocol for data col- lection, processing, and analysis. Although this protocol has been developed for use in Canada, the study design and methods aim to overcome common challenges and limitations in this field of research, and our call for epidemiological rigour in climate-mental health survey design is applicable globally. Methods Primary objectives The overall goal of the study is to estimate the prevalence of a variety of emotional responses and subclinical mental health outcomes that disrupt or impair normal functioning as they relate to climate change (Table 1). Specifically, the primary objective is to estimate the preva- lence of climate-related emotions and subclinical outcomes by province/territory, by month, and by age group (i.e. 13–34 years; 35–54 years; 55–74 years; 75+ years old). Secondary objec- tives include examining the association of subclinical outcomes with various socio-demo- graphic variables (e.g. age, gender, income, and other identities), direct or vicarious experiences of past or current climate change impacts, anticipation of future climate change

impacts, and behavioural responses to climate-related stressors. Design This population-based cross-sectional survey (i.e. prevalence study) of youth and adults aged 13 years and older in Canada will be administered over the course of one year (12 months). The protocol was developed by an interdisciplinary team of researchers in Canada and the USA with expertise spanning mental health, climate change, psychology, epidemiology, social sciences, health geography, economics, and public health. The survey was administered by R. A. Malatest & Associates Ltd. (Malatest), one of Canada’s largest independently owned and operated research and evaluation firms. Survey recruitment commenced on April 1, 2022, and data collection is expected to continue through to March 31, 2023. Climate change and mental health scales and theory Climate change anxiety is a psychological phenomenon that has gained prominence in recent years. Clayton and Karaszia (2020) developed and validated a scale that quantifies the extent to which individuals experience anxiety related to climate change [33]. Their analysis found that Table 1. A summary of research questions related to our primary survey objective. Primary Research Question Example Question RQ1 What is the prevalence of climate-related emotions and subclinical outcomes in Canada? RQ2 What is the prevalence of climate-related emotions and subclinical outcomes in each province/territory in Canada? RQ3 What is the prevalence of climate-related emotions and subclinical outcomes in Canada each month?

RQ4 What is the prevalence of climate-related emotions and subclinical outcomes in Canada by age group? https://doi.org/10.1371/journal.pone.0291303.t001 PLOS ONE Climate change and mental health survey protocol PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 3 / 12

climate change anxiety was made up of two latent constructs: cognitive emotional impairment, which encompassed rumination, sleep-related concerns, difficulties concentrating, and crying, and functional impairment, which encompassed impairments in day-to-day functioning, including tasks at work or school. Some subsequent studies validated the original two-factor structure of the climate change and anxiety scale in other countries and languages [e.g., 34, 35], whereas others could not replicate the two-factor structure [e.g., 36, 37]. Wullenkord et al. (2021) could not reproduce the two-factor structure in the German population, leading them to question the construct validity of the climate change anxiety scale [37]. They recommended further scale development to encompass varying levels of intensity of climate change anxiety, as well as other related emotional experiences. Specifically, they argued for incorporating an emotional factor to measure feelings associated with anxiety (e.g., worry and fear) and for add- ing items that capture experiences of uncertainty that are traditionally associated with anxiety. Therefore, in our study, we incorporated Clayton and Karasizia’s (2020) climate change anxi- ety scale [33] as well as Searle and Gow’s (2010) [38] scale of climate-related emotions, and we also selected items from Reser et al. (2012) that measure feelings of unpredictability related to climate change [43] (Table 2). Survey instrument The survey consists of six sections: (1) self-reported past experiences of climate change; (2)

self-reported climate-related emotions; (3) self-reported past and current impacts, anticipatory impacts, and vicarious experiences of climate change; (4) self-reported subclinical mental health outcomes; (5) self-reported behavioural responses; and (6) demographics (Table 2). The questionnaire was written in English and translated into French and Inuktitut. Translations were back-translated into English to ensure accuracy. The questionnaire was designed to take approximately 10 minutes to complete over the telephone. The English version of the full ques- tionnaire is available in S1 Table. Over a one-week period, we used a convenience sample (n = 35) to pretest the online ques- tionnaire and a random sample (n = 20) to pretest the telephone questionnaire for length and content. We refined the survey based on estimated completion times as well as respondent feedback. The data collected during pretesting will not be included in the final dataset. Eligible participants The questionnaire will be administered in all provinces and territories in Canada. Youth and adults who are 13 years old or older and have a Canadian postal address or telephone number will be eligible to participate. The survey will be offered in English, French, or Inuktitut. Attempts will be made to accommodate participants that speak languages other than English, French, or Inuktitut on an as-requested basis. Sampling Sample size. There are no published prevalence estimates of climate change-related men- tal health outcomes that are representative of Canada. Therefore, we calculated our target sam-

ple sizes using an a priori estimate of 25% prevalence of subclinical outcomes related to climate change based on estimates from the United States of America [33] to calculate a target sample size of 289 people per province/territory. We used an allowable error of 5% and a confi- dence level of 95% to calculate a target sample size of 289 people per province/territory. Reflecting our objective to estimate prevalence by province/territory, our total target sample size is therefore 3,757 people [i.e. (289 people per province or territory) x (10 provinces + 3 ter- ritories) = 3,757 people]. Then, reflecting our objective to estimate the national prevalence by PLOS ONE Climate change and mental health survey protocol PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 4 / 12

month, we distributed the target sample of 3,757 people over 12 months; that is, our monthly target sample size is 313 people per month [i.e. (3,757 people) / (12 months) = 313 people per month] or 24 people per province/territory per month [i.e. (313 people per month) / (13 prov- inces or territories) = 24 people per province or territory per month]. Sampling procedure. A multi-stage, multi-stratified random probability sampling method will be used to obtain a sample representative of Canada (Fig 1). Participants will be randomly selected via a two-stage approach. First, households will be randomly selected and recruited either by an addressed letter or a telephone call (landlines and cellular). Then, within each randomly selected household, the person who is 13 years old or older and has the next birthday will be invited to participate in the survey. Table 2. A summary of the questionnaire sections, with a description of the items in the section, an overview of the purpose of the section, and information on how the items were developed. Questionnaire Section Goal of Questions Measures Validity 1) Past experiences of climate change To capture information about individual experiences of climate change impacts, which can be a precursor to subclinical mental health outcomes. 2 x 5-point Likert scale questions capturing direct and indirect exposures to climate change. We selected two of the three questions assessing personal experiences of climate change validated by Clayton and Karazsia [33]. 2) Climate-related emotions To capture a range of subclinical

outcomes and emotions that can be experienced in response to climate change. 13 x 5-point Likert scale questions capturing emotional responses to climate change (i.e. sad, angry, grief, helpless, hopeless, worried, anxious, depressed, tense, concerned, stressed, scared, and powerless). Our questions cover the 12 emotions assessed by Searle and Gow [38], and we added an additional question about grief. 3) Past and current impacts, anticipatory impacts, and vicarious experiences To measure the drivers of respondents’ emotional reactions to climate change. 3 x 5-point Likert scale questions capturing the extent to which respondents’ reactions to climate change were related to past and current climate change impacts, anticipated future climate change impacts, or news and social media coverage. We developed new questions based on the identified pathways of ecological grief defined by Cunsolo and Ellis [25]. 4) Subclinical outcomes To measure cognitive and emotional impairment from climate change exposures. 8 x 5-point Likert scale questions capturing climate change impacts on concentration and rumination. We adapted the cognitive and emotional impairment questions in Clayton and Karazsia’s [33] climate change anxiety scale. This scale has been used and/or validated in subsequent studies by Cruz and High [39], Innocenti et al. [36], Larionow et al. [34], Mouguima-Daouda et al. [35], Simon et al. [40], and Joo Jang et al. [41]. To measure functional impairment from climate change exposures. 1 x 5-point Likert scale question capturing climate change impacts on daily life.

We adapted the five functional impairment questions from Clayton and Karazsia’s [33] climate anxiety scale to create one proxy question. Hickman et al. [42] also used this question as a proxy for functional impairment. To measure other climate-related worry, thinking, and distress. 5 x 5-point Likert scale questions capturing feelings of uncertainty in response to climate change. We selected and adapted questions from Reser et al.’s [43] 12-item, 6-point scale to address Wullenkord et al.’s [37] critiques of Clayton and Karazsia’s [33] climate anxiety scale. 5) Behavioural responses To assess whether climate change anxiety is associated with individual or collective climate actions. 3 x 5-point Likert scale questions capturing individual actions in response to climate change, and 3 x 5-point Likert scale questions capturing collective actions in response to climate change. We selected and adapted questions from Stanley et al.’s [44] 16-item, 100-point scale. One of these questions was similar in concept to Clayton and Karazsia’s [33] 5-item measure of sustainable behaviour. 6) Demographics To collect independent variables for use in subsequent analyses. 5 close-ended questions capturing age, gender identities, ethnic backgrounds, income, and postal code. Questions were based on the Alberta Human Rights Commission’s [45] description of gender identity, the Government of Canada’s Employment Equity Act’s definition of visible minority groups [46], and the Public Health Agency of Canada’s Foodbook Questionnaire (e.g. for income) [47].

https://doi.org/10.1371/journal.pone.0291303.t002 PLOS ONE Climate change and mental health survey protocol PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 5 / 12

response rate. We will monitor the response rates for each province and territory, as well as for urban and rural areas using the first two digits of respondents’ postal codes, and we will adjust the sample parameters and the number of randomly selected addresses accordingly. Each selected household will only receive one addressed letter during the study period, with the exception of households in Nunavut. In all other provinces and territories, our address-based sample will include a household address and corresponding telephone number; thus, we will be able to follow up on mailed survey invitations with a reminder telephone call, which will be made two weeks after the addressed letters are mailed, provided that selected participants have not completed the survey. Reminder telephone calls will not be possible for households in Fig 1. An overview of the multi-stage random sampling method. https://doi.org/10.1371/journal.pone.0291303.g001 PLOS ONE Climate change and mental health survey protocol PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 6 / 12

Nunavut, since each household address in the Canada Post database does not include a corre- sponding telephone number. Instead, we will send one additional reminder letter to random households that have not completed the survey. Initially, the sampling frame for telephone recruitment will include 60 telephone numbers per province/territory, assuming a 10% response rate. Similar to our approach to our mail- based sampling frame, we will monitor the response rates for each province and territory, as well as for urban and rural areas, and we will make adjustments to the sample parameters and the number of randomly selected telephone numbers accordingly. Within the first 10 days of each month, we will dial each of the selected phone numbers at least once. Phone numbers will be dialled on the following days and times in the time zone of the area being surveyed: Monday to Friday between 13:00 to 20:00; Saturday between 10:00 to 18:00; and Sunday between 12:00 to 20:00. No initial calls will be made on statutory holidays. Each call attempt will allow for a minimum of five rings or until it is sent to voicemail. Initially, we will attempt each telephone number up to five times over the course of one month. Each call will be made on different days of the week and during different times of the day. A voicemail message will be left on the sec- ond unsuccessful attempt and every unsuccessful attempt thereafter. Eligible participants can complete the questionnaire over the telephone with a trained interviewer; schedule an appoint-

ment to be called back later; or receive a link by email or text message to complete the ques- tionnaire online. All callback appointments will be scheduled for the day and time requested by the participant. Regardless of the recruitment method (mail or telephone), participants will complete the same questionnaire either through Voxco via Computer Assisted Telephone Interviewing (CATI) or using an online survey instrument. However, the introductory recruitment script will differ depending on the mode of recruitment: the telephone version requires more intro- ductory information as well as the questions that are necessary to randomly select the member of the household to interview (i.e. the person 13 years or older in the household who has the next birthday). For both modes of recruitment, the day that the questionnaire is completed will be logged as the reference day (i.e. the day when the last question was completed and the survey was submitted). To achieve a representative sample, we will aim for the number of completed questionnaires to be proportional to the distribution of age groups (13–34 years; 35–54 years; 55–74 years; 75 + years) in each province/territory based on Statistics Canada data (2021) [48] (Table 3). Addi- tionally, within each province/territory, we will aim for the number of questionnaires com- pleted to be proportional to that province/territory’s urban/rural population sizes based on the first two digits of respondents’ postal codes based on Statistics Canada data (2016) [49].

We will use the Market Research and Intelligence Agency (MRIA) empirical method to cal- culate the questionnaire response rate [50]. Thus, we will divide the number of responding units by the sum of in-scope and unresolved units. The MRIA empirical method is widely used in Canada, including in previous surveys conducted by the Government of Canada [47, 50]. Options to overcome recruitment challenges If any age or geographical targets are not met during the course of the survey administration, we will employ several methods to increase recruitment success. For example, the proportion of cellular phone, landline telephone, and mailout recruitments in the sample can be adjusted. For those participants contacted by cellular telephone, if there is no response after the third attempt, one text message may be sent to the cellular phone containing a link to the online ver- sion of the questionnaire. Small incentives (i.e. gift cards) may be used to increase enrolment for subpopulations that might have lower response rates (e.g. those living in the Territories PLOS ONE Climate change and mental health survey protocol PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 7 / 12

and younger age groups). If the subpopulation is small, targeted social media advertisements may be used to increase awareness of the survey (but note that these advertisements will not be used to facilitate recruitment). Quotas for certain demographic characteristics can be set each month; that is, once a quota has been met for a demographic group, the questionnaire will not be available for participants belonging to that group for the remainder of the month. Finally, to help reach our demographic quotas, we could limit or remove the ability for certain demo- graphics to be recruited over the telephone (i.e. those in a certain age group are not eligible to be recruited via telephone). Ethics All participants will be provided with an information letter that outlined the study details. We will obtain informed consent from all participants: telephone participants provided informed consent orally (documented by the surveyor) and online participants provided informed con- sent electronically. We were granted a waiver of parental/guardian consent for participants between the ages of 13–18, given that our study met all criteria under Article 3.7 of the TCPS2. Our study is an anonymous survey that collects minimal identifying information and involves minimal risk to participants. The study protocol was approved by the ethics research boards at the University of Alberta and Memorial University of Newfoundland and Labrador. A research licence was obtained from the Nunavut Research Institute. Data processing and analyses

The questionnaire response data will be downloaded in English (all responses to open-ended questions in languages other than English will be translated into English by Malatest and then provided to the research team) into Excel (Microsoft Corporation, Redmond, WA), and then uploaded into Stata (StataCorp LLC, College Station, TX) and R (The R Foundation, Indianap- olis, IN) for analysis. Data will be population-weighted (e.g. by age, province/territory, gender, Table 3. A summary of the target number of responses by province/territory and age group for the entire survey period (1 year). Target Number of Respondents by Age Groups Provinces/Territories 13–34 years 35–54 years 55–74 years 75+ years Total* Alberta 100 97 72 20 289 British Columbia 91 87 84 27 289 Manitoba 103 86 76 24 289 New Brunswick 80 83 96 30 289 Newfoundland and Labrador 77 84 99 29 289 Northwest Territories 112 98 70 9 289 Nova Scotia 86 81 93 29 289 Nunavut 144 97 43 5 289 Ontario 97 86 80 26 289 Prince Edward Island 94 81 87 27 289 Quebec 86 87 87 29 289 Saskatchewan 99 88 77 25 289 Yukon 95 99 81 14 289 Total* 1,214 1,135 1,068 340 3,757 *Target number of respondents were calculated to be proportional to the age demographics of that province or territory using data from Statistics Canada (2021) [48] and may differ from the cumulative sums of each column due to rounding. https://doi.org/10.1371/journal.pone.0291303.t003 PLOS ONE Climate change and mental health survey protocol

PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 8 / 12

rural/remote, and/or income based on Statistics Canada data) to account for oversampling and for the biases inherent in the selection strategy. Descriptive statistics will be calculated and will reflect the survey objectives. The prevalence of climate-related subclinical mental health outcomes and emotions and the measures of central tendency for the independent variables will be calculated. Outcome measures (prevalence) and differences between demographic groups will be calculated with 95% confidence intervals. Factor analyses will be conducted for the emotion and subclinical outcome questions [33, 38]. Population-weighted multivariable regression analyses will be used to explore associations between the outcome variables and the independent variables. Discussion This study will provide the first national prevalence estimates of climate change impacts on psychosocial wellbeing in Canada. By examining the prevalence, magnitude, and distribution of climate-sensitive mental health impacts in Canada, this survey will provide important national evidence to support decision-making, adaptation strategies, and public health invest- ments. In addition, although this survey protocol has been developed for use in Canada, the overall design and methods can serve as a foundation for further understanding climate- related mental health outcomes that can inform and support other national and international surveys on this important topic. Finally, the results of this survey will add population-level insights to the global climate change and mental health knowledge base.

Supporting information S1 Table. English version of the full questionnaire. (DOCX) Acknowledgments We extend our thanks to Nia King and Hannah Bayne for translation support. Special thanks to Hannah Bayne and Kelsey Robertson for their support in developing elements of the ques- tionnaire and pre-testing phases. We sincerely thank Doug Elliot from Malatest for his ongo- ing support and troubleshooting ability. Author Contributions Conceptualization: Sherilee L. Harper, Ashlee Cunsolo, Breanne Aylward, Susan Clayton, Kelton Minor, Madison Cooper, Rachael Vriezen. Data curation: Breanne Aylward. Funding acquisition: Sherilee L. Harper, Ashlee Cunsolo. Methodology: Sherilee L. Harper, Ashlee Cunsolo, Breanne Aylward, Susan Clayton, Kelton Minor, Madison Cooper, Rachael Vriezen. Resources: Sherilee L. Harper. Visualization: Sherilee L. Harper, Ashlee Cunsolo. Writing – original draft: Sherilee L. Harper. Writing – review & editing: Sherilee L. Harper, Ashlee Cunsolo, Breanne Aylward, Susan Clayton, Kelton Minor, Madison Cooper, Rachael Vriezen. PLOS ONE Climate change and mental health survey protocol PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 9 / 12

References 1. Cisse´ G, McLeman R, Adams H, Aldunce P, Bowen K, Campbell-Lendrum D, et al. Chapter 7: Health, Wellbeing, and the Changing Structure of Communities. In: Po¨rtner H-O, Roberts DC, Tignor M, Poloc- zanska ES, Mintenbeck K, Alegrı´a A, et al., editors. Climate Change 2022: Impacts, Adaptation, and Vulnerability Contribution of Working Group II to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change. Cambridge University Press; 2022. 2. Clayton S, Manning C, Speiser M, Hill AN. Mental health and our changing climate: impacts, inequities, responses. Washington, DC, USA: American Psychological Association and ecoAmerica; 2021. 3. Hayes K, Cunsolo A, Augustinavicius J, Stranberg R, Clayton S, Malik M, et al. Mental Health and Well-Being. In: Berry P, Schnitter R, editors. Health of Canadians in a Changing Climate: Advancing our Knowledge for Action. Ottawa, Canada: Government of Canada; 2022. pp. 226–285. https://ftp. maps.canada.ca/pub/nrcan_rncan/publications/STPublications_PublicationsST/329/329530/gid_ 329530.pdf 4. Lawrance EL, Thompson R, Newberry Le Vay J, Page L, Jennings N. The Impact of Climate Change on Mental Health and Emotional Wellbeing: A Narrative Review of Current Evidence, and its Implications. Int Rev Psychiatry. 2022; 34: 443–498. https://doi.org/10.1080/09540261.2022.2128725 PMID: 36165756 5. Obradovich N, Minor K. Identifying and Preparing for the Mental Health Burden of Climate Change. JAMA Psychiatry. 2022; 79: 285–286. https://doi.org/10.1001/jamapsychiatry.2021.4280 PMID: 35195666

6. Aylward B, Cunsolo A, Vriezen R, Harper SL. Climate change is impacting mental health in North Amer- ica: A systematic scoping review of the hazards, exposures, vulnerabilities, risks and responses. Int Rev Psychiatry. 2022; 34: 34–50. https://doi.org/10.1080/09540261.2022.2029368 PMID: 35584021 7. Charlson F, Ali S, Benmarhnia T, Pearl M, Massazza A, Augustinavicius J, et al. Climate change and mental health: A scoping review. Int J Environ Res Public Health. 2021; 18: 4486. https://doi.org/10. 3390/ijerph18094486 PMID: 33922573 8. Hwong AR, Wang M, Khan H, Chagwedera DN, Grzenda A, Doty B, et al. Climate change and mental health research methods, gaps, and priorities: a scoping review. Lancet Planet Heal. 2022; 6: e281– e291. https://doi.org/10.1016/S2542-5196(22)00012-2 PMID: 35278392 9. Sharpe I, Davison CM. Climate change, climate-related disasters and mental disorder in low- And mid- dle-income countries: A scoping review. BMJ Open. 2021; 11: e051908. https://doi.org/10.1136/ bmjopen-2021-051908 PMID: 34649848 10. Zhong S, Yang L, Toloo S, Wang Z, Tong S, Sun X, et al. The long-term physical and psychological health impacts of flooding: A systematic mapping. Sci Total Environ. 2018; 626: 165–194. https://doi. org/10.1016/j.scitotenv.2018.01.041 PMID: 29339262 11. Obradovich N, Migliorini R, Paulus MP, Rahwan I. Empirical evidence of mental health risks posed by climate change. Proc Natl Acad Sci. 2018; 115: 10953–10958. https://doi.org/10.1073/pnas. 1801528115 PMID: 30297424

12. Romanello M, Di Napoli C, Drummond P, Green C, Kennard H, Lampard P, et al. The 2022 report of the Lancet Countdown on health and climate change: health at the mercy of fossil fuels. Lancet. 2022; 400: 1619–1654. https://doi.org/10.1016/S0140-6736(22)01540-9 PMID: 36306815 13. Liu J, Varghese BM, Hansen A, Xiang J, Zhang Y, Dear K, et al. Is there an association between hot weather and poor mental health outcomes? A systematic review and meta-analysis. Environ Int. 2021; 153: 106533. https://doi.org/10.1016/j.envint.2021.106533 PMID: 33799230 14. Thompson R, Hornigold R, Page L, Waite T. Associations between high ambient temperatures and heat waves with mental health outcomes: a systematic review. Public Health. 2018; 161: 171–191. https://doi.org/10.1016/j.puhe.2018.06.008 PMID: 30007545 15. Vins H, Bell J, Saha S, Hess JJ. The mental health outcomes of drought: A systematic review and causal process diagram. Int J Environ Res Public Health. 2015; 12: 13251–13275. https://doi.org/10. 3390/ijerph121013251 PMID: 26506367 16. Chen L, Liu A. The incidence of posttraumatic stress disorder after floods: A meta-analysis. Disaster Med Public Health Prep. 2015; 9: 329–333. https://doi.org/10.1017/dmp.2015.17 PMID: 25857395 17. Fernandez A, Black J, Jones M, Wilson L, Salvador-Carulla L, Astell-Burt T, et al. Flooding and mental health: A systematic mapping review. PLoS One. 2015; 10: e0119929. https://doi.org/10.1371/journal. pone.0119929 PMID: 25860572 18. To P, Eboreime E, Agyapong VIO. The impact of wildfires on mental health: A scoping review. Behav

Sci (Basel). 2021; 11: 126. https://doi.org/10.3390/bs11090126 PMID: 34562964 19. Tam K, Leung AK, Clayton S. Research on climate change in social psychology publications: A system- atic review. Asian J Soc Psychol Publ. 2021; 24: 117–143. https://doi.org/10.1111/ajsp.12477 PLOS ONE Climate change and mental health survey protocol PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 10 / 12

20. Infante-Rivard C, Cusson A. Reflection on modern methods: Selection bias—a review of recent devel- opments. Int J Epidemiol. 2018; 47: 1714–1722. https://doi.org/10.1093/ije/dyy138 PMID: 29982600 21. Lehdonvirta V, Oksanen A, Ra¨ sa¨ nen P, Blank G. Social Media, Web, and Panel Surveys: Using Non- Probability Samples in Social and Policy Research. Policy and Internet. 2021; 13: 134–155. https://doi. org/10.1002/poi3.238 22. Minor K, Agneman G, Davidsen N, Kleemann N, Markussen U, Olsen A, et al. Greenlandic Perspec- tives on Climate Change 2018–2019: Results from a National Survey. University of Greenland and Uni- versity of Copenhagen. Kraks Fond Institute for Urban Research.; 2019. 23. Soutar C, Wand APF. Understanding the Spectrum of Anxiety Responses to Climate Change: A Sys- tematic Review of the Qualitative Literature. Int J Environ Res Public Health. 2022; 19: 990. https://doi. org/10.3390/ijerph19020990 PMID: 35055813 24. Marino E. Fierce climate, sacred ground: An ethnography of climate change in Shishmaref, Alaska. University of Alaska Press; 2015. 25. Cunsolo A, Ellis NR. Ecological grief as a mental health response to climate change-related loss. Nat Clim Chang. 2018; 8: 275–281. https://doi.org/10.1038/s41558-018-0092-2 26. Albrecht G, Sartore G-M, Connor L, Higginbotham N, Freeman S, Kelly B, et al. Solastalgia: the distress caused by environmental change. Australas Psychiatry. 2007; 15: S95–S98. https://doi.org/10.1080/ 10398560701701288 PMID: 18027145

27. Galway LP, Beery T, Jones-Casey K, Tasala K. Mapping the solastalgia literature: A scoping review study. Int J Environ Res Public Health. 2019; 16: 2662. https://doi.org/10.3390/ijerph16152662 PMID: 31349659 28. Middleton J, Cunsolo A, Jones-Bitton A, Wright CJ, Harper SL. Indigenous mental health in a changing climate: A systematic scoping review of the global literature. Environ Res Lett. 2020; 15: 053001. https://doi.org/10.1088/1748-9326/ab68a9 29. Vodden K, Cunsolo A. Rural and remote communities. In: Warren F, Lulham N, editors. Canada in a changing climate: National Issues Report. Ottawa, Canada: Government of Canada; 2021. pp. 103– 184. 30. Hancock B, Andersen W., Calmels F, Collier J, Cunsolo A, Dawson J, et al. Northern Canada. In: War- ren FJ, Lulham N, Dupuis DL, Lemmen DS, editors. Canada in a Changing Climate: Regional Perspec- tives Report. Ottawa, Canada: Government of Canada; 2022. 31. Environment and Climate Change Canada. Canada’s National Adaptation Strategy. Ottawa, Canada: Government of Canada; 2022. https://www.canada.ca/en/services/environment/weather/climatechan ge/climate-plan/national-adaptation-strategy/full-strategy.html 32. Public Health Agency of Canada. Chief Public Health Officer of Canada’s Report on the State of Public Health in Canada 2022: Mobilizing Public Health Action on Climate Change in Canada. Ottawa, Can- ada: Public Health Agency of Canada; 2022. Public Health Agency of Canada (PHAC). (2022). Gener- ating Knowledge to Inform Public Health Action on Climate Change in Canada.

33. Clayton S, Karazsia BT. Development and validation of a measure of climate change anxiety. J Environ Psychol. 2020; 69: 101434. https://doi.org/10.1016/j.jenvp.2020.101434 34. Larionow P, Sołtys M, Izdebski P, Mudło-Głagolska K, Golonka J, Demski M, et al. Climate Change Anxiety Assessment: The Psychometric Properties of the Polish Version of the Climate Anxiety Scale. Front Psychol. 2022; 13: 870392. https://doi.org/10.3389/fpsyg.2022.870392 PMID: 35645848 35. Mouguiama-Daouda C, Blanchard MA, Coussement C, Heeren A. On the Measurement of Climate Change Anxiety: French Validation of the Climate Anxiety Scale. Psychol Belg. 2022; 62: 123–135. https://doi.org/10.5334/pb.1137 PMID: 35414943 36. Innocenti M, Santarelli G, Faggi V, Castellini G, Manelli I, Magrini G, et al. Psychometric properties of the Italian version of the Climate Change Anxiety Scale. J Clim Chang Heal. 2021; 3: 100080. https:// doi.org/10.1016/j.joclim.2021.100080 37. Wullenkord MC, Tro¨ger J, Hamann KRS, Loy LS, Reese G. Anxiety and climate change: a validation of the Climate Anxiety Scale in a German-speaking quota sample and an investigation of psychological correlates. Clim Change. 2021; 168: 20. https://doi.org/10.1007/s10584-021-03234-6 38. Searle K, Gow K. Do concerns about climate change lead to distress? Int J Clim Chang Strateg Manag. 2010; 2: 362–379. https://doi.org/10.1108/17568691011089891 39. Cruz SM, High AC. Psychometric properties of the climate change anxiety scale. J Environ Psychol. 2022; 84: 101905. https://doi.org/10.1016/j.jenvp.2022.101905

40. Simon PD, Pakingan KA, Aruta JJBR. Measurement of climate change anxiety and its mediating effect between experience of climate change and mitigation actions of Filipino youth. Educ Dev Psychol. 2022; 39: 17–27. https://doi.org/10.1080/20590776.2022.2037390 PLOS ONE Climate change and mental health survey protocol PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 11 / 12

41. Jang SJ, Chung SJ, Lee H. Validation of the Climate Change Anxiety Scale for Korean Adults. Martino T, editor. Perspect Psychiatr Care. 2023; 9718834. https://doi.org/10.1155/2023/9718834 42. Hickman C, Marks E, Pihkala P, Clayton S, Lewandowski RE, Mayall EE, et al. Climate anxiety in chil- dren and young people and their beliefs about government responses to climate change: a global sur- vey. Lancet Planet Heal. 2021; 5: e863–e873. https://doi.org/10.1016/S2542-5196(21)00278-3 PMID: 34895496 43. Reser JP, Bradley GL, Glendon AI, Ellul MC, Callaghan R. Public Risk Perceptions, Understandings, and Responses to Climate Change and Natural Disasters in Australia, 2010 and 2011. National Climate Change Adaptation Research Facility, Gold Coast; 2012. https://doi.org/10.1002/9781118845028.ch6 44. Stanley SK, Hogg TL, Leviston Z, Walker I. From anger to action: Differential impacts of eco-anxiety, eco-depression, and eco-anger on climate action and wellbeing. J Clim Chang Heal. 2021; 1: 100003. https://doi.org/10.1016/j.joclim.2021.100003 45. Alberta Human Rights Commission. Protected areas and grounds under the Alberta Human Rights Act. 2018. https://www.albertahumanrights.ab.ca/Documents/ProtAreasGrounds.pdf 46. Statistics Canada. Visible minority of person. Ottawa, Canada: Statistics Canada; 2021. https://www23. statcan.gc.ca/imdb/p3Var.pl?Function=DECI&Id=1323413 47. Public Health Agency of Canada. Foodbook Report. Ottawa, Canada: Centre for Food-borne, Environ- mental and Zoonotic Infectious Diseases, Infectious Diseases Prevention and Control Branch, Public

Health Agency of Canada; 2015. http://www.healthycanadians.gc.ca/publications/eating-nutrition/ foodbook-2015/index-eng.php#t8 48. Statistics Canada. Table 17-10-0005-01 Population estimates on July 1st, by age and sex [Data file]. Ottawa, Canada: Statistics Canada; 2021. https://doi.org/10.25318/1710000501-eng 49. Statistics Canada. Population and Dwelling Count Highlight Tables, 2016 Census. Ottawa, Canada: Statistics Canada; 2018. https://www12.statcan.gc.ca/census-recensement/2016/dp-pd/hlt-fst/pd-pl/ Table.cfm?Lang=Eng&T=1201&S=22&O=A#shr-pg0 50. Public Works and Government Services Canada. Improving Respondent Cooperation for Telephone Surveys. Ottawa, Canada: Government of Canada; 2020. https://www.tpsgc-pwgsc.gc.ca/rop-por/ rapports-reports/telephone/tdm-toc-eng.html PLOS ONE Climate change and mental health survey protocol PLOS ONE | https://doi.org/10.1371/journal.pone.0291303 October 11, 2023 12 / 12