In recent years, governmental institutes have started to use citizen science as a form of public participation. The Dutch water authorities are among them. They face pressure on the water governance system and a water awareness gap among the general public, and consider citizen science a possible solution. The reasons for practitioners to engage in citizen science, and in particular those of government practitioners, have seldom been studied. This article aims to pinpoint the various viewpoints of practitioners at Dutch regional water authorities on citizen science. A Q-methodological approach was used because it allows for exploration of viewpoints and statistical analysis using a small sample size. Practitioners (33) at eight different water authorities ranked 46 statements from agree to disagree. Three viewpoints were identified with a total explained variance of 67 %. Viewpoint A considers citizen science a potential solution that can serve several purposes, thereby encouraging citizen participation in data collection and analysis. Viewpoint B considers citizen science a method for additional, illustrative data. Viewpoint C views citizen science primarily as a means of education. These viewpoints show water practitioners in the Netherlands are willing to embrace citizen science at water authorities, although there is no support for higher levels of citizen engagement.
The OECD (Organization of Economic Cooperation and Development) named the Netherlands “an international example” of water resource management in their 2014 report, but warns against “a striking awareness gap among Dutch citizens related to key water management functions, how they are performed and by whom” (OECD, 2014, p. 21). The main causes of this awareness gap are the absence of major water calamities in the past 60 years and the improvement of water quality over the past decades. Dutch citizens take the excellent water resource management for granted (OECD, 2014), which poses social challenges for Dutch water resource management. Citizens' behaviour counteracts efforts of water authorities; flood defences are violated by property development and civic pollution is common (OECD, 2014). Citizens and interest groups do not recognize water threats (Tielrooij, 2000), which causes a decreasing support for investments in flood defence and water quality management (OECD, 2014; Tielrooij, 2000; UvW, 2015a). Other countries also experience a “lack of citizen concern about water policy and low involvement of water users' associations” (OECD, 2011, p. 60). Half of the reviewed OECD countries across the globe face such challenges, including Chile, Italy, Korea and Mexico (OECD, 2011, p. 61). The Dutch water authorities (Unie van Waterschappen, UvW) governing body concluded that collaboration with other government layers, industry, interest groups and citizens is needed (UvW, 2015a). The UvW envisions increased public participation, with citizen science as a form of such participation (UvW, 2015b). In addition to raising awareness, citizen science could contribute to data collection and help water authorities to enhance their monitoring programmes, particularly with respect to the Water Framework Directive.
Definitions of citizen science can be narrow and focussed solely on data collection for academic purposes. Silvertown (2009) describes citizen science in a broader perspective, applicable to citizen science in practitioners' activities considered in this article. “Today, most citizen scientists work with professional counterparts on projects that have been specifically designed or adapted to give amateurs a role, either for the educational benefit of the volunteers themselves or for the benefit of the project. The best examples benefit both” (Silvertown, 2009, p. 467). To prevent confusion, a distinction is made within this category of professional counterparts (Silvertown, 2009). The professional counterparts in Silvertown's definition include scientists, conservation professionals and government practitioners. We define scientists as those involved in academia. Conservation professionals are those working for nature managers or conservation organizations. Government practitioners are defined as those working at a government agency or at the local government level.
Citizen science in water resource management is upcoming but lingering on the verge of a breakthrough (Buytaert et al., 2014; Cohn, 2008; Fraternali et al., 2012). The rise of robust, cheap and low-maintenance sensors enhances opportunities for citizen science in the complex arena of water resource management (Buytaert et al., 2014). New hydrological modelling frameworks (e.g. Clark et al., 2015) and specifically uncertainty quantification (e.g. Shoaib et al., 2016) can allow for more effective design of citizen science campaigns to systematically reduce model uncertainty, as well as more effective use of citizen-collected data. These data are often considered highly uncertain by practitioners, as they indicated in the exploratory interviews held at the start of this research. Fraternali et al. (2012) give an overview of the potential of amateurs taking part in data collection, data analysis and the process of decision-making in water resource management.
This potential is also recognized in the Netherlands. In November 2014 water
authority Delfland organized a workshop Part of the symposium “De
fysieke Digitiale Delta” (the Physical Digital Delta; see also
Citizens' motivations have been studied extensively in a diverse set of citizen science projects, such as online crowdsourcing (e.g. Chandler and Kapelner, 2013; Raddick et al., 2010; Rogstadius et al., 2011), environmental monitoring (e.g. Hobbs and White, 2012; Roy et al., 2012) and meteorology (e.g. Gharesifard and Wehn, 2016). It has been acknowledged that the idea of “the public” does not exist (e.g. Varner, 2014), since “the public” consists of a wide variety of people with different backgrounds, interests, traits, values and beliefs. Nevertheless, existing studies of citizen science in field and online projects, despite this diversity, reveal the same dominant motivations over a wide range of projects and participants. The most mentioned reasons for citizens to engage in citizen science are because they think it is fun, because the topic interests them, and because the topic matters to them, e.g. they want to contribute to science or nature conservation (e.g. Chandler and Kapelner, 2013; Hobbs and White, 2012; Raddick et al., 2010; Rogstadius et al., 2011; Roy et al., 2012). Citizens are motivated to continue to contribute by (increasing) the extent of their involvement (Rotman et al., 2012; Roy et al., 2012), offering feedback concerning the work at three levels (individual contribution, group contribution and the use of data) and building a relationship based on trust between scientists and citizens (Rotman et al., 2012). The importance of trust is stressed by authors in the field of water management as well (Buytaert et al., 2014; Gharesifard and Wehn, 2016).
The role of citizens varies depending on the purpose of the citizen science project. Tulloch et al. (2013) studied the purpose of citizen science projects in bird watching, a research field with a century-long history of citizen science. The most common purpose of citizen science is knowledge generation (knowledge also new to the involved professionals), followed by improving monitoring methods and raising awareness among citizens. In water resource management, citizen science can enhance knowledge about the water system, for example by generating knowledge on different spatial or temporal scales. It may also be used to add or test new monitoring methods for the existing monitoring network (mentioned in exploratory interviews held at the start of this study). Citizen science can also be used to increase the water awareness that was dubbed absent in the OECD report (OECD, 2014). According to Tulloch et al. (2013), citizen science can be used to improve management practice as well. In water resource management such improved management can be the result of more frequent monitoring. The literature mentions public education as an important purpose of citizen science (e.g. Cohn, 2008), but Tulloch et al. (2013) found that public education was rarely the main purpose. Other identified, yet also more rare, purposes include doing social research (e.g. on human behaviour), offering recreation and serendipity (i.e. unexpected discoveries). A more recent study in the field of ecology specified the potential of citizen science for the purpose of policy development (Hollow et al., 2015). In early stages of a policy development process, citizen science can be used to discover alternative management actions. In case there is a range of alternatives, citizen science can be used to gauge public opinion. In later stages it can be used to persuade public opinion towards a desired alternative or to provide a legal justification for the chosen policy. Citizen science-based data can be used for decision-making in water resource management as well (Macknick and Enders, 2012). Projects can have one or multiple purposes, as the iSPEX project demonstrates. This project served knowledge generation, public education and method improvement (Land-Zandstraet al., 2015; Snik et al., 2014).
For the purposes of knowledge generation, improving monitoring methods improves management and policy development. Bonney et al. (2009) provide a useful classification of citizens' roles. They suggest there are basically three levels of citizen involvement possible: contribution, collaboration and co-creation. In a contributory project, citizens are mainly involved in data collection; the research question and design are done by scientists or experts. In collaborative projects citizens are involved in the analysis and can be involved in the design and dissemination of results as well. In co-created projects citizens are involved in all steps of the research process and may even initiate the project. The vast majority of studies in the overview presented by Bonney et al. (2009) considered contributory projects. Even the occasionally co-created projects were part of multi-case studies in which contributory projects dominated the results. Citizens' involvement in activities other than data collection may serve different purposes; for example, citizen-based goal-setting could enhance adaptive management practices (Cooper et al., 2007). Bonney et al. (2009) is frequently cited (e.g. Rotman et al., 2012; Roy et al. 2012) and can be considered a typical classification. The levels of involvement align to a large extent with the governance structures defined by Conrad and Hilchey (2011): consultative, collaborative and transformative governance. In transformative governance citizens initiate a project. An example can be found in the global community monitor that measures air and water quality on a global scale (Conrad and Hilchey, 2011).
For the purposes of public education, raising awareness, improving management and policy development, science communication literature (e.g. Varner, 2014) provides a more useful classification of the interaction between citizens and professional counterparts. We use the term science communication here in a broad sense and include communication between public and all professional counterparts referred to by Silvertown (2009), including practitioners. Citizen science is often viewed as a form of informal science education, contributing to public awareness of science (PAS) and public understanding of science (PUS). We think this view is too limited, as it only encompasses the deficit model of science communication. Higher levels of involvement public engagement of science (PES) and public participation in science (PPS) are possible (Van der Auweraert, 2005), particularly in the collaborative and co-created projects in Bonney's definition. An example of such participation is the water quality programme in Rhode Island mentioned in the review by Conrad and Hilchey (2011).
The motivation of professional counterparts to engage in citizen science has been less frequently studied than the motivation of citizens, and to our best knowledge research on professionals' motivation is limited to scientists. Scientists' motivations are primarily to advance science as well as develop their careers (Rotman et al., 2012). This is aligned with citizens' motivational desire to contribute to science and conservation or to engage in exploring a topic of their interest further (e.g. Rotman et al., 2012). Weng (2015) identifies three areas of friction between the vision of scientists and volunteers with regard to citizen science. The first area of friction is often short-term participation of volunteers that conflicts with scientists' interest in long-term processes. The second area concerns the limits of what volunteers can do and their dissatisfaction with the research processes. The third area regards a power hierarchy between citizens and scientists. Rotman et al. (2012) found that while the motivations of citizens and scientists are complementary, they can also change over time. Therefore, continued attention by those who are managing citizen science projects with regard to matching these motivations is crucial.
The motivation of scientists cannot be translated one-to-one to practitioners or (local) government representatives for two reasons. First, scientists are concerned with scientific data collection (Rotman et al., 2012), while practitioners are often interested in improving management practices (Weng, 2015) and government agencies are concerned with policy-making (Hollow et al., 2015). Second, the different role of authorities leads to different expectations. Water authorities believe that citizens see water resource management as a task for authorities only, which implies that citizens do not want to be involved. Nevertheless, most water authorities agree that they need the observations of citizens for their work, as expressed in several studies related to flood risk management (Wehn and Evers, 2014; Wehn et al., 2015).
This study aims to explore perspectives of government practitioners regarding citizen science. We explore Dutch water practitioners' perceptions of citizen motivation, acceptance in their organization, (potential) purposes and level of citizen engagement. We address apparent knowledge gaps regarding the motivation of professionals to embrace citizen science and specifically the link with citizen participation. Perceptions were explored using Q methodology. With Q methodology we identified a set of viewpoints that describe the variation in opinions. This variation we consider meaningful for the design and implementation of citizen science at water boards in the Netherlands. In addition to providing insight into the viewpoints of Dutch practitioners, this study aims to develop a methodology to study perspectives regarding citizen science in a wider range of countries and professionals.
The study uses Q methodology (Van Exel and De Graaf, 2005; Watts and Stenner, 2012) to find viewpoints on citizen science among employees of the Dutch water authorities. Q methodology is a relatively uncommon method in water resource management (e.g. Raadgever et al., 2008), but it is a popular method in social sciences fields, such as political science and psychology (Cools et al., 2009). The strengths of the Q methodology are that it combines qualitative and quantitative aspects and that it is statistically robust, with small samples of 30–40 people (Van Exel and De Graaf, 2005; Watts and Stenner, 2012). For this research Q methodology has the advantage over fully quantitative approaches in that we could explore a wide spectrum of viewpoints, whereas quantitative methods would arrive easily at averaged values. Quantitative methods would likely not reveal the distinguishing elements that are in our opinion crucial to be aware of for effective implementation of citizen science. Q methodology has the advantage over fully qualitative methods that it reduces the variation in opinions to a representative small set of viewpoints in a trackable, relatively little biased way (further discussed below).
This section provides a short description of the methodology and research-specific details. We kindly refer readers interested in more methodological details to Van Exel and De Graaf (2005) for a quick introduction, and Watts and Stenner (2012) or Brown (1980) for an elaboration on the philosophy and statistical basis. In conducting this research we closely followed the guidelines of Watts and Stenner (2012). Our Q methodological research consisted of seven stages summarized in Fig. 1 and elaborated below.
Flowchart of the steps of the Q methodological research approach. Based on Watts and Stenner (2012). For clarity reasons, we choose to describe Stage 5 in Watts and Stenner (2012) as three separate stages.
The first stage aimed at collecting as wide a range as possible of opinions on the topic of citizen science for water quality monitoring (discourse) and documenting them in statements (concourse). We held 10 semi-structured interviews with employees of water authorities, nature managers and citizen organizations, from which 181 statements were derived. Additionally, we organized a structured group discussion about citizen science with water professionals at the afore-mentioned workshop, which resulted in an additional 21 statements. To collect a wider range of opinions, we organized a focus group meeting with five middle-aged woman of an informal walking club with high potential to participate in citizen science, which resulted in an additional 20 statements. Finally, benefits and downsides of citizen science were extracted from the literature, which resulted in an additional seven statements. To reduce researcher bias, we based statements as much and as closely as possible on quotes. The final concourse (all possible statements on a topic) consisted of 229 statements. Four themes could be identified in the concourse: (I) citizen motivation, (II) acceptance of citizen science at the water authority, (III) purposes of citizen science for professionals and (IV) level of citizen engagement.
In Stage 2 the concourse was reduced to the so-called Q-set set of 48 statements that still reflected the full discourse. We first reduced the concourse to a preliminary Q-set of 65 statements by excluding or reframing statements that were similar to others, out of scope or ambiguous. Six masters students between the ages of 22 and 25 tested this preliminary Q-set. Two female students had a major in water resource management; the other two female and two male students had a different major (medicine, mathematics, mechanical engineering and management studies). We instructed them to sort the statements and list statements that they did not understand, found similar in meaning or considered irrelevant, and improved the preliminary Q-set based on their feedback. Table 1 contains the final Q-set of 46 statements; the Roman numerals indicate to what theme the statement contributes.
In Stage 3, the P-set (i.e. the group of participants) was sampled using both a structured approach with three criteria and snowball sampling. Flood risk was a first criterion, as water authorities with a high flood risk face different challenges than water authorities with a lower flood risk. Age (expressed in years since the last reform or merger with another water authority) was a second criterion, as a recent reform suggests the organization may be more susceptible to innovation, such as citizen science. Location (within or outside the urban conglomerate Randstad) was a third criterion, because interviewees in the semi-structured interviews held to define the discourse suggested a different relationship between water authority and population in rural and urban areas. The structured approach resulted in eight water authorities representing a combination of these criteria. In each water authority we approached the ecologists because we expected them to be more familiar with the concept of citizen science and we had access to a list of ecologists per water authority. Additionally we used snowball sampling. We asked the participating ecologists to recruit colleagues with a similar opinion, to enhance overlap between individual opinions, and, with different opinions, to increase the diversity of opinions. Also, we asked participants to recommend someone with an opposing opinion, in order to discover as many viewpoints as possible. Participants 20, 24, 25, 30 and 31 out of 33 were recruited with this strategy, with the aim that they would belong to different (new) viewpoints. Two to six people with different positions were interviewed per water authority, which resulted in interviews with 1 politician, 20 policy advisors, 10 ecologists/hydrologists and 2 field staff members.
Next, in Stage 4, the Q-sorts (the actual arranging sorting process) took
place in four sub-steps, taking a total time of 60 to 75 min. First, the
first author gave three examples of consultative citizen science to all
participants, to ensure everyone had a basic level of understanding of
citizen science. These examples were
the Dutch garden bird count ( iSPEX: citizens measured particulate matter with a smartphone device
called iSPEX (Snik et al., 2014, p. 7351); and water level monitoring by citizens in a Dutch water authority
(UvW, 2015b, p. 15).
Second, participants pre-sorted the statements into three piles: agree,
disagree and neutral. Third, they made a final sorting of the statements in a
fixed distribution (see Fig. 2). Finally, the first author held a structured
post-sorting interview. Post-sorting interviews were included in this study,
because they can provide in-depth insight into the beliefs and values
underlying the sorts and allow for an analysis based on the participants'
rationale rather than on the available literature or the researcher's bias
(Gallagher and Porock, 2010). Discussing all statements with participants
would have been preferable, but was not feasible given the available time for
this study and the geographic spreading of participants. In a structured
interview, participants explained their reasoning for the statements in
categories
The fixed distribution used in this study. The participant places
the two statements that he agrees most with in the
Next, in Stage 5, a factor analysis was performed with software package PQMethod, version 3.2.1. PQMethod is used to perform a factor analysis and is frequently used in Q methodological research (Van Exel and De Graaf, 2005; Cools et al., 2009; Raadgever et al., 2008; Watts and Stenner, 2012). A factor analysis is a statistical method to describe variability in a set of correlated variables, in this case the ranking of statements by individuals, by a smaller number of factors. We included three factors with an eigenvalue above 1 (recommended by Watts and Stenner, 2012) for further analysis. The factor analysis also showed which people load on which factor, i.e. which people have a perspective resembling that factor. People can load on none, one or multiple factors. For this a threshold was used, the significant factor loading (SFL). In this study we followed Watts and Stenner (2012) and used a SFL of 0.38. Factors were optimized using factor rotation, which aims to have as many people as possible load on a single factor rather than loading on two factors simultaneously. The rotating process does not alter the results themselves, but changes the researcher's observation position in order to optimize the loading of each Q-sort on a single factor (Watts and Stenner, 2012, p. 118). A manual rotation was preferred above the built-in Varimax rotation of the PQMethod, because it has a lower inter-factor correlation and thus results in more distinct viewpoints.
A summary of the mechanisms used to reduce bias. In two columns actions are listed to reduce researcher bias (left) and selection bias (right).
Next, in Stage 6, a weighted average was used to create an illusory person with a factor loading of 1.0 per factor, i.e. a hypothetical person who has fully adopted this factor. Following Watts and Steiner (2012) Q-sorts with loadings that exceed the SFL of 0.38 for a factor were incorporated to compute the weighted average for that factor. See Table 2 for the factor arrays and Table 3 for the final factor loadings. It must be noted that the number of people loading on a factor cannot be used to determine the distribution of viewpoints in the total population without additional (quantitative) research.
The final stage, Stage 7, is data analysis, where the factor arrays were
translated into a viewpoint narrative. We followed the guidelines of Watts
and Stenner (2012), Gallagher and Porock (2010) and Cools et al. (2009), and
used distinguishing statements. We created a narrative of the
Distribution of interview fragments available per viewpoint and per statement. Interview fragments of people that load to no or two viewpoints were categorized as “neutral”.
The 33 Q-sorts resulted in the identification of three factors from which
three viewpoints were derived: A “Citizen participation for data
application”, B “Water authority in control”, and C “Education and
sharing local knowledge”. The choice for three factors was based on the
explained variance of the first four factors before rotation that displayed
with 53, 8, 6 and 1 % a cut-off after the third factor that was supported
by qualitative information from the interviews. Table 1 and the radar charts
presented in Fig. 5 show how an individual would rank the items if that
person were representing that factor 100 %. For example, Statement 9
(“Citizen Science enables the collection of large amounts of measurements”,
Theme III Purposes of Citizen Science) would be placed under most agree
(column
The remainder of this section contains the three viewpoint narratives. The
term viewpoint is used to refer to the factor's interpretation, for which we
made use of the quantitative factor arrays in Table 1 and qualitative quotes
from participants loading significantly on that factor (see Table 2). The
narratives are based on absolute results (agree or disagree), the relative
results (an item is ranked higher or lower in Viewpoint A than Viewpoints B
and C) and characteristic interview items. Item rankings are presented in the
following format: (item number: item ranking) such that (2:
Final factor arrays; the numbers in columns A, B and C are the theoretical item score for a person whose viewpoint is 100 % that factor. Roman numerals indicate the theme category (cat) of the item. I is citizen motivation, II is water authority acceptance of citizen science, III is purposes, and IV is level of engagement.
Theoretical item score for a person whose viewpoint is 100 % Factor A, B or C. Statements are clustered per theme (citizen motivation, water authority acceptance, purposes and level) in four radar charts. Numbers in brackets refer to the full statement given in Table 1.
Final factor loadings after rotation. Sorts in bold indicate that a person's loading exceeds the significant factor loading (SFL) and a person's viewpoint thus resembles Viewpoint A, B or C. Also included are characteristics of respondents: water authority (Identification (ID), elevation above sea level (El), located in Randstad (RS) and recently reformed (since 2005)) and individual characteristics (sex, age and function group).
The people loading on Factor A (see Table 2) are a mix of hydrologists, advisors, policy advisors, field staff and a politician. In this group are 14 men and 11 women. Eleven people are middle aged (between 45 and 65). They represent all eight incorporated water authorities, which are located within and outside the Randstad and have a mixture of higher and lower flood risk. Nineteen people work at a water authority that has recently gone through an organizational reform.
People with Viewpoint A think that citizen science is important for water
authorities to increase water awareness (2:
Additionally, people with this viewpoint value citizen science for the
collection of large amounts of data (9:
People with Viewpoint A think of citizen science as an interesting way to
give meaning to the concept of citizen participation (23:
The six people loading significantly on Factor B (see Table 2) form a mixture of advisors, policy advisors and field staff. Five out of six are male and four of them are middle aged. They work at three different water authorities; two people work outside the Randstad. Four people work at water authorities that have recently (after 2005) gone through an organizational reform. All work in an area with a high flood risk.
People with Viewpoint B consider citizen science important for increasing
water awareness (2:
People with Viewpoint B believe that local knowledge will be valuable for the
water authority (37:
People with this viewpoint are least convinced that citizen science will
involve another part of the public (27: 0) or that it is an interesting way
to give meaning to citizen participation (23: 1). Moreover, they believe that
citizen science should not be used to decrease the gap between citizens and
water authorities (24:
The six people significantly loading on Factor C (see Table 2) are a mix of advisors, policy advisors and field staff. Four people are middle aged and three of them are male. They work at four different water authorities, three respondents within and three outside the Randstad. Three people work at a water authority that has recently (after 2005) gone through an organizational reform. Three out of six people with Viewpoint C work in an area with a lower flood risk.
People with Viewpoint C think that citizen science is important, because it
contributes to increasing water awareness (2:
They feel that the water authority should use the local knowledge that
citizens have (37:
People with Viewpoint C consider citizen science to be a good way to bind and
involve another part of the audience (27:
This study identified three different viewpoints with regard to citizen science derived with Q methodology. Participants sorted statements about four themes described in the Introduction and Method sections. In this discussion we first (Sect. 4.1) reflect on these four themes and relate the results to the literature, and second (Sect. 4.2) discuss the limitations of the research and make recommendations for future research.
The statements contributed to one of the four themes: (I) citizen motivation, (II) acceptance of citizen science at the water authority, (III) purposes and (IV) level of citizen participation. Several statements related to perceived citizen motivation by the participants (Theme I in Table 1 and the upper-left radar chart in Fig. 5) and acceptance of citizen science at the water authority (Theme II and the upper-right radar chart in Fig. 5). Trust in citizens' motivations and commitment ranged from low in Viewpoint B to high in Viewpoint C. The assessment of high, low or medium was based on the attitude that emerged from the ranking of statements in Themes I and II. Viewpoint C clearly had the most positive attitude towards citizens' motivations and B the least positive. For Theme II the distinction was less clear, although all viewpoints express a rather positive attitude. All three viewpoints are rather positive about implementing citizen science (perhaps due to some volunteer bias discussed in Sect. 4.2), although Viewpoints A and B are concerned with, respectively, the image of the water authority, and with the organizational capacity and a lack of internal support. Table 3 summarizes these findings. Table 4 summarizes the results with regard to the support per viewpoint for the purposes listed in the Introduction (Theme III). The same has been done for the roles that citizens can have (Theme IV) in Table 5 according to the classification of Bonney et al. (2009).
Summary of the perception of the level of citizen motivations to contribute (Theme 1) and the level of acceptance of citizen science at the water authority (Theme II) for Viewpoints A, B and C.
Overview of Theme III (purposes for citizen science) as supported in Viewpoints A, B and C. Purposes clearly indicated are marked with an X. (x) indicates that support for this purpose is not convincing.
All viewpoints embrace data collection by citizens, i.e. contributory projects, and none support co-created projects (Table 5). Viewpoint A is optimistic towards citizen participation in the analysis of the data (see Statement 40), suggesting a potential for collaborative projects. Viewpoints B and C are wary of involving citizens in these steps of the research process. None of the viewpoints supports statements related to co-created projects. The following explanations are illustrative of the reluctance of participants to involve citizens in topic selection for monitoring (Statement 38): “There can be [topics] which we think they are important, while citizens do not find it important in the end” (Q24, Viewpoint A) and “In that case you should answer all [these questions of citizens] and I think our organisation is not equipped at the moment” (Q18, Viewpoint B). Regarding the translation of results to action (Statement 36), participants said “They [citizens] can only focus on the problems in their direct environment, but not on the implications for a wider area” (Q19, Viewpoint A) and “I would not go that far” (Q18, Viewpoint B). Participants mentioned external causes such as the legal obligations a water authority has regarding the use of standardized methods and reports for water quality monitoring. This is consistent with previous conclusions about the responsibility of the water authority in relation to acceptance of citizen science (Wehn and Evers, 2014). Other participants mentioned internal causes, such as the existing procedures for citizens to influence decision-making, including complaint procedures and the water authority general elections once every 4 years.
Overview of theme IV (level of citizen participation), based on Bonney et al. (2009). Supported activities are marked with an X. An (x) indicates the activities are sometimes assigned to citizens.
There appears to be a mismatch between the intentions of the participants with respect to the purposes that citizen science should support and the expressed level of trust in citizens as reflected by the envisioned participation level. Especially people with Viewpoint C believe citizens have noble motivations, and they trust the citizens to a great extent. This trust is not reflected in the roles they envision for citizens, which is limited to data collection. The same goes for Viewpoint A. People with this viewpoint believe citizen science can serve many purposes (see Table 4). However, the envisioned role for citizens is limited to data collection and analysis. A lack of trust in citizens, few intentions to use the citizen scientists' data or a lack of support for higher levels of participation might conflict with citizens' motivations as described in the Introduction. A relation of mutual trust is required as the basis for effective citizen science projects and prolonged contributions by citizens (Rotman et al., 2012). Viewpoint B reveals distrust in the commitment of citizens, citizens' intentions to participate and their capacity (see Statements 20, 21, 22, 40 and 45). Another important motivation for citizens is the provision of feedback on how the data are used (e.g. Bonney et al., 2009; Rotman et al., 2012; Roy et al., 2012), which is particularly in contrast to Viewpoint C. Viewpoint C focuses on the goals of education (see Statements 14 and 15), with little emphasis on the actual use of the data (see Statements 8 and 9). Concerns regarding data quality may linger if recent development in systematic modelling and data assimilation approaches (e.g. Clark et al., 2015; Shoaib et al., 2016; Hut et al., 2015) would be adopted at the water authorities in the Netherlands. Such frameworks would allow systematic tracing of the propagation of uncertainty of citizen data in decision support tools and may identify opportunities for citizen science in model structure determination, which can be the largest source of uncertainty (Shoaib et al., 2016). Ottinger (2010) stressed the need for standardized methods in citizen science and legal embedding to increase the acceptance of the data and actual use of citizen science in policy-making. In the Netherlands systematic data handling and standardization may pave the way for using citizen science for public participation, in line with the vision of the Dutch water authorities governing body (UvW, 2015b).
Q methodology is an abductive research approach (Watts and Stenner, 2012), which means that we tried to understand and explain the data rather than describe it or test a hypothesis. This approach is subjective in nature. Researcher bias was reduced where possible as presented in the framework in Fig. 3. By collecting statements from various sources, reasonable saturation in the statements that formed the discourse was achieved and confirmed by the fact that no clearly new statements arose from the post-sorting interviews. The second sampling strategy (see Stage 4 in the Method section) recruited five participants that were expected to have different viewpoints. Two of them had Viewpoint B and one had Viewpoint C, thus broadening the scope of viewpoints. Still, the voluntary nature of the participation might have attracted participants with a positive attitude towards citizen science. On several occasions the research was presented to water authority employees. They were surprised that all viewpoints were relatively positive about citizen science, because they would have believed to have colleagues who were indeed more sceptical than these viewpoints suggest.
To further reduce researcher bias, we asked participants whether they recognized themselves in the assigned viewpoint described in an early draft of the text presented in the Results section. Fifteen participants responded, 13 of whom fully identified with their viewpoint, because they agreed with the viewpoints' main assertions. Two respondents were in doubt, due to overlap between Viewpoints A and C. The correlation between Factors A and C was 0.43, which indeed indicates that they are interrelated and overlap. Typically, correlations above 0.39 are considered significant (Watts and Stenner, 2012). Still, Factor A and Factor C are considered sufficiently different to regard them as the basis for separate viewpoints, particularly given the (in our opinion crucially) different opinion on involving citizens in data collection. Correlations between Factors A and B and Factors B and C were lower and not significant: 0.26 and 0.35, respectively. A mechanism to further reduce bias, beyond the mechanisms in Fig. 3, could be to execute stages such as statement definition, interviews and transcript analysis by independently working researchers. However, this was not feasible within the scope of this research.
The importance of post-sorting interviews, as stated by Gallagher and Porock (2010), was recognized in this work. In particular, statements with multiple fragments per viewpoint illustrated this. For example, the interview fragments for Statement 36 revealed a difference in the reasoning to exclude citizens from decision-making on measures to realize policy goals. Participants with Viewpoint A feared manipulation of results, while participants with Viewpoint B emphasized the responsibility of the water authority to take an informed decision and balance conflicting interests. Hence, reformulation and/or splitting of Statement 36 may be considered if the set of statements was adopted for future research. Four participants with Viewpoint A literally recalled citizens' unfamiliarity with the tasks of the water authorities in response to Statement 2. Time limitations of the interviews resulted in an unequal distribution of interview fragments over statements and viewpoints (see Fig. 4). A higher coverage of interview fragments and more participants, particularly participants loading significantly on Viewpoint B and C, would likely have resulted in a more consistent image and more understanding of the participant's underlying reasoning. Future research should consider more time for post-sorting interviews or organizing group discussions.
The viewpoints identified in this study are expected to be representative of water authorities in the Netherlands. Only 8 out of 24 Dutch regional water authorities were included, so additional viewpoints may be found if the study would be repeated with participants from the remaining water authorities. We consider this unlikely as none of the selection criteria (see Stage 3 in the method section) were found to influence the results. Flood risk, age (years since the last organizational reform) and location were incorporated as characteristics that might influence participant's viewpoints. All viewpoints represented a combination of age and location; thus, there seems to be no relationship between these characteristics and the results. Sea level might, as all people with Viewpoint B were working at an authority responsible for an area below sea level. Job type did not influence the results; gender might, as almost all people with Viewpoint B were male. This study cannot make any claims regarding the influence of flood risk or gender, but this is a promising direction for further research.
A quantitative follow-up study can be used to determine the distribution of viewpoints across water authorities or within one organization. Such a study would further justify generalization of the results to the Dutch water authorities and would allow one to check how widespread the overall positive attitude towards citizen science found in this research actually is. This article presents results for practitioners in the Netherlands, but we encourage others to repeat the study, particularly in other countries facing low citizen water awareness as described by the OECD (OECD, 2011). The developed set of statements can serve as a basis for such a study as they are not unique to the Dutch situation.
This study contributes to understanding about government practitioners' acceptance and perception of citizen science. A Q methodological approach was applied to identify the viewpoints of practitioners on citizen science, in the case of water quality monitoring at Dutch regional water authorities. Water authority employees sorted a set of 46 statements related to citizen science. Three factors were identified in a factor analysis and translated into corresponding viewpoint narratives.
The first viewpoint, Viewpoint A, is named “Citizen participation for data application”. People with Viewpoint A see more opportunities than challenges when it comes to citizen science. They see applications in practical use of the data, but also in the active engagement of people. The second viewpoint, Viewpoint B, is named “Water authority in control”. People with this viewpoint see a potential for data contributions by citizens in an illustrative way, but are concerned with challenges in organizational capacity, expectation management and motivating citizens as well. The third viewpoint, Viewpoint C, is named “Education and local knowledge”. People with this viewpoint focus on educational goals, such as teaching people about their environment and getting schools involved. They consider data applicability of secondary importance, although the data can be used illustratively.
The outcomes of this study provide strong indications that practitioners at the Dutch water authorities welcome citizen science. These practitioners further believe citizen science can contribute to bridging the awareness gap as identified by the OECD (2014) and the Dutch water authorities (UvW, 2015a). All three viewpoints are positive towards citizen science in the form of contributory projects in which citizens collect data. People with Viewpoint A support collaborative citizen science as well, but none of the viewpoints support co-created projects between citizens and water authorities. Interviews identified low expectations in citizens' motivations and capacities as underlying causes of this low support for higher levels of citizen involvement. This may jeopardize the much-needed trust in the relationship between citizens and practitioners. Although participants recognized the potential of citizen science to change governance structures, the design of citizen science projects in the Netherlands is not expected to move beyond contributory projects in the near future.
We thank S. Abu Shoaib and an anonymous referee for their valuable comments on the discussion paper. Edited by: S. Illingworth Reviewed by: S. Abu Shoaib and one anonymous referee