the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
A network approach for multiscale catchment classification using traits
Charuleka Varadharajan
The classification of river catchments into groups with similar biophysical characteristics is useful to understand and predict their hydrological behavior. The increasing availability of remote sensing and other large-scale geospatial datasets has enabled the use of advanced data-driven approaches to classify catchments using traits such as topography, geology, climate, land cover, land use, and human influence. Unsupervised clustering algorithms based on the Euclidean distance are commonly used for trait-based classification but are not suitable for highly dimensional data. In this study we present a new network-based method for multi-scale catchment classification, which can be applied to large datasets and used to determine the traits associated with different catchment groups. In this framework, two networks are analyzed in parallel: the first being where the nodes are traits and the second being where the nodes are catchments. In both cases, edges represent pairwise similarity, and a network cluster detection algorithm is used for the classification. The trait network is used to investigate redundancy in the trait data and to condense this information into a small number of interpretable categories. The catchments network is used to classify the catchments into clusters and to identify representative catchments for the different groups using the degree centrality metric. We apply this method to classify 9067 river catchments across the contiguous United States at both regional and continental scales using 274 non-categorical traits. At the continental scale, we identify 25 interpretable trait categories and 34 catchment clusters of sizes greater than 50. We find that catchments with similar trait categories are typically located in the same region, with different spatial patterns emerging among clusters dominated by natural and anthropogenic traits. We also find that the catchment clusters exhibit distinct hydrological behavior based on an analysis of streamflow indices. This network approach provides several advantages over traditional means of classification, including better separation of clusters, the use of alternate similarity metrics that are more suitable for highly dimensional data, and reducing redundancy in the trait information. The paired catchment–trait networks enable analysis of hydrological behavior using the dominant trait categories for each catchment cluster. The approach can be used at multiple spatial scales since the network topologies adjust automatically to reflect the trait patterns at the scale of investigation. Finally, the representative catchments identified as hub nodes in the network can be used to guide transferable observational and modeling strategies. The method is broadly applicable beyond hydrology for classification of other complex systems that utilize different types of trait datasets.
- Article
(8845 KB) - Full-text XML
- BibTeX
- EndNote
Catchments are complex environmental systems that consist of diverse natural and anthropogenic components interacting non-linearly in space and time. A fundamental challenge in hydrology is to understand how these interacting components influence critical catchment functions such as streamflow and solute exports (Troch et al., 2015). This is difficult to determine even for catchments with little to no human influence because of the spatial heterogeneity of processes across regions with different characteristics leading to the problem of “uniqueness of place” (Beven, 2000). For the majority of catchments, this challenge is compounded due to anthropogenic activities that cause more complex behaviors that are not easily modeled (Sivakumar et al., 2015; Sivapalan, 2006).
The classification of river catchments into groups with similar characteristics has been called out as a practical approach to address the diversity of hydrologic behavior (McDonnell and Woods, 2004; McDonnell et al., 2007; Wagener et al., 2007). A classification system would establish the baseline for similarities and differences among catchments, and would be extremely beneficial for both modeling and experimental analysis (Dooge, 1986). Several regionalization approaches that attempt to transfer knowledge (observations, theory, or model predictions) from well-observed sites to other less-observed regions, such as those used for predictions in ungaged basins (PUBs), rely on the concept of similarity for extrapolation (Guo et al., 2021; Merz and Blöschl, 2004). The ultimate goal of a classification process is to discover the laws governing the behavior of a system under investigation. By looking at the collective behavior of a group of similar elements, the unique contributions from individual elements average out, revealing the fundamental characteristics that regulate catchment functions (Sokal, 1974).
There is a long history of using physical characteristics and other properties (i.e., their traits) to classify catchments in hydrology, as described in Wagener et al. (2007). The simplest approach uses dimensionless numbers or indices such as stream order (Horton, 1945; Strahler, 1952) and Peclet numbers (Redner, 2001) as organizing constructs. More complex approaches use distribution functions (e.g., hypsometric curve; Langbein, 1947) and conceptual or mathematical models. A common approach is to group catchments by hydroclimatic region, such as in the Köppen classification (Koppen, 1918) or the Budyko framework (Budyko, 1974). Many studies use the dynamic behavior of a catchment as quantified by the signatures of a function of interest as the basis for classification instead of traits (see references in McMillan, 2020) and find the results to be consistent with knowledge about watershed processes (McMillan et al., 2022). However, signature-based classification cannot be used for unmonitored sites, which is a significant issue given the paucity of streamflows and other hydrological measurements.
There has been a dramatic increase in the amount of regional- to global-scale geospatial datasets produced over the past 2 decades, which has enabled a new era of data-driven hydrology (Hubbard et al., 2020). A few data products such as the Geospatial Attributes of Gages for Evaluating Streamflow version II (GAGES-II; Falcone, 2011), StreamCat (Hill et al., 2016), Caravan (Kratzert et al., 2023), and Hysets (Arsenault et al., 2020) now provide extensive information on hundreds of traits such as land surface structure, climate conditions, vegetation, land use, and other human influences across thousands of catchments. Thus, new methods for classification that go beyond simplistic trait representations to account for a diverse array of natural and anthropogenic catchment properties are now possible and would be extremely useful to understand or predict complex system behavior. A classification approach would use the trait features as vectors in a multidimensional space and the relationships among the catchments defined by a distance metric in this space. This approach has been used in recent attempts to group regions with unsupervised machine learning algorithms such as k-means and hierarchical clustering (Sawicz et al., 2011; Wainwright et al., 2022; Kumar et al., 2011).
However, the analysis of large multivariate datasets has two main challenges that need to be addressed. The first is multicollinearity, which is the possibility of information redundancy in the data due to the presence of multiple variables that provide similar information. Machine learning algorithms for classification generally have degraded performance when multicollinearity is present. The second issue is the “curse of dimensionality” (Bellman, 2010), a phenomenon that emerges when using distance metrics to compute the relationship amongst data points represented as vectors of features (e.g., traits) in a multidimensional space. When the number of dimensions increases, the density of data points drastically decreases, making the feature space more sparse (Houle et al., 2010) and causing the difference between the furthest and the closest distances to a point to approach zero (Beyer et al., 1999). This results in degraded performance of similarity measures, and, in particular, some metrics such as the commonly used Euclidean distance are more affected than others (Aggarwal et al., 2001).
Many algorithms typically used for unsupervised classification, including machine learning methods such as k-means and hierarchical clustering, do not address the dual issues of multicollinearity and data dimensionality. The k-means algorithm (MacQueen, 1967) is widely used across many fields and relies on the establishment of cluster centroids in a vectorial space that act as representative points for the clusters. The data points are associated with a cluster by minimizing their Euclidean distance based on the variances within the clusters. However, as the dimension of the vector space grows, the Euclidean distance becomes unreliable in properly quantifying the relationship among the data points (Aggarwal et al., 2001). Additionally, the Euclidean distance discards information about the directionality of the data, producing a value that reflects only the relative position of data points in the vector space and neglecting the contribution of the different components that can be relevant for classification. Another group of algorithms for cluster identification is referred to as agglomerative hierarchical clustering. This class of methods aims to build a hierarchy amongst the data points, and different strategies can be used to find the optimal partitioning. Some of the most notable methods are the complete- and single-linkage clustering, which, respectively, aim to maximize and minimize the distance of two points belonging to different clusters (Müllner, 2011). Although these two methods do not necessarily rely on the Euclidean distance, they are quite sensitive to outliers because they are based on the extreme (i.e., maximum or minimum) distances between points. Such dependence on single data points for partitioning goes against one of the main concepts in the characterization of complex systems, where emergent properties (i.e., the grouping into clusters) are the result of collective phenomena rather than the disproportionate contribution of a single element. The Ward's algorithm (Ward, 1963) mitigates the issue of outliers by introducing the minimum-variance method, but it is based on the Euclidean distance and is therefore subject to the same drawbacks as the k-means method.
Approaches based on network science have been used to investigate complex systems for many applications involving large datasets (Newman, 2018; Börner et al., 2007). The ability of networks to capture complex interactions among different parts of a system and to highlight emergent behaviors has been proven to be extremely powerful (Strogatz, 2001; Boccaletti et al., 2006). By treating each element as a node and the relationships amongst them as edges, the structure of a network provides a natural and intuitive representation of a complex system (Barrat et al., 2004; Albert and Barabási, 2002). Modeling the relationships amongst elements of a complex system as a network also enables the use of suitable distance metrics for large datasets, presenting a solution to address the issues of data dimensionality and multicollinearity. Networks are used extensively in many different scientific domains. For example, in social science, political polarization has been detected with the presence of clusters in a social network (Conover et al., 2011). In biology, protein–protein interaction networks are essential to understand the cell physiology (Jeong et al., 2001), and plant trait networks are used to understand plant adaptation to different environments by examining the complex relationships between their functional traits (He et al., 2020). In hydrology, the concept of networks has mainly been associated with the tree-like structure of rivers and has enabled advancements in understanding geomorphological processes (Rinaldo et al., 2006; Rodríguez-Iturbe and Rinaldo, 2001; Tejedor et al., 2017; Czuba and Foufoula-Georgiou, 2014). The use of networks as a generic framework for hydrological investigation has been postulated (Sivakumar, 2015), and the concepts of complex flow networks have been used to understand river transport in deltas (Sivakumar et al., 2015; Tejedor et al., 2018). However, to date, network theory has not been used for understanding relationships between catchments or their traits.
In this study, we introduce a novel, network-based method to classify catchments at multiple scales based on traits representing their climatic conditions, vegetation, topography, soils, land use, and anthropogenic characteristics. This unsupervised method utilizes two parallel networks to extract clusters of similar traits and catchments while using dimensionality reduction and a cosine distance metric to address the issues of information redundancy and high dimensionality present in large geospatial datasets. This approach enables the characterization of catchments using a small number of interpretable trait categories and provides a more generalizable approach to the regionalization of hydrologic behavior. We demonstrate the utility of our network-based method for analyzing catchment properties and associated hydrological behavior for 9067 catchments and 274 traits across the continental United States. To our knowledge, this is the first instance where networks have been used for trait-based catchment classification in the hydrological sciences. Our methods are broadly applicable beyond catchment classification for the analysis of other environmental traits (e.g., plant functional traits or microbial traits) and large datasets.
In this section, we describe the dataset and the workflow for unsupervised trait-based classification of watersheds using the network approach. The steps in our classification workflow (Fig. 1) include the following: (1) down-selection and preprocessing of traits from the GAGES-II dataset (Sect. 2.1) by transforming and standardizing trait values (Sect. 2.2); (2) removal of redundant information and multicollinearity using the principal component analysis (PCA), which produces lowly dimensional vector representations of both traits and catchments (Sect. 2.3); (3) computation of the pairwise similarities of the dimensionally reduced vectors of both catchments and traits (Sect. 2.4); (4) generation of two similarity networks, one where nodes are catchments and another where nodes are traits (Sect. 2.5) – in both cases, edge weights represent the pairwise similarities within the respective sets; (5) classification via a clustering algorithm to identify trait categories and groups of catchments with similar traits (Sect. 2.6); (6) characterization of the catchment clusters using the over- and under-expression of trait categories (Sect. 2.8); (7) evaluation of the spatial coherence between catchment clusters (Sect. 2.7); (8) selection of representative catchments using network centrality measures (Sect. 2.9); and (9) identifying hydrological behavior based on streamflow indices across the catchment clusters and association with their characteristic trait expression (Sect. 2.10).
2.1 Datasets
The primary dataset used in this study is the Geospatial Attributes of Gages for Evaluating Streamflow version II (GAGES-II), as described in Falcone (2011). This dataset contains a comprehensive set of geospatial characteristics for 9322 gaged catchments in the contiguous United States (CONUS), as well as in Alaska, Hawaii, and Puerto Rico, with long flow records (at least 20 complete years of discharge records since 1950) or with an active record as of water year 2009. Here, we refer to catchments as the areas upstream of each individual gaging station in the GAGES-II dataset, of which 2057 are considered to be pristine (reference), while 7265 are disturbed by human influences (non-reference).
The geospatial attributes, referred to as traits in this paper, are compiled from various data sources for the CONUS (see Falcone et al., 2010, for details). The 354 traits in the dataset span climate (e.g., historical average precipitation and air temperature), soil types and composition, geomorphology (e.g., topography), vegetation (e.g., extent of forests), surface waters (e.g., extent of lakes and wetlands), stream characteristics (e.g., sinuosity and stream order), and anthropogenic influences (e.g., proximity to developed areas, land use, or presence of dams). Some traits have multiple representations; for example, elevation is provided at the location of the stream gage and as an average across the catchment.
Many of the climate traits are calculated from the 800 m gridded PRISM dataset (Daly et al., 2000), which is derived from 30-year records that span different time periods (primarily 1961–1990 or 1971–2000). We highlight that the runoff variables present in the dataset are not measured values of the discharge but instead are estimates from the period of 1951–2000 computed by a water balance model for 4 km grids using precipitation and temperature as inputs (Wolock and McCabe, 1999). Land use and land cover data are derived from the 2006 USGS National Land Cover Database. We selected the GAGES-II dataset for our unsupervised classification because of its comprehensiveness across catchments, its diversity of traits, and its spatial coverage.
The second dataset used in this study consists of streamflow data obtained from the USGS National Water Information Service (USGS, 2022) for the period 1971 to 2000. We chose this time window to overlap with the period of data availability for most of the traits used from GAGES-II.
2.2 Data filtering and preprocessing
This study focuses on the 9067 stream gages from catchments that are present within the CONUS in the GAGES-II dataset, excluding the gages in Alaska, Puerto Rico, and Hawaii. Out of the 354 traits present in the dataset, we selected 274 that had numerical values and discarded 74 categorical variables (e.g., geology type) or textual labels (e.g., county name). We also discarded six additional traits: station identification number (STAID), the two-digit hydrological unit (HUC02; Seaber et al., 1987 that each station belongs to, the latitude (LAT_GAGE) and longitude (LNG_GAGE) of the station, soil with variable drainage characteristics (HGVAR), and mean watershed aspect (ASPECT_DEGREES). The STAID, HUC02, LAT_GAGE, and LNG_GAGE variables contain explicit information about the location of the gaging stations. We chose to exclude them to develop the classification scheme solely using natural and anthropogenic features, which avoids bias due to spatial proximity and is transferable to any location. Additionally, their exclusion from the classification enables an unbiased evaluation of the emerging spatial patterns amongst the resulting catchment clusters. The HGVAR variable is removed because it has zero variance and thus cannot be standardized in the preprocessing routine. The ASPECT_DEGREES trait is removed because its periodicity has poor physical coherence (the quantities of both 0 and 360 convey the same information but are represented by the extreme values of the variable range). Furthermore, the aspect information is present in two other variables that we include, ASPECT_EASTNESS and ASPECT_NORTHNESS, which are the sine and cosine of the ASPECT_DEGREES variable, respectively.
The preprocessing step is composed of two operations (step 1 in Fig. 1). The first involves feature transformations of non-monotonic traits to a consistent monotonic function. For example, several traits denote the presence of points of interest in the basin, such as dams and canals. However, when such a point is not present in the basin, the trait is assigned the value −999. This creates an inconsistency with the physical distance values and thus is remapped to be physically coherent for use as an input in the PCA method. Further details on mapping of variables to monotonic functions are in Appendix A. The second step is data standardization, which involves subtracting the arithmetic mean from each variable and dividing the result by the standard deviation. As a result, the standardized values will have zero mean and a standard deviation equal to 1. The standardization is essential for the PCA, which requires the data to have a zero mean and additionally scales variables in the dataset that span up to 5 orders of magnitude into a comparable set of values and variances needed for the PCA projections. Each of the 9067 catchments is represented as a vector of these 274 filtered and remapped traits. We provide the GAGES-II dataset, preprocessed according to these steps, as part of the dataset (Ciulla and Varadharajan, 2023).
2.3 Dimensionality reduction
The next step in the workflow (step 2 in Fig. 1) involves reducing the dimensionality of the preprocessed dataset using the principal component analysis (PCA) algorithm (Pearson, 1901), which is required for two reasons. First, it is used to mitigate the issue of the curse of dimensionality, which results in a reduction in the performance of distance metrics in highly dimensional vector spaces, such as the 274-dimensional trait vectors used to represent catchments in our study (Aggarwal et al., 2001). Secondly, the dimensionality reduction minimizes the redundancy in the dataset caused when information present in one trait is also represented (partially or totally) in other traits. Information redundancy is generally detrimental for machine learning algorithms and needs to be addressed. This information redundancy can be detected by computing the trait correlations and is referred to as multicollinearity. The traits in the GAGES-II dataset contain significant redundancies, with 84 % of pairwise Pearson correlation coefficients (Pearson, 1895) and 92 % of pairwise Spearman coefficients, which account for non-linear relationships (Spearman, 1987), having a significant p value of 0.05. The coefficient of determination between these two metrics is equal to 0.76, which indicates that, although non-linear relationships among the traits are present, they are not so dominant as to prevent the use of a linear dimensionality reduction method such as PCA. Another factor that can affect the PCA algorithm's performance is the presence of outliers. We determined that the PCA is a reasonable choice for the GAGES-II dataset since only 8.1 % of the traits lie outside their “inner fence”, a common threshold for outliers, defined as the range between and for each trait, where Q1 and Q3 are the first and third quartiles, respectively, and is the interquartile range.
The PCA algorithm collapses the dimensions of linearly correlated variables into a lower-dimensional vector representation. The information of the variables is retained in directions called principal components that maximize the variance of the original data, thus addressing the issues of multicollinearity and high dimensionality. In the PCA, the dataset is represented as a matrix – where n is the number catchments, and f is the number of traits – and each catchment is represented by a multidimensional vector of traits in the f-dimensional space (Fig. 2). The PCA transforms the n×f matrix M into a new n×k matrix Mk, where the catchments are represented by n lowly dimensional vectors of size k. The only free parameter of the algorithm is the number of final dimensions k, which reflects the amount of information retained. By using Cao's implementation (Cao, 1997) of the false nearest-neighbor (FNN) method (Krakovská et al., 2015), we set k=20 (see Appendix B for details).
Hence, the original matrix M is transformed into the matrix , containing 9067 vectors of dimension 20, where each vector is a lowly dimensional representation of the traits in each of the catchments, used in the following steps of our analysis. Complementarily to , the matrix of principal components contains f=274 vectors of size k that encode information about how the traits are expressed in the catchments. The analysis of is used to identify the relationships and information redundancy amongst the different traits. To summarize, the PCA results in a set of n k-dimensional vectors that encode the trait information for each catchment and f k-dimensional vectors that describe the trait expressions.
2.4 Similarity measure
We identify the relationships between catchments and traits using the cosine similarity as a distance metric. Cosine similarity is defined as in Eq. (1) (Salton, 1983):
where x and y are two vectors with the same lengths. The cosine similarity is preferred over the classical Euclidean distance metrics for two reasons. First, the reduced-order vectors from the PCA are still considered to be highly dimensional data for distance calculations. Secondly, the cosine distance retains information about the directionality of the data (see Appendix C for an additional explanation about the rationale for the choice of this similarity measure).
The cosine similarity is computed as the dot product of the L2-normalized matrices Mk and PCk with their corresponding transposed matrices (Fig. 2b). This results in two matrices, SC and ST, of size n×n and f×f that contain the pairwise similarities between catchments and traits, respectively. The diagonal elements of both matrices are unit values because they are the results of the dot product of vectors normalized with themselves.
2.5 Network generation
In this study, we adopt networks as a tool to investigate the relationship among the catchments. For more details on network theory, see Appendix D. We use the cosine similarity matrix SC to build a network NC, where nodes are catchments, and the edges represent their similarity (step 4 in Fig. 1). In particular, the edge weights are the cosine similarity values mapped to a range between 0 and 1 (Eq. 2):
Thus, two nodes are connected if they are similar, as per the cosine metric, and the strength of the similarity is reflected by the edge weights. The self-loops (i.e., an edge that originates from and ends at the same node) given by the unitary values of the diagonal similarity matrix are deliberately discarded. The connectivity patterns in the network reveal clusters of nodes that are more similar to each other than to the rest of the network.
By assigning an edge to each pair of nodes using the similarity metric, we produce a fully connected network, namely a network with all the possible edges.
Such a network is a relatively uninteresting one because the presence of all possible edges hides eventual complex topological patterns present within the network. In order to reveal such patterns, we apply a filtering mechanism to our set of edges. In particular, we use the disparity filter as described in Serrano et al. (2009). Such a method takes a network as an input and filters out some of its edges, returning what is called the network backbone. The disparity filter assumes complete homogeneity among the edge weights, with the null hypothesis being that the weights of the edges incident to a node are uniformly distributed. Then it retains only the edges whose weight magnitude is incompatible with such a hypothesis according to a certain significance level. By repeating this process for each node in the network, we generate the network backbone, where all the edges are statistically validated against the uniform distribution hypothesis. Only edges are affected by this technique, while the nodes are unaffected, and their number in the network stays the same. The method does not prescribe a universal value for the significance level, which has to be evaluated case by case.
In our implementation of the disparity filter, we choose a significance level where 95 % of the nodes in the network belong to the giant component, which is the connected component in a network that includes most of the nodes. The choice of 100 % of the nodes in the giant component is impractical because there could be nodes that potentially never connect to any other ones, making the 100 % value impossible to reach.
The procedure used for generating the catchment network is also used to produce a network of traits NT via the matrix ST, where each node is a trait, and the edges connect two traits, with weights representing how similarly they are expressed across the catchments. Similarly to the catchment case, we extract the backbone network to reveal complex patterns among groups of traits.
For catchments, the backbone network NC contains 9067 nodes and 559 207 edges. The number of edges corresponds to only 1.4 % of the ones that can possibly be present in a fully connected network of such a size. In the case of the traits, the backbone network NT has 274 nodes and 1422 edges, comprising 3.8 % of all the possible edges. These networks are used in the following step to identify clusters of similar catchments and traits.
2.6 Cluster identification
A complex network is a network with non-trivial connectivity patterns (Strogatz, 2001; Boccaletti et al., 2006). One of the main hints of the presence of such patterns is given by the heterogeneous distribution of the values of the clustering coefficient, a topological measure of the tendency of a network to form groups of nodes that are more connected to each other than to the rest of the network (Wasserman and Faust, 1994; Scott and Carrington, 2023). Appendix E contains a detailed discussion on clustering coefficients. These groups of nodes are called clusters, and there are a variety of algorithms to discover them (Fortunato, 2010).
To obtain the division of nodes into clusters, we implement the Infomap clustering algorithm (Rosvall and Bergstrom, 2008) for both the catchment and the trait networks. This is an agglomerative clustering method for networks that starts by assigning each node to its own cluster and uses the map equation as described in Rosvall et al. (2009) to optimize the iterative merging of these partitions. One advantage of using the Infomap algorithm is its capability to split already formed clusters at successive iterations if this action benefits the clustering optimization function.
When applied to the catchment network, 95 % of the nodes in the entire network are contained in the top 71 clusters, ranked based on their size. We provide the number of clusters at 95 % coverage because, as is usual for complex networks, the cluster size spans several orders of magnitude, and, thus, accounting for all the clusters is inappropriate. The cluster size ranges from 1 to 953 nodes, with the latter comprising about 10 % of the nodes of the entire network. Because of how the catchment network is built, catchments within a cluster have more similar traits than with the rest of the network. When the Infomap algorithm is applied to the trait network, the number of top clusters in terms of size, comprising 95 % of the network, is 20, and the cluster sizes range from 1 to 25. For this network, the clusters denote groups of traits that have similar expression patterns across the catchments.
The cluster identification represents the first milestone of our workflow (step 5 in Fig. 1), resulting in the classification of both traits and catchments using a completely unsupervised methodology. The only choices we made were informed by statistical analysis to set the two free parameters of the framework, namely the number of dimensions for the PCA algorithm and the confidence level for the backbone disparity filter.
2.7 Spatial homogeneity of catchment clusters
Contrarily to supervised methods that compute model performance using testing data, unsupervised algorithms like ours do not have a direct means of assessing their performance. Thus, to identify a measure of performance for our unsupervised catchment classification, we use the principle of Tobler's first law of geography, which states that “everything is related to everything else, but near things are more related than distant things” (Tobler, 1970). This law, applied to our classification analysis, would mean that there is a higher probability of catchments that are geographically close to each other belonging to the same cluster. To quantify this concept, we compute the global homogeneity measure Hglobal as the average probability that, for each catchment, the nearest neighbor in terms of spatial proximity belongs to the same cluster. This quantity can be interpreted as geographical homogeneity in the sense that catchments surrounded by others within the same cluster make the system more homogeneous.
Here, is the total number of catchments, j is the closest catchment to catchment i, and ci and cj are the clusters that catchments i and j belong to. Hglobal provides a single value for the entire set of catchments, where values closer to 1 indicate that the system is more homogeneous. Additionally, we compute a within-cluster homogeneity measure, , as the probability of finding catchments belonging to cluster i within the convex hulls Ai of all catchments in ci. This metric is similar to the relative abundance of species in ecology and is computed for each cluster as the ratio between the number of catchments belonging to ci in convex hull Ai and the overall number of catchments NA within this area:
If a convex hull contains only one type of catchment cluster – which, by default, will be the cluster that generates the convex hull – then the value of is equal to 1, indicating complete homogeneity.
2.8 Characterization of catchment clusters
One of the goals of this study is to provide a methodology that enables the interpretability of the resulting catchment classification. This would correspond to answering the following question: what are the characteristic traits of the catchments belonging to a particular cluster? We answer this question by identifying the set of traits that are over- or under-expressed amongst all the nodes of a particular catchment cluster (step 6 in Fig. 1).
This is done by computing the z score of each trait for each catchment in the dataset. This value represents the unique expression of a trait in a specific catchment. Next, the z-score values are aggregated for each catchment cluster as an arithmetic average, producing a mean z score of each trait for each catchment cluster:
Here, zuv is the mean z score of the trait u in the cluster cv of size . The value xuw is the value of the trait u for the node w in the cluster cv. μu and σu are the average and standard deviation of the trait u in the entire dataset.
In this way, a high absolute value of the average z score represents a substantive expression of a trait in a particular catchment cluster, with positive values indicating over-expression and negative values denoting under-expression of the trait.
However, investigating the unique expression of each of the 274 traits for each catchment cluster would disregard the redundancy of information identified by the trait clusters and neglect the eventual collective contribution of several traits. Instead, a better analysis of trait expression can be achieved by considering their z-score values within the context of other traits in the dataset by leveraging the clusters produced by the trait similarity network. So, instead of investigating the expression of each trait in isolation, we aggregate the z scores of all the traits belonging to each cluster in the network of traits. In this way, we characterize each catchment cluster by the expression of a few easily interpretable groups of traits (referred to as trait categories). The advantage of the investigation of catchment clusters in the context of the network of traits will become more evident when we discuss the results in Sect. 3.
2.9 Identification of representative catchments
One advantage of modeling a system as a network is the ability to use a multitude of metrics from graph theory (Newman, 2018; Börner et al., 2007). One of the most used ones is the degree centrality (Börner et al., 2007), defined as the number of edges incident to a node. The nodes at the other end of these edges are referred to as neighbors. The interpretation of the degree varies according to the nature of the edges, but, in general, nodes with a high degree play a more important role in the network and are often referred to as hubs. In the case of a similarity network, a node with a high degree centrality identifies an element that is very similar to many others, while a low-degree node is similar to fewer nodes, and zero degrees indicates that the node is disconnected from the rest of the network. High-degree nodes in similarity networks are the best candidates to be selected as representative nodes because they have the highest number of neighbors. By sorting the nodes according to their degree centrality, we can select a small number of nodes that are representative of the entire network.
We apply this concept to the network of catchments to select a small set that is representative of the cluster the catchments belong to (step 8 in Fig. 1). This is done by ranking catchments within each cluster and selecting nodes based on the degree centrality measure. However, we do not simply choose the nodes that have the highest degree centrality since that could potentially lead to selection of two or more nodes that are topologically close to each other but that both share a high number of neighbors, thus undermining network coverage and resulting in redundant choices of representative catchments. Thus, to promote network coverage and minimize superfluous representation, our method first selects the node with the highest degree centrality in a cluster and then removes both the selected node and its neighbors from the cluster. The new degree-based ranking for the remaining nodes is then updated due to the removal of nodes. We continue this selection process until the size of the union set of representative catchments and their neighbors is equal to 95 % of the size of the cluster they are extracted from. Using this methodology, nodes with an initially high degree centrality, which share many neighbors with a selected catchment (i.e., they are topologically close from a network perspective), will have their degree reduced and are less likely to be selected.
2.10 Analysis of streamflow indices
The unsupervised classification workflow developed in this study finds groups of similar catchments using only traits and does not use observations of hydrological variables such as streamflows or temperature. Hence, we can use the classification to examine the hydrologic behavior of the catchment clusters and their associated trait expressions. Here, we focus on streamflow regimes following the method in Olden and Poff (2003). They recommend using 34 representative flow indices, which are considered to minimize collinearity based on a review of 171 indices calculated using long-term flow records from 420 sites from across the CONUS. The list of these indices can be found in Table S1 in the data repository associated with this paper (Ciulla and Varadharajan, 2023).
To compute the indices, we use the historical record of river mean daily discharge values for the 9067 gaging stations, retrieved using the BASIN-3D software (Varadharajan et al., 2022), which synthesizes, on demand, time series data from different data sources, including the USGS National Water Information System (NWIS) (USGS, 2022). We only consider the discharge data from 1971 to 2000 to match the time range of most of the traits in the GAGES-II dataset. We eliminate stations with more than 50 % of missing values in our time range, resulting in a down-selected set of 5251 stations. To compute the 34 hydrologic indices, we use the EFlowCalc package provided by Thibault (2021) that discards missing values in the computation of aggregated measures such as averages or standard deviations.
We aggregate indices as average values for each catchment cluster after further down-selecting to stations that are within 34 clusters containing at least 50 catchments. On average, 59 % of the catchments in each of these 34 clusters have a corresponding long-term flow record for which we computed the hydrological indices. Given this relatively high percentage, we use the averaged streamflow indices from these catchments as proxies for the hydrological behavior of the entire cluster.
For all the hydrological indices, we use the statistical Kruskal–Wallis test (Kruskal and Wallis, 1952) to determine if there is a statistically significant difference between the distribution of the values between individual clusters and the rest of the catchments. This test does not assume normality in the data distribution and is the non-parametric alternative to the ANOVA method, which are necessary considerations because none of the streamflow index values were normally distributed as per the Shapiro test (Shapiro and Wilk, 1965). The result of the Kruskall–Wallis test indicates if the indices grouped according to the clusters are drawn from the same distribution as the entire set. If that is not the case, it means that catchment clusters resulting from our trait-based classification have different streamflow characteristics.
We conducted two additional statistical tests to further examine whether the hydrological indices of catchment clusters are significantly distinct. The first is a nonparametric one-sample Kolmogorov–Smirnov (K–S) test that compares a sample distribution to a reference one for each hydrological index. This expands upon the Kruskall–Wallis test but allows us to determine the number of clusters that are statistically distinct from the entire catchment dataset. Here, each sample is constituted by the indices of one cluster, and the reference distribution is based on all the catchments within the CONUS. The null hypothesis is that samples are drawn from the reference distribution when using 0.05 as threshold for the p value. The second is a two-sample K–S test comparing the distributions of indices for pairs of catchment clusters, which allows us to determine how different the clusters are from each other. Here, each sample pair is constituted by the distribution of indices for the clusters being compared. Similarly to the one-sample test, the null hypothesis is that samples are drawn from the same distribution when using 0.05 as the threshold for the p value.
2.11 Comparison with traditional clustering techniques
We compare the clusters obtained from our methodology, which uses network theory and the cosine distance metric, with the ones resulting from the traditional k-means and hierarchical clustering approaches. Since these are all unsupervised methods, we cannot use any target variable to compute the accuracy of the classification to compare performance. For this reason, we identified two metrics to evaluate the performance of the different methods.
The first metric, which we refer to as cluster similarity, reflects the similarity between traits of the catchment clusters, which are represented by the average trait z scores aggregated across the catchments in each cluster, as described in Sect. 2.8. Here, each catchment cluster is compared to the others by calculating their pairwise cosine similarity. The highest value of the cosine distance within each catchment cluster is used as a conservative measure of inter-cluster similarity to assess how far apart the catchment clusters are from each other. The median value of the inter-cluster similarities represents how distinct the clusters produced by each algorithm are. We aim to minimize this metric since a good classification algorithm should produce more distinct clusters.
The second metric is the silhouette score (Rousseeuw, 1987), which is a measure of intra-cluster similarity. It represents how similar each element (i.e., a catchment) is to other elements within its cluster relative to elements in other clusters. The values of this metric range between −1 and 1, with higher values denoting that an element is well placed in its cluster compared to other clusters. The silhouette values are averaged for all items in the dataset. A good clustering algorithm would produce higher values in terms of the silhouette score.
We use these two metrics to compare our clustering approach with the hierarchical clustering (in its common implementation using the Ward criterion; Ward, 1963) and the k-means clustering algorithm (MacQueen, 1967). Additionally, to determine the effects of the distance metric, we compare the results from our workflow, which uses the cosine distance, with a version where the pairwise similarity between nodes is computed using the Euclidean distance. Finally, to show the robustness of our approach, we examine various choices for the two free parameters in our workflow, namely the number of reduced dimensions after the PCA (k) and the cluster granularity, which is governed by the disparity filter parameter α used to tune the removal of network edges during the backbone extraction step (Sect. 2.5). Three different values of k are investigated: k=6, corresponding to 50 % of information retained after PCA; k=20 (our choice in the study), corresponding to 72 % of retained information; and k=90, corresponding to 95 % of retained information. For each value of k, we generate clusters with different α values, with the number of clusters covering 95 % of the dataset, ranging between 20 and 120.
3.1 The trait network
The trait network has 274 nodes representing individual traits and 1422 edges connecting the nodes (Fig. 3). This network encodes the similarity between catchment traits as edge weights. We use the network edges in the clustering to generate groups of traits that are connected to each other and hence contain similar information. This enables aggregation of our analysis from individual, redundant traits to a smaller number of interpretable, higher-level trait categories that represent similar properties of the catchments.
The size of the clusters range from 35 nodes to 1 node (Table 1), where the 20 largest clusters contain 95 % of all nodes in the network. All the clusters are labeled with a unique numerical identifier and are assigned a name that is representative of the trait category. For instance, we refer to cluster number 2 as the “temperature” trait category since it includes nodes like average annual air temperature for the watershed (T_AVG_BASIN) and other related quantities such as the mean day of the year of first freeze (FST32SITE). Analogously, cluster number 0 includes nodes like the percentages of watershed land covered by development areas at high (DEVHINLCD06), low (DEVLOWNLCD06), and medium intensity (DEVMEDNLCD06). Thus, we identify cluster 0 as “developed areas” to indicate the presence of these and other traits that represent the extent of human development in the catchment. A full list of traits contained in each cluster of the network is provided in Table F1 in the Appendix. A more comprehensive table of trait categories, which includes descriptions of each trait, as well as the trait network topology, is provided in the dataset associated with this paper (Ciulla and Varadharajan, 2023).
3.2 The catchment network
In the catchment network, each of the 9067 catchments is a node, and the 559207 edges connect pairs of catchments with similar traits. The network provides information about catchment similarity, and nodes belonging to a cluster are more similar to each other than they are to the rest of the network. The clusters range from 953 nodes to 1 node in size. The top 71 clusters contain 95 % of the nodes in the network, while the 34 clusters with sizes greater than 50 nodes cover 84 % of all nodes. We provide the data for the catchment network topology and partitioning into clusters in Ciulla and Varadharajan (2023).
Figure 4 shows the spatial distribution of catchment clusters using the coordinates of their corresponding gaging stations. We find that catchments within a cluster tend to be located in the same region, even though no geographical coordinates were used as traits in our network methodology. For example, large portions of the Midwestern US are predominantly cluster 2 (green circles) and the coastal areas of the southeastern US are cluster 4 (purple circles). However, cluster 1 (orange circles) is distributed across the CONUS and comprises agglomerates of dense nodes separated by long distances. The global homogeneity measure of the catchments is 0.71, which means that the nearest neighbors for 71 % of the catchments belong to the same cluster. This is significantly higher than the homogeneity measure of 0.04 when clusters are randomly distributed throughout the CONUS. In Sect. 3.3, we show how the predominant traits of the catchment clusters can be used to interpret this result.
3.3 Characterization of catchment clusters with trait categories
We infer traits that are over- or under-expressed in each catchment cluster using the z scores from the trait network. We use two clusters as examples (Fig. 5) to highlight how the network methodology allows for an interpretation of the characteristics of each catchment cluster. The catchments within cluster 0 (blue circles) are spread across the western US only, while cluster 1 (orange circles) is distributed across the CONUS. The z scores of every trait for the two clusters are shown in Fig. 6a and b, where each node in the network is sized according to the absolute values of their z score, while the color reflects the sign (of over- or under-expression). For both catchment clusters, the respective trait network contains entire groups of over- and under-expressed nodes.
Leveraging the trait clusters, we condense the information of the unique expression of the 274 traits into 25 interpretable categories by computing the cluster-wide average of the trait z scores (see examples in Fig. 6c, d). Cluster 0 (blue circles) shows over-expression of the categories of elevation (z score =1.49) and evergreen forests (z score =1.04) and under-expression of the temperature category (z score ). Based on the expression of these and other trait categories, we infer that the blue cluster generally represents mountainous forested areas. Cluster 1 (orange circles) is dominated by the trait category of developed areas (z score =2.29), indicating that the catchments represented by the orange nodes are located in close proximity to developed areas such as cities. The fact that this cluster is dominated by an anthropogenic category is consistent with the heterogeneous nature of its spatial pattern. In contrast, the rather homogeneous distribution of catchment cluster 0 is likely due to the prominence of climatic trait categories that are more correlated with the geographical location.
The list of trait categories and their relative z-score values associated with all the catchment clusters identified using our methodology is provided in the dataset (Ciulla and Varadharajan, 2023). A brief summary for clusters with sizes greater than 50 is shown in Table 2, along with their corresponding spatial homogeneity measures.
3.4 The representative catchments
Here, we provide an example of how our methodology can be used to identify representative catchments using the two clusters highlighted in Sect. 3.3. A total of 10 catchments are considered to be representative of cluster 0, and 14 are considered to be representative of cluster 1 (Fig. 7). In both cases, the selected catchments represent at least 95 % of the nodes in each cluster. The selected representative nodes are geographically distributed within the spatial domain of the cluster they belong to. This behavior is the result of the combined effect of (1) the intrinsic multiscale connection patterns in the network, where heterogeneity at different scales produces groups of more densely connected nodes within the clusters, and (2) the strategy of node selection, which promotes the spread of representative nodes across each cluster. These representative catchments can be used to prioritize locations for observations or modeling purposes.
3.5 Hydrological indices and trait categories
The results of the statistical tests are summarized in Appendix in Table G1 for all 34 streamflow indices. When averaged for all the indices, 83 % of the clusters for the one-sample K–S test and 79 % for the two-sample K–S test reject the null hypothesis, meaning that the distribution of their streamflow indices is mostly distinct from the overall distribution at the continental scale. These results show that the trait-based clustering approach results in distinct signature classifications. See Sect. 4.5 for further discussion about the distinct hydrological behaviors across the catchment clusters.
3.6 Comparison with traditional clustering techniques
The two metrics, cluster similarity and silhouette score, indicate that our workflow performs better than traditional unsupervised methods of classification (Fig. 8). We also find that the network-based clustering (red and green points) is considerably superior in relation to both k-means (yellow points) and hierarchical clustering (blue points) across the different values of k and cluster granularity (Fig. H1 in Appendix). This is evident from the consistently low values in terms of the median cluster similarity and the higher values in terms of silhouette scores for our methodology. Also, the network generated using the cosine distance as a similarity metric (red points) performs better than its counterpart that uses the Euclidean distance (green points). This confirms that the cosine similarity should be preferred as a distance metric in high dimensions, and the directionality of the data can contain valuable information.
4.1 Advantages of our network-based workflow as a tool for classification
In this study, we present a novel methodology to classify river catchments in an unsupervised manner using network science. We chose to use the GAGES-II dataset as the source of information for catchment characterization because of its comprehensive set of over 300 natural and anthropogenic traits across more than 9000 catchments in the CONUS. In our methodology, we use the combination of the PCA algorithm, networks, and the cosine similarity metric to mitigate the issues of information redundancy and high dimensionality in the data. In particular, the distance metrics perform worse (referred to as degradation) as the number of dimensions grows (Aggarwal et al., 2001). One of the consequences of this phenomenon is that the ratio of the distances of the nearest and farthest neighbors to a given point in high dimensions approaches 1, meaning that the points become uniformly distant from each other (Beyer et al., 1999). The PCA partly resolves these issues by projecting the original highly dimensional vector data into a smaller set of orthogonal directions called principal components. However, there are limitations to how small the resulting vectors can be because data compression inevitably results in some loss of information. It is not uncommon to retain a high number of dimensions after PCA (20 in our case), which still results in degradation of the distance metric and has some redundant information. Thus, applying k-means or hierarchical clustering algorithms after PCA to large dimensional datasets is not a solution to the issues of multicollinearity and high data dimensionality, given the dependence of these methods on the Euclidean distance.
Hence, we use networks to model the relationships amongst elements of the system represented by the highly dimensional vectors. The elements are the nodes of a network connected by edges that represent their pairwise distance metrics, which are not bound to be points in a vectorial space. Instead, we use their vectorial representation to compute any appropriate distance metric, and that information is reflected in the connection between nodes as edge weights. Thus, the task of finding clusters in the Euclidean space is shifted to the identification of connectivity patterns in a network. In this respect, the network constitutes a generalized tool for system analysis where edges can represent different types of distance metrics or other pairwise relational quantities. In our study, we chose to use the cosine distance to describe the relationships amongst the reduced vectors of both traits and catchments since it is more appropriate for use in high dimensions and preserves the directionality of the data. The rationale for the choice of this similarity metric over the Euclidean distance is discussed in Appendix C. The use of the network enables us to move to this alternate distance metric, surmounting issues encountered by common methods like the k-means and Ward's hierarchical clustering that rely on the Euclidean distance to generate the division into classes. Once we set up our investigation as a network analysis, the problem of classification is translated into finding clusters in the networks. Many clustering algorithms are available for network science (Fortunato, 2010), and our method implements the widely used Infomap algorithm (Rosvall and Bergstrom, 2008).
We have demonstrated that our network-based workflow outperforms the k-means or the Ward's hierarchical algorithms for two different metrics (see Sect. 3.6), particularly with the parameters we chose for dimensionality reduction and the disparity filter (dashed black lines in Fig. 8, corresponding to k=20 dimensions retained). We conclude that our method produces more distinct clusters and is hence a better choice than traditionally used classification approaches.
In addition to addressing the challenges of information redundancy and data dimensionality, our analysis using the catchment–trait networks is also interpretable as it can quantitatively determine trait categories that are over- or under-expressed in catchment clusters (Sect. 4.2). Additionally, we are able to use a variety of network-specific metrics that highlight the role of the elements of the system at different scales of the network. For example, we use the degree centrality computed using the nearest neighbors of a node as a local measure to identify catchments that have a high number of connections to others. In a similarity network, a node with a high degree measure means it is similar to many other nodes, and, hence, we use the degree centrality to generate sets of representative catchments. At an intermediate scale, the clustering coefficient reveals how many neighbors of a node are connected to each other, revealing heterogeneous, non-trivial connectivity patterns that indicate the presence of clusters. At a global scale across the network, we leverage the flow of information traveling through the nodes in the Infomap algorithm (Rosvall et al., 2009) to generate the clusters. Additionally, statistical methods can be applied to select the information contained in the edges of the network (see Sect. 4.4.2 for an example). Although we demonstrate the use of this workflow for catchment classification, the methodology can easily be extended to analyze other types of environmental trait datasets, such as of microbial or plant traits.
4.2 Interpretability and redundancy analysis
Machine learning techniques are capable of proficiently learning patterns in the data (Bishop and Nasrabadi, 2006) but are often black-box methods that are difficult to interpret. In the case of supervised approaches, the accuracy of a method can be evaluated using a test set, which is not an option for unsupervised algorithms because of the lack of labeled data. Hence, we simultaneously analyze the information from the networks of traits and catchments to interpret the results for a deeper understanding of the specific set of traits that result in the classification of a catchment cluster.
Specifically, we characterize the clusters of catchments by investigating the traits that are over- or under-expressed, which are grouped into a small, interpretable set of trait categories. The generation of the higher-level trait categories reduces the number of redundant traits by aggregating them into clusters, which allows for easier human interpretation. For example, a set of traits related to air temperatures, when clustered together, are no longer isolated measures and are easier to interpret when presented as an aggregated temperature category. To illustrate how our approach helps with reducing trait redundancy, we computed the Spearman correlation coefficients (ρ) between streamflow indices and catchment traits, which account for non-linearities in the data. We find that traits belonging to the same trait categories have similar correlations to the streamflow indices (Fig. I1 in the Appendix). We find that the Spearman correlation coefficients between the streamflow indices and individual catchment traits can be effectively represented as an aggregated median value for the trait categories generated in our method (Fig. 10), which indicates that our reduced set of trait categories is sufficient to determine the general relationships between traits and hydrological signatures. Thus, interpretability is enabled with the generation of a small number of trait categories whose composition can be easily visualized and statistically analyzed.
Topological proximity at the cluster level is also meaningful. Clusters that share a connection and that are close to each other are also more related to each other. For example, cluster 3 in the trait network, which includes agricultural traits, and cluster 5, which has traits related to croplands, as well as to dams, are topologically close, with many shared edges, and also appear intuitively to be related to each other.
Finally, the identification of dominant traits is not only useful to characterize individual catchment clusters (Fig. 6) but can also be used to compare across different clusters. For example, in Fig. 9, we show the differences between the traits categories of two catchment clusters located in the western US. Since the cluster locations overlap geographically, we use the differences in the z-score values of the trait categories to understand how the groups were split by identifying which categories are relatively over-expressed in the two clusters. We can deduce that cluster 0 refers to catchments with higher precipitation and runoff, higher elevation, and the presence of evergreen forests, while the cluster 3 has higher temperatures and shrublands. Note that these are relative quantities, and, in fact, cluster 0 has lower precipitation and runoff overall in comparison to the rest of the network, as shown in Fig. 6. In the rest of the Discussion subsections, we leverage the trait categories associated with catchment clusters to reveal insights relevant to their hydrological behavior.
4.3 Spatial homogeneity of catchment clusters with natural and anthropogenic traits
The results in Sect. 3.5 show that, in general, the catchment clusters tend to be geographically co-located throughout the CONUS, with a few exceptions. This means that the trait-based classification results in clusters that have some geographical homogeneity, which would not occur with a random distribution of clusters. However, at the cluster level, we see a high variability in terms of spatial homogeneity, as shown in Table 2. This reveals that the geographical domain generated by each cluster (i.e., its convex hull) contains catchments from other clusters, and the extent of the relative abundance changes across clusters.
We leverage the information from the trait categories to investigate this variability. We find that most of the trait clusters are composed of mostly anthropogenic or natural traits only. This result not only provides additional validation of the trait classification, but it can be used to identify the effects of human influence on the hydrological behavior of catchment clusters. Thus, we divide the catchment clusters into three groups of increasing (low, middle, high) human influence. Our hypothesis is that clusters dominated by natural factors, with little human disturbance, should exhibit more spatial homogeneity as a consequence of the environmental forcing. Conversely, clusters with strong anthropogenic influences, like urban areas or dams, are less coupled to natural factors and should display lower homogeneity. A middle ground is constituted by clusters where the human impact is interlaced with natural factors, such as in croplands. We first sorted the catchment clusters from the lowest to the highest value of cluster homogeneity (Fig. 11a). The six clusters with strong anthropogenic influence are amongst the last ten with respect to their spatial homogeneity, confirming that the human activities are associated with a more heterogeneous spatial distribution of catchment clusters. However, none of the clusters have a homogeneity measure lower than the one assuming a random cluster distribution. Note that the spatial homogeneity is computed using geographical coordinates and does not account for the elevation of the catchments. This could explain lower homogeneity values in some of the catchment clusters dominated by natural factors.
4.4 Trait relevance at different spatial scales
So far, our study has only focused on the classification of the catchments at the continental scale. However, our proposed method can be applied at multiple spatial scales as long as relevant trait information is available. Here, we show two different approaches that can be used for catchment classification at different scales.
4.4.1 Multiscale analysis at regional and continental scales
First, we apply the workflow previously used for the CONUS scale at the regional scales to obtain the trait and catchment networks. We demonstrate this approach for the Upper Colorado River Basin (UCRB; USGS HUC 14). There are 368 catchments within this area, which is about 25 times smaller than the total number across the CONUS. Similarly to the results from the CONUS scale, we find a well-defined geographical coherence among the nodes of each catchment cluster (Fig. 12).
Not surprisingly, the trait network connectivity and cluster composition changes to reflect the characteristics of this subset of catchments. The characteristic z scores calculated for this subset can provide an interpretation of the trait expression in this region. New trait clusters emerge that are more relevant to the UCRB, like the one representing areas at high elevations covered with sandy soils. Some trait clusters, like the one consisting of temperature-related traits or the cluster associated with shrubland-dominated environments, are present at both the CONUS scale and this particular regional scale. The complete list of trait network clusters for the UCRB is available in Ciulla and Varadharajan (2023).
4.4.2 Edge weight filter tuning
Another way to capture insights at different spatial scales is to tune the edge filtering parameter, as discussed in Sect. 2.5. By changing the significance level of the disparity filter, we tune the connectivity of the network of catchments to generate larger or smaller clusters. There is no prescribed granularity at which the system should be investigated, and we can make adjustments to fit the goals of the analysis. Here, we provide an example where a smaller value of the significance level acts as a higher threshold for the edge weights, reducing the number of edges in the network of catchments and producing smaller clusters. Here, cluster 4, generated using the original filter threshold that was spread across most of the South Atlantic US (purple circles in Fig. 4), is split into the two new clusters as shown in Fig. 13. We again use the difference between the z scores of the trait categories in the two newly generated clusters to interpret the partitioning. We find that the difference is primarily due to the separation of catchments that have predominant traits such as herbaceous wetlands, croplands and canals, and moderately higher temperatures and summer precipitation, which tend to be concentrated in the Florida Peninsula, in contrast to those with evergreen forests and lower-order streams, which were more prevalent in the rest of the original cluster (Fig. 13b).
4.5 Distinct hydrological behavior of catchment clusters
In this study, we have so far analyzed the characteristics of river catchments at regional to CONUS scales, along with their physical traits. Here, we extend our analysis to examine possible connections between the catchment clusters and their hydrological behaviors. In Sect. 3.5, we show that the distributions of hydrological indices calculated using streamflows are statistically different when aggregated by catchment cluster, indicating that the partitioning with the traits generates clusters that have distinct hydrological behaviors.
We can leverage the interpretability provided by the trait categories to hypothesize about predominant factors that influence the distinct hydrological behavior in the catchment clusters. To illustrate this, we first examine the distributions of two indices from Olden and Poff (2003), mean annual runoff (ma41) and the average yearly number of moderate flood events in a watershed (fh6) (see Fig. 14). In fh6, a flood is considered to be moderate when the streamflow exceeds 3 times the value of the median flow. Cluster 7 (gray box in Fig. 14) displays the highest median and the highest upper whisker for ma41, which is the 75th percentile plus 1.5 times the interquartile range. The catchments in this cluster are predominantly located in the Pacific Northwest (Fig. 4). From the analysis of the over-expressed trait categories, we find that this cluster is characterized by high precipitation. Not surprisingly, we find that catchments in the Pacific Northwest with higher precipitation also have greater average flows. Cluster 1 (orange box in Fig. 14b) displays the highest median and the highest upper whisker for fh6 and contains catchments in close proximity to developed areas (Fig. 6d). Hence, we can hypothesize that predominantly developed catchments are more vulnerable to moderate flooding, which is consistent with a previous finding from Ombadi and Varadharajan (2022) showing that catchments with a higher percentage of impervious cover in the GAGES-II dataset generally have increased runoff ratios in both temperate and arid climates. The boxplots of the full set of hydrological indices included in this study are presented in Ciulla and Varadharajan (2023).
Additionally, we utilize the ability to determine correlations between streamflow indices and a reduced set of interpretable trait categories (Sect. 4.2). We find that, across the 9067 catchments, mean annual runoff (ma41) is positively correlated not only with traits related to precipitation but also with the presence of mixed forests (ρ=0.45) and, to a lesser degree, evergreen forests (ρ=0.25). The ma41 index is also negatively correlated with the pastures and grasslands trait category (). This highlights the role of vegetation in mediating flows and is somewhat counterintuitive given that, in the absence of management, forested catchments with higher evapotranspiration would be expected to have lower flows compared to grasslands. Similarly, the fh6 index is positively correlated not only with precipitation traits but also with traits related to developed areas (ρ=0.40), croplands (ρ=0.32), and temperature (ρ=0.43). It is also inversely correlated with elevation (), the presence of shrublands (), evergreen forests (), and coarse soils and groundwater (). These relationships are consistent across other flood indices. For example, the fh7 index showing the propensity for heavy floods (above 7 times median flows) similarly has a moderate positive correlation with temperature (ρ=0.44) and overland flow (ρ=0.38) and a moderate negative correlation with elevation () and coarse soils and groundwater (). This indicates how flooding is affected by the complex relationships between land use, vegetation, soil infiltration capacity, and base flows.
These examples highlight the use of our methodology to demonstrate how specific hydrological behaviors can be connected to catchment traits such as their climatic conditions, topography, land use, or anthropogenic influence. The ability to link catchment traits to specific hydrological behavior enables further analysis of the factors that influence different streamflow characteristics (e.g., high versus low flows). In particular, the distinction between anthropogenically influenced trait categories and natural traits (see Table 1) enables further analysis of the impact of human activities on hydrologic behavior.
4.6 Examining diversity of hydrologic behavior within catchment clusters
We can also use our methodology to gain insights into the traits that may result in diversity of hydrologic behavior within similar catchments. For this purpose, we selected catchment subsets that are considered to be outliers – i.e., where the index is either above the 90th percentile or below the 10th percentile of all indices in the cluster for each streamflow index and for each cluster of catchments. We compare the z scores (Z) of the traits associated with the catchment subsets relative to the entire catchment cluster to evaluate whether there are differences in traits that would explain the anomalous hydrological behavior. As an example, we look at catchments within a cluster that have distinct baseflow regimes based on a baseflow index (ml17) in Olden and Poff (2003) that represents the 7 d minimum flows divided by mean annual daily flows. The results for anomalous catchments that have higher-than-normal (>90th percentile) baseflow are shown in Fig. 15, where the size and color of the bubbles are the relative z scores of the trait categories.
We focus on a crop-dominated catchment cluster such as the one generally encompassing the Ohio Valley region (cluster 2), displayed in the third row of the bubble plot. This cluster is characterized by relatively low elevation and the presence of croplands and fine soil, as indicated by the higher z scores of these trait categories relative to the rest of the CONUS catchments (Fig. 16a). Using our approach, we can identify the over- and under-expressed traits of the catchments with anomalously high baseflows in cluster 2, which generally has low-elevation croplands. In Fig. 15, we find that there is a positive association of high baseflows with coarse soils (Z=0.98) and a negative one with fine soils (), which is not surprising. In addition, there is an association of high baseflows with the non-cropland trait category (third-last column with green label, Z=0.85), which aggregates all non-agricultural land use such as urban areas and forests. This indicates that, within the context of a cropland-dominated cluster, the catchments that have relatively lower areas of croplands have higher baseflows. Interestingly, there is also a strong positive association of high baseflows with shrubland (Z=1.12) and a moderate negative association with temperature (). One possible explanation for these results is that pumping groundwater for agriculture decreases the groundwater input into streams, resulting in lower baseflows. This depletion of groundwater discharge into streams does not occur in shrublands or other areas without croplands.
Another catchment cluster with a strong agricultural presence is cluster 14, generally located in North and South Dakota, which are characterized by low temperatures, herbaceous wetlands, and croplands (Fig. 16b). Similarly to cluster 2, there is a positive association of anomalously high baseflows with coarse soils (Z=0.76) and non-croplands (Z=1.10) and a negative association with fine soils (). However, in comparison to cluster 2, several other factors have a positive association with high baseflows, including precipitation and summer precipitation (Z=0.90 and Z=1.04, respectively); the presence of lakes, ponds, and reservoirs (Z=1.19); herbaceous wetland areas (Z=0.76); evergreen, mixed, and/or deciduous forests (Z=0.58, Z=0.74, and Z=0.88, respectively); and developed areas (Z=0.66). There is also a negative association with overland flows (). This reveals that, in catchment cluster 14, anomalously high baseflows are more likely in the presence of surface waterbodies, such as lakes and wetlands, that have the potential for increased surface–groundwater exchange. High baseflows also occur in forested areas of these agricultural catchments, potentially indicating that the partitioning of precipitation is weighted towards infiltration and recharge over evapotranspiration in these catchments.
Overall, averaged z scores for all catchments in the CONUS (shown in the last row of Fig. 15) indicate that there is a moderate positive association of anomalously high base flows with the presence of lakes, ponds, and reservoirs (11th column in light blue, Z=0.29) and with coarse soils and groundwater trait categories (18th column in gray, Z=0.40). Conversely, there is a negative link to fine soils (13th column in green, ). This indicates the potential for surface–groundwater exchange in regions where waterbodies are present and, not surprisingly, the importance of soil texture in mediating baseflow through infiltration and recharge.
4.7 Application for regionalization studies
Our methodology can be used as the initial steps of typical workflows used for predictions for unmonitored basins. These steps constitute (1) classifying catchments into groups for regionalization and (2) selecting a subset of traits from a large predictor space, a common challenge in many large sample studies. For the former, we choose to classify catchments using traits since geospatial datasets are now available with a lot of trait information that allows us to do catchment classification at large spatial scales, including for unmonitored catchments. For the latter, we find that we can condense a very large dataset containing hundreds of traits into 25 trait categories with the network approach due to the redundancy in the traits. Thus, our paired catchment–trait network approach not only classifies catchments into clusters but enables the reduction of a large dataset of traits into an interpretable set of trait categories by eliminating their redundancy. This provides the ability to identify distinct trait categories that are over- or under-expressed in catchment clusters in relation to streamflow behaviors. The parallel analysis of cluster and trait data as networks is an important characteristic that distinguishes our method from other typical unsupervised clustering workflows.
In this study, we demonstrate a new network-based method for unsupervised classification of river catchments using their environmental and anthropogenic traits. This approach builds two parallel networks – the first identifies similar catchments, and the second reduces the large set of redundant traits into a small, interpretable set of trait categories. The method outperforms traditional unsupervised approaches for classification and enables simultaneous analysis of the catchment clusters and co-expression of the trait categories. This makes it possible to identify the predominant traits that result in the partitioning of catchments into different groups, as well as their distinct hydrologic behaviors. This trait-based approach can be used beyond hydrological applications to classify highly dimensional datasets that have correlated information.
Using this method, we classified 9067 catchments in the continental United States based on 274 traits from the GAGES-II dataset. The resulting clusters tend to be geographically coherent, even though no coordinates were used as inputs, revealing spatial patterns for catchments with predominantly natural or anthropogenic traits. The method can be implemented at multiple spatial scales for which trait data are available. As expected, the catchment clusters and associated trait expressions vary according to the spatial scale used for the analysis. We also find that the catchment clusters display distinct streamflow characteristics, as quantified by hydrological indices, indicating the potential for using the trait-based classification to understand and predict hydrological behavior.
We can also leverage network-specific metrics, like the degree centrality, using this workflow. We demonstrate their utility by identifying a small set of watersheds that are representative of a group of catchments with specific traits. These representative sites can be used to determine locations to conduct observations or modeling activities that are transferable to other catchments.
Catchments are complex systems, and their hydrological behavior is determined by the combined effect of multiple co-dependent traits. Thus, networks are an extremely useful tool for investigating catchment properties and behavior since they enable a holistic approach to studying the system. The collective analysis of traits creates the opportunity to average out the unique characteristics of individual catchments and to characterize emergent hydrological behaviors across spatial scales.
The traits in GAGES-II with the prefix “RAW_” describe the straight-line distance (in km) of water stations from points of interest such as dams, canals, etc. If no such point of interest is present in the basin, the trait is assigned a missing value of −999. This choice of missing value makes the traits non-monotonic because they have small positive values for stations in close proximity to a point of interest, large values for stations far from it, and a large negative value when the point is not present in the catchment. We transform these traits by computing the inverse of the variable for values greater than 0 (Fig. A1). The arbitrary −999 values are mapped into zeros. When gaging stations geographically coincide with the point of interest, the original zero distances are replaced with the maximum of the newly transformed values. In this way, the newly transformed trait values are monotonic and are a continuous and differentiable function of the distance.
The only free parameter of the PCA method is the number k, which is the final dimension of the reduced space. We determine k using the false nearest-neighbor (FNN) method from (Krakovská et al., 2015), which is based on the assumption that two points that are near each other in a sufficiently lowly dimensional space should remain close as the dimensions increase. In particular, we use Cao's version of FNN (Cao, 1997), where the average distances E(k+1) of the closest neighbors of all the elements in the space of dimension k+1 are divided by the same quantity computed in the k-dimensional space. For sufficiently high values of k, the ratio approaches the value of 1, indicating that the average distances are not changing in two consecutive dimensions. We chose an arbitrary value of 1.05 to define the threshold below which the value R(k) is assumed to be constant. The value for which determines the number of principal components to be retained in the PCA method. For our dataset, the value of is 20. By choosing dimensions in the reduced space, we account for 71.6 % of the total variance of the original data.
We present a comparison of the cosine similarity, our choice for the similarity measure, against the widely used Euclidean distance and highlight why the latter is not the best choice to capture relationships within highly dimensional vectors.
The first reason is that vectors associated with two random points in an n-dimensional space have a high probability of being almost orthogonal when the number of dimensions n diverges (Aggarwal et al., 2001). Thus,
The Euclidean distance DE between two vectors x and y is
where represents the Euclidean norm.
In the case of highly dimensional vectors, applying Eq. (C1) in Eq. (C2) causes the Euclidean distance to become a function of solely the vector norms:
This is not desirable because we lose the information about the relationship between the vectors, which is of interest when computing a distance metric. Although there is no definitive size threshold above which the effect of the high dimensionality will be prevalent, we expect that the effect would not be negligible even in the 20-dimensional space obtained after our dimensionality reduction step through the PCA.
Another consideration when choosing a distance measure is the type of information it provides. In the case of the Euclidean distance, the directionality of the vectors associated with the data point does not influence the metric. Figure C1 illustrates an example in two dimensions where the directionality of the data is not captured by the Euclidean distance. In particular, the points A and B have swapped coordinates (xA=yB and yA=xB) with . Instead, C has the same y coordinate as B (yB=yC), while the x coordinates are in such a way that the Euclidean distances between A and B dE(A,B) and between B and C dE(B,C) are the same. So the Euclidean distance would indicate that the relationship is equal between two points with swapped coordinates, which should depict two very different elements, and between one of the two and a third one that shares exactly one coordinate, while the second coordinate is simply greater.
Conversely, the cosine distance captures the difference between A–B and B–C because it considers the directionality. Specifically, the angle αAB between A and B is much greater than the one αBC between B and C, leading to a bigger cosine distance. The cosine similarity captures the information contained in the different coordinates of the data points. In our methodology, the coordinates are the components given by the principal components as computed by the PCA, which represent a mixture of traits. We contend that, in a trait-based approach, the directionality is important both before and after the dimensionality reduction and needs to be captured.
Hence, to mitigate the effects of dimensionality and to include information on directionality, we use the cosine similarity instead of the Euclidean distance to compute the relationship between vectors. Computationally, the cosine similarity is computed as the dot product of a matrix with normalized row vectors and its transpose. In Eq. (1), the dot product between the two vectors is the numerator of a ratio with the vector norms. Since it is a multiplicative factor, the dot product is retained regardless of how small its value is. For the Euclidean metric, a negligible value of the dot product will be outweighed by the norms of the vectors.
Finally, it is worth noting that the Euclidean distance and the cosine similarity are related to each other and are equivalent when applied to normalized vectors. Specifically, when the vectors are normalized, then Eq. C2 becomes
where is defined as the cosine distance.
A network G is a mathematical object constituted by two sets {N,E}, where N is the set containing the nodes of the network, and E is the set of pairs of nodes called edges: . A network is a great tool to model relationships and interactions among the elements of a system (Börner et al., 2007). The elements of the system are represented as nodes, while the relationships are described by the edges. If the relationship between a pair of nodes is commutative, then the network is called undirected, meaning that there is no directionality in the edge: . Edges with the same node as endpoints are self-loops and may or may not be present according to what the edges represent. An edge can simply be present or not (for which unweighted networks are appropriate), or it can carry a weight representing the strength of the edge whose interpretation depends on the system under analysis. The maximum number of edges present in an undirected network with no self-loops is the number of possible combinations of pairs of elements in N without considering the order . Here, is the number of nodes and also represents the size of the network. A network that has all possible edges is called complete, and its edge number is . This rarely occurs for real-world phenomena; hence, typically, the number of edges in real-world networks is much smaller than (Newman, 2005). This is a crucial point because it is the arrangement of edges and their eventual heterogeneous distribution, namely the network topology, that give rise to connectivity patterns that reveal insights about the system. We refer to networks as being complex when they display non-trivial topological features, with patterns of connection between their elements that are neither regular nor purely random. All this information is condensed in an adjacency matrix, where both rows and columns are nodes, and each element of the matrix is the weight of the edge between the two nodes identifying the matrix element and zero otherwise. If the network is undirected, such a matrix is symmetric. For a complete review of network properties, refer to Newman (2018).
The clustering coefficient is a network measure that quantifies the connections among the neighbors of a certain node (Wasserman and Faust, 1994; Scott and Carrington, 2023). This measure ranges from 0 (corresponding to the situation where no neighbors of a node are connected to each other) to 1 (where all the neighbors of a node are connected to each other). We compute the clustering coefficient for all the nodes in both the catchments and trait networks and show the results as a probability density function in E1. In both cases, the clustering coefficient spans the entire possible range of 0 to 1. In the network of catchments, the average clustering coefficient, computed by averaging the clustering coefficient of all nodes, is 0.61, while in the network of traits, it is equal to 0.75. This means that, in both cases, on average, more than half of the possible connections among neighbors are present. This fact indicates the presence of a group of nodes that are well connected with each other and is the first indication of the presence of complex connectivity patterns that can lead to the formation of clusters in both networks.
In the trait network, the value with the highest probability is 1, meaning that there are parts of the network that form complete cliques, namely subsets of nodes that have all the possible edges allowed among them. This fact confirms the intuitive understanding that some of the attributes provide redundant information because their similarity, in terms of co-expression as learned by the PCA, generates such tightly connected areas.
The daily observations of streamflow and specific conductance used in this study are publicly available from USGS NWIS at http://waterdata.usgs.gov/nwis/ (USGS, 2022). The characteristics of catchments from the GAGES-II dataset are publicly available and can be accessed at https://doi.org/10.3133/70046617 (Falcone, 2011). The data and code used for this study are publicly available with a CCBy4 license in the US Department of Energy ESS-DIVE data repository and are accessible with the https://doi.org/10.15485/1987555 (Ciulla and Varadharajan, 2023).
Author contributions follow the CRediT taxonomy. Conceptualization: FC, CV. Data curation: CV. Formal analysis: FC. Funding acquisition: CV. Investigation: FC. Methodology: FC. Project administration: CV. Resources: CV. Software: FC. Supervision: CV. Validation: FC, CV. Visualization: FC. Writing – original draft: FC. Writing – review and editing: CV.
The contact author has declared that none of the authors has any competing interests.
Publisher’s note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors.
This research is supported by the Early Career Research Program funded by the US Department of Energy, Office of Science, Biological and Environmental Research Program under Berkeley Lab contract no. DE-AC02-05CH11231. We acknowledge the discussions with Eoin Brodie on trait identification and the group discussions with Helen Weierbach, Mohammed Ombadi, Aranildo Lima, and Jared Willard, which inspired ideas for inclusion in this paper and provided feedback on the methodology. We also acknowledge Valerie Hendrix and Danielle Christianson for their help with using the BASIN-3D software to download the data used in this paper.
This research has been supported by the US Department of Energy, Office of Science, Biological and Environmental Research Program under Berkeley Lab contract no. DE-AC02-05CH11231.
This paper was edited by Roger Moussa and reviewed by two anonymous referees.
Aggarwal, C. C., Hinneburg, A., and Keim, D. A.: On the Surprising Behavior of Distance Metrics in High Dimensional Space, in: Database Theory – ICDT 2001, 420–434, Springer, Berlin, Germany, https://doi.org/10.1007/3-540-44503-X_27, 2001. a, b, c, d, e
Albert, R. and Barabási, A.-L.: Statistical mechanics of complex networks, Rev. Mod. Phys., 74, 47–97, https://doi.org/10.1103/RevModPhys.74.47, 2002. a
Arsenault, R., Brissette, F., Martel, J.-L., Troin, M., Lévesque, G., Davidson-Chaput, J., Gonzalez, M. C., Ameli, A., and Poulin, A.: A comprehensive, multisource database for hydrometeorological modeling of 14,425 North American watersheds, Sci. Data, 7, 1–12, https://doi.org/10.1038/s41597-020-00583-2, 2020. a
Barrat, A., Barthélemy, M., Pastor-Satorras, R., and Vespignani, A.: The architecture of complex weighted networks, P. Natl. Acad. Sci. USA, 101, 3747–3752, https://doi.org/10.1073/pnas.0400087101, 2004. a
Bellman, R. E.: Dynamic Programming, Princeton University Press, Princeton, NJ, USA, https://press.princeton.edu/books/paperback/9780691146683/dynamic-programming (last access: 4 March 2024), 2010. a
Beven, K. J.: Uniqueness of place and process representations in hydrological modelling, Hydrol. Earth Syst. Sci., 4, 203–213, https://doi.org/10.5194/hess-4-203-2000, 2000. a
Beyer, K., Goldstein, J., Ramakrishnan, R., and Shaft, U.: When Is “Nearest Neighbor” Meaningful?, in: Database Theory – ICDT'99, 217–235, Springer, Berlin, Germany, https://doi.org/10.1007/3-540-49257-7_15, 1999. a, b
Bishop, C. M. and Nasrabadi, N. M.: Pattern recognition and machine learning, vol. 4, Springer, ISBN 978-0387-31073-2, 2006. a
Boccaletti, S., Latora, V., Moreno, Y., Chavez, M., and Hwang, D.-U.: Complex networks: Structure and dynamics, Phys. Rep., 424, 175–308, https://doi.org/10.1016/j.physrep.2005.10.009, 2006. a, b
Börner, K., Sanyal, S., and Vespignani, A.: Network science, Ann. Rev. Info. Sci. Tech., 41, 537–607, https://doi.org/10.1002/aris.2007.1440410119, 2007. a, b, c, d
Budyko, M.: Climate and Life, Volume 18 – 1st Edition, https://shop.elsevier.com/books/climate-and-life/budyko/978-0-12-139450-9 (last access: 20 July 2023), 1974. a
Cao, L.: Practical method for determining the minimum embedding dimension of a scalar time series, Physica D, 110, 43–50, https://doi.org/10.1016/S0167-2789(97)00118-8, 1997. a, b
Ciulla, F. and Varadharajan, C.: Classification of River Catchments in the Contiguous United States: Code, Dataset, Similarity Patterns, and Resulting Classes, ESS-DIVE repository [code and data set], https://doi.org/10.15485/1987555, 2023. a, b, c, d, e, f, g, h, i
Conover, M., Ratkiewicz, J., Francisco, M., Goncalves, B., Menczer, F., and Flammini, A.: Political Polarization on Twitter, ICWSM, 5, 89–96, https://doi.org/10.1609/icwsm.v5i1.14126, 2011. a
Czuba, J. A. and Foufoula-Georgiou, E.: A network-based framework for identifying potential synchronizations and amplifications of sediment delivery in river basins, Water Resour. Res., 50, 3826–3851, https://doi.org/10.1002/2013WR014227, 2014. a
Daly, C., Taylor, G. H., Gibson, W. P., Parzybok, T. W., Johnson, G. L., and Pasteris, P. A.: HIGH-QUALITY SPATIAL CLIMATE DATA SETS FOR THE UNITED STATES AND BEYOND, T. ASAE, 43, 1957–1962, https://doi.org/10.13031/2013.3101, 2000. a
Dooge, J. C. I.: Looking for hydrologic laws, Water Resour. Res., 22, 46S–58S, https://doi.org/10.1029/WR022i09Sp0046S, 1986. a
Falcone, J. A.: GAGES-II: Geospatial Attributes of Gages for Evaluating Streamflow, Technical Report, Tech. rep., USGS [data set], https://doi.org/10.3133/70046617, 2011. a, b
Falcone, J. A., Carlisle, D. M., Wolock, D. M., and Meador, M. R.: GAGES: A stream gage database for evaluating natural and altered flow conditions in the conterminous United States, Ecology, 91, 621, https://doi.org/10.1890/09-0889.1, 2010. a
Fortunato, S.: Community detection in graphs, Phys. Rep., 486, 75–174, https://doi.org/10.1016/j.physrep.2009.11.002, 2010. a, b
Guo, Y., Zhang, Y., Zhang, L., and Wang, Z.: Regionalization of hydrological modeling for predicting streamflow in ungauged catchments: A comprehensive review, WIREs Water, 8, e1487, https://doi.org/10.1002/wat2.1487, 2021. a
He, N., Li, Y., Liu, C., Xu, L., Li, M., Zhang, J., He, J., Tang, Z., Han, X., Ye, Q., Xiao, C., Yu, Q., Liu, S., Sun, W., Niu, S., Li, S., Sack, L., and Yu, G.: Plant Trait Networks: Improved Resolution of the Dimensionality of Adaptation, Trends Ecol. Evol., 35, 908–918, https://doi.org/10.1016/j.tree.2020.06.003, 2020. a
Hill, R. A., Weber, M. H., Leibowitz, S. G., Olsen, A. R., and Thornbrugh, D. J.: The Stream-Catchment (StreamCat) Dataset: A Database of Watershed Metrics for the Conterminous United States, J. Am. Water Resour. Assoc., 52, 120–128, https://doi.org/10.1111/1752-1688.12372, 2016. a
Horton, R. E.: Erosional development of streams and their drainage basins; hydrophysical approach to quantitative morphology, GSA Bulletin, 56, 275–370, https://doi.org/10.1130/0016-7606(1945)56[275:EDOSAT]2.0.CO;2, 1945. a
Houle, M. E., Kriegel, H.-P., Kröger, P., Schubert, E., and Zimek, A.: Can Shared-Neighbor Distances Defeat the Curse of Dimensionality?, in: Scientific and Statistical Database Management, 482–500, Springer, Berlin, Germany, https://doi.org/10.1007/978-3-642-13818-8_34, 2010. a
Hubbard, S. S., Varadharajan, C., Wu, Y., Wainwright, H., and Dwivedi, D.: Emerging technologies and radical collaboration to advance predictive understanding of watershed hydrobiogeochemistry, Hydrol. Process., 34, 3175–3182, https://doi.org/10.1002/hyp.13807, 2020. a
Jeong, H., Mason, S. P., Barabási, A.-L., and Oltvai, Z. N.: Lethality and centrality in protein networks, Nature, 411, 41–42, https://doi.org/10.1038/35075138, 2001. a
Köppen, W.: Klassifikation der klimate nach Temperatur, Niederschlag und Yahreslauf, Pet. Mitt., 64, 193–203, 1918. a
Krakovská, A., Mezeiová, K., and Budáčová, H.: Use of False Nearest Neighbours for Selecting Variables and Embedding Parameters for State Space Reconstruction, Journal of Complex Systems, 2015, 932750, https://doi.org/10.1155/2015/932750, 2015. a, b
Kratzert, F., Nearing, G., Addor, N., Erickson, T., Gauch, M., Gilon, O., Gudmundsson, L., Hassidim, A., Klotz, D., Nevo, S., Shalev, G., and Matias, Y.: Caravan – A global community dataset for large-sample hydrology, Sci. Data, 10, 61, https://doi.org/10.1038/s41597-023-01975-w, 2023. a
Kruskal, W. H. and Wallis, W. A.: Use of ranks in one-criterion variance analysis, J. Am. Stat. Assoc., 47, 583–621, https://doi.org/10.2307/2280779, 1952. a
Kumar, J., Mills, R. T., Hoffman, F. M., and Hargrove, W. W.: Parallel k-Means Clustering for Quantitative Ecoregion Delineation Using Large Data Sets, Procedia Comput. Sci., 4, 1602–1611, https://doi.org/10.1016/j.procs.2011.04.173, 2011. a
Langbein, W. B.: Topographic characteristics of drainage basins, Water Supply Paper, 125–157, https://doi.org/10.3133/wsp968C, 1947. a
MacQueen, J.: Some methods for classification and analysis of multivariate observations, in: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Statistics, vol. 5.1, pp. 281–298, University of California Press, Ewing, NJ, USA, https://projecteuclid.org/ebooks/berkeley-symposium-on-mathematical-statistics-and-probability/Some-methods-for-classification-and-analysis-of-multivariate-observations/chapter/Some-methods-for-classification-and-analysis-of-multivariate-observations/bsmsp/1200512992 (last access: 4 March 2024), 1967. a, b
McDonnell, J. J. and Woods, R.: On the need for catchment classification, J. Hydrol., 299, 2–3, https://doi.org/10.1016/j.jhydrol.2004.09.003, 2004. a
McDonnell, J. J., Sivapalan, M., Vaché, K., Dunn, S., Grant, G., Haggerty, R., Hinz, C., Hooper, R., Kirchner, J., Roderick, M. L., Selker, J., and Weiler, M.: Moving beyond heterogeneity and process complexity: A new vision for watershed hydrology, Water Resour. Res., 43, W07301, https://doi.org/10.1029/2006WR005467, 2007. a
McMillan, H.: Linking hydrologic signatures to hydrologic processes: A review, Hydrol. Processes, 34, 1393–1409, https://doi.org/10.1002/hyp.13632, 2020. a
McMillan, H. K., Gnann, S. J., and Araki, R.: Large Scale Evaluation of Relationships Between Hydrologic Signatures and Processes, Water Resour. Res., 58, e2021WR031 751, https://doi.org/10.1029/2021WR031751, 2022. a
Merz, R. and Blöschl, G.: Regionalisation of catchment model parameters, J. Hydrol., 287, 95–123, https://doi.org/10.1016/j.jhydrol.2003.09.028, 2004. a
Müllner, D.: Modern hierarchical, agglomerative clustering algorithms, arXiv, https://doi.org/10.48550/arXiv.1109.2378, 2011. a
Newman, M.: Networks, Oxford University Press, Oxford, England, UK, https://global.oup.com/academic/product/networks-9780198805090 (last access: 4 March 2024), 2018. a, b, c
Newman, M. E.: Power laws, Pareto distributions and Zipf's law, Contemp. Phys., 46, 323–351, https://doi.org/10.1080/00107510500052444, 2005. a
Olden, J. D. and Poff, N. L.: Redundancy and the choice of hydrologic indices for characterizing streamflow regimes, River Res. Appl., 19, 101–121, https://doi.org/10.1002/rra.700, 2003. a, b, c, d
Ombadi, M. and Varadharajan, C.: Urbanization and aridity mediate distinct salinity response to floods in rivers and streams across the contiguous United States, Water Research, 220, 118664, https://doi.org/10.1016/j.watres.2022.118664, 2022. a
Pearson, K.: Note on Regression and Inheritance in the Case of Two Parents, Proceedings of the Royal Society of London Series I, 58, 240–242, 1895. a
Pearson, K.: LIII. On lines and planes of closest fit to systems of points in space, The London, Edinburgh, and Dublin philosophical magazine and journal of science, 2, 559–572, https://doi.org/10.1080/14786440109462720, 1901. a
Redner, S.: A Guide to First-Passage Processes, Cambridge University Press, Cambridge, England, UK, https://doi.org/10.1017/CBO9780511606014, 2001. a
Rinaldo, A., Banavar, J. R., and Maritan, A.: Trees, networks, and hydrology, Water Resour. Res., 42, W06D07, https://doi.org/10.1029/2005WR004108, 2006. a
Rodríguez-Iturbe, I. and Rinaldo, A.: Fractal River Basins, Cambridge University Press, Cambridge, England, UK, https://www.cambridge.org/us/universitypress/subjects/earth-and-environmental-science/hydrology-hydrogeology-and-water-resources/fractal-river-basins-chance-and-self-organization?format=PB&isbn=9780521004053 (last access: 4 March 2024), 2001. a
Rosvall, M. and Bergstrom, C. T.: Maps of random walks on complex networks reveal community structure, P. Natl. Acad. Sci. USA, 105, 1118–1123, https://doi.org/10.1073/pnas.0706851105, 2008. a, b
Rosvall, M., Axelsson, D., and Bergstrom, C. T.: The map equation, Eur. Phys. J. Spec. Top., 178, 13–23, https://doi.org/10.1140/epjst/e2010-01179-1, 2009. a, b
Rousseeuw, P. J.: Silhouettes: A graphical aid to the interpretation and validation of cluster analysis, J. Comput. Appl. Math., 20, 53–65, https://doi.org/10.1016/0377-0427(87)90125-7, 1987. a
Salton, G.: Introduction to modern information retrieval, McGraw-Hill, 1983. a
Sawicz, K., Wagener, T., Sivapalan, M., Troch, P. A., and Carrillo, G.: Catchment classification: empirical analysis of hydrologic similarity based on catchment function in the eastern USA, Hydrol. Earth Syst. Sci., 15, 2895–2911, https://doi.org/10.5194/hess-15-2895-2011, 2011. a
Scott, J. and Carrington, P. J.: The Sage Handbook of Social Network Analysis, SAGE Publications Inc, Thousand Oaks, CA, USA, https://us.sagepub.com/en-us/nam/the-sage-handbook-of-social-network-analysis/book277881 (last access: 4 March 2024), 2023. a, b
Seaber, P. R., Kapinos, F. P., and Knapp, G. L.: Hydrologic unit maps, U.S. G.P.O., https://doi.org/10.3133/wsp2294, 1987. a
Serrano, M. Á, Boguñá, M., and Vespignani, A.: Extracting the multiscale backbone of complex weighted networks, P. Natl. Acad. Sci. USA, 106, 6483–6488, https://doi.org/10.1073/pnas.0808904106, 2009. a
Shapiro, S. S. and Wilk, M. B.: An analysis of variance test for normality (complete samples), Biometrika, 52, 591–611, https://doi.org/10.2307/2333709, 1965. a
Sivakumar, B.: Networks: a generic theory for hydrology?, Stochastic Environ. Res. Risk Assess., 29, 761–771, https://doi.org/10.1007/s00477-014-0902-7, 2015. a
Sivakumar, B., Singh, V. P., Berndtsson, R., and Khan, S. K.: Catchment Classification Framework in Hydrology: Challenges and Directions, J. Hydrol. Eng., 20, A4014002, https://doi.org/10.1061/(ASCE)HE.1943-5584.0000837, 2015. a, b
Sivapalan, M.: Pattern, Process and Function: Elements of a Unified Theory of Hydrology at the Catchment Scale, chap. 13, John Wiley & Sons, Ltd, https://doi.org/10.1002/0470848944.hsa012, 2006. a
Sokal, R. R.: Classification: Purposes, Principles, Progress, Prospects, Science, 185, 1115–1123, https://doi.org/10.1126/science.185.4157.1115, 1974. a
Spearman, C.: The Proof and Measurement of Association between Two Things, Am. J. Psychol., 100, 441–471, https://www.jstor.org/stable/1422689 (last access: 25 December 2023), 1987. a
Strahler, A. N.: Hypsometric (Area-Altitude) Analysis of Erosional Topography, GSA Bulletin, 63, 1117–1142, https://doi.org/10.1130/0016-7606(1952)63[1117:HAAOET]2.0.CO;2, 1952. a
Strogatz, S. H.: Exploring complex networks, Nature, 410, 268–276, https://doi.org/10.1038/35065725, 2001. a, b
Tejedor, A., Longjas, A., Edmonds, D. A., Zaliapin, I., Georgiou, T. T., Rinaldo, A., and Foufoula-Georgiou, E.: Entropy and optimality in river deltas, P. Natl. Acad. Sci. USA, 114, 11651–11656, https://doi.org/10.1073/pnas.1708404114, 2017. a
Tejedor, A., Longjas, A., Passalacqua, P., Moreno, Y., and Foufoula-Georgiou, E.: Multiplex Networks: A Framework for Studying Multiprocess Multiscale Connectivity Via Coupled-Network Theory With an Application to River Deltas, Geophys. Res. Lett., 45, 9681–9689, https://doi.org/10.1029/2018GL078355, 2018. a
Thibault, H.: eflowcalc: a streamflow characteristics calculator in Python, Zenodo [code], https://doi.org/10.5281/zenodo.4721439, 2021. a
Tobler, W. R.: A computer movie simulating urban growth in the Detroit region, Econ. Geogr., 46, 234–240, https://doi.org/10.2307/143141, 1970. a
Troch, P. A., Lahmers, T., Meira, A., Mukherjee, R., Pedersen, J. W., Roy, T., and Valdés-Pineda, R.: Catchment coevolution: A useful framework for improving predictions of hydrological change?, Water Resour. Res., 51, 4903–4922, https://doi.org/10.1002/2015WR017032, 2015. a
USGS: U.S. Geological Survey, National Water Information System data available on the World Wide Web (Water Data for the Nation), http://waterdata.usgs.gov/nwis/ (last access: 1 September 2022), 2022. a, b
Varadharajan, C., Hendrix, V. C., Christianson, D. S., Burrus, M., Wong, C., Hubbard, S. S., and Agarwal, D. A.: BASIN-3D: A brokering framework to integrate diverse environmental data, Comput. Geosci., 159, 105024, https://doi.org/10.1016/j.cageo.2021.105024, 2022. a
Wagener, T., Sivapalan, M., Troch, P., and Woods, R.: Catchment Classification and Hydrologic Similarity, Geography Compass, 1, 901–931, https://doi.org/10.1111/j.1749-8198.2007.00039.x, 2007. a, b
Wainwright, H. M., Uhlemann, S., Franklin, M., Falco, N., Bouskill, N. J., Newcomer, M. E., Dafflon, B., Siirila-Woodburn, E. R., Minsley, B. J., Williams, K. H., and Hubbard, S. S.: Watershed zonation through hillslope clustering for tractably quantifying above- and below-ground watershed heterogeneity and functions, Hydrol. Earth Syst. Sci., 26, 429–444, https://doi.org/10.5194/hess-26-429-2022, 2022. a
Ward, Jr., J. H.: Hierarchical Grouping to Optimize an Objective Function, J. Am. Stat. Assoc., 58, 236–244, https://doi.org/10.2307/2282967, 1963. a
Wasserman, S. and Faust, K.: Social Network Analysis: Methods and Applications, Cambridge Core, https://doi.org/10.1017/CBO9780511815478, 1994. a, b
Wolock, D. M. and McCabe, G. J.: Estimates of runoff using water-balance and atmospheric general circulation models, JAWRA Journal of the American Water Resources Association, 35, 1341–1350, 1999. a
- Abstract
- Introduction
- Methods
- Results
- Discussion
- Conclusions
- Appendix A: Data preprocessing
- Appendix B: Cao's method
- Appendix C: Cosine similarity
- Appendix D: Brief introduction to networks
- Appendix E: Clustering coefficient
- Appendix F: Trait network cluster composition
- Appendix G: Hydrological index statistics
- Appendix H: Comparison with traditional unsupervised techniques
- Appendix I: Hydrological index correlation with traits
- Code and data availability
- Author contributions
- Competing interests
- Disclaimer
- Acknowledgements
- Financial support
- Review statement
- References
- Abstract
- Introduction
- Methods
- Results
- Discussion
- Conclusions
- Appendix A: Data preprocessing
- Appendix B: Cao's method
- Appendix C: Cosine similarity
- Appendix D: Brief introduction to networks
- Appendix E: Clustering coefficient
- Appendix F: Trait network cluster composition
- Appendix G: Hydrological index statistics
- Appendix H: Comparison with traditional unsupervised techniques
- Appendix I: Hydrological index correlation with traits
- Code and data availability
- Author contributions
- Competing interests
- Disclaimer
- Acknowledgements
- Financial support
- Review statement
- References