Next Article in Journal
Bio-Based Decontamination and Detoxification of Total Petroleum Hydrocarbon-Contaminated Dredged Sediments: Perspectives to Produce Constructed Technosols in the Frame of the Circular Economy
Previous Article in Journal
Spatiotemporal Variations in Actual Evapotranspiration Based on LPJ Model and Its Driving Mechanism in the Three Gorges Reservoir Area
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Improved Deep Learning Predictions for Chlorophyll Fluorescence Based on Decomposition Algorithms: The Importance of Data Preprocessing

1
School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
2
Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China
3
School of Artificial Intelligence, Chongqing University of Education, Chongqing 400065, China
4
Dianchi Lake Ecosystem Observation and Research Station of Yunnan Province, Kunming Dianchi and Plateau Lakes Institute, Kunming 650228, China
5
Chongqing Eco-Environmental Monitoring Center, Chongqing 401147, China
*
Authors to whom correspondence should be addressed.
Water 2023, 15(23), 4104; https://doi.org/10.3390/w15234104
Submission received: 28 October 2023 / Revised: 16 November 2023 / Accepted: 20 November 2023 / Published: 27 November 2023

Abstract

:
Harmful algal blooms (HABs) have been deteriorating global water bodies, and the accurate prediction of algal dynamics using the modelling method is a challenging research area. High-frequency monitoring and deep learning technology have opened up new horizons for HAB forecasting. However, the non-stationary and stochastic process behind algal dynamics monitoring largely limits the prediction performance and the early warning of algal booms. Through an analysis of the published literature, we found that decomposition methods are widely used in time-series analysis for hydrological processes. Predictions of ecological indicators have received less attention due to their inherent fluctuations. This study explores and demonstrates the predictive enhancement for chlorophyll fluorescence data based on the coupling of three decomposition algorithms with conventional deep learning models: the convolutional neural network (CNN) and long short-term memory (LSTM). We found that the decomposition algorithms can successfully capture the time-series patterns of chlorophyll fluorescence concentrations. The results indicate that decomposition-based models can enhance the accuracy of single models in predicting chlorophyll concentrations in terms of the improvement percentages in RMSE (with increases ranging from 25.7% to 71.3%), MAE (ranging from 28.3% to 75.7%), and R2 values (increasing ranging from 14.8% to 34.8%). In addition, the comparison experiment for different decomposition methods might suggest the superiority of singular spectral analysis in hourly predictive tasks of chlorophyll fluorescence over the wavelet transform and empirical mode decomposition models. Overall, while decomposition methods come with their respective strengths and weaknesses, they are undeniably efficient in combination with deep learning models in dealing with the high-frequency monitoring of chlorophyll fluorescence data. We also suggest that model developers pay more attention to online data preprocessing and conduct comparative analyses to determine the best model combinations for forecasting algal blooms and water management.

1. Introduction

Harmful algal blooms (HABs) have become a worldwide severe environmental problem by releasing excess toxins, which can have detrimental effects on aquatic ecosystems and endanger human health [1]. The timely and high-accuracy prediction of HAB occurrence and intensity is essential in controlling their detrimental environmental and public health effects [2]. Continuous and high-frequency monitoring technologies are widely applied in HAB monitoring. For instance, flow cytometry analysis [3], hyperspectral imagery [4] and unmanned aerial vehicles [5] could monitor the real-time distribution of HABs. In particular, chlorophyll-a (Chla) is a crucial parameter for characterizing phytoplankton communities, making it a commonly employed diagnostic pigment in measurements [2]. Chlorophyll fluorescence sensors can provide fast, cost-effective, and highly temporal revolution data to train the advanced models for HAB predictions [6]. However, high-resolution time-series data often exhibit stochastic non-stationarity distributions, owing to environmental drivers interactively influencing the formation of HABs [7]. Therefore, additional modelling efforts are required to overcome the challenges associated with HAB forecasting.
In recent years, data-driven models have gained wider usage for forecasting algal blooms in inland water [8]. Machine learning algorithms, including neural networks [9], evolutionary computation [10], support vector machines (SVMs) [11], random forests [12], and gradient boost machines [13], are well-known to be helpful in predicting HABs. Consequently, the non-linearity and intermittency process behind the algal monitoring data hinders the performance of machine learning in the accurate forecasting of early-stage blooms [14]. With evolving artificial intelligence, deep learning (DL) models have received increasing attention in HAB forecasts [15]. For instance, the independent recurrent neural network (RNN) [16], long short-term memory (LSTM) [17], and gated recurrent unit (GRU) [18] have been increasingly used to forecast HABs [19,20]. Some researchers have also demonstrated the effectiveness of image-based convolutional neural networks (CNNs) in modelling HABs [21,22]. Nonetheless, deep learning requires large-scale monitoring to train models. In fact, the online monitoring of HAB sensors often contains abnormal values, peak values, and error components with irregular random movements, causing inherently non-linear, complex, and non-stationary algal sequence time series [23]. Therefore, pure data-driven methodologies prove unsatisfactory in addressing the high variations in algal dynamics [24]. In this case, choosing an appropriate data preprocessing procedure might be essential to increase the forecasting accuracy of the predictive algal parameters [25,26].
The decomposition-based frameworks have been demonstrated to extract the dynamic features of time-series data and enhance models’ predictive performance in an increasing number of studies [27]. In contrast to conventional time-series models, the decomposition-based frameworks divide the time series into components of varying frequencies, predicting each component individually with deep learning models, and summing them to obtain the predicted results. From the perspectives of decomposition algorithms, the wavelet transform (WT) and empirical mode decomposition (EMD) methods are two of the most commonly used decomposition methods [28]. For example, Liu et al. [26] proposed a hybrid prediction model combining WT and LSTM, which decomposes the original algal parameters series into multiple sub-series using wavelet transform, and then employs LSTM on the sub-series components. Zhu et al. [29] reported the hybrid EMD-LSTM with the attention mechanism model and indicated that empirical mode decomposition (EMD) can effectively enhance the smoothness of the time series and increase predictive accuracy. In addition, Luo et al. [30] develop an improved empirical mode decomposition model (EEMD)–LSTM prediction model to predict water quality. Apaydin et al. [31] investigate the singular spectral analysis (SSA) with LSTM to increase the monthly streamflow prediction accuracy. Following that, integrated SSA and genetic-based models have been developed for river flow forecasting and showed improved accuracy [32]. To date, no reported study has compared the difference in employing these above-mentioned decomposition-based methods in dealing with high-frequency water-quality data, especially for chlorophyll fluorescence monitoring.
In this study, we evaluate and compare the performance of different hybrid approaches that couple WT, EEMD, and SSA decomposition for extracting the sub-series component of Chla data, along with the deep learning approaches for predicting HABs. The Chla is obtained from a substantial volume of in situ multi-sensor monitoring data in Lake Dianchi, China. Specifically, the goals of this paper are as follows: (1) to obtain better prediction performance of the Chla fluorescence by combining the WT, EEMD, and SSA decomposition approaches; (2) to develop decomposition-based hybrid models and evaluate the prediction effectiveness of the models; and (3) to further compare the prediction performance of different decomposition approaches for chlorophyll fluorescence forecasting. This study demonstrates that the decomposition-based Chla prediction methods could function as a robust and trustworthy tool for forecasting HABs in water management.

2. Materials and Methods

2.1. Study Sites and Data

The study area is located in Lake Danchi (24°40′–25°02′ N, 102°36′–102°47′ E), Kunming, Yunnan, in southwest China (Figure 1). Lake Danchi is a famous plateau freshwater lake with a surface area of 330 km2, and the average depth measures 4.4 m, with a maximum water depth reaching 6.7 m and a watershed area spanning 2920 km2 [33]. Additionally, an artificial causeway, Haigeng Dam, divides the lake into two parts—Caohai in the north and Waihai in the south—covering 286.78 km2 [34]. Over recent decades, this eutrophic lake has frequently experienced intense HABs and has gradually developed to have some of the heaviest cyanobacterial blooms in Chinese lakes [35]. Due to the low water flow and high pollutant concentration, cyanobacterial blooms are a frequent occurrence in Caohai, which is located closer to the urban area. This study collected the average values of the Chla data of the Duanqiao and Caohai center sampling sites through continuous monitoring every four hours from 1 February 2019 to 8 January 2021 (Table 1). The two online monitoring sites in Caohai, Dianchi Lake, belong to the sections managed by Kunming Municipal Environmental Monitoring Center, Yunnan, China. The first 50% of the sequence (February 2019–January 2020) was used to train the hybrid models. The remaining data (January 2020–January 2021) were eventually used to test the model performance.

2.2. Decomposition-Based Deep Learning Model Development

In this section, we present the multi-decomposition architecture (Section 2.2.1) and introduce the wavelet transformation analysis (Section 2.2.2), ensemble empirical mode decomposition (Section 2.2.3), and singular spectral analysis (Section 2.2.4). We further illustrate convolutional neural networks (Section 2.2.5) and LSTM (Section 2.2.6).

2.2.1. The Multi-Decomposition Architecture

This study established and compared the performance of three decomposition-based models in forecasting the Chla in the Caohai center and Duanqiao sites of Lake Dianchi. A technical flowchart of this study is presented in Figure 2. Firstly, the original series data of the Chla were decomposed into sub-series based on the multi-decomposition process. Then, the sub-sequences were input into deep learning models to be trained and validated one by one. Finally, all the individual forecasted sub-series were summed to derive the predicted results of the sequence of Chla.

2.2.2. Wavelet Transformation Analysis

The wavelet transformation analysis method (WT) is a useful mathematical tool of signal analysis theory in physics and engineering [36,37]. By decomposing the original signal into several sub-components at different time frequency spaces, the WT can analyze non-stationary data and effectively extract time frequency features of the original time series simultaneously. The sub-sequences are typically derived from a template referred to as the “mother wavelet”, and these deconstructed wavelets are scaled and translated based on the mother wavelet. The advantage of wavelet analysis lies in its capacity for the adaptable selection of the mother wavelet to match the specific characteristics of the investigated time series. However, determining scale and translation parameters for every possible position necessitates significant computational effort when utilizing a continuous wavelet transformation (CWT).
In contrast, the discrete wavelet transformation (DWT) substantially alleviates the computational complexities associated with wavelet transformations by adopting dyadic scales and positions, typically based on powers of two [26]. The DWT of a time series, f(t), is typically carried out as follows:
W f ( a , b ) = a , b Z f ( t ) Ψ * a , b ( t )
Ψ * a , b ( t ) = m 0 a 2 Ψ ( m 0 a t n 0 b ) , m 0 > 1 , n 0 > 0
where the integers a and b represent the decomposition level and translation factor, respectively; the constant m0 is decomposition scale factor; the constant n0 is the position factor of translation; Ψ * a , b ( t ) is the wavelet function; Ψ ( t ) is the mother wavelet that can be set as the “Daubechies”, “Haar”, and “Morlet” wavelets; and W f ( a , b ) are the DWT coefficients. The discrete wavelet transformation (DWT) employs high-pass and low-pass filters to decompose the original time series, f(t), into different resolution levels, yielding a low-frequency approximation sub-sequence (An) and a high-frequency sub-sequence (D1, D2, …, Dn), and finally obtaining detailed coefficients and approximation sub-time series.

2.2.3. Ensemble Empirical Mode Decomposition (EEMD)

Empirical mode decomposition (EMD) is a noise-reduction, signal-adaptive decomposition algorithm for non-linear and non-stationary data [38]. The original time series can be decomposed into finite modal components and intrinsic mode functions (IMFs) that contain only a single instantaneous frequency, and residual (Res) [39]. Nonetheless, the noise of signal may result in mode aliasing within the IMFs, consequently generating inaccurate time frequency distributions and diminishing the interpretability of the IMFs. To mitigate the adverse impact of noise during the decomposition process, Zhaohua and Norden (2009) [40] propose ensemble empirical mode decomposition (EEMD), a data analysis approach that incorporates white noise into the original time series. The detailed process of EEMD is as follows:
Given an original series, denoted as f(t), the detailed process of EEMD is described below:
(1)
Add random white noise to the original time series, n i ( t ) ( 0 , σ 2 ) , where σ is known.
f i ( t ) = f ( t ) + n i ( t )
where i denotes the count of white noise additions.
(2)
The EMD algorithm is employed to decompose the composited sequences ,   f i ( t ) , with noise into I M F s i j ( t ) , (j = 1, 2, …, K), and the residual, R e s i ( t ) .
f i ( t ) = j = 1 K I M F s i j ( t ) + R e s i ( t )
where   I M F s i j ( t )   indicates the j-th IMF component of derived from the decomposition of the i-th mixed original series.
(3)
Repeat the steps described above N times, each time using different Gaussian white noise, and determine the corresponding IMFs.
(4)
Repeat the aforementioned procedure N times, introducing different Gaussian white noise in each iteration, and obtain each corresponding IMF. Compute the average of the sum of the corresponding decomposed IMFs over N iterations to mitigate the impact of the introduced white noise on the original signal. The j-th IMF component is as follows:
a v r ( f j ( t ) ) = 1 N j = 1 K I M F s i j ( t )
(5)
Finally, the original series, f(t), are decomposed by EEMD models, which can be expressed as follows:
f ( t ) = j = 1 K a v r ( f j ( t ) ) + R e s i ( t ) = 1 N j = 1 K I M F s i j ( t ) + R e s i ( t )
where i = 1, 2, …, N.

2.2.4. Singular Spectral Analysis

Singular spectral analysis (SSA) is a non-parametric method for estimating the spectral characteristics of time series data, aimed at discerning distinct patterns of variability [41]. The fundamental framework of SSA encompasses data embedding, singular value decomposition (SVD), eigentriple grouping, and diagonal averaging.
Embedding can be viewed as a transformation that converts a one-dimensional time series into a trajectory matrix using the selected window length (L), upon which SVD is performed. The window length is the time step by which the data is further divided to extract components. The final product of singular value decomposition is feature triples, the count of which matches the chosen window length. Consider Y N = ( y 1 , y 2 , , y N ) , which is not a series with all zeros; let “X” be the trajectory matrix, which can be expressed as
X = ( y 1 y 2 y 3 y K y 2 y 3 y 4 y K + 1 y 3 y 4 y 5 y K + 2 y L y L + 1 y L + 2 y N )
where K = NL + 1. Note that the resulting trajectory matrix is a Hankel matrix, implying that all elements along the diagonal, where i + j is a constant, are equivalent.
Secondly, singular value decomposition is applied to the trajectory matrix, X. Let S = XXT, λ1, λ2, …, λL is the eigenvalue of S sorted in descending order (λ1 …λL 0), and U 1 , U L are the standard orthonormal vectors of the matrix S corresponding to these eigenvalues. Let d = rank(X) = max{i, λi > 0} (in practical sequences, usually d = L*, L* = min(L, K)). Then, the SVD of the trajectory matrix can be written as X = X1 + … + Xd, where X i = δ i U i V i T .
In the grouping step, we can choose to analyze the periodogram, right eigenvector scatter plot, or eigenvalue function plot to distinguish between noise and signal. In the process of reconstructing the signal, there are no specific rules for the way of grouping. The set of subscripts {1, …, d} can be divided into m disjoint subsets according to the properties of the time series to be reconstructed, i.e., I1, I2, …, Im. If I = {i1, …, ip}, then the composite matrix corresponds to X = X I 1 + X I 2 + + X I M . The final step of SSA involves transforming each resulting matrix from the grouping into a new sequence of length N. Let T be a L × K matrix with elements tij, 1 ≤ iL, 1 ≤ jK. Set L* = min {L, K}, K* = max {L, K}, and N = L + K − 1. Let tij* = tij if L < K, and tij* = tji otherwise. Through the process of diagonal averaging, matrix T is transformed into a series t1, t2, …, tN using the following formula:
t k = { 1 k m = 1 k t * m , k m + 1 ,     1 k < L * 1 L * m = 1 L * t * m , k m + 1 ,     L * k < K * 1 N k + 1 m = k K * + 1 N K * + 1 t * m , k m + 1 ,     K * k < N
A single RCt sub-sequence of length N can be obtained according to the formula. The new X component is the sum of d RCt components and can be expressed as X * = RC 1 + RC 2 + + RC d .

2.2.5. Convolutional Neural Network

One-dimensional convolution (1D-CNN) can be executed by employing a filter that is specialized for handling sequential data, allowing for the extraction of sequence features as the network slides over the data using convolution kernels. A standard 1D-CNN typically comprises an input layer, multiple interleaved convolutional and pooling layers, a fully connected layer, and an output layer, as illustrated in Figure 3. The convolutional and pooling layers are distinctive components of the convolutional neural network. With a single-layer 1D-CNN, the output vector Y : [ y 1 , , y j , , y m n + 1 t ] is obtained as follows:
y j = { i = 1 b I j + i 1 k i ,     j = 1 i = 1 b I j + i + τ 2 k i ,       1 < j a b + 1 t
where I:[I1, …, Ii, …, Ia] is an input vector with the size of a, t is the stride, and b stands for the size of the convolution kernel, k. After y1 is obtained according Equation (3), the calculation window slides back to It+1 to calculate. This process is repeated until there are no remaining data from the input.

2.2.6. Long Short-Term Memory

The LSTM network is variant of a recurrent neural network (RNN) model and is improved on the basis of recurrent neural networks to make it have a long short-term memory function. The LSTM effectively captures long-range dependencies, addressing the problems of gradients exploding and vanishing during backpropagation that are common in traditional RNNs [17]. Each LSTM block consists of a memory cell and three parts: the input gate, forget gate, and output gate (Figure 4). The manner in which information from the previous layer is passed to the current layer is determined by each gate selectively. The memory cell acts as an accumulator of state information, preserving the hidden details of the time series. This allows the LSTM to leverage long-term historical context. The specific content is as follows: In LSTM, the forgetting gate first determines the retention of the state at the previous moment, and the calculation formula is
f t = σ   ( W f · [ h t 1 ,   x t ] + b f )
In this formula,   σ is the activation function Sigmoid,   W f   represents the weights of forgotten gate weights, and   b f represents the bias of the forget gate. The Sigmoid function maps the input and the state of the previous moment to a value from 0 to 1. The value of f t is 1 to indicate full retention and 0 to signify complete discarding. The input gate determines the extent to which the current network input, denoted as   x t , is incorporated into the cell state   C t .
i t = σ   ( W i · [ h t 1 ,   x t ] + b i )
C ˜ t = t a n h ( W c · [ h t 1 ,   x t ] + b c )
C t = f t × C t 1 + i t × C ˜ t
W i and b i are the weights and bias of the input gate;   W c and b c represent the weight and bias when constructing the candidate vector, determining the proportion of forgetting by the sigmoid function. C t of Equation (13) implements the cell state update at moment t. The output gate needs to determine the output value with the following formula:
o t = σ   ( W o · [ h t 1 ,   x t ] + b o )
h t = o t · tanh ( C t )
where W o and b o are the weights and bias of the output gate. The current state, C t , is multiplied by the output,   o t , of the activation function layer after tanh to obtain the output, h t , at the current moment.

2.3. Model Implementation

In this study, decomposition-based hybrid models are employed for predicting the concentration of Chla in Dianchi Lake. To appropriately train the deep learning predicting models, we split the modeling procedure into training and testing. In the training part, the first 50% of the decomposed sequence (February 2019–January 2020) are input to build the network. In the testing part, the remaining data (January 2020–January 2021) are accustomed to estimate the model performance. Based on the training data, to prevent the influence of varying scales on parameter learning, Chla concentrations are normalized to a range from 0 to 1 using min–max normalization. Furthermore, we utilize the mean square error (MSE) as the loss function and implement the adaptive momentum estimation method (Adam) to optimize the weights. We implemented our deep learning network on the Keras development platform. In this study, the Daubechies-4 (db4) mother wavelet was utilized to perform a three-level decomposition of the original time series, a choice popular for its widespread acceptance and efficient performance [26]. The ensemble number of the EEMD model was set to 100, and the standard deviation of Gaussian white noise, n i ( t ) , was 0.05 [30]. We set the window length of the SSA to 15 according to the empirical evaluation of component contributions in the experiment. The WT, EEMD, and SSA were carried out using the MATLAB R2019b software. For the purpose of conducting an equitable comparative analysis across various decomposition methodologies, the parameters for the CNN and LSTM are presented in Table 2.

2.4. Evaluation Metrics

To comprehensively measure the prediction performance of the decomposed-base hybrid deep learning models, three different criteria are used, including the RMSE (root mean square error), mean absolute error (MAE), and the coefficient of determination (R2). The formulas for calculating these indicators are as follows:
R M S E = 1 n i = 1 n ( y i y ^ i ) 2
M A E = 1 n i = 1 n | y i y ^ i |
R 2 = 1 i = 1 n ( y i y ^ i ) 2 i = 1 n ( y i y ¯ ) 2
where n represents the number of observed data in the test data; y i   and y ^ i denote the observed algal parameter values and predicted algal parameter values, respectively. Also, y ¯   displays the mean observed values.
Moreover, the improvement percentage is introduced to facilitate quantitative comparisons between the decomposition-base hybrid deep learning model and single models. The improvement percentage for the RMSE, MAE, and R2 are calculated as follows:
P R M S E = R M S E 1 R M S E 2 R M S E 1 × 100 %
P M A E = M A E 1 M A E 2 M A E 1 × 100 %
P R 2 = R 2 1 R 2 2 R 2 1 × 100 %
where RMSE1 and MAE1 denote the errors of the single models, and RMSE2 and MAE2 represent the errors of the decomposition-based models. R21 and R22 denote the errors of the decomposition-based and single models, respectively. A substantial positive value indicates superior accuracy of the decomposition-based models compared to the single models.

3. Results and Discussion

Firstly, we present the decomposition results of the WT, EEMD, and SSA models. Secondly, we present and discuss the Chla concentration forecasting enhancement by the hybrid WT-CNN, EEMD-CNN, SSA-CNN, WT-LSTM, EEMD-LSTM, and SSA-LSTM models compared to the independent CNN and LSTM models. Then, we compare the performance among those hybrid deep learning models. Finally, we also assess the strengths and limitations of these decomposition techniques in algal parameter prediction.

3.1. The Process of Different Decomposition-Based Algorithms for Chlorophyll Fluorescence Data

Due to the intricate non-stationary nature of algal parameter series, the appropriate decomposition of the original data plays an important role in improving forecasting accuracy. After data preprocessing, the Chla concentration algal parameters were decomposed using the WT, EEMD, and SSA methods. The decomposition results of the algal parameters at the Duanqiao and Caohai center sites are shown in Figure 5. In detail, the wavelet decomposition of the hourly original chlorophyll series effectively generated an approximation low-frequency coefficient (A3) and three detailed high-frequency coefficients (D1–D3) at the Duanqiao and Caohai center sites, as depicted in Figure 5a,b. Compared to the original time series, the sub-series A3 extracted the hourly algal series trend and major peaks, while sub-series levels D1 to D3 captured more subtle and fluctuation components simultaneously.
The EEMD results of the algal parameters are shown in Figure 5c,d. The hourly original chlorophyll series were decomposed into four volatility characteristic IMFs with different frequencies and one residual component. Figure 5c,d show IMFs from high frequency to low frequency, the residue, and the original algal series sequentially from top to bottom. Intuitively, it is clear that the EEMD captures the trend of chlorophyll series and volatility characteristics exactly. Furthermore, the SSA decomposed the algal series into 15 components (Figure 5e,f) with a window length setting to 15. The RC1–RC6 components, with a contribution rate of 97.50%, were reconstructed into the main trend terms. The RC7–RC13 sub-series was chosen as the fluctuation component, and RC14–RC15 was considered as the noise at the Duanqiao site. In comparison, the top six sub-series (i.e., RC1–RC6) with a contribution rate of 97.90% were chosen as the main trend components of algal parameters, and the remaining RC7–RC11 and RC11–RC15 components were considered as the volatility characteristics and noise into the subsequent model at the Caohai center site. The series of algal parameters exhibited more prominent trends after reconstruction, suggesting that SSA can effectively extract the trend, volatility, and noise components, capturing the primary features of the series.

3.2. Evaluating the Predictive Performance of Deep Learning Based on Multi-Decomposition Process

In this section, the CNN and LSTM predict each sub-series obtained through the multi-decomposition methods. We procure the final algal series’ predicted values by summing up the forecasting results of all the sub-components. To adequately assess the effectiveness of the hybrid deep learning models, we employ hybrid CNN and LSTM models based on multi-decomposition, including WT-CNN, EEMD-CNN, SSA-CNN, WT-LSTM, EEMD-LSTM, and SSA-LSTM. The detailed performance curves of the prediction and observed values in the train and test datasets are shown in Figure 6. From Figure 6, the fitting curve obtained by the SSA-based hybrid models (orange lines) closely approximates the observed values (blue lines), especially pronounced at peak locations. Therefore, it implies that the performance of SSA-based hybrid models are better than the performance of WT-based and EEMD-based hybrid models in algal sequence prediction. While individual CNN and LSTM models demonstrate the ability to forecast the Chla trends, significant errors exist between observed and predicted values. These models demonstrate inadequate prediction accuracy in capturing details and sharp peaks. The decomposition-based hybrid models can more accurately predict the detailed components and significantly enhance the model performance. All of this evidence convincingly indicates that the decomposition-based hybrid methods can reliably predict algal dynamics at different sampling sites.
The hybrid decomposition-based deep learning framework and commonly employed time series individual forecasting methods (CNN and LSTM) are also cross-compared based on the Caohai center and Duanqiao sites of Lake Dianchi (Figure 7). For the CNN model, the best predictions were achieved by the SSA-based hybrid model, resulting in highly satisfactory R2 values (R2 = 0.9652 and 0.9518), which represented a 32.16% increase for the Caohai center site and a 26.67% increase for the Duanqiao site (Figure 7a,b). When compared to the CNN, the prediction accuracy of WT-CNN and EEMD-CNN, as measured based on the evaluation indicators of R2, showed improvements of 28.02%, 24.99%, 19.18%, and 14.8% for the two sites, respectively. Furthermore, as for the LSTM approach, which is consistent with the CNN method, SSA-LSTM outperforms the single LSTM in terms of its R2 statistic (0. 978 vs. 0.738 in Caohai center, and 0.975 vs. 0. 723 in Duanqiao, respectively). Additionally, although the WT-LSTM models (R2 = 0.955, 0.944) perform better than EEMD-LSTM (R2 = 0.857, 0.881) at the two sites, they still exhibit a slightly lower performance compared to the SSA-LSTM approach. As for the CNN and LSTM approaches, all models demonstrated the lowest performance among the four cases examined (Figure 7), showing the limitation of single deep learning models in handling complicated and non-stationary forecasting tasks of algal dynamics.
Cross-comparisons between hybrid-based CNN or LSTM and single models show that the most significant improvement in forecasting HAB dynamics is achieved through decomposition-based hybrid approaches. These outcomes show that the hybrid deep learning algorithms based on multi-decomposition can decompose non-stationary time series into sub-sequences and better detect the main trend, volatility, and noise components of algal dynamics. In addition, sub-series are fed to the CNN and LSTM models one by one to improve HAB forecasting further. The hybrid models based on decomposition exhibit the ability to uncover the peak and extreme values of algal parameters, indicating the robust resilience and effective signal-smoothing capability of the preprocessing approach. This is in line with the previous study by Liu et al. [26], who demonstrated that the decomposition-based hybrid WT-LSTM model could enhance the fitting of abrupt or extreme data points and improve HAB prediction performance. Likewise, Luo et al. [30] developed a hybrid EEMD-LSTM model for predicting water quality, and the results demonstrated that the proposed model outperformed the individual LSTM model in various evaluation indicators. Cui et al. [42] also discovered that integrating SSA with a lightweight gradient-boosting machine in a hybrid model led to high-accuracy, real-time predictions of urban runoff. Interestingly, the advantages of hybrid models integrating LSTM over CNN-based models become apparent, indicating the benefits of automatically capturing long-temporal information through LSTM recurrent chains.

3.3. Comparing the Effectiveness of Different Decomposition Approaches in Forecasting HABs

To compare the prediction performance of different decomposition approaches, we combine common decomposition approaches—namely WT, EEMD, and SSA—with the CNN and LSTM forecasting techniques to forecast the algal series at two stations. The results are presented in Table 3 and Table 4. Firstly, when combined with the SSA decomposition, the hybrid-based LSTM and CNN prediction methods reach the lowest RMSE (1.518 μg/L, 1.927 μg/L, 1.092 μg/L and 1.513 μg/L) and MAE values (0.855 μg/L, 1.361 μg/L, 0.702 μg/L, 1.025 μg/L) and the biggest R2 (0.978, 0.965, 0.975, 0.952) at Caohai center and Duanqiao station, respectively. This verifies the superiority of the SSA decomposition method over other WT and EEMD methods. Secondly, the decomposition methods demonstrate enhanced effectiveness when combined with a more precise forecasting technique. In particular, LSTM can achieve significantly improved accuracy percentages through decomposition compared to the CNN. Specifically, WT decomposition increases the LSTM improvement percentages of the RMSE from 5.282 to 2.198 by 58.4%, the MAE from 3.525 to 1.405 by 60.1%, and the R2 from 0.738 to 0.955 by 29.3%; the CNN improvement percentages of RMSE increase from 5.364 to 2.635 by 50.9%, MAE from 3.538 to 1.742 by 50.8%, and the R2 from 0.730 to 0.935 by 28%. Similarly, the SSA decomposition method offers a greater performance enhancement for LSTM than the CNN model, while EEMD decomposition yields similar results for both models. Thirdly, employing the same WT and SSA decomposition techniques, LSTM typically outperforms the CNN regarding prediction accuracy, while for EEMD decomposition, LSTM is not always superior to the CNN.
Table 5 provides a concise comparison of the WT, EEMD, and SSA decomposition methods employed in this study. It is essential to note that each approach possesses its distinct strengths and limitations. Specifically, WT is commonly employed as a preprocessing method for predicting water levels [43], algal blooms [26], precipitation [44], rainfall runoff [45], and river flow [46]. WT is well suited for handling signals with a constant frequency and near periodicity, but requires presetting the basis function and their order, significantly impacting the decomposition results. The noise-assisted ensemble empirical mode decomposition (EEMD) method is utilized to address the issue of mode mixing and is capable of processing complex and non-stationary time series. EEMD has gained extensive adoption in enhancing the forecasting performance of precipitation [47], daily runoff [48], water levels [49], rainfall [50], streamflow [51], river flow [52], and water quality [30]. Singular spectral analysis (SSA) has found widespread applications in the preprocessing of hydrological data, including streamflow [31], rainfall [53], runoff [54], and rainfall runoff [42] prediction. Previous research has demonstrated that SSA can significantly enhance the prediction effectiveness of independent deep learning models, highlighting its potential to enhance forecasting accuracy. Diverse decomposition methods exhibit distinct applicability conditions. Consequently, selecting the appropriate decomposition methods based on different applicability ranges can provide a research example for the prediction of algal blooms. Despite the extensive research on decomposition-based hybrid deep learning models, some obstacles still demand additional consideration. Firstly, the decomposition process includes future unknown data, leading to information leakage. Secondly, the predictability of individual sub-series can vary, leading to differences in the weighting of prediction residuals among them. Thus, selecting suitable decomposition and prediction methods based on varying application scenarios is of significance in algal bloom forecasting, thereby contributing to the early warning and management of algal blooms.

4. Conclusions

To attain high-performance chlorophyll fluorescence forecasting results, hybrid chlorophyll prediction models coupling multi-decomposition methods were developed in this paper. Firstly, wavelet transform (WT), the empirical mode decomposition model (EEMD), and singular spectral analysis (SSA) are employed on time-series sequences of hourly chlorophyll data of Lake Dianchi to decompose original sequences into multiple sub-series, including high-frequency and low-frequency components simultaneously. Moreover, for individual forecasting, all sub-sequences are fed to deep learning models, namely a convolutional neural network (CNN) and long short-term memory (LSTM). Ultimately, the predicted chlorophyll values are obtained by summing up the results of the forecasting sub-series. The results illustrate that decomposition methods can precisely capture the trend, volatility, and noise of chlorophyll fluorescence, overcoming the shortcomings of the independent deep learning model in processing non-linear chlorophyll sequences. Furthermore, the chlorophyll prediction results from two test stations indicate that hybrid deep learning models based on decomposition achieve higher prediction accuracy than single approaches, with the improvement percentages of the RMSE increasing, ranging from 25.7% to 71.3%, with MAE improvements ranging from 28.3% to 75.7% and the R2 values increasing by 14.8% to 34.8%. In addition, the results of the comparative experiment involving various decomposition techniques substantiate SSA decomposition’s superiority over the commonly employed WT and EEMD methods for chlorophyll forecasting. In conclusion, the decomposition–prediction framework has the potential for applications in short-term prediction of HABs by implementing high-frequency monitoring. This allows for the anticipation of future trends in algal blooms, serving as a foundation for devising measures to manage the water environment.

Author Contributions

Conceptualization, L.W., M.S. and K.S.; Methodology, L.W., M.X., Z.G., X.W. and K.S.; Software, Z.G.; Validation, L.W., M.X., B.Y., X.W. and K.S.; Investigation, L.W., M.X., M.P., F.H., B.Y., X.W. and K.S.; Resources, M.P., F.H. and K.S.; Data curation, L.W., M.X., M.P., F.H., B.Y., Z.G. and K.S.; Writing—original draft, L.W., M.X. and K.S.; Writing—review & editing, L.W., M.X. and K.S.; Supervision, L.W., M.P., F.H., B.Y., Z.G. and M.S.; Project administration, M.P., F.H., Z.G., M.S. and K.S.; Funding acquisition, M.S., K.S., L.W. and B.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Yunnan Science and Technology Commission (202202AH210006-4), National Natural Science Foundation of China (No. 52379081; 62072429), the Chongqing Science and Technology Commission (CSTB2022TIAD-KPX0199; cstc2021jcyj-msxmX1199), the Chongqing Education Commission (HZ2021008; KJQN202101622), the West Light Foundation of The Chinese Academy of Sciences (E1296001).

Data Availability Statement

The data presented in this study are available on request from the corresponding authors.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Huisman, J.; Codd, G.A.; Paerl, H.W.; Ibelings, B.W.; Verspagen, J.M.H.; Visser, P.M. Cyanobacterial blooms. Nat. Rev. Microbiol. 2018, 16, 471–483. [Google Scholar] [CrossRef] [PubMed]
  2. Shan, K.; Ouyang, T.; Wang, X.; Yang, H.; Zhou, B.; Wu, Z.; Shang, M. Temporal prediction of algal parameters in Three Gorges Reservoir based on highly time-resolved monitoring and long short-term memory network. J. Hydrol. 2022, 605, 127304. [Google Scholar] [CrossRef]
  3. Thyssen, M.; Tarran, G.A.; Zubkov, M.V.; Holland, R.J.; Gregori, G.; Burkill, P.H.; Denis, M. The emergence of automated high-frequency flow cytometry: Revealing temporal and spatial phytoplankton variability. J. Plankton Res. 2008, 30, 333–343. [Google Scholar] [CrossRef]
  4. Yan, Y.; Bao, Z.; Shao, J. Phycocyanin concentration retrieval in inland waters: A comparative review of the remote sensing techniques and algorithms. J. Great Lakes Res. 2018, 44, 748–755. [Google Scholar] [CrossRef]
  5. Cheng, K.H.; Chan, S.N.; Lee, J.H.W. Remote sensing of coastal algal blooms using unmanned aerial vehicles (UAVs). Mar. Pollut. Bull. 2020, 152, 110889. [Google Scholar] [CrossRef] [PubMed]
  6. Bertone, E.; Burford, M.A.; Hamilton, D.P. Fluorescence probes for real-time remote cyanobacteria monitoring: A review of challenges and opportunities. Water Res. 2018, 141, 152–162. [Google Scholar] [CrossRef]
  7. Shin, J.; Yoon, S.; Kim, Y.; Kim, T.; Go, B.; Cha, Y. Effects of class imbalance on resampling and ensemble learning for improved prediction of cyanobacteria blooms. Ecol. Inform. 2021, 61, 101202. [Google Scholar] [CrossRef]
  8. Cui, Z.D.; Du, D.P.; Zhang, X.L.; Yang, Q. Modeling and Prediction of Environmental Factors and Chlorophyll a Abundance by Machine Learning Based on Tara Oceans Data. J. Mar. Sci. Eng. 2022, 10, 1749. [Google Scholar] [CrossRef]
  9. Deng, T.; Chau, K.-W.; Duan, H.-F. Machine learning based marine water quality prediction for coastal hydro-environment management. J. Environ. Manag. 2021, 284, 112051. [Google Scholar] [CrossRef]
  10. Recknagel, F.; Orr, P.T.; Bartkow, M.; Swanepoel, A.; Cao, H. Early warning of limit-exceeding concentrations of cyanobacteria and cyanotoxins in drinking water reservoirs by inferential modelling. Harmful Algae 2017, 69, 18–27. [Google Scholar] [CrossRef]
  11. Shen, J.; Qin, Q.; Wang, Y.; Sisson, M. A data-driven modeling approach for simulating algal blooms in the tidal freshwater of James River in response to riverine nutrient loading. Ecol. Model. 2019, 398, 44–54. [Google Scholar] [CrossRef]
  12. ASegura, M.; Piccini, C.; Nogueira, L.; Alcantara, I.; Calliari, D.; Kruk, C. Increased sampled volume improves Microcystis aeruginosa complex (MAC) colonies detection and prediction using Random Forests. Ecol. Indic. 2017, 79, 347–354. [Google Scholar] [CrossRef]
  13. Xia, R.; Wang, G.S.; Zhang, Y.; Yang, P.; Yang, Z.W.; Ding, S.; Jia, X.B.; Yang, C.; Liu, C.J.; Ma, S.Q.; et al. River algal blooms are well predicted by antecedent environmental conditions. Water Res. 2020, 185, 129583. [Google Scholar] [CrossRef] [PubMed]
  14. Faruk, D.O. A hybrid neural network and ARIMA model for water quality time series prediction. Eng. Appl. Artif. Intell. 2010, 23, 586–594. [Google Scholar] [CrossRef]
  15. Vincon-Leite, B.; Casenave, C. Modelling eutrophication in lake ecosystems: A review. Sci. Total Environ. 2019, 651, 2985–3001. [Google Scholar] [CrossRef] [PubMed]
  16. Williams, R.J.; Zipser, D. A Learning Algorithm for Continually Running Fully Recurrent Neural Networks. Neural Comput. 1989, 1, 270–280. [Google Scholar] [CrossRef]
  17. Hochreiter, S.; Schmidhuber, J. Long short-term memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar] [CrossRef]
  18. Cho, K.; Van Merriënboer, B.; Gulcehre, C.; Bahdanau, D.; Bougares, F.; Schwenk, H.; Bengio, Y. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv 2014, arXiv:1406.1078. [Google Scholar]
  19. Hill, P.R.; Kumar, A.; Temimi, M.; Bull, D.R. HABNet: Machine learning, remote sensing-based detection of harmful algal blooms. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2020, 13, 3229–3239. [Google Scholar] [CrossRef]
  20. Zheng, L.; Wang, H.P.; Liu, C.; Zhang, S.R.; Ding, A.Z.; Xie, E.; Li, J.; Wang, S.R. Prediction of harmful algal blooms in large water bodies using the combined EFDC and LSTM models. J. Environ. Manag. 2021, 295, 109027. [Google Scholar] [CrossRef]
  21. Cao, H.; Han, L.; Li, L. A deep learning method for cyanobacterial harmful algae blooms prediction in Taihu Lake, China. Harmful Algae 2022, 113, 102189. [Google Scholar] [CrossRef] [PubMed]
  22. Pyo, J.; Duan, H.; Baek, S.; Kim, M.S.; Jeon, T.; Kwon, Y.S.; Lee, H.; Cho, K.H. A convolutional neural network regression for quantifying cyanobacteria using hyperspectral imagery. Remote Sens. Environ. 2019, 233, 111350. [Google Scholar] [CrossRef]
  23. Muharemi, F.; Logofatu, D.; Leon, F. Machine learning approaches for anomaly detection of water quality on a real-world data set. J. Inf. Telecommun. 2019, 3, 294–307. [Google Scholar] [CrossRef]
  24. Xiao, X.; He, J.Y.; Huang, H.M.; Miller, T.R.; Christakos, G.; Reichwaldt, E.S.; Ghadouani, A.; Lin, S.P.; Xu, X.H.; Shi, J.Y. A novel single-parameter approach for forecasting algal blooms. Water Res. 2017, 108, 222–231. [Google Scholar] [CrossRef]
  25. Wang, L.P.; Zheng, B.H. Prediction of chlorophyll-a in the Daning River of Three Gorges Reservoir by principal component scores in multiple linear regression models. Water Sci. Technol. 2013, 67, 1150–1158. [Google Scholar]
  26. Liu, M.Y.; He, J.Y.; Huang, Y.Z.; Tang, T.; Hu, J.; Xiao, X. Algal bloom forecasting with time-frequency analysis: A hybrid deep learning approach. Water Res. 2022, 219, 118591. [Google Scholar] [CrossRef] [PubMed]
  27. Buyuksahin, U.C.; Ertekina, S. Improving forecasting accuracy of time series data using a new ARIMA-ANN hybrid method and empirical mode decomposition. Neurocomputing 2019, 361, 151–163. [Google Scholar] [CrossRef]
  28. Qian, Z.; Pei, Y.; Zareipour, H.; Chen, N. A review and discussion of decomposition-based hybrid models for wind energy forecasting applications. Appl. Energy 2019, 235, 939–953. [Google Scholar] [CrossRef]
  29. Zhu, Y.; Gao, Y.; Wang, Z.; Cao, G.; Wang, R.; Lu, S.; Li, W.; Nie, W.; Zhang, Z. A Tailings Dam Long-Term Deformation Prediction Method Based on Empirical Mode Decomposition and LSTM Model Combined with Attention Mechanism. Water 2022, 14, 1229. [Google Scholar] [CrossRef]
  30. Luo, L.; Zhang, Y.; Dong, W.; Zhang, J.; Zhang, L. Ensemble Empirical Mode Decomposition and a Long Short-Term Memory Neural Network for Surface Water Quality Prediction of the Xiaofu River, China. Water 2023, 15, 1625. [Google Scholar] [CrossRef]
  31. Apaydin, H.; Sattari, M.T.; Falsafian, K.; Prasad, R. Artificial intelligence modelling integrated with Singular Spectral analysis and Seasonal-Trend decomposition using Loess approaches for streamflow predictions. J. Hydrol. 2021, 600, 126506. [Google Scholar] [CrossRef]
  32. Azimi, S.; Dariane, A.B. Streamflow forecasting by combining neural networks and fuzzy models using advanced methods of input variable selection. J. Hydroinform. 2018, 20, 520–532. [Google Scholar]
  33. Wang, J.-H.; Li, C.; Xu, Y.-P.; Li, S.-Y.; Du, J.-S.; Han, Y.-P.; Hu, H.-Y. Identifying major contributors to algal blooms in Lake Dianchi by analyzing river-lake water quality correlations in the watershed. J. Clean. Prod. 2021, 315, 128144. [Google Scholar] [CrossRef]
  34. Liu, G.; Liu, Z.; Chen, F.; Zhang, Z.; Gu, B.; Smoak, J.M. Response of the cladoceran community to eutrophication, fish introductions and degradation of the macrophyte vegetation in Lake Dianchi, a large, shallow plateau lake in southwestern China. Limnology 2013, 14, 159–166. [Google Scholar] [CrossRef]
  35. Wu, Y.; Li, L.; Zheng, L.; Dai, G.; Ma, H.; Shan, K.; Wu, H.; Zhou, Q.; Song, L. Patterns of succession between bloom-forming cyanobacteria Aphanizomenon flos-aquae and Microcystis and related environmental factors in large, shallow Dianchi Lake, China. Hydrobiologia 2016, 765, 1–13. [Google Scholar] [CrossRef]
  36. Labat, D. Recent advances in wavelet analyses: Part 1. A review of concepts. J. Hydrol. 2005, 314, 275–288. [Google Scholar] [CrossRef]
  37. Kim, M.E.; Shon, T.S.; Shin, H.S. Forecasting algal bloom (chl-a) on the basis of coupled wavelet transform and artificial neural networks at a large lake. Desalin. Water Treat. 2013, 51, 4118–4128. [Google Scholar] [CrossRef]
  38. Huang, N.E.; Shen, Z.; Long, S.R.; Wu, M.; Shih, H.H.; Zheng, Q.N.; Yen, N.C.; Tung, C.C.; Liu, H.H. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 1998, 454, 903–995. [Google Scholar] [CrossRef]
  39. Zhang, C.; Fu, S.; Ou, B.; Liu, Z.; Hu, M. Prediction of Dam Deformation Using SSA-LSTM Model Based on Empirical Mode Decomposition Method and Wavelet Threshold Noise Reduction. Water 2022, 14, 3380. [Google Scholar] [CrossRef]
  40. Zhaohua, W.U.; Norden, E.H. Ensemble empirical mode decomposition: A noise-assisted data analysis method. Adv. Adapt. Data Anal. 2009, 1, 1–41. [Google Scholar]
  41. Golyandina, N. Particularities and commonalities of singular spectrum analysis as a method of time series analysis and signal processing. Wiley Interdiscip. Rev.-Comput. Stat. 2020, 12, 4. [Google Scholar] [CrossRef]
  42. Cui, Z.; Qing, X.; Chai, H.; Yang, S.; Zhu, Y.; Wang, F. Real-time rainfall-runoff prediction using light gradient boosting machine coupled with singular spectrum analysis. J. Hydrol. 2021, 603, 127124. [Google Scholar] [CrossRef]
  43. Seo, Y.; Kim, S.; Kisi, O.; Singh, V.P. Daily water level forecasting using wavelet decomposition and artificial intelligence techniques. J. Hydrol. 2015, 520, 224–243. [Google Scholar] [CrossRef]
  44. Sahay, R.R.; Srivastava, A. Predicting Monsoon Floods in Rivers Embedding Wavelet Transform, Genetic Algorithm and Neural Network. Water Resour. Manag. 2013, 28, 301–317. [Google Scholar] [CrossRef]
  45. Anctil, F.; Tape, D.G. An exploration of artificial neural network rainfall-runoff forecasting combined with wavelet decomposition. J. Environ. Eng. Sci. 2004, 3 (Suppl. S1), S121–S128. [Google Scholar] [CrossRef]
  46. Tahroudi, M.N.; Mirabbasi, R. Frequency decomposition associated with machine learning algorithms and copula modeling for river flow prediction. Stoch. Environ. Res. Risk Assess. 2023, 37, 2897–2918. [Google Scholar] [CrossRef]
  47. Luo, S.; Zhang, M.; Nie, Y.; Jia, X.; Cao, R.; Zhu, M.; Li, X. Forecasting of monthly precipitation based on ensemble empirical mode decomposition and Bayesian model averaging. Front. Earth Sci. 2022, 10, 926067. [Google Scholar] [CrossRef]
  48. Yuan, R.; Cai, S.; Liao, W.; Lei, X.; Zhang, Y.; Yin, Z.; Ding, G.; Wang, J.; Xu, Y. Daily Runoff Forecasting Using Ensemble Empirical Mode Decomposition and Long Short-Term Memory. Front. Earth Sci. 2021, 9, 621780. [Google Scholar] [CrossRef]
  49. Chen, Y.-C.; Yeh, H.-C.; Kao, S.-P.; Wei, C.; Su, P.-Y. Water Level Forecasting in Tidal Rivers during Typhoon Periods through Ensemble Empirical Mode Decomposition. Hydrology 2023, 10, 47. [Google Scholar] [CrossRef]
  50. Ali, M.; Prasad, R.; Xiang, Y.; Yaseen, Z.M. Complete ensemble empirical mode decomposition hybridized with random forest and kernel ridge regression model for monthly rainfall forecasts. J. Hydrol. 2020, 584, 124647. [Google Scholar] [CrossRef]
  51. Apaydin, H.; Sibtain, M. A multivariate streamflow forecasting model by integrating improved complete ensemble empirical mode decomposition with additive noise, sample entropy, Gini index and sequence-to-sequence approaches. J. Hydrol. 2021, 603, 126831. [Google Scholar] [CrossRef]
  52. Rezaie-Balf, M.; Kim, S.; Fallah, H.; Alaghmand, S. Daily river flow forecasting using ensemble empirical mode decomposition based heuristic regression models: Application on the perennial rivers in Iran and South Korea. J. Hydrol. 2019, 572, 470–485. [Google Scholar] [CrossRef]
  53. Unnikrishnan, P.; Jothiprakash, V. Hybrid SSA-ARIMA-ANN Model for Forecasting Daily Rainfall. Water Resour. Manag. 2020, 34, 3609–3623. [Google Scholar] [CrossRef]
  54. Zhang, Q.; Wang, B.-D.; He, B.; Peng, Y.; Ren, M.-L. Singular Spectrum Analysis and ARIMA Hybrid Model for Annual Runoff Forecasting. Water Resour. Manag. 2011, 25, 2683–2703. [Google Scholar] [CrossRef]
Figure 1. Overview of the study area in Caohai, Lake Dianchi, and the distribution of sampling sites. (a) Location of Lake Dianchi in Yunnan, Southwest China. (b) Distribution of Lake Dianchi and riverway networks in Lake Dianchi Basin. (c) The red pentagon marks the location of the two sampling sites inside Caohai of Lake Dianchi.
Figure 1. Overview of the study area in Caohai, Lake Dianchi, and the distribution of sampling sites. (a) Location of Lake Dianchi in Yunnan, Southwest China. (b) Distribution of Lake Dianchi and riverway networks in Lake Dianchi Basin. (c) The red pentagon marks the location of the two sampling sites inside Caohai of Lake Dianchi.
Water 15 04104 g001
Figure 2. Schematic flow chart of the decomposition-based hybrid deep learning models.
Figure 2. Schematic flow chart of the decomposition-based hybrid deep learning models.
Water 15 04104 g002
Figure 3. One-dimensional CNN model flowchart.
Figure 3. One-dimensional CNN model flowchart.
Water 15 04104 g003
Figure 4. LSTM model flowchart.
Figure 4. LSTM model flowchart.
Water 15 04104 g004
Figure 5. (a) Decomposition results of the Chla concentrations for (a,b) WT; (c,d) EEMD; (e,f) SSA in Duanqiao and Caohai center sites, respectively.
Figure 5. (a) Decomposition results of the Chla concentrations for (a,b) WT; (c,d) EEMD; (e,f) SSA in Duanqiao and Caohai center sites, respectively.
Water 15 04104 g005
Figure 6. Predicted and observed time series of Chla concentrations by the decomposition-based hybrid deep learning models and independent CNN and LSTM approaches in the Lake Dianchi at (a,b) Caohai Center and (c,d) Duanqiao.
Figure 6. Predicted and observed time series of Chla concentrations by the decomposition-based hybrid deep learning models and independent CNN and LSTM approaches in the Lake Dianchi at (a,b) Caohai Center and (c,d) Duanqiao.
Water 15 04104 g006aWater 15 04104 g006b
Figure 7. Scatter diagrams of the Chla with one-step prediction lead times at the Caohai center and Duanqiao stations in Lake Dianchi. Red dots represent the single models, green dots represent the hybrid EEMD-based models, orange dots represent the hybrid WT-based models, and blue dots represent the hybrid SSA-based models. (a) Comparison of single model and hybrid CNN-based models at Caohai center station. (b) Comparison of single model and hybrid CNN-based models at Duanqiao station. (c) Comparison of single model and hybrid LSTM-based models at Caohai center station. (d) Comparison of single model and hybrid CNN-based models at Duanqiao station.
Figure 7. Scatter diagrams of the Chla with one-step prediction lead times at the Caohai center and Duanqiao stations in Lake Dianchi. Red dots represent the single models, green dots represent the hybrid EEMD-based models, orange dots represent the hybrid WT-based models, and blue dots represent the hybrid SSA-based models. (a) Comparison of single model and hybrid CNN-based models at Caohai center station. (b) Comparison of single model and hybrid CNN-based models at Duanqiao station. (c) Comparison of single model and hybrid LSTM-based models at Caohai center station. (d) Comparison of single model and hybrid CNN-based models at Duanqiao station.
Water 15 04104 g007
Table 1. Overview of online monitoring datasets for chlorophyll-a at two monitoring sites.
Table 1. Overview of online monitoring datasets for chlorophyll-a at two monitoring sites.
LocationSample SizeMeanStandard DeviationMinMedianMax
Duanqiao40818.466.190.326.9555
Caohai Center408114.419.440.491360
Table 2. The hyper-parameters of the CNN and LSTM models.
Table 2. The hyper-parameters of the CNN and LSTM models.
Parameter NameCNNLSTM
Time Lag1010
Hidden Size1616
Learning Rate0.0010.002
Epoch10050
Batch Size3232
Activation Functionrelurelu
Kernel_Size3/
Input_size11
Table 3. The improvement percentages in the accuracy of the decomposition-based CNN and LSTM methods compared with single CNN and LSTM approaches for Chla (chlorophyll-a) prediction in Caohai center station (μg/L). (+Δ represents the improvement percentages in RMSE and MAE for decomposition-based models compared to single models.)
Table 3. The improvement percentages in the accuracy of the decomposition-based CNN and LSTM methods compared with single CNN and LSTM approaches for Chla (chlorophyll-a) prediction in Caohai center station (μg/L). (+Δ represents the improvement percentages in RMSE and MAE for decomposition-based models compared to single models.)
ModelsTraining SetTest Set
RMSE (μg/L)MAE (μg/L)R2RMSE (μg/L)MAE (μg/L)R2
LSTM3.435 2.324 0.813 5.282 3.525 0.738
EEMD-LSTM2.143(+Δ37.6%)1.475(+Δ36.6%)0.927(+Δ14.0%)3.912(+Δ26.0%)2.383(+Δ32.4%)0.857(+Δ16.0%)
WT-LSTM1.255(+Δ63.5%)0.888(+Δ61.8%)0.975(+Δ19.9%)2.198(+Δ58.4%)1.405(+Δ60.1%)0.955(+Δ29.3%)
SSA-LSTM0.740(+Δ78.5%)0.491(+Δ78.9%)0.991(+Δ21.9%)1.518(+Δ71.3%)0.855(+Δ75.7%)0.978(+Δ32.5%)
CNN3.405 2.323 0.816 5.364 3.538 0.730
EEMD-CNN2.122(+Δ37.7%)1.477(+Δ36.4%)0.929(+Δ13.8%)3.719(+Δ30.7%)2.461(+Δ30.4%)0.870(+Δ19.2%)
WT-CNN1.499(+Δ56.0%)1.035(+Δ55.4%)0.964(+Δ18.1%)2.635(+Δ50.9%)1.742(+Δ50.8%)0.935(+Δ28.0%)
SSA-CNN1.266(+Δ62.8%)0.900(+Δ61.3%)0.975(+Δ19.4%)1.927(+Δ64.1%)1.361(+Δ61.5%)0.965(+Δ32.2%)
Table 4. The improvement percentages in the accuracy of the decomposition-based CNN and LSTM methods compared with single CNN and LSTM approaches for Chla (chlorophyll-a) prediction in Duanqiao station (μg/L). (+Δ represents the improvement percentages in RMSE and MAE for decomposition-based models compared to single models.)
Table 4. The improvement percentages in the accuracy of the decomposition-based CNN and LSTM methods compared with single CNN and LSTM approaches for Chla (chlorophyll-a) prediction in Duanqiao station (μg/L). (+Δ represents the improvement percentages in RMSE and MAE for decomposition-based models compared to single models.)
ModelsTraining SetTest Set
RMSE (μg/L)MAE (μg/L)R2RMSE (μg/L)MAE (μg/L)R2
LSTM2.381 1.588 0.739 3.624 2.295 0.723
EEMD-LSTM1.281(+Δ46.2%)0.913(+Δ42.5%)0.924(+Δ25.1%)2.378(+Δ34.4%)1.452(+Δ36.7%)0.881(+Δ21.8%)
WT-LSTM0.855(+Δ64.1%)0.595(+Δ62.6%)0.966(+Δ30.8%)1.633(+Δ54.9%)0.942(+Δ58.9%)0.944(+Δ30.5%)
SSA-LSTM0.650(+Δ72.7%)0.543(+Δ65.8%)0.981(+Δ32.7%)1.092(+Δ69.9%)0.702(+Δ69.4%)0.975(+Δ34.8%)
CNN2.444 1.680 0.725 3.436 2.251 0.751
EEMD-CNN1.281(+Δ47.6%)0.931(+Δ44.6%)0.924(+Δ27.6%)2.554(+Δ25.7%)1.614(+Δ28.3%)0.863(+Δ14.8%)
WT-CNN1.309(+Δ46.4%)1.116(+Δ33.6%)0.921(+Δ27.1%)1.699(+Δ50.6%)1.284(+Δ43.0%)0.939(+Δ25.0%)
SSA-CNN0.858(+Δ64.9%)0.691(+Δ58.8%)0.966(+Δ33.3%)1.513(+Δ56.0%)1.025(+Δ54.5%)0.952(+Δ26.7%)
Table 5. The concise comparison of decomposition models for different variable forecasting.
Table 5. The concise comparison of decomposition models for different variable forecasting.
MethodsAdvantagesDisadvantagesVariables
Wavelet Transform (WT)Strict mathematical theory.
Appropriate for steady-frequency and nearly periodic signals.
Requires the prior specification of wavelet basis and parameters.
Separates the modes.
Not suitable for highly non-stationary signals.
Water level [43]
Algal bloom [26]
Precipitation [44]
Rainfall runoff [45]
River flow [46]
Ensemble Empirical Mode Decomposition (EEMD)Fully data-driven.
Addresses mode mixing issue.
Suitable for both non-linear and non-stable signals.
Fully adaptive by originally introducing the intrinsic mode functions (IMFs).
Lacks rigorous mathematical theory.
Additional noise is present in the reconstructed signal.
Needs many computational resources.
Precipitation [47]
Daily Runoff [48]
Water Level [49]
Rainfall [50]
Streamflow [51]
River flow [52]
Water Quality [30]
Singular Spectrum Analysis (SSA)Strict mathematical theory.
Decompose a time series into distinct components.
Parameters must be fine-tuned to isolate each component.Streamflow [31]
Rainfall [53]
Runoff [54]
Rainfall runoff [42]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, L.; Xie, M.; Pan, M.; He, F.; Yang, B.; Gong, Z.; Wu, X.; Shang, M.; Shan, K. Improved Deep Learning Predictions for Chlorophyll Fluorescence Based on Decomposition Algorithms: The Importance of Data Preprocessing. Water 2023, 15, 4104. https://doi.org/10.3390/w15234104

AMA Style

Wang L, Xie M, Pan M, He F, Yang B, Gong Z, Wu X, Shang M, Shan K. Improved Deep Learning Predictions for Chlorophyll Fluorescence Based on Decomposition Algorithms: The Importance of Data Preprocessing. Water. 2023; 15(23):4104. https://doi.org/10.3390/w15234104

Chicago/Turabian Style

Wang, Lan, Mingjiang Xie, Min Pan, Feng He, Bing Yang, Zhigang Gong, Xuke Wu, Mingsheng Shang, and Kun Shan. 2023. "Improved Deep Learning Predictions for Chlorophyll Fluorescence Based on Decomposition Algorithms: The Importance of Data Preprocessing" Water 15, no. 23: 4104. https://doi.org/10.3390/w15234104

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop