Inicio  /  Applied Sciences  /  Vol: 12 Par: 7 (2022)  /  Artículo
ARTÍCULO
TITULO

Self-Attentive Moving Average for Time Series Prediction

Yaxi Su    
Chaoran Cui and Hao Qu    

Resumen

Time series prediction has been studied for decades due to its potential in a wide range of applications. As one of the most popular technical indicators, moving average summarizes the overall changing patterns over a past period and is frequently used to predict the future trend of time series. However, traditional moving average indicators are calculated by averaging the time series data with equal or predefined weights, and ignore the subtle difference in the importance of different time steps. Moreover, unchanged data weights will be applied across different time series, regardless of the differences in their inherent characteristics. In addition, the interaction between different dimensions of different indicators is ignored when using the moving averages of different scales to predict future trends. In this paper, we propose a learning-based moving average indicator, called the self-attentive moving average (SAMA). After encoding the input signals of time series based on recurrent neural networks, we introduce the self-attention mechanism to adaptively determine the data weights at different time steps for calculating the moving average. Furthermore, we use multiple self-attention heads to model the SAMA indicators of different scales, and finally combine them through a bilinear fusion network for time series prediction. Extensive experiments on two real-world datasets demonstrate the effectiveness of our approach. The data and codes of our work have been released.

 Artículos similares

       
 
Dessalegn Jaweso, Brook Abate, Andreas Bauwe and Bernd Lennartz    
This study aimed to assess trends of hydro-meteorological variables in the Upper Omo-Ghibe river basin, Ethiopia. Data records from eleven rainfall, eight air temperature, and five streamflow stations between 1981 to 2008 were investigated. The trends an... ver más
Revista: Water

 
Ivan Gabriel-Martin, Alvaro Sordo-Ward, Luis Garrote and Juan T. García    
This paper focuses on proposing the minimum number of storms necessary to derive the extreme flood hydrographs accurately through event-based modelling. To do so, we analyzed the results obtained by coupling a continuous stochastic weather generator (the... ver más
Revista: Water

 
Huiying Ren, Z. Jason Hou, Mark Wigmosta, Ying Liu and L. Ruby Leung    
Changes in extreme precipitation events may require revisions of civil engineering standards to prevent water infrastructures from performing below the designated guidelines. Climate change may invalidate the intensity-duration-frequency (IDF) computatio... ver más
Revista: Water

 
Francisco Leitão, Vânia Baptista, Vasco Vieira, Patrícia Laginha Silva, Paulo Relvas and Maria Alexandra Teodósio    
Coastal upwelling has a significant local impact on marine coastal environment and on marine biology, namely fisheries. This study aims to evaluate climate and environmental changes in upwelling trends between 1950 and 2010. Annual, seasonal and monthly ... ver más
Revista: Water

 
Igor Paz, Bernard Willinger, Auguste Gires, Bianca Alves de Souza, Laurent Monier, Hervé Cardinal, Bruno Tisserand, Ioulia Tchiguirinskaia and Daniel Schertzer    
Recent studies have highlighted the need for high resolution rainfall measurements for better modelling of urban and peri-urban catchment responses. In this work, we used a fully-distributed model called ?Multi-Hydro? to study small-scale rainfall variab... ver más
Revista: Water