sub_modules#
Implementation of nn.Modules for TimeXer model.
Classes
|
Attention layer that combines query, key, and value projections with an attention mechanism. |
|
Data embedding module for time series data. |
|
Encoder embedding module for time series data. |
|
Encoder module for the TimeXer model. |
|
Encoder layer for the TimeXer model. |
|
Flatten head for the output of the model. |
|
Full attention mechanism with optional masking and dropout. :param mask_flag: Whether to apply masking. :type mask_flag: bool :param factor: Factor for scaling the attention scores. :type factor: int :param scale: Scaling factor for attention scores. :type scale: float :param attention_dropout: Dropout rate for attention scores. :type attention_dropout: float :param output_attention: Whether to output attention weights. :type output_attention: bool :param use_efficient_attention: Whether to use PyTorch's native, optimized Scaled Dot Product Attention implementation which can reduce computation time and memory consumption for longer sequences. PyTorch automatically selects the optimal backend (FlashAttention-2, Memory-Efficient Attention, or their own C++ implementation) based on user's input properties, hardware capabilities, and build configuration. :type use_efficient_attention: bool. |
|
Positional embedding module for time series data. |
|
Triangular causal mask for attention mechanism. |