Implementation of nn.Modules for temporal fusion transformer.
nn.Modules
Classes
AddNorm(input_size, skip_size, trainable_add)
AddNorm
Initializes internal Module state, shared by both nn.Module and ScriptModule.
GateAddNorm(input_size, hidden_size, …)
GateAddNorm
GatedLinearUnit(input_size, hidden_size, dropout)
GatedLinearUnit
Gated Linear Unit
GatedResidualNetwork(input_size, …)
GatedResidualNetwork
InterpretableMultiHeadAttention(n_head, …)
InterpretableMultiHeadAttention
PositionalEncoder(d_model[, max_seq_len])
PositionalEncoder
ResampleNorm(input_size, output_size, …)
ResampleNorm
ScaledDotProductAttention(dropout, scale)
ScaledDotProductAttention
TimeDistributed(module, batch_first)
TimeDistributed
TimeDistributedInterpolation(output_size, …)
TimeDistributedInterpolation
VariableSelectionNetwork(input_sizes, int], …)
VariableSelectionNetwork
Calcualte weights for num_inputs variables which are each of size input_size
num_inputs
input_size