TCN: y t = ∑ k = 1 K w k ⋅ x t − d ⋅ k y_t = \sum_{k=1}^{K} w_k \cdot x_{t-d\cdot k}yt=k=1∑Kwk⋅xt−d⋅k 其中d dd为膨胀因子,K KK为卷积核大小。
Transformer自注意力: Attention ( Q , K , V ) = softmax ( Q K T d k ) V \text{Attention}(Q,K,V) = \text{softmax}\left(\frac{QK^T}{\sqrt{d_k}}\right)VAttention(Q,K,V)=softmax(dkQKT)V
BiLSTM: h t = LSTM ( x t , h t − 1 ) ( 前向 + 后向 ) h_t = \text{LSTM}(x_t, h_{t-1}) \quad (\text{前向 + 后向})ht=LSTM(xt,ht−1)(前向+后向)