Transformer
Transformer.forward()
Encoder
Encoder.attention_map
Encoder.forward()
Decoder
Decoder.forward()
MultiHeadAttention
MultiHeadAttention.attention_map
MultiHeadAttention.forward()
MultiHeadAttentionChunk
MultiHeadAttentionChunk.forward()
MultiHeadAttentionWindow
MultiHeadAttentionWindow.forward()
PositionwiseFeedForward
PositionwiseFeedForward.forward()
OZELoss
OZELoss.forward()
generate_local_map_mask()
generate_original_PE()
generate_regular_PE()