Modules

• Transformer module
  • Transformer
    • Transformer.forward()
• Encoder module
  • Encoder
    • Encoder.attention_map
    • Encoder.forward()
• Decoder module
  • Decoder
    • Decoder.forward()
• MultiHeadAttention module
  • MultiHeadAttention
    • MultiHeadAttention.attention_map
    • MultiHeadAttention.forward()
  • MultiHeadAttentionChunk
    • MultiHeadAttentionChunk.forward()
  • MultiHeadAttentionWindow
    • MultiHeadAttentionWindow.forward()
• PositionwiseFeedForward module
  • PositionwiseFeedForward
    • PositionwiseFeedForward.forward()
• Loss module
  • OZELoss
    • OZELoss.forward()
• Utils module
  • generate_local_map_mask()
  • generate_original_PE()
  • generate_regular_PE()