Simple Multi Attention Head Model
- class flood_forecast.transformer_xl.multi_head_base.MultiAttnHeadSimple(number_time_series: int, seq_len=10, output_seq_len=None, d_model=128, num_heads=8, dropout=0.1, output_dim=1, final_layer=False)[source]
A simple multi-head attention model inspired by Vaswani et al.