CyberZHG / keras-multi-head

A wrapper layer for stacking layers horizontally

https://pypi.org/project/keras-multi-head/

CyberZHG/keras-multi-head Issues

Is it possible to use cross-attention with the multi-head attention?
Updated 2 years ago
How to load a keras_multi_head model?
Closed 3 years ago2
When running MultiHeadAttention I get "AttributeError: module 'keras' has no attribute 'applications"
Closed 3 years ago2
get_custom_objects() static method implementation for MultiHeadAttention
Closed 4 years ago
MultiHeadAttention layer defaults to non-linear projections
Closed 4 years ago1
您好！请问这里多头注意力输入的只是一个tensor的话，是不是就是多头自注意力
Closed 4 years ago1
Example in simple time-series
Closed 4 years ago1
feature_dim in muti_head_attention
Closed 4 years ago1
Multi-head Attention with 2 Input Layers
Closed 4 years ago2
AttributeError: 'Tensor' object has no attribute 'supports_masking'
Closed 5 years ago1
Fitting MultiHeadAttention in memory for long sequences
Closed 5 years ago1