time series data like BTC price
tesla-cat opened this issue · comments
if we have a time series data like BTC price, then we don't need to do token_embedding i suppose,
how do we do position_embedding in this case?
The paper "Attention is all you need", used the below encoding. Take a look, might be useful for you time series.
Paper link: https://arxiv.org/pdf/1706.03762.pdf
Section: 3.5 Positional Encoding
