lucidrains / x-transformers

A simple but complete full-attention transformer with a set of promising experimental features from various papers

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Enhancement: Multi Input/Output transformers

RyanKim17920 opened this issue · comments

Hey @lucidrains, while working with your x-transformers for a music transformer, I found the need to incorporate multiple input/output modifications into the code. If I adapt this code to handle various inputs/outputs, would you be open to me submitting a pull request? I'm thinking of either modifying the existing TransformerWrapper and AutoRegressiveWrapper or creating a new version, perhaps named MultiIOTransformerWrapper/MultiIOAutoRegressiveWrapper. What do you think?

yea definitely! they could live in a separate file, like continuous or xval