Giters

kyegomez / LongNet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

Home Page:https://discord.gg/qUtxnK2NMf

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Import issues

jtrechot opened this issue · comments

commented

Hello,

Thank you for the great effort to provide a version of LongNet! 😃
I noticed that I have some import issues, for example in the LongNet/model.py file:

ModuleNotFoundError: No module named 'LongNet.transformer'

I think this is due to some modification of the imports that used to be from LongNet.Transformer import LongNet but was changed to from LongNet.transformer import LongNet

Would it be possible to have a check on that ? 🔧

Thank you!

Upvote & Fund

  • We're using Polar.sh so you can upvote and help fund this issue.
  • We receive the funding once the issue is completed & confirmed by you.
  • Thank you in advance for helping prioritize & fund our backlog.
Fund with Polar
commented

@jtrechot Hey please excuse me for the issue, I've fixed it now. We're still working on the model architecture to get it ready for training and democratization.