kingoflolz / mesh-transformer-jax

Model parallel transformers in JAX and Haiku

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

the-eye.eu down - alternative access to GPT-J-6B/step_383500_slim.tar.zstd ?

PhilWicke opened this issue · comments

Thank you for your hard work and dedication to the project.
I've been trying to load the slim checkpoint from the-eye.eu. Apparently, the side is down. I've checked any sort of access, but it probably is an outage on their end (https://downforeveryoneorjustme.com/the-eye.eu).

They might resolve it shortly - or maybe not. Is there any alternative address to wget GPT-J-6B/step_383500_slim.tar.zstd ?
Thank you.

Same issue here, if there's an alternate hosting that would be great!

FYI, the-eye.eu is down for maintenance only for a few days from 2021 Dec. 11th to 2021 Dec. 13th.
Source: https://twitter.com/arankomatsuzaki/status/1470244542670589952
Thanks to @AranKomat for quick explanation!

It's still unavailable. Maybe I'm just impatient and it's a different time-zone etc.

Still down. I should have downloaded it locally.

Apparently, the-eye was affected by the tornado, and they're currently working on getting it back up.

You can still load the model from HF though. Anyway, please take a look at the discussion in gpt-j channel at EleutherAI. If you have any question, they can answer your question :)

Thanks. The HF model is not the "slim" model though, right? (https://huggingface.co/EleutherAI/gpt-j-6B)
If I'm trying to load the HF model, it'll exceed the memory in the Colab file. Maybe the slim model can be added to HF?

Any chance we could get you to load the slim model in an alternative server? We'd really like to try it out. Thanks

I found this one. No idea who runs this site but models are stored there

http://eaidata.bmk.sh/data/GPT-J-6B/

wow it has meta data too. @jmherrera11