The Eye

Question

The Eye

Robbie-chew opened this issue 4 years ago · comments

The eye is a platform deicatded to archving any and all kinds of data.

They say they have 140 Tb in total in assorted formats and a good fraction seems to be in text format.

unfortuatly due to the fact that all of their size estimates seem to be "pending update" it is dificult to give exact estimats on how much of this is textual

Charles Foster · Answer 1 · Mon Oct 12 2020 07:40:56 GMT+0800 (China Standard Time)

I believe the team has contacted folks at the Eye. The Bibliotik component is from them. Do they have other big text datasets that you know of?

Stella Biderman · Answer 2 · Tue Oct 13 2020 23:04:49 GMT+0800 (China Standard Time)

Indeed, we are in contact with them and have gotten datasets from them. Long term we are working on hosting a copy of all of the data in the Pile on their systems.

Are there any specific datasets you recommend?

Robbie-chew · Answer 3 · Tue Oct 13 2020 23:41:45 GMT+0800 (China Standard Time)

Not Really

…

On Tue, Oct 13, 2020 at 4:05 PM Stella Biderman ***@***.***> wrote: Indeed, we are in contact with them and have gotten datasets from them. Long term we are working on hosting a copy of all of the data in the Pile on their systems. Are there any specific datasets you recommend? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#51 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/APLK3R66YGSL2DUQVAYFMBDSKRUCNANCNFSM4SLEDAPQ> .

Stella Biderman · Answer 4 · Sat Oct 17 2020 03:17:14 GMT+0800 (China Standard Time)

Okay. I’m going to tentatively close this issue, but feel free to suggest additional data sets in the future either on GitHub or on Discord.