davidpr0811 / FalconLLM

datasets	language
tiiuae/falcon-refinedweb	en

Falcon-7B

Falcon-7B is a 7B parameters causal decoder-only model built by TII and trained on 1500B tokens of RefinedWeb enhanced with curated corpora. It is made available under the TII Falcon LLM License.

More details coming soon.

Model Card for Falcon-7B

Model Details

Model Description

• Developed by: https://www.tii.ae
• Model type: Causal decoder-only
• Language(s) (NLP): English
• License: TII Falcon LLM License

Model Source

• Paper: coming soon
• Demo: coming soon

Uses

Out-of-Scope Use

Production use without adequate assessment of risks and mitigation; any use cases which may be considered irresponsible or harmful

Bias, Risks, and Limitations

Falcon-7B is trained on English and French data only, and will not generalize appropriately to other languages. Furthermore, as it is trained on a large-scale corpora representative of the web, it will carry the stereotypes and biases commonly encountered online

Paper

More details coming soon in the paper.