-
PatentGPT-J models are pre-trained with patent corpus and based on the GPT-J-6B & Mesh Transformer JAX.
-
Model files
- PatentGPT-J-279M
- PatentGPT-J-456M
- PatentGPT-J-1.6B
- sample code of using these models for inference (see the following Sentiment Analysis experiment)
-
Experiments
-
Autocomplete Effectiveness (AE) ratio
-
Unreasonable effectiveness in Few-Shot Learning: Sentiment_Analysis_by_PatentGPT_J.ipynb
-