edwinksl / PatentGPT-J

PatentGPT-J

• PatentGPT-J models are pre-trained with patent corpus and based on the GPT-J-6B & Mesh Transformer JAX.

• Model files

  • PatentGPT-J-279M
  • PatentGPT-J-456M
  • PatentGPT-J-1.6B
  • sample code of using these models for inference (see the following Sentiment Analysis experiment)

• Experiments

  • Autocomplete Effectiveness (AE) ratio

    • Inspecting AE ratio and keystroke distribution (data: ipg22)
    • Inspecting AE ratio and keystroke distribution (data: ipg220104)
    • Inspecting AE ratio and keystroke distribution (data: unicorn text)

  • Unreasonable effectiveness in Few-Shot Learning: Sentiment_Analysis_by_PatentGPT_J.ipynb