smooth-quantization

There are 0 repository under smooth-quantization topic.

• aahouzi / llama2-chatbot-cpu

  A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTorch with bfloat16.

  bfloat16cpuint8langchainllama2optimizationstreamlitsmooth-quantizationchatbothuggingfacechatbot-memorychatgptllamameta-aiintelipexmetanumaneural-compression4-bit-cpu
  Language:Python 8