Giters

manickavela29 / EmoTwitter

OnnxRT based Inference Optimization of Roberta model trained for Sentiment Analysis On Twitter Dataset

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

avx2avx512bert-modelscpuinference-optimizationonnxonnxruntimequantizationroberta-modelsentiment-analysis

Onnxruntime based Inference Optimization of Roberta text classification model.

Analysed Inference optimization based on

  • Graph optimization
  • Quatnization
  • CPU archtecture AVX2,AVX512

Metrics : Conclusion based on

  • Classification Accuracy
  • Performance in milliseconds(ms)

Dataset : Huggingface model :

About

OnnxRT based Inference Optimization of Roberta model trained for Sentiment Analysis On Twitter Dataset

avx2avx512bert-modelscpuinference-optimizationonnxonnxruntimequantizationroberta-modelsentiment-analysis

Languages

Language:Jupyter Notebook 50.3%Language:Python 33.1%Language:HTML 14.5%Language:Dockerfile 2.2%