IvanLauLinTiong / language-detector

A language detector which can identify types of language based on written texts

Language Detector

This app used pretrained xlm-roberta-base model and fine-tuned on the common_language dataset under PyTorch and HuggingFace framework. It can detect 45 languages based on user text input and is hosted on HuggingFace space platform.

Fine-tuned Model

Download: language-detection-fine-tuned-on-xlm-roberta-base

Demo

Try it out: language detector

Files Description

• hf_demo

  • repo for HuggingFace space app demo

• datset

  • folder where train and test dataset will be downloaded to.

• xlm_roberta_base_commonlanguage_language_detector.ipynb

  • notebook for fine-tuning xlm-roberta-base model