code-switching

There are 6 repositories under code-switching topic.

• Tomiinek / Multilingual_Text_to_Speech

  An implementation of Tacotron 2 that supports multilingual experiments with parameter-sharing, code-switching, and voice cloning.

  text-to-speechspeech-synthesismultilingualttscode-switchingvoice-cloning
  Language:Python 842

• gentaiscool / code-switching-papers

  A curated list of research papers and resources on code-switching

  bilingualcode-mixedcode-mixingcode-switchcode-switchinglanguagenlppapersresearchspeech
  328

• microsoft / CodeMixed-Text-Generator

  This tool helps automatic generation of grammatically valid synthetic Code-mixed data by utilizing linguistic theories such as Equivalence Constant Theory and Matrix Language Theory.

  code-mixingnatural-language-processingcode-switchinglinguisticspython3synthetic-data-generationlanguage-modelingdata-generation
  Language:Jupyter Notebook 56

• microsoft / LID-tool

  This code provides word level language identification tool for identifying language for individual words in Code-Mixed text. e.g. The text that includes words from two languages such as Hindi written in roman script, mixed with English.

  language-identificationnatural-language-processingpython3malletlanguage-tagscode-mixingcode-switchinglinguistics
  Language:Python 55

• audioku / meta-transfer-learning

  Implementation of meta-transfer-learning for ASR and LM (ACL 2020)

  meta-learningspeechspeech-recognitionasrcode-switchingmulti-linguallanguagelanguage-modelneural-networktransformerpytorchmeta-transfer-learningmixed-languageacl
  Language:Python 51

• sagorbrur / codeswitch

  CodeSwitch is a NLP tool, can use for language identification, pos tagging, name entity recognition, sentiment analysis of code mixed data.

  codeswitchcode-mixednlpposnercode-switchinghindi-englishspanish-englishpos-tagginglanguage-identificationsentiment-analysishuggingfacetransformers
  Language:Jupyter Notebook 36

• Nativeatom / NaturalLanguageProcessing

  Natural Language Procesing

  natural-language-processingdeep-learningmachine-learningnlppapernlp-machine-learningcode-switchingdatasetmachine-translationnlp-resourcesartificial-intelligenceembedding
  35

• gentaiscool / meta-emb

  Multilingual Meta-Embeddings for Named Entity Recognition (RepL4NLP & EMNLP 2019)

  code-switchingdeep-learningmeta-embeddingsmultilingualnerrepresentation-learningtransformer
  Language:Python 32

• andi611 / CS-Tacotron-Pytorch

  Pytorch implementation of CS-Tacotron, a code-switching speech synthesis end-to-end generative TTS model.

  code-switchcode-switchingspeech-synthesistext-to-speechttstacotronchinese-englishdspdigital-signal-processingntuntuee
  Language:Python 23

• cisnlp / MaskLID

  💬 MaskLID: Code-Switching Language Identification through Iterative Masking -- ACL 2024

  code-mixingcode-switchcode-switchinglanguage-identificationlanguage-identification-toolkitlanguage-identifier
  Language:Python 10

• amsuhane / ACL20-Code-switching-patterns

  Code-switching patterns can be an effective route to improve performance of downstream NLP applications: A case study of humour, sarcasm and hate speech detection

  natural-language-processingcode-switchingmultilingualmachine-learningdeep-learningacl2020
  Language:Python 9

• gentaiscool / multi-task-cs-lm

  Code-Switching Language Modeling using Syntax-Aware Multi-Task Learning (CALCS 2018, ACL)

  language-modelcode-switchingmulti-task-learningjoint-learning
  Language:Python 9

• sedflix / unsacmt

  Unsupervised Sentiment Analysis for Code-mixed Data

  sentiment-analysiscode-mixedcode-switchingembeddingscross-lingualmulti-lingualzero-shot-learningunsupervised
  Language:Jupyter Notebook 8

• ash-shar / Code-Switching-and-Swearing-Patterns-on-Twitter

  Repository containing Abusive Tweet Detection, Location Detection and Gender Detection codes

  nlpsocial-network-analysisswearingtwitterlocation-detectiongender-detectioncode-mixingcode-switching
  Language:Python 7

• dieuthu / sequencetagging

  A sequence tagging model with active learning

  sequencetaggingactive-learningbilstm-crf-modelcode-switching
  Language:Python 7

• feyzaakyurek / newsframing

  Code repository for ACL2020 paper Multi-label and Multilingual News Framing Analysis

  agenda-settingbertcode-switchinggun-violencemulti-label-classificationmultilingual-translationnewsnews-classificationnews-framingnlptransfer-learning
  Language:Jupyter Notebook 7

• javadr / PyTorch-Detect-Code-Switching

  Implementation of a deep learning model (BiLSTM) to detect code-switching

  bilstmcode-switchinglanguage-detectionpytorchcharacter-based-modelnatural-language-processingnlppaper-implementations
  Language:Python 7

• mmaguero / josa-corpus

  Jopara (Guarani-dominant mixed with Spanish) sentiment analysis corpus

  low-resource-languagescorpus-linguisticssentiment-analysisbaselinestext-classificationtext-categorizationsentiment-classificationbert-fine-tuningbilstmtraditional-machine-learningdeep-learningmultilingualcode-switchingcode-mixing
  7

• PPPI / POSIT

  POSIT aims to segment and tag mixed-text that contains English and C-like code, such that the user both knows what a token is, and within the language it's used in, what role, such as an AST tag or PoS tag, it serves.

  bilstm-crf-modelmixed-textcode-switchingpart-of-speech-taggingstackoverflow
  Language:Python 7

• umar1997 / propaganda-codeswitched-text

  [EMNLP 2023] Official repository of paper titled "Detecting Propaganda Techniques in Code-Switched Social Media Text"

  code-switchinglow-resource-languagesnatural-language-processingpropaganda-detection
  Language:Jupyter Notebook 7

• DinoTheDinosaur / ml_determination

  A package for determining the matrix language in bilingual sentences

  code-switchingmatrix-languagemultilingual
  Language:Python 6

• enesyugan / PIER-CodeSwitching-Evaluation

  Point of Interest Error Rate (PIER) Metric for Code-Switching ASR: A specialized evaluation metric designed to focus on critical points in multilingual speech recognition, providing a more accurate analysis of code-switched utterances.

  asrcode-switchingevaluation-metricsmultilingual-asrpier
  Language:Python 5

• pika-online / Foreign_Pronunciation_Generator_for_Code-Switch_ASR

  a socket script to obtain chinese phones-sequence for any english word

  code-switchingasrpronunciation-lexicon-generationkaldi
  Language:Python 5

• sophiayk20 / covoswitch

  Code for "CoVoSwitch: Machine Translation of Synthetic Code-Switched Text Based on Intonation Units" (Accepted at ACL-SRW 2024) 🇹🇭

  acl2024code-switchingmachine-translationspeech-to-text
  Language:Python 5

• ishan00 / translation-for-code-switching-acl

  Official repository for the paper titled "From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text" accepted at ACL 2021

  acl2021code-switchinglanguage-modelingtranslation
  Language:Python 3

• vincenthuang75025 / chinglish

  Chrome extension for translating highlighted English text into Chinglish (a chinese + english hybrid)

  aws-lambdachrome-extensioncode-switchingnlpserverlesstranslation
  Language:Python 3

• 97arushisharma / Hindi-English-Code-Switching

  A simple UI to translate a text written in romanised hindi form to fully english sentence

  nltk-pythonpython3tkinter-guicode-switchinglanguage-translation
  Language:Lex 2
• tagLID

  andrianllmm / tagLID

  A word-level Language Identification (LID) tool for Tagalog-English (Taglish) text

  language-identificationnlptaglishcode-mixingcode-switchingenglishtagaloglinguistics
  Language:Python 2

• Nexdata-AI / 207-Hours-Japanese-Speaking-English-Speech-Data-by-Mobile-Phone

  Japanese Speaking English Speech Dataset

  asraudiocode-switchingdatasetdeep-learningdeeplearningspeech-recognitionspeech-to-text
  2

• vsoto / crowdsourced_bangor

  This repository contains crowdsourced universal part-of-speech tags for the Miami Bangor corpus.

  part-of-speechuniversalcode-switching
  2

• b-ashford / MIAMI-Corpus

  An English-Spanish code switching dataset adapted from the Miami-Corpus

  code-switchingdatasetdiarizationdiarisationrttmspeechmiami-corpusdata-set
  1

• ChingtingC / Code-Switching-Sentence-Generation-by-GAN

  Code-Switching Sentence Generation by Generative Adversarial Networks and its Application to Data Augmentation. (Interspeech 2019)

  code-switchinggenerative-adversarial-networkinterspeech
  Language:Python 1

• KjAeRsTuIsK / ArEnAV

  ArEnAV: Arabic English Audio Visual Code-Switching Deepfake Dataset

  arabic-englishaudio-visualcode-switchingdeepfakes
  1

• kjgpta / Code-Switch-Language-Modeling-for-English-and-Malay

  Code-Switched Data generation based on Part-of-speech and Language Modeling of the generated text.

  code-switchingdata-generationenglish-malaylanguage-modeling
  Language:Jupyter Notebook 1

• Lidan0241 / language-detection

  A language detection model for code-switched texts in es/en/zh

  code-mixingcode-switchingidentification-languagenlp
  Language:Jupyter Notebook 1

• Wei-RongRong2 / RojakLanguageSentimentAnalysis

  This is a machine learning project focused on analysing and classifying sentiments in code-switched and code-mixed text, specifically targeting the unique linguistic characteristics found in Malaysian conversations.

  code-mixingcode-switchingdeep-learningdocker-imageflask-applicationlstmmachine-learningmalaya-librarymalaysian-languagemultilingual-nlpmultinomial-naive-bayesnamed-entity-recognitionnatural-language-processingrender-deploymentsentiment-analysissupport-vector-machine
  Language:Jupyter Notebook 1