cross-lingual

There are 1 repository under cross-lingual topic.

Separius / awesome-sentence-embedding
A curated list of pretrained sentence and word embedding models
awesome awesome-list bert contextualized-representation cross-lingual embedding-models language-model natural-language nlp pretrained-embedding pretrained-language-model pretrained-models sentence-embeddings sentence-representations subword-models unsupervised-learning word-embeddings wordembedding
Language:Python 2204
ictnlp / BayLing
“百聆”是一个基于LLaMA的语言对齐增强的英语/中文大语言模型，具有优越的英语/中文能力，在多语言和通用任务等多项测试中取得ChatGPT 90%的性能。BayLing is an English/Chinese LLM equipped with advanced language alignment, showing superior capability in English/Chinese generation, instruction following and multi-turn interaction.
aigc chinese cross-lingual general-language-model human-performance instruction-tuning interactive large-language-models multilingual-translation bayling chatgpt gpt4 machine-translation translation llama
Language:Python 292
artitw / text2text
Text2Text: Crosslingual NLP/G toolkit
nlp question-generation natural-language-processing natural-language-generation data-augmentation translator cross-lingual multi-lingual question-answering transformers levenshtein-distance embeddings backtranslation search tf-idf tokenizer information-retrieval summarization chatgpt llm
Language:Python 278
CZWin32768 / XNLG
AAAI-20 paper: Cross-Lingual Natural Language Generation via Pre-Training
cross-lingual nlg pretraining aaai20
Language:Python 128
ConsistencyVC / ConsistencyVC-voive-conversion
Using joint training speaker encoder with consistency loss to achieve cross-lingual voice conversion and expressive voice conversion
cross-lingual emotional-voice-conversion voice-conversion
Language:Python 123
ymcui / Cross-Lingual-MRC
Cross-Lingual Machine Reading Comprehension (EMNLP 2019)
natural-language-processing reading-comprehension bert cross-lingual cmrc2018 drcd
Language:Python 67
thespectrewithin / joint_align
Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework
cross-lingual nlp
Language:Python 52
chaitanyamalaviya / NeuralFactorGraph
This repo contains the code for the paper Neural Factor Graph Models for Cross-lingual Morphological Tagging.
morphology cross-lingual structured-prediction graphical-models
Language:Python 51
seahore / PPG-GradVC
A diffusion-based cross-lingual voice conversion model, as my bachelor's thesis
audio-processing diffusion-models phonetic-posteriorgram ppg ppg-features voice-conversion cross-language cross-lingual
Language:Python 43
google-research-datasets / swim-ir
SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 languages, generated using PaLM 2 and summarize-then-ask prompting.
cross-lingual datasets deep-learning information-retrieval machine-learning multilingual natural-language-processing neural-information-retrieval nlp training-data
42
GeekDream-x / SemEval2022-Task8-TonyX
Deep-learning system proposed by HFL for SemEval-2022 Task 8: Multilingual News Similarity
computational-linguistics cross-lingual crosslingual deep-learning machine-learning multi-lingual multilingual natural-language-processing nlp paper semantic-similarity semeval-2022 xlm-roberta
Language:Python 40
alexandra-chron / relm_unmt
Python source code for EMNLP 2020 paper "Reusing a Pretrained Language Model on Languages with Limited Corpora for Unsupervised NMT".
transfer-learning language-models cross-lingual pretraining low-resource-languages unsupervised-machine-translation residual-adapters
Language:Python 35
mhardalov / exams-qa
A Multi-subject High School Examinations Dataset for Cross-lingual and Multilingual Question Answering
cross-lingual crosslingual dataset exams multi-subject multilingual multiple-choice nlp question-answering reading-comprehension school-examinations-dataset
Language:Python 35
yaushian / mSimCSE
mSimCSE: Multilingual SimCSE
cross-lingual multi-lingual natural-language-processing sentence-embeddings
Language:Python 33
krystalan / ClidSum
EMNLP 2022: ClidSum: A Benchmark Dataset for Cross-Lingual Dialogue Summarization
cross-lingual cross-lingual-summarization dataset dialogue dialogue-summarization paper text-summarization
Language:Python 32
zliucr / mixed-language-training
Attention-Informed Mixed-Language Training for Zero-shot Cross-lingual Task-oriented Dialogue Systems (AAAI-2020)
cross-lingual zero-shot task-oriented-dialogue low-resource multilingual nlu dst
Language:Python 32
jxhe / cross-lingual-struct-flow
PyTorch implementation of ACL paper https://arxiv.org/abs/1906.02656
cross-lingual dependency-parsing invertible-transformation latent-variable-models pos-tagging
Language:Python 24
BobXWu / InfoCTM
Code for InfoCTM: A Mutual Information Maximization Perspective of Cross-lingual Topic Modeling (AAAI2023)
cross-lingual multilingual-topic-models topic-modeling
Language:Python 23
zliucr / Crosslingual-NLU
Zero-shot Cross-lingual Task-Oriented Dialogue Systems (EMNLP 2019)
cross-lingual zero-shot task-oriented-dialogue natural-language-understanding nlu low-resource multilingual
Language:Python 23
sheng-z / cross-lingual-open-ie
MT/IE: Cross-lingual Open Information Extraction with Neural Sequence-to-Sequence Models
tensorflow sequence-to-sequence openie cross-lingual
Language:Python 22
thunlp / CLSP
Code and data for EMNLP 2018 paper "Cross-lingual Lexical Sememe Prediction"
sememe cross-lingual
Language:C 20
zliucr / crosslingual-slu
EMNLP-2020: Cross-lingual Spoken Language Understanding with Regularized Representation Alignment
cross-lingual multilingual dialogue spoken-language-understanding slu task-oriented-dialogue low-resource few-shot zero-shot
Language:Python 18
checkstep / senti-stance
Few-Shot Cross-Lingual Stance Detection with Sentiment-Based Pre-Training
nlp ai cross-lingual few-shot stance stance-detection pattern-exploiting sentiment-analysis sentiment label-encoder multilingual
Language:Python 17
SapienzaNLP / unify-srl
Unifying Cross-Lingual Semantic Role Labeling with Heterogeneous Linguistic Resources (NAACL-2021).
nlp deep-learning semantics cross-lingual semantic-role-labeling
Language:Python 17
shimo-lab / Universal-Geometry-with-ICA
Discovering Universal Geometry in Embeddings with ICA
cross-lingual embeddings ica independent-component-analysis interpretability pca principal-component-analysis whitening isotropy emnlp emnlp2023
Language:Python 16
shyamupa / xling-el
pytorch model for cross-lingual entity linking.
cross-lingual entity-linking pytorch
Language:Python 16
BobXWu / CNPMI
Cross-lingual Normalized Pointwise Mutual Information for cross-lingual topic evaluation.
cross-lingual multilingual-topic-models topic-modeling
Language:Python 14
GeorgeVern / smala
Python source code for EMNLP 2021 Findings paper: "Subword Mapping and Anchoring Across Languages".
cross-lingual xnli language-model machine-translation
Language:Python 13
princeton-nlp / MultilingualAnalysis
Repository for the paper titled: "When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer"
multilingual transformers multilingual-bert zero-shot cross-lingual
Language:Python 13
nutcrtnk / DHGNet
Code for paper "Cross-lingual Transfer for Text Classification with Dictionary-based Heterogeneous Graph", EMNLP 2021 - findings.
text-classification cross-lingual cross-lingual-embeddings graph-neural-networks word-embeddings
Language:Python 12
xANLG
Pzoom522 / xANLG
Data and code for "Understanding Linearity of Cross-Lingual Word Embedding Mappings" (TMLR 2022)
cross-lingual word-analogy word-embedding natural-language-processing
Language:Python 12
Youggls / ACROSS-ACL23
Official code repo for paper: ACROSS: An Alignment-based Framework for Low-Resource Many-to-One Cross-Lingual Summarization
cross-lingual lm nlp python summarization
12
maum-ai / sane-tts
SANE-TTS: Stable And Natural End-to-End Multilingual Text-to-Speech
cross-lingual multilingual speech-syntheis text-to-speech tts
11
anlausch / XWEAT
Cross-lingual version of WEAT
bias cross-lingual natural-language-processing word-embeddings
Language:Python 9
jhliu17 / xlingual-mrc
Code for the paper "Cross-lingual Machine Reading Comprehension with Language Branch Knowledge Distillation" (COLING 2020)
benchmark cross-lingual machine-reading-comprehension mlqa xquad
Language:Python 8
sedflix / unsacmt
Unsupervised Sentiment Analysis for Code-mixed Data
sentiment-analysis code-mixed code-switching embeddings cross-lingual multi-lingual zero-shot-learning unsupervised
Language:Jupyter Notebook 8

cross-lingual

Separius / awesome-sentence-embedding

ictnlp / BayLing

artitw / text2text

CZWin32768 / XNLG

ConsistencyVC / ConsistencyVC-voive-conversion

ymcui / Cross-Lingual-MRC

thespectrewithin / joint_align

chaitanyamalaviya / NeuralFactorGraph

seahore / PPG-GradVC

google-research-datasets / swim-ir

GeekDream-x / SemEval2022-Task8-TonyX

alexandra-chron / relm_unmt

mhardalov / exams-qa

yaushian / mSimCSE

krystalan / ClidSum

zliucr / mixed-language-training

jxhe / cross-lingual-struct-flow

BobXWu / InfoCTM

zliucr / Crosslingual-NLU

sheng-z / cross-lingual-open-ie

thunlp / CLSP

zliucr / crosslingual-slu

checkstep / senti-stance

SapienzaNLP / unify-srl

shimo-lab / Universal-Geometry-with-ICA

shyamupa / xling-el

BobXWu / CNPMI

GeorgeVern / smala

princeton-nlp / MultilingualAnalysis

nutcrtnk / DHGNet

Pzoom522 / xANLG

Youggls / ACROSS-ACL23

maum-ai / sane-tts

anlausch / XWEAT

jhliu17 / xlingual-mrc

sedflix / unsacmt