speech-translation

There are 6 repositories under speech-translation topic.

PaddlePaddle / PaddleSpeech
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.
transformer conformer speech-translation streaming-asr speech-alignment punctuation-restoration streaming-tts speech-synthesis tts asr kws speech-recognition sound-classification voice-cloning vocoder voice-recognition self-supervised-learning wav2vec2 whisper code-switch
Language:Python 10093
NVIDIA / NeMo
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
machine-translation speaker-recognition asr tts generative-ai multimodal deeplearning neural-networks speaker-diariazation speech-translation speech-synthesis large-language-models
Language:Python 10012
espnet / espnet
End-to-End Speech Processing Toolkit
chainer deep-learning end-to-end kaldi machine-translation pytorch singing-voice-synthesis speaker-diarization speech-enhancement speech-recognition speech-separation speech-synthesis speech-translation spoken-language-understanding voice-conversion
Language:Python 7863
microsoft / SpeechT5
Unified-Modal Speech-Text Pre-Training for Spoken Language Processing
speech-pretraining speech2c speecht5 speechlm speechut speech-recognition speech-synthesis speech-translation speech-text-pretraining vallex vatlm
Language:Python 999
zhangshaolei1998 / Awesome-Simultaneous-Translation
Paper list of simultaneous translation / streaming translation, including text-to-text machine translation and speech-to-text translation.
machine-translation simultaneous-translation natural-language-processing speech-translation text-translation awesome paper paperlist nlp simultaneous-machine-translation streaming
545
Dadangdut33 / Speech-Translate
A realtime speech transcription and translation application using Whisper OpenAI and free translation API. Interface made using Tkinter. Code written fully in Python.
python speech-transcription speech-translation tkinter-python translate whisper
Language:Python 384
double22a / speech_dataset
The dataset of Speech Recognition
asr speech-recognition deep-learning dataset audio deep-neural-networks wav speech-to-text speech tts speech-synthesis voice-conversion speech-translation speech-enhancement speech-diarization speech-separation speech-segmentation text-to-speech automatic-speech-recognition
352
kahne / SpeechTransProgress
Tracking the progress in end-to-end speech translation
natural-language-generation speech-translation artificial-intelligence spoken-language-processing machine-translation natural-language-processing speech-processing spoken-language-translation
238
dqqcasia / awesome-speech-translation
speech-processing speech-translation simultaneous-translation machine-translation text-translation speech-recognition natural-language-processing multimodal-machine-translation speech-to-speech cascaded-speech-translation multimodal-machine-learning non-autoregressive-translation disfluency-detection punctuation-restoration speech-to-subtitles speech-synthesis speech
169
bzhangGo / zero
Zero -- A neural machine translation system
aan adaptive-feature-selection average-attention-network deep-transformer depth-scaled-initialization fast-bidirectional-decoder l0drop massively-multilingual-translation neural-machine-translation opus-100 speech-translation transformer
Language:Python 145
echogarden-project / echogarden
Integrated speech toolset designed to be accessible to end-users. Fully open-source.
forced-alignment language-identification speech speech-alignment speech-recognition speech-synthesis speech-to-text speech-translation text-to-speech language-detection
Language:TypeScript 75
ReneeYe / ConST
code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)
contrastive-learning machine-translation neural-machine-translation pytorch speec speech-translation transformer translation spoken-language-processing naacl2022
Language:Python 54
ictnlp / DASpeech
Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".
machine-translation speech-to-speech speech-to-speech-translation speech-translation
Language:Python 53
ictnlp / STEMM
Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".
machine-translation speech-to-text speech-translation
Language:Python 34
mt-upc / SHAS
SHAS: Approaching optimal Segmentation for End-to-End Speech Translation
audio-segmentation speech-translation speech-to-text speech wav2vec2
Language:Python 33
George0828Zhang / torch_cif
A fast parallel PyTorch implementation of the "CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition" https://arxiv.org/abs/1905.11235.
pytorch cif continuous-integrate-and-fire alignment asr automatic-speech-recognition monotonic speech speech-recognition speech-to-text speech-translation torch
Language:Python 28
hlt-mt / FBK-fairseq
Repository containing the open source code of works published at the FBK MT unit.
deep-learning pytorch speech-to-text speech-translation gender-bias simultaneous-translation subtitling
Language:Python 28
ictnlp / DiSeg
Source code for ACL 2023 paper "End-to-End Simultaneous Speech Translation with Differentiable Segmentation"
machine-translation segment segmentation sequence-segmentation simultaneous-machine-translation simultaneous-translation speech speech-translation streaming streaming-speech-to-text
Language:Python 27
George0828Zhang / simulst
PyTorch toolkit for streaming speech recognition, speech translation and simultaneous translation based on fairseq.
pytorch streaming speech-recognition speech-to-text speech-translation simultaneous-translation
Language:Python 21
Rongjiehuang / awesome-speech-to-speech-translation
List of direct speech-to-speech translation papers.
speech-translation s2st speech-to-speech-translation awesome awesome-list
21
liamdugan / speech-to-speech
Code for the INTERSPEECH 2023 paper "Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models"
simultaneous-translation speech-processing speech-to-speech speech speech-translation
Language:Python 19
VinAIResearch / PhoST
A High-Quality and Large-Scale Dataset for English-Vietnamese Speech Translation (INTERSPEECH 2022)
benchmark-dataset english english-to-vietnamese machine-translation phost speech-translation vietnamese
19
ReneeYe / XSTNet
This is an implementation of paper "End-to-end Speech Translation via Cross-modal Progressive Training" (Interspeech2021)
interspeech2021 machine-translation neural-machine-translation speech-recognition speech-translation spoken-language-processing tensorflow2
Language:Python 18
mt-upc / ZeroSwot
Pushing the Limits of Zero-shot End-to-End Speech Translation
speech-translation translation
Language:Python 15
ictnlp / CRESS
Code for ACL 2023 main conference paper "Understanding and Bridging the Modality Gap for Speech Translation".
machine-translation speech-to-text speech-translation
Language:Python 12
ictnlp / ITST
Code for EMNLP 2022 main conference paper "Information-Transport-based Policy for Simultaneous Translation"
end-to-end-speech-translation machine-translation simultaneous-machine-translation simultaneous-translation speech-translation
Language:Python 12
bzhangGo / st_from_scratch
Revisiting End-to-End Speech-to-Text Translation From Scratch
speech-to-text-translation end-to-end-speech-translation speech-translation speech-translation-from-scratch
Language:Python 11
IESTAC
Giuseppe-Della-Corte / IESTAC
A corpus that can be used to train English-to-Italian End-to-End Speech-to-Text Machine Translation models
machine-translation speech-translation corpus parallel-corpus parallel-corpora end-to-end-machine-learning forced-alignment speech-processing mfcc-features bitext sentence-embeddings sentence-similarity statistical-machine-translation speech-recognition text-processing text-preprocessinig web-scraping named-entity-recognition audio-data sql-database
11
ictnlp / BT4ST
Code for ACL 2023 main conference paper "Back Translation for Speech-to-text Translation Without Transcripts".
machine-translation speech-to-text speech-translation
Language:Python 10
KevKibe / African-Whisper
🚀 Seamlessly fine-tune and deploy Whisper model.
asr speech speech-recognition speech-to-text speech-transcription speech-translation whisper
Language:Python 9
xuchennlp / S2T
The project for speech translation
speech-translation speech-recognition speech-to-text
Language:Python 8
JeffWang0325 / Microsoft-Azure-Cognitive-Services
🖍️ This project combines multiple operations in Microsoft Azure Cognitive Services into one GUI, including QnA Maker, LUIS, Computer Vision, Custom Vision, Face, Form Recognizer, Text To Speech, Speech To Text and Speech Translation. It's very user-friendly for users to implement any operation mentioned above.
microsoft azure cognitive-services computer-vision luis luis-ai qnamaker qna-maker speech-recognition speech-to-text speech-synthesis text-to-speech translation speech-translation customvision face-recognition face-detection face formrecognizer
Language:C# 7
mt-upc / iwslt-2022
Systems submitted to IWSLT 2022 by the MT-UPC group.
adapters fine-tuning pretrained-models speech-to-speech speech-translation translation
Language:Python 7
csikasote / bigc
This repository contains the data resources for the LacunaFund supported project, Multimodal datasets for the Bemba Language of Zambia.
bemba-language machine-translation speech-recognition speech-translation zambia africa-language image-grounded-conversations multimodal-learning
5
tran-khoa / joint-training-cascaded-st
Code for the paper "Does Joint Training Really Help Cascaded Speech Translation?" (EMNLP 2022)
emnlp2022 fairseq nlp speech-translation
Language:Python 3
yousef0sa / Speech-To-Text
Speech-To-Text is a C# desktop app that uses Azure Cognitive Services to convert and translate speech. You can copy or show the text on the screen, and choose the language of the speech or the translation.
azure-cognitive-services c-sharp desktop-application dotnet speech-to-text speech-translation
Language:C# 2

speech-translation

PaddlePaddle / PaddleSpeech

NVIDIA / NeMo

espnet / espnet

microsoft / SpeechT5

zhangshaolei1998 / Awesome-Simultaneous-Translation

Dadangdut33 / Speech-Translate

double22a / speech_dataset

kahne / SpeechTransProgress

dqqcasia / awesome-speech-translation

bzhangGo / zero

echogarden-project / echogarden

ReneeYe / ConST

ictnlp / DASpeech

ictnlp / STEMM

mt-upc / SHAS

George0828Zhang / torch_cif

hlt-mt / FBK-fairseq

ictnlp / DiSeg

George0828Zhang / simulst

Rongjiehuang / awesome-speech-to-speech-translation

liamdugan / speech-to-speech

VinAIResearch / PhoST

ReneeYe / XSTNet

mt-upc / ZeroSwot

ictnlp / CRESS

ictnlp / ITST

bzhangGo / st_from_scratch

Giuseppe-Della-Corte / IESTAC

ictnlp / BT4ST

KevKibe / African-Whisper

xuchennlp / S2T

JeffWang0325 / Microsoft-Azure-Cognitive-Services

mt-upc / iwslt-2022

csikasote / bigc

tran-khoa / joint-training-cascaded-st

yousef0sa / Speech-To-Text