Kevin Ko's repositories
transformer
Transformer: PyTorch Implementation of "Attention Is All You Need"
nlp-datasets
Curation note of NLP datasets
summarizers
Package for controllable summarization
python-mecab-kor
Yet another python binding for mecab-ko
gpt2-tokenizer-java
Java implementation of GPT2 tokenizer.
kobart-transformers
Kobart model on Huggingface transformers
stop-sequencer
Implementation of stop sequencer for Huggingface Transformers
fast_retention
Speed up Parallel Retention about 2x times
hyunwoongko
miscellaneous
code-pipeline
Test repository for AWS code-pipeline deployment.
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Open-Assistant
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
python-nori
Pynori - Lucene Nori, Korean Mopological Analyzer, in Python
OpenRLHF
An Easy-to-use, Scalable and High-performance RLHF Framework (Support 70B+ full tuning & LoRA & Mixtral & KTO)
simpleDATrie
Simple Double Array Trie implementation
text-generation-inference
Large Language Model Text Generation Inference