Jong-hun Shin's repositories
cudnn.torch
Torch-7 FFI bindings for NVIDIA CuDNN
docker-elk
elasticsearch-kibana docker
EasyEdit
An Easy-to-use Knowledge Editing Framework for LLMs.
fast_align
Simple, fast unsupervised word aligner
fastT5
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
gbswt5
CharFormer(Tay et al., 2022; Gradient-based Subword Tokenizer + T5) model implementation for Huggingface Transformers
gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
KorNLUDatasets
KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding
lua-sentencepiece
A simple lua bindings for sentencepiece(https://github.com/google/sentencepiece) implementation
OpenNMT-py
Open Source Neural Machine Translation in PyTorch
seq2seq-attn
Sequence-to-sequence model with LSTM encoder/decoders and attention
InstructZero
Official Implementation of InstructZero; the first framework to optimize bad prompts of ChatGPT(API LLMs) and finally obtain good prompts!
lo-fit
LoFiT: Localized Fine-tuning on LLM Representations
overleaf_community_docker
Overleaf(sharelatex)를 on-prem으로 구동하기 위한 docker-compose script 등
text-generation-inference
Large Language Model Text Generation Inference
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
wmt16-scripts
scripts and configuration files for Edinburgh neural MT submission to WMT 16 shared translation task