Rocke Dong's repositories
ColabFold
Making Protein folding accessible to all!
ChatGLM-6B
ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
Struct2Graph
A PyTorch implementation of GCN with mutual attention for protein-protein interaction prediction
PeptideBERT
Transformer Based Language Model for Peptide Property Prediction
PDGA-MAP4_AP
peptide design
NeuroPred-PLM
neuropeptide prediction
biopython.github.io
Source of biopython.org website, migrated from MediaWiki
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
wikiextractor
A tool for extracting plain text from Wikipedia dumps
SimCSE
[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
Firefly
Firefly(流萤): 中文对话式大语言模型(全量微调+QLoRA),支持微调Aquila2、Baichuan2、CodeLlama、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya、Bloom等大模型
Chinese-LLaMA-Alpaca-2
中文LLaMA-2 & Alpaca-2大模型二期项目 + 16K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs, including 16K long context models)
llama
Inference code for LLaMA models
Efficient-Tuning-LLMs
Easy and Efficient Finetuning of QLoRA LLMs. (Supported LLama, LLama2, bloom, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
DeepNeuropePred
DeepNeuropePred:a robust tool to predict cleavage sites in neuropeptide precursors
Firefly-LLaMA2-Chinese
Firefly中文LLaMA-2大模型,支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型
open_clip
An open source implementation of CLIP.
Chinese-CLIP
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
reinforcement-learning-an-introduction
Python Implementation of Reinforcement Learning: An Introduction
nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
BayesianOptimization
A Python implementation of global optimization with gaussian processes.
PyTorch-VAE
A Collection of Variational Autoencoders (VAE) in PyTorch.
Wasserstein-AutoEncoders
PyTorch implementation of Wasserstein Auto-Encoders
wrapt_timeout_decorator
Python Powerful Timeout Decorator that can be used safely on classes, methods, class methods