Takuya Makino's starred repositories
mistral.rs
Blazingly fast LLM inference.
Causality4NLP_Papers
A reading list for papers on causality for natural language processing (NLP)
causal-text-papers
Curated research at the intersection of causal inference and natural language processing.
PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
text-generation-inference
Large Language Model Text Generation Inference
llama-cpp-python
Python bindings for llama.cpp
CaBERT-SLU
Interspeech 2021: Context-Aware Hierarchical BERT Fushion Network for multiple dialog act detection
mistral-inference
Official inference library for Mistral models