Saiting Lf's repositories
oh_my_loam
ROS-free implementation of LOAM
network-representation-learning
network-representation-learning: DeepWalk, LINE, Node2Vec, GraRep
oh_my_vslam
my implementation of visual slam, it's ros-free!
postdoc-report-latex-template-zju
postdoc report latex template for Zhejiang University (ZJU)
pytorch-llm-infer
pytorch llm inference: oh my implementation (from scratch) of some famous large language model (LLM) for inference purpose only.
Language:Jupyter NotebookMIT000
Language:C++000
fastllm
纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行
Language:C++Apache-2.0000
feixyz10.github.io
My site
ggml
Tensor library for machine learning
Language:CMIT000
inferflow
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
Language:C++MIT000
ohLLM
Pure C++ LLM inference engine, support quantization, mainstream LLM models, GPUs...
Language:PythonMIT000
Language:C000
TinyChatEngine
TinyChatEngine: On-Device LLM Inference Library
MIT000