distributed-llm

There are 0 repository under distributed-llm topic.

distributed-llama
b4rtaz / distributed-llama
Tensor parallelism is all you need. Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.
distributed-computing distributed-llm llama2 llama3 llm llm-inference llms neural-network open-llm
Language:C++ 1001

b4rtaz / distributed-llama