defenseunicorns / leapfrogai

Production-ready Generative AI for local, cloud native, airgap, and edge deployments.

Home Page:https://leapfrog.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

chore: Slim down the things getting installed into the the vLLM Dockerfile

YrrepNoj opened this issue · comments

Describe what should be investigated or refactored

Right now we are installing several things into our vLLM container that we are not installing into the other model containers. Most of these installations are necessary, but some could potentially be removed.

Go through the things being installed (especially things being installed via apt-get) and either:

  1. Remove the installation if it is unnecessary
  2. Leave a comment describing WHY it is necessary to install

Links to any relevant code