Giters

docker / genai-stack

Langchain + Docker + Neo4j + Ollama

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Pulling manifest......

Kannan665 opened this issue · comments

commented

Every time, when I start the genai-stack using "docker compose --profile linux-gpu up", I am able to see the following stack of containers fired-up....

docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
a25d59ab30b3 ollama/ollama:latest "/bin/ollama serve" 8 minutes ago Up 8 minutes 11434/tcp genai-stack-llm-gpu-1
961a9c47f33f genai-stack-front-end "npm run dev" 10 minutes ago Up 54 seconds 0.0.0.0:8505->8505/tcp, :::8505->8505/tcp genai-stack-front-end-1
9f79929d20ca genai-stack-bot "streamlit run bot.p…" 10 minutes ago Up About a minute (healthy) 0.0.0.0:8501->8501/tcp, :::8501->8501/tcp genai-stack-bot-1
640e183a4b1f genai-stack-api "uvicorn api:app --h…" 10 minutes ago Up About a minute (healthy) 0.0.0.0:8504->8504/tcp, :::8504->8504/tcp genai-stack-api-1
e8c060ee60a1 genai-stack-loader "streamlit run loade…" 10 minutes ago Up About a minute (health: starting) 0.0.0.0:8502->8502/tcp, :::8502->8502/tcp, 0.0.0.0:8081->8080/tcp, :::8081->8080/tcp genai-stack-loader-1
9966fe097a20 genai-stack-pdf_bot "streamlit run pdf_b…" 10 minutes ago Up About a minute (healthy) 0.0.0.0:8503->8503/tcp, :::8503->8503/tcp genai-stack-pdf_bot-1
86e9733bb4ba genai-stack/pull-model:1.0 "bb -f pull_model.clj" 10 minutes ago Exited (0) About a minute ago genai-stack-pull-model-1
ea48c6568915 neo4j:5.11 "tini -g -- /startup…" 10 minutes ago Up 8 minutes (healthy) 0.0.0.0:7474->7474/tcp, :::7474->7474/tcp, 7473/tcp, 0.0.0.0:7687->7687/tcp, :::7687->7687/tcp genai-stack-database-1
f23d832a09e8 ollama/ollama:latest "/bin/ollama serve" 10 minutes ago Exited (0) 9 minutes ago 11434/tcp genai-stack-llm-1

But it repeats "pulling manifest" everytime.....
Am I missing something here?
Once the Pull model is completed in a running docker stack instance, should I commit any of the running docker containers?

Warm Regards............Kannan Rama

commented

You mean the download restart from zero at each startup?

It shouldn't do that, are you using docker compose down instead of docker compose stop by any chance, that would delete the container (and the model with it)?

If it is something else, I would add a mount volume, but it shouldn't be necessary... Are you still experiencing the issue?

commented

You mean the download restart from zero at each startup?

It shouldn't do that, are you using docker compose down instead of docker compose stop by any chance, that would delete the container (and the model with it)?

If it is something else, I would add a mount volume, but it shouldn't be necessary... Are you still experiencing the issue?

Thanks for your response, but I did not see it for almost 2 weeks......Today, I am trying the docker gen-ai stack again......Will check based on the inputs, given by you......