GRPC: stderr load_binding_model: error: unable to load model
pasqualesimonetti opened this issue · comments
LocalAGI version:
August, 25th 2023
Environment, CPU architecture, OS, and version:
MacBook Pro 2018
Intel x86 Core i7 2,6 GHz
16 GB 2400. MHz DDR4
macOS Ventura 13.5.1
Docker Desktop 4.22.0
Issue:
GRPC: stderr load_binding_model: error: unable to load model
How to reproduce:
1. Clone the repository
git clone https://github.com/mudler/LocalAGI.git
cd LocalAGI
2. Comment or delete the following lines in docker-compose.yaml file
docker-compose.yaml file devices:
- /dev/snd
to avoid this error...
Error response from daemon: error gathering device information while adding custom device "/dev/snd": no such file or directory
(Even brew install pulseaudio && brew services start pulseaudio isn't enough to solve this issue).
3. Then run the container with the --skip-avatar argument to avoid the following error...
--skip-avatar argument to avoid the following error...INFO | __main__:<module>:391 - Creating avatar, please wait...
Traceback (most recent call last):
File "/app/./main.py", line 392, in <module>
display_avatar(localagi)
File "/app/./main.py", line 158, in display_avatar
image_url = agi.get_avatar(input_text, model)
TypeError: LocalAGI.get_avatar() takes 2 positional arguments but 3 were given
Here is LocalAGI log:
% docker-compose run -i --rm localagi --skip-avatar
[+] Running 20/20
✔ api 19 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 1127.4s
✔ 6a70103cc499 Already exists 0.0s
✔ ccb4221e2c63 Already exists 0.0s
✔ 9fe6e67e69c8 Already exists 0.0s
✔ d4960566fad8 Pull complete 60.9s
✔ 75df79f77651 Pull complete 128.8s
✔ 2aea24d2c7fb Pull complete 128.9s
✔ 2c0457ed6212 Pull complete 157.2s
✔ 4f4fb700ef54 Pull complete 157.3s
✔ a05ae947f92c Pull complete 159.3s
✔ 38f15235e87f Pull complete 164.2s
✔ 1b63c30bfd38 Pull complete 355.6s
✔ e33ff4fe2f50 Pull complete 1028.4s
✔ 8562064ddd50 Pull complete 1034.7s
✔ 32f598439fb4 Pull complete 1036.5s
✔ 8fbc41ea9b16 Pull complete 1065.0s
✔ 48c0b51e5e89 Pull complete 1072.4s
✔ a2ea6b91b6ef Pull complete 1072.7s
✔ 267e23db1f55 Pull complete 1116.1s
✔ f3ce65614ee7 Pull complete 1123.9s
[+] Creating 2/2
✔ Network localagi_default Created 0.3s
✔ Container localagi-api-1 Created 1.8s
[+] Running 1/1
✔ Container localagi-api-1 Started 1.3s
[+] Building 17.3s (13/13) FINISHED docker:desktop-linux
=> [localagi internal] load build definition from Dockerfile 0.3s
=> => transferring dockerfile: 456B 0.1s
=> [localagi internal] load .dockerignore 0.3s
=> => transferring context: 51B 0.0s
=> [localagi internal] load metadata for docker.io/library/python:3.10-b 2.3s
=> [localagi auth] library/python:pull token for registry-1.docker.io 0.0s
=> [localagi 1/7] FROM docker.io/library/python:3.10-bullseye@sha256:02c 0.0s
=> [localagi internal] load build context 0.1s
=> => transferring context: 215.89kB 0.1s
=> CACHED [localagi 2/7] WORKDIR /app 0.0s
=> CACHED [localagi 3/7] COPY ./requirements.txt /app/requirements.txt 0.0s
=> CACHED [localagi 4/7] RUN pip install --no-cache-dir -r requirements. 0.0s
=> CACHED [localagi 5/7] RUN apt-get update -y && apt-get install -y 0.0s
=> [localagi 6/7] COPY . /app 0.6s
=> [localagi 7/7] RUN pip install . 13.7s
=> [localagi] exporting to image 0.1s
=> => exporting layers 0.1s
=> => writing image sha256:384ae0e839bc4f372ebc384065877176a6aa5ae4cac81 0.0s
=> => naming to docker.io/library/localagi-localagi 0.0s
2023-08-25 16:17:25.098 | INFO | __main__:<module>:366 - Creating LocalAGI instance
2023-08-25 16:17:25.099 | INFO | __main__:<module>:387 - Welcome to LocalAGI
2023-08-25 16:17:25.099 | INFO | __main__:<module>:397 - LocalAGI internally can do the following actions: 'search_internet' 'save_file' 'save_memory' 'search_memory' 'plan' 'reply'
2023-08-25 16:17:25.099 | INFO | __main__:<module>:400 - >>> Interactive mode <<<
2023-08-25 16:17:25.099 | INFO | __main__:<module>:420 - >>> Ready! What can I do for you? ( try with: plan a roadtrip to San Francisco ) <<<
>>> plan a roadtrip to San Francisco
2023-08-25 16:17:54.995 | ERROR | localagi.localagi:evaluate:499 - ==> error:
2023-08-25 16:17:54.995 | ERROR | localagi.localagi:evaluate:500 - could not load model: rpc error: code = Unknown desc = failed loading model {"error":{"code":500,"message":"could not load model: rpc error: code = Unknown desc = failed loading model","type":""}} 500 {'error': {'code': 500, 'message': 'could not load model: rpc error: code = Unknown desc = failed loading model', 'type': ''}} {'Date': 'Fri, 25 Aug 2023 16:17:54 GMT', 'Content-Type': 'application/json', 'Content-Length': '120'}
2023-08-25 16:17:54.996 | INFO | localagi.localagi:evaluate:618 - ==> no action needed
Traceback (most recent call last):
File "/app/./main.py", line 425, in <module>
conversation_history=localagi.evaluate(
File "/usr/local/lib/python3.10/site-packages/localagi/localagi.py", line 626, in evaluate
response = self.converse(conversation_history)
File "/usr/local/lib/python3.10/site-packages/localagi/localagi.py", line 289, in converse
response = openai.ChatCompletion.create(
File "/usr/local/lib/python3.10/site-packages/openai/api_resources/chat_completion.py", line 25, in create
return super().create(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/openai/api_resources/abstract/engine_api_resource.py", line 153, in create
response, _, api_key = requestor.request(
File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 298, in request
resp, got_stream = self._interpret_response(result, stream)
File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 700, in _interpret_response
self._interpret_response_line(
File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 765, in _interpret_response_line
raise self.handle_error_response(
openai.error.APIError: could not load model: rpc error: code = Unknown desc = failed loading model {"error":{"code":500,"message":"could not load model: rpc error: code = Unknown desc = failed loading model","type":""}} 500 {'error': {'code': 500, 'message': 'could not load model: rpc error: code = Unknown desc = failed loading model', 'type': ''}} {'Date': 'Fri, 25 Aug 2023 16:17:56 GMT', 'Content-Type': 'application/json', 'Content-Length': '120'}
Here is LocalAGI API full log:
2023-08-25 17:11:07 localagi-api-1 | @@@@@
2023-08-25 17:11:07 localagi-api-1 | Skipping rebuild
2023-08-25 17:11:07 localagi-api-1 | @@@@@
2023-08-25 17:11:07 localagi-api-1 | If you are experiencing issues with the pre-compiled builds, try setting REBUILD=true
2023-08-25 17:11:07 localagi-api-1 | If you are still experiencing issues with the build, try setting CMAKE_ARGS and disable the instructions set as needed:
2023-08-25 17:11:07 localagi-api-1 | CMAKE_ARGS="-DLLAMA_F16C=OFF -DLLAMA_AVX512=OFF -DLLAMA_AVX2=OFF -DLLAMA_FMA=OFF"
2023-08-25 17:11:07 localagi-api-1 | see the documentation at: https://localai.io/basics/build/index.html
2023-08-25 17:11:07 localagi-api-1 | Note: See also https://github.com/go-skynet/LocalAI/issues/288
2023-08-25 17:11:07 localagi-api-1 | @@@@@
2023-08-25 17:11:07 localagi-api-1 | CPU info:
2023-08-25 17:11:07 localagi-api-1 | model name : Intel(R) Core(TM) i7-8850H CPU @ 2.60GHz
2023-08-25 17:11:07 localagi-api-1 | flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch fsgsbase bmi1 hle avx2 smep bmi2 erms rdseed adx smap clflushopt xsaveopt xsavec xgetbv1 arat
2023-08-25 17:11:07 localagi-api-1 | CPU: AVX found OK
2023-08-25 17:11:07 localagi-api-1 | CPU: AVX2 found OK
2023-08-25 17:11:08 localagi-api-1 | CPU: no AVX512 found
2023-08-25 17:11:08 localagi-api-1 | @@@@@
2023-08-25 17:11:08 localagi-api-1 | 3:11PM INF Starting LocalAI using 14 threads, with models path: /models
2023-08-25 17:11:08 localagi-api-1 | 3:11PM INF LocalAI version: d15508f (d15508f52c1b7227546e0eadffd082afe353c7c3)
2023-08-25 17:11:09 localagi-api-1 | 3:11PM DBG Extracting backend assets files to /tmp/localai/backend_data
2023-08-25 17:11:26 localagi-api-1 | 3:11PM DBG Config overrides map[context_size:2048 f16:true mirostat:2 mirostat_eta:0.1 mirostat_tau:5 mmap:true parameters:map[model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin temperature:0.1 top_k:40 top_p:0.95]]
2023-08-25 17:11:26 localagi-api-1 | 3:11PM DBG Checking "wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin" exists and matches SHA
2023-08-25 17:11:26 localagi-api-1 | 3:11PM DBG Downloading "https://huggingface.co/TheBloke/WizardLM-13B-V1.0-Uncensored-GGML/resolve/main/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin"
2023-08-25 17:11:27 localagi-api-1 | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 32.0 KiB/7.3 GiB (0.00%) ETA: 1160h1m23.158882454s
2023-08-25 17:11:32 localagi-api-1 | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 25.1 MiB/7.3 GiB (0.33%) ETA: 1h51m13.573270482s
2023-08-25 17:11:37 localagi-api-1 | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 49.5 MiB/7.3 GiB (0.66%) ETA: 1h8m47.092130707s
2023-08-25 17:11:42 localagi-api-1 | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 71.8 MiB/7.3 GiB (0.96%) ETA: 55m52.577308996s
2023-08-25 17:11:47 localagi-api-1 | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 92.0 MiB/7.3 GiB (1.23%) ETA: 50m13.935110964s
2023-08-25 17:11:52 localagi-api-1 | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 114.7 MiB/7.3 GiB (1.53%) ETA: 45m32.762191754s
2023-08-25 17:11:57 localagi-api-1 | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 139.5 MiB/7.3 GiB (1.86%) ETA: 41m43.801512221s
2023-08-25 17:12:02 localagi-api-1 | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 166.6 MiB/7.3 GiB (2.22%) ETA: 38m29.518137494s
2023-08-25 17:12:07 localagi-api-1 | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 195.9 MiB/7.3 GiB (2.61%) ETA: 35m42.22766659s
2023-08-25 17:12:12 localagi-api-1 | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 227.0 MiB/7.3 GiB (3.03%) ETA: 33m20.958874437s
2023-08-25 17:12:22 localagi-api-1 | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 253.6 MiB/7.3 GiB (3.38%) ETA: 34m42.90436436s
2023-08-25 17:12:27 localagi-api-1 | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 294.0 MiB/7.3 GiB (3.92%) ETA: 31m49.174989357s
2023-08-25 17:12:32 localagi-api-1 | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 333.6 MiB/7.3 GiB (4.45%) ETA: 29m40.80482878s
2023-08-25 17:12:37 localagi-api-1 | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 374.5 MiB/7.3 GiB (4.99%) ETA: 27m52.411444056s
2023-08-25 17:12:42 localagi-api-1 | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 414.7 MiB/7.3 GiB (5.53%) ETA: 26m27.03396895s
2023-08-25 17:12:47 localagi-api-1 | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 453.7 MiB/7.3 GiB (6.05%) ETA: 25m20.443821888s
2023-08-25 17:12:52 localagi-api-1 | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 493.4 MiB/7.3 GiB (6.58%) ETA: 24m21.317492521s
2023-08-25 17:12:57 localagi-api-1 | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 532.3 MiB/7.3 GiB (7.10%) ETA: 23m32.545553841s
2023-08-25 17:13:02 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 562.7 MiB/7.3 GiB (7.50%) ETA: 23m11.984294504s
2023-08-25 17:13:07 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 593.9 MiB/7.3 GiB (7.92%) ETA: 22m51.208973299s
2023-08-25 17:13:12 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 624.3 MiB/7.3 GiB (8.32%) ETA: 22m33.730933172s
2023-08-25 17:13:17 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 656.0 MiB/7.3 GiB (8.75%) ETA: 22m14.615396656s
2023-08-25 17:13:22 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 685.4 MiB/7.3 GiB (9.14%) ETA: 22m1.674150039s
2023-08-25 17:13:27 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 715.9 MiB/7.3 GiB (9.54%) ETA: 21m47.063076868s
2023-08-25 17:13:32 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 744.6 MiB/7.3 GiB (9.93%) ETA: 21m36.845879927s
2023-08-25 17:13:37 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 771.1 MiB/7.3 GiB (10.28%) ETA: 21m30.995989232s
2023-08-25 17:13:44 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 793.3 MiB/7.3 GiB (10.58%) ETA: 21m49.084205443s
2023-08-25 17:13:49 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 822.4 MiB/7.3 GiB (10.96%) ETA: 21m37.991246358s
2023-08-25 17:13:54 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 850.3 MiB/7.3 GiB (11.34%) ETA: 21m29.258105183s
2023-08-25 17:13:59 localagi-api-1 | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 879.1 MiB/7.3 GiB (11.72%) ETA: 21m19.249936622s
2023-08-25 17:14:04 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 908.5 MiB/7.3 GiB (12.11%) ETA: 21m8.684302416s
2023-08-25 17:14:09 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 937.8 MiB/7.3 GiB (12.50%) ETA: 20m58.578750544s
2023-08-25 17:14:14 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 971.4 MiB/7.3 GiB (12.95%) ETA: 20m42.412434857s
2023-08-25 17:14:19 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 994.9 MiB/7.3 GiB (13.26%) ETA: 20m41.495523441s
2023-08-25 17:14:24 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1021.4 MiB/7.3 GiB (13.62%) ETA: 20m35.994690129s
2023-08-25 17:14:29 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.0 GiB/7.3 GiB (13.99%) ETA: 20m28.403407252s
2023-08-25 17:14:34 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.1 GiB/7.3 GiB (14.37%) ETA: 20m20.937255329s
2023-08-25 17:14:39 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.1 GiB/7.3 GiB (14.59%) ETA: 20m28.312626963s
2023-08-25 17:14:44 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.1 GiB/7.3 GiB (14.80%) ETA: 20m37.397763944s
2023-08-25 17:14:49 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.1 GiB/7.3 GiB (15.10%) ETA: 20m35.781882001s
2023-08-25 17:14:54 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.1 GiB/7.3 GiB (15.41%) ETA: 20m34.366402496s
2023-08-25 17:14:59 localagi-api-1 | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.2 GiB/7.3 GiB (15.72%) ETA: 20m32.77579477s
2023-08-25 17:15:04 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.2 GiB/7.3 GiB (16.06%) ETA: 20m27.703140357s
2023-08-25 17:15:09 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.2 GiB/7.3 GiB (16.41%) ETA: 20m22.377718994s
2023-08-25 17:15:14 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.2 GiB/7.3 GiB (16.75%) ETA: 20m16.976247522s
2023-08-25 17:15:19 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.3 GiB/7.3 GiB (17.10%) ETA: 20m11.642698705s
2023-08-25 17:15:24 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.3 GiB/7.3 GiB (17.45%) ETA: 20m5.786874175s
2023-08-25 17:15:29 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.3 GiB/7.3 GiB (17.78%) ETA: 20m1.543224566s
2023-08-25 17:15:34 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.3 GiB/7.3 GiB (18.09%) ETA: 19m59.434568991s
2023-08-25 17:15:39 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.3 GiB/7.3 GiB (18.41%) ETA: 19m56.254501787s
2023-08-25 17:15:44 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.4 GiB/7.3 GiB (18.73%) ETA: 19m52.532006253s
2023-08-25 17:15:49 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.4 GiB/7.3 GiB (19.07%) ETA: 19m47.833014478s
2023-08-25 17:15:54 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.4 GiB/7.3 GiB (19.38%) ETA: 19m45.451840315s
2023-08-25 17:15:59 localagi-api-1 | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.4 GiB/7.3 GiB (19.69%) ETA: 19m42.215799705s
2023-08-25 17:16:04 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.5 GiB/7.3 GiB (20.00%) ETA: 19m40.020451056s
2023-08-25 17:16:09 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.5 GiB/7.3 GiB (20.30%) ETA: 19m37.296948593s
2023-08-25 17:16:14 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.5 GiB/7.3 GiB (20.62%) ETA: 19m33.935310229s
2023-08-25 17:16:19 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.5 GiB/7.3 GiB (20.94%) ETA: 19m30.394287487s
2023-08-25 17:16:24 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.6 GiB/7.3 GiB (21.28%) ETA: 19m25.372887639s
2023-08-25 17:16:29 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.6 GiB/7.3 GiB (21.61%) ETA: 19m20.699834206s
2023-08-25 17:16:34 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.6 GiB/7.3 GiB (21.75%) ETA: 19m29.294962248s
2023-08-25 17:16:39 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.6 GiB/7.3 GiB (22.08%) ETA: 19m24.188437566s
2023-08-25 17:16:44 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.6 GiB/7.3 GiB (22.44%) ETA: 19m17.601819766s
2023-08-25 17:16:49 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.7 GiB/7.3 GiB (22.80%) ETA: 19m11.106938736s
2023-08-25 17:16:54 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.7 GiB/7.3 GiB (23.15%) ETA: 19m5.143893263s
2023-08-25 17:16:59 localagi-api-1 | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.7 GiB/7.3 GiB (23.50%) ETA: 18m59.130991854s
2023-08-25 17:17:04 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.7 GiB/7.3 GiB (23.86%) ETA: 18m53.040572641s
2023-08-25 17:17:09 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.8 GiB/7.3 GiB (24.20%) ETA: 18m47.708131736s
2023-08-25 17:17:14 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.8 GiB/7.3 GiB (24.55%) ETA: 18m41.676343219s
2023-08-25 17:17:19 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.8 GiB/7.3 GiB (24.88%) ETA: 18m36.7639545s
2023-08-25 17:17:24 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.8 GiB/7.3 GiB (25.24%) ETA: 18m30.497419178s
2023-08-25 17:17:29 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.9 GiB/7.3 GiB (25.59%) ETA: 18m24.618300723s
2023-08-25 17:17:34 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.9 GiB/7.3 GiB (25.93%) ETA: 18m19.82038486s
2023-08-25 17:17:39 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.9 GiB/7.3 GiB (26.25%) ETA: 18m15.611140395s
2023-08-25 17:17:44 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.9 GiB/7.3 GiB (26.58%) ETA: 18m11.266168185s
2023-08-25 17:17:49 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.0 GiB/7.3 GiB (26.90%) ETA: 18m7.048943796s
2023-08-25 17:17:54 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.0 GiB/7.3 GiB (27.22%) ETA: 18m3.109761596s
2023-08-25 17:17:59 localagi-api-1 | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.0 GiB/7.3 GiB (27.36%) ETA: 18m8.555035167s
2023-08-25 17:18:04 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.0 GiB/7.3 GiB (27.68%) ETA: 18m4.397042663s
2023-08-25 17:18:09 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.0 GiB/7.3 GiB (27.98%) ETA: 18m1.121307167s
2023-08-25 17:18:14 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.1 GiB/7.3 GiB (28.29%) ETA: 17m57.204746782s
2023-08-25 17:18:19 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.1 GiB/7.3 GiB (28.60%) ETA: 17m53.354857927s
2023-08-25 17:18:24 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.1 GiB/7.3 GiB (28.91%) ETA: 17m49.792106435s
2023-08-25 17:18:29 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.1 GiB/7.3 GiB (29.22%) ETA: 17m45.73561303s
2023-08-25 17:18:34 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.2 GiB/7.3 GiB (29.55%) ETA: 17m40.827579363s
2023-08-25 17:18:39 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.2 GiB/7.3 GiB (29.88%) ETA: 17m36.299823656s
2023-08-25 17:18:44 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.2 GiB/7.3 GiB (30.21%) ETA: 17m31.307468157s
2023-08-25 17:18:49 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.2 GiB/7.3 GiB (30.48%) ETA: 17m29.455463108s
2023-08-25 17:18:54 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.3 GiB/7.3 GiB (30.83%) ETA: 17m23.324266684s
2023-08-25 17:18:59 localagi-api-1 | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.3 GiB/7.3 GiB (31.17%) ETA: 17m18.199433324s
2023-08-25 17:19:04 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.3 GiB/7.3 GiB (31.52%) ETA: 17m12.300001286s
2023-08-25 17:19:09 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.3 GiB/7.3 GiB (31.85%) ETA: 17m7.112836381s
2023-08-25 17:19:14 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.4 GiB/7.3 GiB (32.21%) ETA: 17m0.994874068s
2023-08-25 17:19:19 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.4 GiB/7.3 GiB (32.54%) ETA: 16m56.055774973s
2023-08-25 17:19:24 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.4 GiB/7.3 GiB (32.88%) ETA: 16m50.408642473s
2023-08-25 17:19:29 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.4 GiB/7.3 GiB (33.22%) ETA: 16m45.439241271s
2023-08-25 17:19:34 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.5 GiB/7.3 GiB (33.54%) ETA: 16m40.612797697s
2023-08-25 17:19:39 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.5 GiB/7.3 GiB (33.87%) ETA: 16m35.91858101s
2023-08-25 17:19:44 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.5 GiB/7.3 GiB (34.20%) ETA: 16m30.797456962s
2023-08-25 17:19:49 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.5 GiB/7.3 GiB (34.54%) ETA: 16m25.80084117s
2023-08-25 17:19:54 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.6 GiB/7.3 GiB (34.86%) ETA: 16m21.054863164s
2023-08-25 17:19:59 localagi-api-1 | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.6 GiB/7.3 GiB (35.18%) ETA: 16m16.486333033s
2023-08-25 17:20:07 localagi-api-1 | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.6 GiB/7.3 GiB (35.28%) ETA: 16m27.02196543s
2023-08-25 17:20:12 localagi-api-1 | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.6 GiB/7.3 GiB (35.59%) ETA: 16m22.656893748s
2023-08-25 17:20:17 localagi-api-1 | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.6 GiB/7.3 GiB (35.92%) ETA: 16m17.654029242s
2023-08-25 17:20:22 localagi-api-1 | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.7 GiB/7.3 GiB (36.24%) ETA: 16m12.88673457s
2023-08-25 17:20:27 localagi-api-1 | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.7 GiB/7.3 GiB (36.57%) ETA: 16m8.055811954s
2023-08-25 17:20:32 localagi-api-1 | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.7 GiB/7.3 GiB (36.88%) ETA: 16m3.478360861s
2023-08-25 17:20:37 localagi-api-1 | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.7 GiB/7.3 GiB (37.21%) ETA: 15m58.678258573s
2023-08-25 17:20:42 localagi-api-1 | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.8 GiB/7.3 GiB (37.55%) ETA: 15m52.890718631s
2023-08-25 17:20:47 localagi-api-1 | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.8 GiB/7.3 GiB (37.70%) ETA: 15m55.189332576s
2023-08-25 17:20:52 localagi-api-1 | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.8 GiB/7.3 GiB (38.05%) ETA: 15m49.385689435s
2023-08-25 17:20:57 localagi-api-1 | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.8 GiB/7.3 GiB (38.39%) ETA: 15m43.778819788s
2023-08-25 17:21:02 localagi-api-1 | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.8 GiB/7.3 GiB (38.73%) ETA: 15m38.366130574s
2023-08-25 17:21:07 localagi-api-1 | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.9 GiB/7.3 GiB (39.07%) ETA: 15m32.749597745s
2023-08-25 17:21:12 localagi-api-1 | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.9 GiB/7.3 GiB (39.42%) ETA: 15m26.770776732s
2023-08-25 17:21:17 localagi-api-1 | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.9 GiB/7.3 GiB (39.75%) ETA: 15m21.687334663s
2023-08-25 17:21:22 localagi-api-1 | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.9 GiB/7.3 GiB (40.07%) ETA: 15m16.983377134s
2023-08-25 17:21:32 localagi-api-1 | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.0 GiB/7.3 GiB (40.32%) ETA: 15m22.664352352s
2023-08-25 17:21:38 localagi-api-1 | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.0 GiB/7.3 GiB (40.62%) ETA: 15m18.373829356s
2023-08-25 17:21:43 localagi-api-1 | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.0 GiB/7.3 GiB (40.95%) ETA: 15m13.031691476s
2023-08-25 17:21:48 localagi-api-1 | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.0 GiB/7.3 GiB (41.27%) ETA: 15m8.440209048s
2023-08-25 17:21:53 localagi-api-1 | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.0 GiB/7.3 GiB (41.59%) ETA: 15m3.594932153s
2023-08-25 17:21:58 localagi-api-1 | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.1 GiB/7.3 GiB (41.91%) ETA: 14m58.67475933s
2023-08-25 17:22:03 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.1 GiB/7.3 GiB (42.22%) ETA: 14m53.888823691s
2023-08-25 17:22:08 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.1 GiB/7.3 GiB (42.55%) ETA: 14m48.817506838s
2023-08-25 17:22:13 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.1 GiB/7.3 GiB (42.86%) ETA: 14m44.361093748s
2023-08-25 17:22:18 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.2 GiB/7.3 GiB (43.10%) ETA: 14m42.424477497s
2023-08-25 17:22:23 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.2 GiB/7.3 GiB (43.42%) ETA: 14m37.311131625s
2023-08-25 17:22:28 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.2 GiB/7.3 GiB (43.76%) ETA: 14m31.891968173s
2023-08-25 17:22:33 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.2 GiB/7.3 GiB (44.09%) ETA: 14m26.64999921s
2023-08-25 17:22:38 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.3 GiB/7.3 GiB (44.42%) ETA: 14m21.397252165s
2023-08-25 17:22:43 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.3 GiB/7.3 GiB (44.75%) ETA: 14m15.885711914s
2023-08-25 17:22:48 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.3 GiB/7.3 GiB (45.07%) ETA: 14m11.030314974s
2023-08-25 17:22:53 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.3 GiB/7.3 GiB (45.40%) ETA: 14m5.713721982s
2023-08-25 17:22:58 localagi-api-1 | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.4 GiB/7.3 GiB (45.74%) ETA: 14m0.344593152s
2023-08-25 17:23:03 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.4 GiB/7.3 GiB (46.07%) ETA: 13m55.117411405s
2023-08-25 17:23:08 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.4 GiB/7.3 GiB (46.41%) ETA: 13m49.453485998s
2023-08-25 17:23:13 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.4 GiB/7.3 GiB (46.76%) ETA: 13m43.623272228s
2023-08-25 17:23:18 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.5 GiB/7.3 GiB (47.10%) ETA: 13m38.052157518s
2023-08-25 17:23:23 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.5 GiB/7.3 GiB (47.45%) ETA: 13m32.28195579s
2023-08-25 17:23:28 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.5 GiB/7.3 GiB (47.80%) ETA: 13m26.389803735s
2023-08-25 17:23:33 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.5 GiB/7.3 GiB (48.14%) ETA: 13m20.909850581s
2023-08-25 17:23:38 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.6 GiB/7.3 GiB (48.48%) ETA: 13m15.31538669s
2023-08-25 17:23:43 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.6 GiB/7.3 GiB (48.83%) ETA: 13m9.483990621s
2023-08-25 17:23:48 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.6 GiB/7.3 GiB (49.17%) ETA: 13m3.976471744s
2023-08-25 17:23:53 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.6 GiB/7.3 GiB (49.50%) ETA: 12m58.733045778s
2023-08-25 17:23:58 localagi-api-1 | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.6 GiB/7.3 GiB (49.81%) ETA: 12m54.294751725s
2023-08-25 17:24:03 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.7 GiB/7.3 GiB (50.04%) ETA: 12m52.020575059s
2023-08-25 17:24:08 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.7 GiB/7.3 GiB (50.30%) ETA: 12m49.119077319s
2023-08-25 17:24:13 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.7 GiB/7.3 GiB (50.55%) ETA: 12m46.200523347s
2023-08-25 17:24:18 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.7 GiB/7.3 GiB (50.82%) ETA: 12m42.886130275s
2023-08-25 17:24:23 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.7 GiB/7.3 GiB (51.05%) ETA: 12m40.787286769s
2023-08-25 17:24:28 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.8 GiB/7.3 GiB (51.32%) ETA: 12m37.307356791s
2023-08-25 17:24:33 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.8 GiB/7.3 GiB (51.58%) ETA: 12m34.123582718s
2023-08-25 17:24:38 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.8 GiB/7.3 GiB (51.86%) ETA: 12m30.383542156s
2023-08-25 17:24:43 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.8 GiB/7.3 GiB (52.16%) ETA: 12m26.035022003s
2023-08-25 17:24:48 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.8 GiB/7.3 GiB (52.47%) ETA: 12m21.502504697s
2023-08-25 17:24:53 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.9 GiB/7.3 GiB (52.79%) ETA: 12m16.250250842s
2023-08-25 17:24:58 localagi-api-1 | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.9 GiB/7.3 GiB (53.13%) ETA: 12m10.906401894s
2023-08-25 17:25:03 localagi-api-1 | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.9 GiB/7.3 GiB (53.47%) ETA: 12m5.177824983s
2023-08-25 17:25:08 localagi-api-1 | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.9 GiB/7.3 GiB (53.77%) ETA: 12m0.823133643s
2023-08-25 17:25:13 localagi-api-1 | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.0 GiB/7.3 GiB (54.05%) ETA: 11m56.986892335s
2023-08-25 17:25:18 localagi-api-1 | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.0 GiB/7.3 GiB (54.37%) ETA: 11m52.170566986s
2023-08-25 17:25:23 localagi-api-1 | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.0 GiB/7.3 GiB (54.65%) ETA: 11m48.091344524s
2023-08-25 17:25:28 localagi-api-1 | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.0 GiB/7.3 GiB (54.95%) ETA: 11m43.893414811s
2023-08-25 17:25:33 localagi-api-1 | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.0 GiB/7.3 GiB (55.24%) ETA: 11m39.615241426s
2023-08-25 17:25:38 localagi-api-1 | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.1 GiB/7.3 GiB (55.53%) ETA: 11m35.345070267s
2023-08-25 17:25:46 localagi-api-1 | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.1 GiB/7.3 GiB (55.68%) ETA: 11m38.170659014s
2023-08-25 17:25:51 localagi-api-1 | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.1 GiB/7.3 GiB (56.02%) ETA: 11m32.774051445s
2023-08-25 17:25:56 localagi-api-1 | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.1 GiB/7.3 GiB (56.36%) ETA: 11m27.053724117s
2023-08-25 17:26:01 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.2 GiB/7.3 GiB (56.68%) ETA: 11m22.08403689s
2023-08-25 17:26:06 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.2 GiB/7.3 GiB (57.00%) ETA: 11m16.916852564s
2023-08-25 17:26:12 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.2 GiB/7.3 GiB (57.33%) ETA: 11m11.476663608s
2023-08-25 17:26:17 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.2 GiB/7.3 GiB (57.66%) ETA: 11m6.171470937s
2023-08-25 17:26:22 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.2 GiB/7.3 GiB (58.00%) ETA: 11m0.62937032s
2023-08-25 17:26:27 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.3 GiB/7.3 GiB (58.14%) ETA: 11m0.330436919s
2023-08-25 17:26:32 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.3 GiB/7.3 GiB (58.48%) ETA: 10m54.878750887s
2023-08-25 17:26:37 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.3 GiB/7.3 GiB (58.82%) ETA: 10m49.25692654s
2023-08-25 17:26:42 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.3 GiB/7.3 GiB (59.16%) ETA: 10m43.538901174s
2023-08-25 17:26:47 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.4 GiB/7.3 GiB (59.50%) ETA: 10m37.873720135s
2023-08-25 17:26:52 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.4 GiB/7.3 GiB (59.86%) ETA: 10m31.809885996s
2023-08-25 17:26:57 localagi-api-1 | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.4 GiB/7.3 GiB (60.22%) ETA: 10m25.827255313s
2023-08-25 17:27:02 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.4 GiB/7.3 GiB (60.58%) ETA: 10m19.800208293s
2023-08-25 17:27:07 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.5 GiB/7.3 GiB (60.93%) ETA: 10m13.913690128s
2023-08-25 17:27:12 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.5 GiB/7.3 GiB (61.27%) ETA: 10m8.283971765s
2023-08-25 17:27:17 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.5 GiB/7.3 GiB (61.62%) ETA: 10m2.481418934s
2023-08-25 17:27:22 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.5 GiB/7.3 GiB (61.97%) ETA: 9m56.708343548s
2023-08-25 17:27:27 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.6 GiB/7.3 GiB (62.32%) ETA: 9m50.91170664s
2023-08-25 17:27:32 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.6 GiB/7.3 GiB (62.66%) ETA: 9m45.449901827s
2023-08-25 17:27:37 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.6 GiB/7.3 GiB (62.99%) ETA: 9m40.014182466s
2023-08-25 17:27:42 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.6 GiB/7.3 GiB (63.32%) ETA: 9m34.797978724s
2023-08-25 17:27:47 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.7 GiB/7.3 GiB (63.65%) ETA: 9m29.480798152s
2023-08-25 17:27:53 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.7 GiB/7.3 GiB (63.70%) ETA: 9m32.359437237s
2023-08-25 17:27:58 localagi-api-1 | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.7 GiB/7.3 GiB (64.05%) ETA: 9m26.356445924s
2023-08-25 17:28:03 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.7 GiB/7.3 GiB (64.42%) ETA: 9m20.142564774s
2023-08-25 17:28:08 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.7 GiB/7.3 GiB (64.79%) ETA: 9m13.92563419s
2023-08-25 17:28:13 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.8 GiB/7.3 GiB (65.16%) ETA: 9m7.708261603s
2023-08-25 17:28:18 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.8 GiB/7.3 GiB (65.53%) ETA: 9m1.34773687s
2023-08-25 17:28:23 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.8 GiB/7.3 GiB (65.89%) ETA: 8m55.446844944s
2023-08-25 17:28:28 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.9 GiB/7.3 GiB (66.25%) ETA: 8m49.479491131s
2023-08-25 17:28:33 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.9 GiB/7.3 GiB (66.60%) ETA: 8m43.6578998s
2023-08-25 17:28:38 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.9 GiB/7.3 GiB (66.95%) ETA: 8m37.891858536s
2023-08-25 17:28:43 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.9 GiB/7.3 GiB (67.28%) ETA: 8m32.638835397s
2023-08-25 17:28:48 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.0 GiB/7.3 GiB (67.62%) ETA: 8m27.284724739s
2023-08-25 17:28:53 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.0 GiB/7.3 GiB (67.95%) ETA: 8m22.01044305s
2023-08-25 17:28:58 localagi-api-1 | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.0 GiB/7.3 GiB (68.28%) ETA: 8m16.813724216s
2023-08-25 17:29:03 localagi-api-1 | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.0 GiB/7.3 GiB (68.61%) ETA: 8m11.561919741s
2023-08-25 17:29:09 localagi-api-1 | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.0 GiB/7.3 GiB (68.93%) ETA: 8m6.478325472s
2023-08-25 17:29:15 localagi-api-1 | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.1 GiB/7.3 GiB (69.17%) ETA: 8m3.794660979s
2023-08-25 17:29:20 localagi-api-1 | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.1 GiB/7.3 GiB (69.50%) ETA: 7m58.654310711s
2023-08-25 17:29:25 localagi-api-1 | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.1 GiB/7.3 GiB (69.83%) ETA: 7m53.260175828s
2023-08-25 17:29:30 localagi-api-1 | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.1 GiB/7.3 GiB (70.19%) ETA: 7m47.479800137s
2023-08-25 17:29:35 localagi-api-1 | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.2 GiB/7.3 GiB (70.54%) ETA: 7m41.86881001s
2023-08-25 17:29:40 localagi-api-1 | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.2 GiB/7.3 GiB (70.88%) ETA: 7m36.296089413s
2023-08-25 17:29:45 localagi-api-1 | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.2 GiB/7.3 GiB (71.23%) ETA: 7m30.54516436s
2023-08-25 17:29:50 localagi-api-1 | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.2 GiB/7.3 GiB (71.60%) ETA: 7m24.59215289s
2023-08-25 17:30:00 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.3 GiB/7.3 GiB (71.89%) ETA: 7m22.384151287s
2023-08-25 17:30:05 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.3 GiB/7.3 GiB (72.25%) ETA: 7m16.294592863s
2023-08-25 17:30:10 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.3 GiB/7.3 GiB (72.63%) ETA: 7m9.989322452s
2023-08-25 17:30:15 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.3 GiB/7.3 GiB (73.02%) ETA: 7m3.572005697s
2023-08-25 17:30:20 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.4 GiB/7.3 GiB (73.39%) ETA: 6m57.482790273s
2023-08-25 17:30:25 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.4 GiB/7.3 GiB (73.74%) ETA: 6m51.723936478s
2023-08-25 17:30:30 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.4 GiB/7.3 GiB (74.08%) ETA: 6m46.289392743s
2023-08-25 17:30:35 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.5 GiB/7.3 GiB (74.44%) ETA: 6m40.453960662s
2023-08-25 17:30:42 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.5 GiB/7.3 GiB (74.45%) ETA: 6m42.498754262s
2023-08-25 17:30:47 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.5 GiB/7.3 GiB (74.83%) ETA: 6m36.290802482s
2023-08-25 17:30:52 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.5 GiB/7.3 GiB (75.22%) ETA: 6m29.726397616s
2023-08-25 17:30:57 localagi-api-1 | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.5 GiB/7.3 GiB (75.60%) ETA: 6m23.377199471s
2023-08-25 17:31:02 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.6 GiB/7.3 GiB (75.96%) ETA: 6m17.496802935s
2023-08-25 17:31:07 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.6 GiB/7.3 GiB (76.32%) ETA: 6m11.779402279s
2023-08-25 17:31:12 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.6 GiB/7.3 GiB (76.66%) ETA: 6m6.221988698s
2023-08-25 17:31:17 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.6 GiB/7.3 GiB (77.01%) ETA: 6m0.594352684s
2023-08-25 17:31:22 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.7 GiB/7.3 GiB (77.36%) ETA: 5m54.988617228s
2023-08-25 17:31:27 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.7 GiB/7.3 GiB (77.69%) ETA: 5m49.825749927s
2023-08-25 17:31:32 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.7 GiB/7.3 GiB (78.01%) ETA: 5m44.822874072s
2023-08-25 17:31:37 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.7 GiB/7.3 GiB (78.32%) ETA: 5m39.81219167s
2023-08-25 17:31:42 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.8 GiB/7.3 GiB (78.64%) ETA: 5m34.793898765s
2023-08-25 17:31:47 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.8 GiB/7.3 GiB (78.97%) ETA: 5m29.642342195s
2023-08-25 17:31:52 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.8 GiB/7.3 GiB (79.31%) ETA: 5m24.344060961s
2023-08-25 17:31:57 localagi-api-1 | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.8 GiB/7.3 GiB (79.63%) ETA: 5m19.211793884s
2023-08-25 17:32:06 localagi-api-1 | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.8 GiB/7.3 GiB (79.82%) ETA: 5m17.805561415s
2023-08-25 17:32:11 localagi-api-1 | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.9 GiB/7.3 GiB (80.17%) ETA: 5m12.170485547s
2023-08-25 17:32:16 localagi-api-1 | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.9 GiB/7.3 GiB (80.55%) ETA: 5m6.018303599s
2023-08-25 17:32:21 localagi-api-1 | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.9 GiB/7.3 GiB (80.92%) ETA: 4m59.982040555s
2023-08-25 17:32:26 localagi-api-1 | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.0 GiB/7.3 GiB (81.28%) ETA: 4m54.075160731s
2023-08-25 17:32:31 localagi-api-1 | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.0 GiB/7.3 GiB (81.65%) ETA: 4m48.064577336s
2023-08-25 17:32:36 localagi-api-1 | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.0 GiB/7.3 GiB (82.02%) ETA: 4m42.190651695s
2023-08-25 17:32:41 localagi-api-1 | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.0 GiB/7.3 GiB (82.39%) ETA: 4m36.11044512s
2023-08-25 17:32:48 localagi-api-1 | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.0 GiB/7.3 GiB (82.41%) ETA: 4m37.279563799s
2023-08-25 17:32:53 localagi-api-1 | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.1 GiB/7.3 GiB (82.77%) ETA: 4m31.334343168s
2023-08-25 17:32:58 localagi-api-1 | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.1 GiB/7.3 GiB (83.16%) ETA: 4m25.064159896s
2023-08-25 17:33:03 localagi-api-1 | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.1 GiB/7.3 GiB (83.55%) ETA: 4m18.727316009s
2023-08-25 17:33:08 localagi-api-1 | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.1 GiB/7.3 GiB (83.93%) ETA: 4m12.574052657s
2023-08-25 17:33:13 localagi-api-1 | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.2 GiB/7.3 GiB (84.29%) ETA: 4m6.672507429s
2023-08-25 17:33:18 localagi-api-1 | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.2 GiB/7.3 GiB (84.63%) ETA: 4m1.380403797s
2023-08-25 17:33:23 localagi-api-1 | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.2 GiB/7.3 GiB (84.95%) ETA: 3m56.245009324s
2023-08-25 17:33:31 localagi-api-1 | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.2 GiB/7.3 GiB (85.02%) ETA: 3m56.350434138s
2023-08-25 17:33:36 localagi-api-1 | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.3 GiB/7.3 GiB (85.36%) ETA: 3m50.873512841s
2023-08-25 17:33:41 localagi-api-1 | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.3 GiB/7.3 GiB (85.70%) ETA: 3m45.452081801s
2023-08-25 17:33:46 localagi-api-1 | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.3 GiB/7.3 GiB (86.04%) ETA: 3m40.12545014s
2023-08-25 17:33:51 localagi-api-1 | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.3 GiB/7.3 GiB (86.38%) ETA: 3m34.671901584s
2023-08-25 17:33:56 localagi-api-1 | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.4 GiB/7.3 GiB (86.71%) ETA: 3m29.380932967s
2023-08-25 17:34:01 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.4 GiB/7.3 GiB (87.04%) ETA: 3m24.167731775s
2023-08-25 17:34:06 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.4 GiB/7.3 GiB (87.37%) ETA: 3m18.903337351s
2023-08-25 17:34:11 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.4 GiB/7.3 GiB (87.70%) ETA: 3m13.760789832s
2023-08-25 17:34:16 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.4 GiB/7.3 GiB (88.02%) ETA: 3m8.731062831s
2023-08-25 17:34:21 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.5 GiB/7.3 GiB (88.35%) ETA: 3m3.456562105s
2023-08-25 17:34:26 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.5 GiB/7.3 GiB (88.69%) ETA: 2m58.117618021s
2023-08-25 17:34:31 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.5 GiB/7.3 GiB (89.02%) ETA: 2m52.891370694s
2023-08-25 17:34:36 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.5 GiB/7.3 GiB (89.35%) ETA: 2m47.571875478s
2023-08-25 17:34:41 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.6 GiB/7.3 GiB (89.69%) ETA: 2m42.305334213s
2023-08-25 17:34:46 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.6 GiB/7.3 GiB (90.02%) ETA: 2m37.026365414s
2023-08-25 17:34:54 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.6 GiB/7.3 GiB (90.17%) ETA: 2m35.356344868s
2023-08-25 17:34:59 localagi-api-1 | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.6 GiB/7.3 GiB (90.54%) ETA: 2m29.398809795s
2023-08-25 17:35:04 localagi-api-1 | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.7 GiB/7.3 GiB (90.92%) ETA: 2m23.306501411s
2023-08-25 17:35:09 localagi-api-1 | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.7 GiB/7.3 GiB (91.29%) ETA: 2m17.295006523s
2023-08-25 17:35:14 localagi-api-1 | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.7 GiB/7.3 GiB (91.66%) ETA: 2m11.520996946s
2023-08-25 17:35:19 localagi-api-1 | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.7 GiB/7.3 GiB (92.01%) ETA: 2m5.817621571s
2023-08-25 17:35:24 localagi-api-1 | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.8 GiB/7.3 GiB (92.36%) ETA: 2m0.318285529s
2023-08-25 17:35:29 localagi-api-1 | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.8 GiB/7.3 GiB (92.72%) ETA: 1m54.667092557s
2023-08-25 17:35:36 localagi-api-1 | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.8 GiB/7.3 GiB (92.75%) ETA: 1m54.594768281s
2023-08-25 17:35:41 localagi-api-1 | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.8 GiB/7.3 GiB (93.12%) ETA: 1m48.740386968s
2023-08-25 17:35:46 localagi-api-1 | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.8 GiB/7.3 GiB (93.50%) ETA: 1m42.665622802s
2023-08-25 17:35:51 localagi-api-1 | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.9 GiB/7.3 GiB (93.88%) ETA: 1m36.536511587s
2023-08-25 17:35:56 localagi-api-1 | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.9 GiB/7.3 GiB (94.25%) ETA: 1m30.632805243s
2023-08-25 17:36:01 localagi-api-1 | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.9 GiB/7.3 GiB (94.62%) ETA: 1m24.812570583s
2023-08-25 17:36:06 localagi-api-1 | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.0 GiB/7.3 GiB (94.96%) ETA: 1m19.371899134s
2023-08-25 17:36:11 localagi-api-1 | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.0 GiB/7.3 GiB (95.31%) ETA: 1m13.906750315s
2023-08-25 17:36:16 localagi-api-1 | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.0 GiB/7.3 GiB (95.63%) ETA: 1m8.815639758s
2023-08-25 17:36:21 localagi-api-1 | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.0 GiB/7.3 GiB (95.96%) ETA: 1m3.64973243s
2023-08-25 17:36:26 localagi-api-1 | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.1 GiB/7.3 GiB (96.29%) ETA: 58.478146583s
2023-08-25 17:36:31 localagi-api-1 | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.1 GiB/7.3 GiB (96.61%) ETA: 53.402750696s
2023-08-25 17:36:36 localagi-api-1 | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.1 GiB/7.3 GiB (96.94%) ETA: 48.260231331s
2023-08-25 17:36:41 localagi-api-1 | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.1 GiB/7.3 GiB (97.25%) ETA: 43.368217601s
2023-08-25 17:36:46 localagi-api-1 | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.1 GiB/7.3 GiB (97.58%) ETA: 38.105579603s
2023-08-25 17:36:51 localagi-api-1 | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.2 GiB/7.3 GiB (97.92%) ETA: 32.81132063s
2023-08-25 17:37:01 localagi-api-1 | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.2 GiB/7.3 GiB (98.17%) ETA: 28.970745549s
2023-08-25 17:37:06 localagi-api-1 | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.2 GiB/7.3 GiB (98.52%) ETA: 23.311608499s
2023-08-25 17:37:11 localagi-api-1 | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.2 GiB/7.3 GiB (98.88%) ETA: 17.715404274s
2023-08-25 17:37:16 localagi-api-1 | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.3 GiB/7.3 GiB (99.22%) ETA: 12.295851605s
2023-08-25 17:37:21 localagi-api-1 | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.3 GiB/7.3 GiB (99.57%) ETA: 6.760272639s
2023-08-25 17:37:26 localagi-api-1 | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.3 GiB/7.3 GiB (99.92%) ETA: 1.287626746s
2023-08-25 17:37:27 localagi-api-1 | 3:37PM DBG File "wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin" downloaded and verified
2023-08-25 17:37:27 localagi-api-1 | 3:37PM DBG Prompt template "wizardlm-completion" written
2023-08-25 17:37:27 localagi-api-1 | 3:37PM DBG Prompt template "wizardlm-chat" written
2023-08-25 17:37:27 localagi-api-1 | 3:37PM DBG Written config file /models/gpt-4.yaml
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG Checking "stablediffusion_assets/AutoencoderKL-256-256-fp16-opt.param" exists and matches SHA
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/AutoencoderKL-256-256-fp16-opt.param"
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG Downloading: 16.7 KiB
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG File "stablediffusion_assets/AutoencoderKL-256-256-fp16-opt.param" downloaded and verified
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG Checking "stablediffusion_assets/AutoencoderKL-512-512-fp16-opt.param" exists and matches SHA
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/AutoencoderKL-512-512-fp16-opt.param"
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG File "stablediffusion_assets/AutoencoderKL-512-512-fp16-opt.param" downloaded and verified
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG Checking "stablediffusion_assets/AutoencoderKL-base-fp16.param" exists and matches SHA
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/AutoencoderKL-base-fp16.param"
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG File "stablediffusion_assets/AutoencoderKL-base-fp16.param" downloaded and verified
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG Checking "stablediffusion_assets/AutoencoderKL-encoder-512-512-fp16.bin" exists and matches SHA
2023-08-25 17:37:42 localagi-api-1 | 3:37PM DBG Downloading "https://github.com/lenaxia/stablediffusion-bins/releases/download/2023.05.24/AutoencoderKL-encoder-512-512-fp16.bin"
2023-08-25 17:37:47 localagi-api-1 | 3:37PM DBG Downloading stablediffusion_assets/AutoencoderKL-encoder-512-512-fp16.bin: 16.7 MiB/65.2 MiB (25.55%) ETA: 56.938166657s
2023-08-25 17:37:52 localagi-api-1 | 3:37PM DBG Downloading stablediffusion_assets/AutoencoderKL-encoder-512-512-fp16.bin: 42.1 MiB/65.2 MiB (64.60%) ETA: 13.446919582s
2023-08-25 17:37:56 localagi-api-1 | 3:37PM DBG File "stablediffusion_assets/AutoencoderKL-encoder-512-512-fp16.bin" downloaded and verified
2023-08-25 17:37:56 localagi-api-1 | 3:37PM DBG Checking "stablediffusion_assets/AutoencoderKL-fp16.bin" exists and matches SHA
2023-08-25 17:37:56 localagi-api-1 | 3:37PM DBG Downloading "https://github.com/lenaxia/stablediffusion-bins/releases/download/2023.05.24/AutoencoderKL-fp16.bin"
2023-08-25 17:37:57 localagi-api-1 | 3:37PM DBG Downloading stablediffusion_assets/AutoencoderKL-fp16.bin: 271.4 KiB/94.5 MiB (0.28%) ETA: 2h55m2.942067667s
2023-08-25 17:38:02 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/AutoencoderKL-fp16.bin: 25.1 MiB/94.5 MiB (26.55%) ETA: 1m35.60086898s
2023-08-25 17:38:07 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/AutoencoderKL-fp16.bin: 50.7 MiB/94.5 MiB (53.71%) ETA: 34.097725835s
2023-08-25 17:38:12 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/AutoencoderKL-fp16.bin: 76.1 MiB/94.5 MiB (80.60%) ETA: 10.725745184s
2023-08-25 17:38:15 localagi-api-1 | 3:38PM DBG File "stablediffusion_assets/AutoencoderKL-fp16.bin" downloaded and verified
2023-08-25 17:38:15 localagi-api-1 | 3:38PM DBG Checking "stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin" exists and matches SHA
2023-08-25 17:38:15 localagi-api-1 | 3:38PM DBG Downloading "https://github.com/lenaxia/stablediffusion-bins/releases/download/2023.05.24/FrozenCLIPEmbedder-fp16.bin"
2023-08-25 17:38:17 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 5.0 MiB/235.1 MiB (2.13%) ETA: 38m0.9226026s
2023-08-25 17:38:23 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 25.6 MiB/235.1 MiB (10.90%) ETA: 7m32.960517287s
2023-08-25 17:38:28 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 51.0 MiB/235.1 MiB (21.71%) ETA: 3m37.898329753s
2023-08-25 17:38:33 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 76.9 MiB/235.1 MiB (32.71%) ETA: 2m14.553513213s
2023-08-25 17:38:38 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 103.0 MiB/235.1 MiB (43.83%) ETA: 1m30.258932242s
2023-08-25 17:38:43 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 128.3 MiB/235.1 MiB (54.58%) ETA: 1m2.767845077s
2023-08-25 17:38:48 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 154.2 MiB/235.1 MiB (65.60%) ETA: 42.175626662s
2023-08-25 17:38:53 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 179.7 MiB/235.1 MiB (76.43%) ETA: 26.340457044s
2023-08-25 17:38:58 localagi-api-1 | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 205.5 MiB/235.1 MiB (87.40%) ETA: 13.036886207s
2023-08-25 17:39:03 localagi-api-1 | 3:39PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 231.4 MiB/235.1 MiB (98.43%) ETA: 1.518087126s
2023-08-25 17:39:03 localagi-api-1 | 3:39PM DBG File "stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin" downloaded and verified
2023-08-25 17:39:03 localagi-api-1 | 3:39PM DBG Checking "stablediffusion_assets/FrozenCLIPEmbedder-fp16.param" exists and matches SHA
2023-08-25 17:39:03 localagi-api-1 | 3:39PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/FrozenCLIPEmbedder-fp16.param"
2023-08-25 17:39:04 localagi-api-1 | 3:39PM DBG File "stablediffusion_assets/FrozenCLIPEmbedder-fp16.param" downloaded and verified
2023-08-25 17:39:04 localagi-api-1 | 3:39PM DBG Checking "stablediffusion_assets/log_sigmas.bin" exists and matches SHA
2023-08-25 17:39:04 localagi-api-1 | 3:39PM DBG Downloading "https://github.com/EdVince/Stable-Diffusion-NCNN/raw/main/x86/linux/assets/log_sigmas.bin"
2023-08-25 17:39:04 localagi-api-1 | 3:39PM DBG File "stablediffusion_assets/log_sigmas.bin" downloaded and verified
2023-08-25 17:39:04 localagi-api-1 | 3:39PM DBG Checking "stablediffusion_assets/UNetModel-256-256-MHA-fp16-opt.param" exists and matches SHA
2023-08-25 17:39:04 localagi-api-1 | 3:39PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/UNetModel-256-256-MHA-fp16-opt.param"
2023-08-25 17:39:05 localagi-api-1 | 3:39PM DBG File "stablediffusion_assets/UNetModel-256-256-MHA-fp16-opt.param" downloaded and verified
2023-08-25 17:39:05 localagi-api-1 | 3:39PM DBG Checking "stablediffusion_assets/UNetModel-512-512-MHA-fp16-opt.param" exists and matches SHA
2023-08-25 17:39:05 localagi-api-1 | 3:39PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/UNetModel-512-512-MHA-fp16-opt.param"
2023-08-25 17:39:05 localagi-api-1 | 3:39PM DBG File "stablediffusion_assets/UNetModel-512-512-MHA-fp16-opt.param" downloaded and verified
2023-08-25 17:39:05 localagi-api-1 | 3:39PM DBG Checking "stablediffusion_assets/UNetModel-base-MHA-fp16.param" exists and matches SHA
2023-08-25 17:39:05 localagi-api-1 | 3:39PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/UNetModel-base-MHA-fp16.param"
2023-08-25 17:39:06 localagi-api-1 | 3:39PM DBG File "stablediffusion_assets/UNetModel-base-MHA-fp16.param" downloaded and verified
2023-08-25 17:39:06 localagi-api-1 | 3:39PM DBG Checking "stablediffusion_assets/UNetModel-MHA-fp16.bin" exists and matches SHA
2023-08-25 17:39:06 localagi-api-1 | 3:39PM DBG Downloading "https://github.com/lenaxia/stablediffusion-bins/releases/download/2023.05.24/UNetModel-MHA-fp16.bin"
2023-08-25 17:39:08 localagi-api-1 | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 7.2 MiB/1.6 GiB (0.44%) ETA: 6h17m59.890437293s
2023-08-25 17:39:13 localagi-api-1 | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 32.1 MiB/1.6 GiB (1.96%) ETA: 1h27m57.286930339s
2023-08-25 17:39:18 localagi-api-1 | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 57.4 MiB/1.6 GiB (3.50%) ETA: 50m47.01494865s
2023-08-25 17:39:23 localagi-api-1 | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 83.2 MiB/1.6 GiB (5.07%) ETA: 36m1.059608235s
2023-08-25 17:39:28 localagi-api-1 | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 109.0 MiB/1.6 GiB (6.65%) ETA: 28m11.753295591s
2023-08-25 17:39:33 localagi-api-1 | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 134.6 MiB/1.6 GiB (8.21%) ETA: 23m23.556231892s
2023-08-25 17:39:38 localagi-api-1 | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 160.7 MiB/1.6 GiB (9.80%) ETA: 20m1.080820555s
2023-08-25 17:39:49 localagi-api-1 | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 187.2 MiB/1.6 GiB (11.41%) ETA: 18m22.885136281s
2023-08-25 17:39:54 localagi-api-1 | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 216.2 MiB/1.6 GiB (13.18%) ETA: 16m8.831553165s
2023-08-25 17:39:59 localagi-api-1 | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 245.5 MiB/1.6 GiB (14.96%) ETA: 14m24.031819352s
2023-08-25 17:40:04 localagi-api-1 | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 274.0 MiB/1.6 GiB (16.70%) ETA: 13m3.082703469s
2023-08-25 17:40:09 localagi-api-1 | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 301.9 MiB/1.6 GiB (18.40%) ETA: 11m58.474609491s
2023-08-25 17:40:14 localagi-api-1 | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 327.8 MiB/1.6 GiB (19.98%) ETA: 11m8.924209617s
2023-08-25 17:40:19 localagi-api-1 | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 353.7 MiB/1.6 GiB (21.56%) ETA: 10m25.964267434s
2023-08-25 17:40:24 localagi-api-1 | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 378.8 MiB/1.6 GiB (23.09%) ETA: 9m49.81801908s
2023-08-25 17:40:29 localagi-api-1 | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 404.0 MiB/1.6 GiB (24.63%) ETA: 9m17.265168836s
2023-08-25 17:40:34 localagi-api-1 | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 428.4 MiB/1.6 GiB (26.11%) ETA: 8m49.245471776s
2023-08-25 17:40:39 localagi-api-1 | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 453.1 MiB/1.6 GiB (27.62%) ETA: 8m23.278832925s
2023-08-25 17:40:44 localagi-api-1 | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 477.1 MiB/1.6 GiB (29.08%) ETA: 8m0.587643649s
2023-08-25 17:40:49 localagi-api-1 | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 501.7 MiB/1.6 GiB (30.58%) ETA: 7m38.64961531s
2023-08-25 17:40:54 localagi-api-1 | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 526.1 MiB/1.6 GiB (32.07%) ETA: 7m18.598469317s
2023-08-25 17:41:00 localagi-api-1 | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 550.4 MiB/1.6 GiB (33.55%) ETA: 7m0.100599108s
2023-08-25 17:41:05 localagi-api-1 | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 574.1 MiB/1.6 GiB (34.99%) ETA: 6m43.269869452s
2023-08-25 17:41:13 localagi-api-1 | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 587.5 MiB/1.6 GiB (35.81%) ETA: 6m45.060395943s
2023-08-25 17:41:18 localagi-api-1 | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 615.6 MiB/1.6 GiB (37.53%) ETA: 6m24.560687026s
2023-08-25 17:41:23 localagi-api-1 | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 643.4 MiB/1.6 GiB (39.22%) ETA: 6m5.76501277s
2023-08-25 17:41:28 localagi-api-1 | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 672.4 MiB/1.6 GiB (40.99%) ETA: 5m46.987552009s
2023-08-25 17:41:33 localagi-api-1 | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 699.5 MiB/1.6 GiB (42.64%) ETA: 5m30.942787725s
2023-08-25 17:41:38 localagi-api-1 | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 724.3 MiB/1.6 GiB (44.15%) ETA: 5m17.532193502s
2023-08-25 17:41:43 localagi-api-1 | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 749.9 MiB/1.6 GiB (45.71%) ETA: 5m4.070571651s
2023-08-25 17:41:48 localagi-api-1 | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 775.0 MiB/1.6 GiB (47.24%) ETA: 4m51.476391205s
2023-08-25 17:41:56 localagi-api-1 | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 783.0 MiB/1.6 GiB (47.73%) ETA: 4m54.376370533s
2023-08-25 17:42:01 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 810.2 MiB/1.6 GiB (49.39%) ETA: 4m40.564825791s
2023-08-25 17:42:06 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 838.3 MiB/1.6 GiB (51.10%) ETA: 4m26.777359484s
2023-08-25 17:42:11 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 866.0 MiB/1.6 GiB (52.79%) ETA: 4m13.771498382s
2023-08-25 17:42:16 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 893.4 MiB/1.6 GiB (54.46%) ETA: 4m1.523535565s
2023-08-25 17:42:21 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 920.8 MiB/1.6 GiB (56.13%) ETA: 3m49.632125383s
2023-08-25 17:42:26 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 947.8 MiB/1.6 GiB (57.77%) ETA: 3m38.376605723s
2023-08-25 17:42:31 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 973.6 MiB/1.6 GiB (59.35%) ETA: 3m28.077383379s
2023-08-25 17:42:36 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 998.8 MiB/1.6 GiB (60.88%) ETA: 3m18.399175565s
2023-08-25 17:42:41 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.0 GiB/1.6 GiB (62.46%) ETA: 3m8.61266218s
2023-08-25 17:42:46 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.0 GiB/1.6 GiB (63.98%) ETA: 2m59.461835272s
2023-08-25 17:42:51 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.0 GiB/1.6 GiB (65.54%) ETA: 2m50.261224507s
2023-08-25 17:42:56 localagi-api-1 | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.1 GiB/1.6 GiB (67.11%) ETA: 2m41.172019396s
2023-08-25 17:43:01 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.1 GiB/1.6 GiB (68.64%) ETA: 2m32.4989343s
2023-08-25 17:43:06 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.1 GiB/1.6 GiB (70.23%) ETA: 2m23.606239342s
2023-08-25 17:43:11 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.2 GiB/1.6 GiB (71.82%) ETA: 2m14.873662952s
2023-08-25 17:43:16 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.2 GiB/1.6 GiB (73.32%) ETA: 2m6.894547786s
2023-08-25 17:43:21 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.2 GiB/1.6 GiB (74.84%) ETA: 1m58.926896001s
2023-08-25 17:43:26 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.2 GiB/1.6 GiB (76.31%) ETA: 1m51.394612665s
2023-08-25 17:43:31 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.2 GiB/1.6 GiB (77.79%) ETA: 1m43.853940123s
2023-08-25 17:43:36 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.3 GiB/1.6 GiB (79.26%) ETA: 1m36.519646093s
2023-08-25 17:43:41 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.3 GiB/1.6 GiB (80.76%) ETA: 1m29.084662348s
2023-08-25 17:43:46 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.3 GiB/1.6 GiB (82.27%) ETA: 1m21.652233394s
2023-08-25 17:43:51 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.3 GiB/1.6 GiB (83.83%) ETA: 1m14.026745s
2023-08-25 17:43:56 localagi-api-1 | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.4 GiB/1.6 GiB (85.38%) ETA: 1m6.568601149s
2023-08-25 17:44:01 localagi-api-1 | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.4 GiB/1.6 GiB (86.92%) ETA: 59.25735593s
2023-08-25 17:44:06 localagi-api-1 | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.4 GiB/1.6 GiB (88.47%) ETA: 51.98745797s
2023-08-25 17:44:11 localagi-api-1 | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.4 GiB/1.6 GiB (90.02%) ETA: 44.776780455s
2023-08-25 17:44:16 localagi-api-1 | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.5 GiB/1.6 GiB (91.53%) ETA: 37.826817273s
2023-08-25 17:44:21 localagi-api-1 | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.5 GiB/1.6 GiB (93.08%) ETA: 30.758091622s
2023-08-25 17:44:26 localagi-api-1 | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.5 GiB/1.6 GiB (94.66%) ETA: 23.65020277s
2023-08-25 17:44:31 localagi-api-1 | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.5 GiB/1.6 GiB (96.19%) ETA: 16.785389539s
2023-08-25 17:44:36 localagi-api-1 | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.6 GiB/1.6 GiB (97.80%) ETA: 9.645912666s
2023-08-25 17:44:45 localagi-api-1 | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.6 GiB/1.6 GiB (98.69%) ETA: 5.814153569s
2023-08-25 17:44:49 localagi-api-1 | 3:44PM DBG File "stablediffusion_assets/UNetModel-MHA-fp16.bin" downloaded and verified
2023-08-25 17:44:49 localagi-api-1 | 3:44PM DBG Checking "stablediffusion_assets/vocab.txt" exists and matches SHA
2023-08-25 17:44:49 localagi-api-1 | 3:44PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/vocab.txt"
2023-08-25 17:44:49 localagi-api-1 | 3:44PM DBG File "stablediffusion_assets/vocab.txt" downloaded and verified
2023-08-25 17:44:49 localagi-api-1 | 3:44PM DBG Written config file /models/stablediffusion.yaml
2023-08-25 17:44:58 localagi-api-1 | 3:44PM DBG Checking "voice-en-us-kathleen-low.tar.gz" exists and matches SHA
2023-08-25 17:44:58 localagi-api-1 | 3:44PM DBG Downloading "https://github.com/rhasspy/piper/releases/download/v0.0.2/voice-en-us-kathleen-low.tar.gz"
2023-08-25 17:44:58 localagi-api-1 | 3:44PM DBG Downloading voice-en-us-kathleen-low.tar.gz: 32.0 KiB/55.6 MiB (0.06%) ETA: 4h30m12.935090177s
2023-08-25 17:45:03 localagi-api-1 | 3:45PM DBG Downloading voice-en-us-kathleen-low.tar.gz: 29.8 MiB/55.6 MiB (53.57%) ETA: 12.245668299s
2023-08-25 17:45:08 localagi-api-1 | 3:45PM DBG SHA missing for "voice-en-us-kathleen-low.tar.gz". Skipping validation
2023-08-25 17:45:08 localagi-api-1 | 3:45PM DBG File "voice-en-us-kathleen-low.tar.gz" downloaded and verified
2023-08-25 17:45:08 localagi-api-1 | 3:45PM DBG File "voice-en-us-kathleen-low.tar.gz" is an archive, uncompressing to /models
2023-08-25 17:45:16 localagi-api-1 | 3:45PM DBG Config overrides map[backend:huggingface-embeddings embeddings:true parameters:map[model:all-MiniLM-L6-v2]]
2023-08-25 17:45:16 localagi-api-1 | 3:45PM DBG Prompt template "completion" written
2023-08-25 17:45:16 localagi-api-1 | 3:45PM DBG Prompt template "chat" written
2023-08-25 17:45:16 localagi-api-1 | 3:45PM DBG Written config file /models/all-MiniLM-L6-v2.yaml
2023-08-25 17:45:25 localagi-api-1 | 3:45PM DBG Config overrides map[context_size:2048 f16:true function:map[disable_no_action:true] mirostat:2 mirostat_eta:0.1 mirostat_tau:5 mmap:true parameters:map[model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin temperature:0.1 top_k:40 top_p:0.95] roles:map[assistant:ASSISTANT: assistant_function_call:FUNCTION_CALL: function:FUNCTION CALL RESULT: system:SYSTEM:] template:map[chat: completion:]]
2023-08-25 17:45:25 localagi-api-1 | 3:45PM DBG Checking "wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin" exists and matches SHA
2023-08-25 17:45:25 localagi-api-1 | 3:45PM DBG Downloading "https://huggingface.co/TheBloke/WizardLM-13B-V1.0-Uncensored-GGML/resolve/main/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin"
2023-08-25 17:45:26 localagi-api-1 | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 32.0 KiB/6.8 GiB (0.00%) ETA: 614h52m19.040349984s
2023-08-25 17:45:31 localagi-api-1 | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 29.3 MiB/6.8 GiB (0.42%) ETA: 58m53.562987733s
2023-08-25 17:45:36 localagi-api-1 | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 56.8 MiB/6.8 GiB (0.81%) ETA: 40m26.193791576s
2023-08-25 17:45:41 localagi-api-1 | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 84.0 MiB/6.8 GiB (1.20%) ETA: 34m7.085027374s
2023-08-25 17:45:46 localagi-api-1 | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 110.0 MiB/6.8 GiB (1.58%) ETA: 31m8.715846813s
2023-08-25 17:45:51 localagi-api-1 | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 135.4 MiB/6.8 GiB (1.94%) ETA: 29m25.856540429s
2023-08-25 17:45:56 localagi-api-1 | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 160.6 MiB/6.8 GiB (2.30%) ETA: 28m16.084889081s
2023-08-25 17:46:01 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 185.8 MiB/6.8 GiB (2.66%) ETA: 27m23.353737309s
2023-08-25 17:46:09 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 197.8 MiB/6.8 GiB (2.83%) ETA: 30m34.838834555s
2023-08-25 17:46:14 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 224.8 MiB/6.8 GiB (3.22%) ETA: 29m18.312524751s
2023-08-25 17:46:19 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 252.4 MiB/6.8 GiB (3.61%) ETA: 28m13.29145975s
2023-08-25 17:46:24 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 280.7 MiB/6.8 GiB (4.02%) ETA: 27m15.764827334s
2023-08-25 17:46:29 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 307.7 MiB/6.8 GiB (4.41%) ETA: 26m34.20106392s
2023-08-25 17:46:34 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 334.9 MiB/6.8 GiB (4.79%) ETA: 25m58.510846915s
2023-08-25 17:46:39 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 360.4 MiB/6.8 GiB (5.16%) ETA: 25m34.304463107s
2023-08-25 17:46:44 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 385.8 MiB/6.8 GiB (5.52%) ETA: 25m13.63422926s
2023-08-25 17:46:49 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 396.9 MiB/6.8 GiB (5.68%) ETA: 25m51.680304828s
2023-08-25 17:46:54 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 422.9 MiB/6.8 GiB (6.05%) ETA: 25m28.241492514s
2023-08-25 17:46:59 localagi-api-1 | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 449.6 MiB/6.8 GiB (6.44%) ETA: 25m4.252377344s
2023-08-25 17:47:04 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 475.8 MiB/6.8 GiB (6.81%) ETA: 24m44.079224197s
2023-08-25 17:47:09 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 501.5 MiB/6.8 GiB (7.18%) ETA: 24m27.156780518s
2023-08-25 17:47:14 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 527.6 MiB/6.8 GiB (7.55%) ETA: 24m10.125181485s
2023-08-25 17:47:19 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 553.6 MiB/6.8 GiB (7.93%) ETA: 23m54.734561213s
2023-08-25 17:47:24 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 580.5 MiB/6.8 GiB (8.31%) ETA: 23m37.701889286s
2023-08-25 17:47:29 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 604.5 MiB/6.8 GiB (8.66%) ETA: 23m29.084928037s
2023-08-25 17:47:34 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 626.5 MiB/6.8 GiB (8.97%) ETA: 23m25.662018804s
2023-08-25 17:47:39 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 646.9 MiB/6.8 GiB (9.26%) ETA: 23m25.944030306s
2023-08-25 17:47:44 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 667.6 MiB/6.8 GiB (9.56%) ETA: 23m25.214801587s
2023-08-25 17:47:49 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 684.9 MiB/6.8 GiB (9.81%) ETA: 23m32.059327738s
2023-08-25 17:47:54 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 702.2 MiB/6.8 GiB (10.05%) ETA: 23m38.267074715s
2023-08-25 17:47:59 localagi-api-1 | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 719.0 MiB/6.8 GiB (10.29%) ETA: 23m45.088227298s
2023-08-25 17:48:04 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 735.3 MiB/6.8 GiB (10.53%) ETA: 23m52.366225392s
2023-08-25 17:48:09 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 748.5 MiB/6.8 GiB (10.72%) ETA: 24m5.789634092s
2023-08-25 17:48:14 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 755.9 MiB/6.8 GiB (10.82%) ETA: 24m31.255451005s
2023-08-25 17:48:19 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 771.7 MiB/6.8 GiB (11.05%) ETA: 24m37.719377079s
2023-08-25 17:48:24 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 777.9 MiB/6.8 GiB (11.14%) ETA: 25m4.775894072s
2023-08-25 17:48:29 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 789.5 MiB/6.8 GiB (11.30%) ETA: 25m19.083901564s
2023-08-25 17:48:34 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 807.5 MiB/6.8 GiB (11.56%) ETA: 25m19.300396497s
2023-08-25 17:48:39 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 826.7 MiB/6.8 GiB (11.84%) ETA: 25m16.505580285s
2023-08-25 17:48:44 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 847.4 MiB/6.8 GiB (12.13%) ETA: 25m10.741555212s
2023-08-25 17:48:49 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 869.8 MiB/6.8 GiB (12.45%) ETA: 25m1.660771614s
2023-08-25 17:48:54 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 891.1 MiB/6.8 GiB (12.76%) ETA: 24m54.81318706s
2023-08-25 17:48:59 localagi-api-1 | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 907.9 MiB/6.8 GiB (13.00%) ETA: 24m56.714185144s
2023-08-25 17:49:04 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 925.2 MiB/6.8 GiB (13.25%) ETA: 24m57.257341449s
2023-08-25 17:49:09 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 942.6 MiB/6.8 GiB (13.50%) ETA: 24m57.448848322s
2023-08-25 17:49:14 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 959.4 MiB/6.8 GiB (13.74%) ETA: 24m58.734426286s
2023-08-25 17:49:19 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 977.8 MiB/6.8 GiB (14.00%) ETA: 24m56.658442969s
2023-08-25 17:49:24 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 995.5 MiB/6.8 GiB (14.25%) ETA: 24m55.762827266s
2023-08-25 17:49:29 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1012.4 MiB/6.8 GiB (14.50%) ETA: 24m56.212050715s
2023-08-25 17:49:34 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.0 GiB/6.8 GiB (14.78%) ETA: 24m51.156651539s
2023-08-25 17:49:39 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.0 GiB/6.8 GiB (15.08%) ETA: 24m45.25550841s
2023-08-25 17:49:44 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.0 GiB/6.8 GiB (15.31%) ETA: 24m46.648610092s
2023-08-25 17:49:49 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.0 GiB/6.8 GiB (15.39%) ETA: 25m5.069933867s
2023-08-25 17:49:54 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (15.60%) ETA: 25m7.851151984s
2023-08-25 17:49:59 localagi-api-1 | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (15.91%) ETA: 24m59.843546032s
2023-08-25 17:50:04 localagi-api-1 | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (16.19%) ETA: 24m54.932627035s
2023-08-25 17:50:09 localagi-api-1 | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (16.42%) ETA: 24m55.104952647s
2023-08-25 17:50:14 localagi-api-1 | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (16.67%) ETA: 24m53.861627663s
2023-08-25 17:50:19 localagi-api-1 | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (16.80%) ETA: 25m4.536074904s
2023-08-25 17:50:24 localagi-api-1 | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.2 GiB/6.8 GiB (17.05%) ETA: 25m2.056516166s
2023-08-25 17:50:29 localagi-api-1 | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.2 GiB/6.8 GiB (17.33%) ETA: 24m56.314692485s
2023-08-25 17:50:34 localagi-api-1 | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.2 GiB/6.8 GiB (17.62%) ETA: 24m50.148371411s
2023-08-25 17:50:39 localagi-api-1 | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.2 GiB/6.8 GiB (17.92%) ETA: 24m42.732668761s
2023-08-25 17:50:45 localagi-api-1 | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.2 GiB/6.8 GiB (18.22%) ETA: 24m35.131474208s
2023-08-25 17:50:50 localagi-api-1 | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.3 GiB/6.8 GiB (18.55%) ETA: 24m25.959062061s
2023-08-25 17:50:55 localagi-api-1 | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.3 GiB/6.8 GiB (18.88%) ETA: 24m15.639683608s
2023-08-25 17:51:00 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.3 GiB/6.8 GiB (19.22%) ETA: 24m5.30559338s
2023-08-25 17:51:05 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.3 GiB/6.8 GiB (19.54%) ETA: 23m56.33904647s
2023-08-25 17:51:10 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.4 GiB/6.8 GiB (19.86%) ETA: 23m47.249835957s
2023-08-25 17:51:15 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.4 GiB/6.8 GiB (20.18%) ETA: 23m39.000545325s
2023-08-25 17:51:20 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.4 GiB/6.8 GiB (20.51%) ETA: 23m29.621017321s
2023-08-25 17:51:25 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.4 GiB/6.8 GiB (20.83%) ETA: 23m21.431435087s
2023-08-25 17:51:30 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.4 GiB/6.8 GiB (21.15%) ETA: 23m13.763702334s
2023-08-25 17:51:35 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (21.46%) ETA: 23m6.45824725s
2023-08-25 17:51:40 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (21.71%) ETA: 23m4.302905075s
2023-08-25 17:51:46 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (21.75%) ETA: 23m25.659225723s
2023-08-25 17:51:51 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (22.06%) ETA: 23m18.076507891s
2023-08-25 17:51:56 localagi-api-1 | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (22.38%) ETA: 23m9.723191308s
2023-08-25 17:52:01 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (22.70%) ETA: 23m0.890955399s
2023-08-25 17:52:06 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.6 GiB/6.8 GiB (23.04%) ETA: 22m51.898918337s
2023-08-25 17:52:11 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.6 GiB/6.8 GiB (23.36%) ETA: 22m43.736657334s
2023-08-25 17:52:16 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.6 GiB/6.8 GiB (23.66%) ETA: 22m36.969808172s
2023-08-25 17:52:21 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.6 GiB/6.8 GiB (23.97%) ETA: 22m30.076277514s
2023-08-25 17:52:26 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.7 GiB/6.8 GiB (24.28%) ETA: 22m23.113157142s
2023-08-25 17:52:31 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.7 GiB/6.8 GiB (24.57%) ETA: 22m17.379214499s
2023-08-25 17:52:36 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.7 GiB/6.8 GiB (24.86%) ETA: 22m11.701384074s
2023-08-25 17:52:41 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.7 GiB/6.8 GiB (25.16%) ETA: 22m5.734602425s
2023-08-25 17:52:46 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.7 GiB/6.8 GiB (25.44%) ETA: 22m0.615750964s
2023-08-25 17:52:51 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.8 GiB/6.8 GiB (25.73%) ETA: 21m55.011226301s
2023-08-25 17:52:56 localagi-api-1 | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.8 GiB/6.8 GiB (26.03%) ETA: 21m48.981109654s
2023-08-25 17:53:01 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.8 GiB/6.8 GiB (26.33%) ETA: 21m43.234211947s
2023-08-25 17:53:09 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.8 GiB/6.8 GiB (26.60%) ETA: 21m44.85644611s
2023-08-25 17:53:14 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.8 GiB/6.8 GiB (26.90%) ETA: 21m38.916124492s
2023-08-25 17:53:19 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.9 GiB/6.8 GiB (27.20%) ETA: 21m32.105912939s
2023-08-25 17:53:24 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.9 GiB/6.8 GiB (27.52%) ETA: 21m25.005707793s
2023-08-25 17:53:29 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.9 GiB/6.8 GiB (27.83%) ETA: 21m17.912107128s
2023-08-25 17:53:34 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.9 GiB/6.8 GiB (28.14%) ETA: 21m11.321791611s
2023-08-25 17:53:39 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.9 GiB/6.8 GiB (28.46%) ETA: 21m3.93448686s
2023-08-25 17:53:44 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.0 GiB/6.8 GiB (28.78%) ETA: 20m56.98373563s
2023-08-25 17:53:49 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.0 GiB/6.8 GiB (29.09%) ETA: 20m50.416393521s
2023-08-25 17:53:54 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.0 GiB/6.8 GiB (29.41%) ETA: 20m43.381401303s
2023-08-25 17:53:59 localagi-api-1 | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.0 GiB/6.8 GiB (29.71%) ETA: 20m37.152239049s
2023-08-25 17:54:04 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.0 GiB/6.8 GiB (29.98%) ETA: 20m32.817981929s
2023-08-25 17:54:09 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.1 GiB/6.8 GiB (30.26%) ETA: 20m28.049910642s
2023-08-25 17:54:14 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.1 GiB/6.8 GiB (30.53%) ETA: 20m24.004479208s
2023-08-25 17:54:19 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.1 GiB/6.8 GiB (30.80%) ETA: 20m20.062819647s
2023-08-25 17:54:24 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.1 GiB/6.8 GiB (31.07%) ETA: 20m15.500767517s
2023-08-25 17:54:29 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.1 GiB/6.8 GiB (31.34%) ETA: 20m11.224202546s
2023-08-25 17:54:34 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.2 GiB/6.8 GiB (31.61%) ETA: 20m6.844568665s
2023-08-25 17:54:39 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.2 GiB/6.8 GiB (31.89%) ETA: 20m2.383315912s
2023-08-25 17:54:44 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.2 GiB/6.8 GiB (32.19%) ETA: 19m56.636977835s
2023-08-25 17:54:49 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.2 GiB/6.8 GiB (32.47%) ETA: 19m51.487288471s
2023-08-25 17:54:54 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.2 GiB/6.8 GiB (32.76%) ETA: 19m46.168736556s
2023-08-25 17:54:59 localagi-api-1 | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.3 GiB/6.8 GiB (33.07%) ETA: 19m39.914101608s
2023-08-25 17:55:04 localagi-api-1 | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.3 GiB/6.8 GiB (33.38%) ETA: 19m33.612478728s
2023-08-25 17:55:09 localagi-api-1 | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.3 GiB/6.8 GiB (33.69%) ETA: 19m27.196363002s
2023-08-25 17:55:15 localagi-api-1 | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.3 GiB/6.8 GiB (33.89%) ETA: 19m28.007308085s
2023-08-25 17:55:20 localagi-api-1 | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.3 GiB/6.8 GiB (34.21%) ETA: 19m21.357373415s
2023-08-25 17:55:25 localagi-api-1 | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.4 GiB/6.8 GiB (34.54%) ETA: 19m13.936370629s
2023-08-25 17:55:30 localagi-api-1 | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.4 GiB/6.8 GiB (34.87%) ETA: 19m6.572813151s
2023-08-25 17:55:35 localagi-api-1 | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.4 GiB/6.8 GiB (35.19%) ETA: 18m59.55307753s
2023-08-25 17:55:40 localagi-api-1 | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.4 GiB/6.8 GiB (35.52%) ETA: 18m52.354750762s
2023-08-25 17:55:45 localagi-api-1 | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.4 GiB/6.8 GiB (35.83%) ETA: 18m46.287884185s
2023-08-25 17:55:50 localagi-api-1 | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.5 GiB/6.8 GiB (36.13%) ETA: 18m40.327528666s
2023-08-25 17:55:55 localagi-api-1 | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.5 GiB/6.8 GiB (36.44%) ETA: 18m34.582194394s
2023-08-25 17:56:00 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.5 GiB/6.8 GiB (36.57%) ETA: 18m36.97730824s
2023-08-25 17:56:05 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.5 GiB/6.8 GiB (36.85%) ETA: 18m31.953734017s
2023-08-25 17:56:10 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.5 GiB/6.8 GiB (37.14%) ETA: 18m26.7178465s
2023-08-25 17:56:15 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (37.43%) ETA: 18m21.333355991s
2023-08-25 17:56:20 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (37.72%) ETA: 18m16.337356877s
2023-08-25 17:56:25 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (38.00%) ETA: 18m11.300524768s
2023-08-25 17:56:30 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (38.29%) ETA: 18m6.113650471s
2023-08-25 17:56:35 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (38.59%) ETA: 18m0.581502712s
2023-08-25 17:56:40 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (38.73%) ETA: 18m2.097905662s
2023-08-25 17:56:45 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.7 GiB/6.8 GiB (39.00%) ETA: 17m57.837553421s
2023-08-25 17:56:50 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.7 GiB/6.8 GiB (39.29%) ETA: 17m52.586951028s
2023-08-25 17:56:55 localagi-api-1 | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.7 GiB/6.8 GiB (39.57%) ETA: 17m47.585849956s
2023-08-25 17:57:00 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.7 GiB/6.8 GiB (39.87%) ETA: 17m42.000951679s
2023-08-25 17:57:05 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.7 GiB/6.8 GiB (40.16%) ETA: 17m36.612665656s
2023-08-25 17:57:10 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.8 GiB/6.8 GiB (40.46%) ETA: 17m30.753236951s
2023-08-25 17:57:15 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.8 GiB/6.8 GiB (40.76%) ETA: 17m25.252370198s
2023-08-25 17:57:20 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.8 GiB/6.8 GiB (41.05%) ETA: 17m19.907245261s
2023-08-25 17:57:25 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.8 GiB/6.8 GiB (41.34%) ETA: 17m14.75974087s
2023-08-25 17:57:30 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.8 GiB/6.8 GiB (41.62%) ETA: 17m9.789433337s
2023-08-25 17:57:35 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.9 GiB/6.8 GiB (41.90%) ETA: 17m5.110573113s
2023-08-25 17:57:40 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.9 GiB/6.8 GiB (42.17%) ETA: 17m0.427255164s
2023-08-25 17:57:45 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.9 GiB/6.8 GiB (42.46%) ETA: 16m55.43891319s
2023-08-25 17:57:50 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.9 GiB/6.8 GiB (42.73%) ETA: 16m50.834745697s
2023-08-25 17:57:55 localagi-api-1 | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.9 GiB/6.8 GiB (43.01%) ETA: 16m46.160252203s
2023-08-25 17:58:00 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (43.29%) ETA: 16m41.217654738s
2023-08-25 17:58:07 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (43.34%) ETA: 16m48.259185605s
2023-08-25 17:58:12 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (43.66%) ETA: 16m41.769766152s
2023-08-25 17:58:17 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (43.98%) ETA: 16m35.359351352s
2023-08-25 17:58:22 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (44.30%) ETA: 16m28.534509825s
2023-08-25 17:58:27 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (44.63%) ETA: 16m21.769909449s
2023-08-25 17:58:32 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.1 GiB/6.8 GiB (44.94%) ETA: 16m15.683075482s
2023-08-25 17:58:37 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.1 GiB/6.8 GiB (45.21%) ETA: 16m11.083112347s
2023-08-25 17:58:42 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.1 GiB/6.8 GiB (45.51%) ETA: 16m5.434041376s
2023-08-25 17:58:47 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.1 GiB/6.8 GiB (45.78%) ETA: 16m0.902770047s
2023-08-25 17:58:52 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.1 GiB/6.8 GiB (46.04%) ETA: 15m56.739178012s
2023-08-25 17:58:57 localagi-api-1 | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (46.30%) ETA: 15m52.467389484s
2023-08-25 17:59:02 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (46.58%) ETA: 15m47.790774876s
2023-08-25 17:59:07 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (46.82%) ETA: 15m44.145870079s
2023-08-25 17:59:12 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (47.05%) ETA: 15m41.206626327s
2023-08-25 17:59:17 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (47.26%) ETA: 15m38.983179602s
2023-08-25 17:59:22 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (47.46%) ETA: 15m36.937692259s
2023-08-25 17:59:27 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (47.67%) ETA: 15m34.737070156s
2023-08-25 17:59:32 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (47.85%) ETA: 15m33.32879484s
2023-08-25 17:59:37 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.02%) ETA: 15m32.496607183s
2023-08-25 17:59:42 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.10%) ETA: 15m34.747064941s
2023-08-25 17:59:47 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.28%) ETA: 15m33.680546627s
2023-08-25 17:59:52 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.46%) ETA: 15m32.056156998s
2023-08-25 17:59:57 localagi-api-1 | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.66%) ETA: 15m29.988031538s
2023-08-25 18:00:02 localagi-api-1 | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.86%) ETA: 15m27.890348455s
2023-08-25 18:00:13 localagi-api-1 | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (49.07%) ETA: 15m31.606490288s
2023-08-25 18:00:18 localagi-api-1 | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.4 GiB/6.8 GiB (49.30%) ETA: 15m28.107022753s
2023-08-25 18:00:23 localagi-api-1 | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.4 GiB/6.8 GiB (49.56%) ETA: 15m23.53524591s
2023-08-25 18:00:28 localagi-api-1 | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.4 GiB/6.8 GiB (49.83%) ETA: 15m18.578561154s
2023-08-25 18:00:33 localagi-api-1 | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.4 GiB/6.8 GiB (50.12%) ETA: 15m13.306949066s
2023-08-25 18:00:38 localagi-api-1 | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.4 GiB/6.8 GiB (50.41%) ETA: 15m7.524497412s
2023-08-25 18:00:43 localagi-api-1 | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.5 GiB/6.8 GiB (50.70%) ETA: 15m1.969624599s
2023-08-25 18:00:48 localagi-api-1 | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.5 GiB/6.8 GiB (50.99%) ETA: 14m56.391647821s
2023-08-25 18:00:53 localagi-api-1 | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.5 GiB/6.8 GiB (51.29%) ETA: 14m50.291923361s
2023-08-25 18:00:58 localagi-api-1 | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.5 GiB/6.8 GiB (51.57%) ETA: 14m45.218338962s
2023-08-25 18:01:03 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.5 GiB/6.8 GiB (51.85%) ETA: 14m40.085193323s
2023-08-25 18:01:08 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (52.14%) ETA: 14m34.293876557s
2023-08-25 18:01:13 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (52.45%) ETA: 14m28.073762252s
2023-08-25 18:01:18 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (52.75%) ETA: 14m22.115468631s
2023-08-25 18:01:23 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (53.05%) ETA: 14m16.278394391s
2023-08-25 18:01:28 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (53.34%) ETA: 14m10.726885056s
2023-08-25 18:01:34 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (53.51%) ETA: 14m9.550513848s
2023-08-25 18:01:39 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.7 GiB/6.8 GiB (53.82%) ETA: 14m3.518252548s
2023-08-25 18:01:44 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.7 GiB/6.8 GiB (54.13%) ETA: 13m57.174044755s
2023-08-25 18:01:49 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.7 GiB/6.8 GiB (54.42%) ETA: 13m51.731530367s
2023-08-25 18:01:54 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.7 GiB/6.8 GiB (54.71%) ETA: 13m46.117925225s
2023-08-25 18:01:59 localagi-api-1 | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.7 GiB/6.8 GiB (54.95%) ETA: 13m42.272999701s
2023-08-25 18:02:04 localagi-api-1 | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (55.18%) ETA: 13m38.701071288s
2023-08-25 18:02:09 localagi-api-1 | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (55.39%) ETA: 13m35.693754726s
2023-08-25 18:02:16 localagi-api-1 | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (55.60%) ETA: 13m34.435797394s
2023-08-25 18:02:21 localagi-api-1 | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (55.79%) ETA: 13m32.154217308s
2023-08-25 18:02:26 localagi-api-1 | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (56.00%) ETA: 13m29.481735915s
2023-08-25 18:02:31 localagi-api-1 | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (56.23%) ETA: 13m25.708748348s
2023-08-25 18:02:36 localagi-api-1 | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (56.46%) ETA: 13m22.090860913s
2023-08-25 18:02:41 localagi-api-1 | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (56.67%) ETA: 13m19.011460843s
2023-08-25 18:02:46 localagi-api-1 | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (56.90%) ETA: 13m15.549359171s
2023-08-25 18:02:51 localagi-api-1 | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (57.11%) ETA: 13m12.426732692s
2023-08-25 18:02:56 localagi-api-1 | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (57.34%) ETA: 13m8.655749443s
2023-08-25 18:03:01 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (57.54%) ETA: 13m5.821821024s
2023-08-25 18:03:06 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (57.77%) ETA: 13m2.340846741s
2023-08-25 18:03:11 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (58.01%) ETA: 12m58.220907395s
2023-08-25 18:03:16 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (58.23%) ETA: 12m54.70794477s
2023-08-25 18:03:21 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (58.45%) ETA: 12m51.292111935s
2023-08-25 18:03:26 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (58.69%) ETA: 12m47.324531711s
2023-08-25 18:03:31 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (58.94%) ETA: 12m43.070612456s
2023-08-25 18:03:36 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (59.20%) ETA: 12m38.1792959s
2023-08-25 18:03:44 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (59.34%) ETA: 12m39.827562348s
2023-08-25 18:03:49 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.1 GiB/6.8 GiB (59.65%) ETA: 12m33.454715319s
2023-08-25 18:03:54 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.1 GiB/6.8 GiB (59.97%) ETA: 12m26.625994889s
2023-08-25 18:03:59 localagi-api-1 | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.1 GiB/6.8 GiB (60.31%) ETA: 12m19.565248914s
2023-08-25 18:04:04 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.1 GiB/6.8 GiB (60.63%) ETA: 12m12.790517847s
2023-08-25 18:04:09 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.2 GiB/6.8 GiB (60.97%) ETA: 12m5.870761896s
2023-08-25 18:04:14 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.2 GiB/6.8 GiB (61.29%) ETA: 11m59.082871981s
2023-08-25 18:04:19 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.2 GiB/6.8 GiB (61.60%) ETA: 11m52.902275574s
2023-08-25 18:04:24 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.2 GiB/6.8 GiB (61.90%) ETA: 11m46.924159349s
2023-08-25 18:04:29 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.2 GiB/6.8 GiB (62.20%) ETA: 11m41.162498688s
2023-08-25 18:04:34 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.3 GiB/6.8 GiB (62.49%) ETA: 11m35.666352299s
2023-08-25 18:04:39 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.3 GiB/6.8 GiB (62.77%) ETA: 11m30.080220218s
2023-08-25 18:04:44 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.3 GiB/6.8 GiB (63.03%) ETA: 11m25.38085855s
2023-08-25 18:04:49 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.3 GiB/6.8 GiB (63.30%) ETA: 11m20.468914226s
2023-08-25 18:04:54 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.3 GiB/6.8 GiB (63.57%) ETA: 11m15.504013663s
2023-08-25 18:05:00 localagi-api-1 | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (63.82%) ETA: 11m11.1770899s
2023-08-25 18:05:06 localagi-api-1 | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (64.02%) ETA: 11m9.089279112s
2023-08-25 18:05:11 localagi-api-1 | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (64.28%) ETA: 11m4.313815051s
2023-08-25 18:05:16 localagi-api-1 | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (64.54%) ETA: 10m59.405509312s
2023-08-25 18:05:21 localagi-api-1 | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (64.83%) ETA: 10m53.929449954s
2023-08-25 18:05:26 localagi-api-1 | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (65.10%) ETA: 10m48.76507989s
2023-08-25 18:05:31 localagi-api-1 | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.5 GiB/6.8 GiB (65.40%) ETA: 10m43.01768139s
2023-08-25 18:05:36 localagi-api-1 | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.5 GiB/6.8 GiB (65.69%) ETA: 10m37.429193049s
2023-08-25 18:05:41 localagi-api-1 | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.5 GiB/6.8 GiB (65.98%) ETA: 10m31.720278154s
2023-08-25 18:05:46 localagi-api-1 | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.5 GiB/6.8 GiB (66.29%) ETA: 10m25.80162278s
2023-08-25 18:05:51 localagi-api-1 | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.5 GiB/6.8 GiB (66.43%) ETA: 10m24.287810662s
2023-08-25 18:05:56 localagi-api-1 | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.6 GiB/6.8 GiB (66.74%) ETA: 10m18.104310187s
2023-08-25 18:06:01 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.6 GiB/6.8 GiB (67.05%) ETA: 10m12.104076964s
2023-08-25 18:06:06 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.6 GiB/6.8 GiB (67.35%) ETA: 10m6.052951185s
2023-08-25 18:06:11 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.6 GiB/6.8 GiB (67.66%) ETA: 10m0.060696827s
2023-08-25 18:06:16 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.6 GiB/6.8 GiB (67.96%) ETA: 9m54.099435666s
2023-08-25 18:06:21 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (68.25%) ETA: 9m48.656619273s
2023-08-25 18:06:26 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (68.54%) ETA: 9m43.255673835s
2023-08-25 18:06:31 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (68.68%) ETA: 9m41.671256852s
2023-08-25 18:06:36 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (68.99%) ETA: 9m35.656983881s
2023-08-25 18:06:41 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (69.27%) ETA: 9m30.143321642s
2023-08-25 18:06:46 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (69.57%) ETA: 9m24.537726355s
2023-08-25 18:06:51 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.8 GiB/6.8 GiB (69.86%) ETA: 9m18.938844309s
2023-08-25 18:06:56 localagi-api-1 | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.8 GiB/6.8 GiB (70.17%) ETA: 9m12.931654463s
2023-08-25 18:07:01 localagi-api-1 | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.8 GiB/6.8 GiB (70.46%) ETA: 9m7.308826747s
2023-08-25 18:07:06 localagi-api-1 | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.8 GiB/6.8 GiB (70.74%) ETA: 9m2.008076402s
2023-08-25 18:07:16 localagi-api-1 | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.8 GiB/6.8 GiB (70.93%) ETA: 9m1.047036298s
2023-08-25 18:07:21 localagi-api-1 | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (71.19%) ETA: 8m56.158391194s
2023-08-25 18:07:26 localagi-api-1 | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (71.48%) ETA: 8m50.826955478s
2023-08-25 18:07:31 localagi-api-1 | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (71.74%) ETA: 8m45.940389132s
2023-08-25 18:07:36 localagi-api-1 | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (71.99%) ETA: 8m41.305765303s
2023-08-25 18:07:41 localagi-api-1 | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (72.23%) ETA: 8m37.060355169s
2023-08-25 18:07:46 localagi-api-1 | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (72.46%) ETA: 8m33.120765242s
2023-08-25 18:07:51 localagi-api-1 | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (72.68%) ETA: 8m29.393681809s
2023-08-25 18:07:56 localagi-api-1 | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (72.80%) ETA: 8m28.285210586s
2023-08-25 18:08:01 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (73.01%) ETA: 8m24.672860617s
2023-08-25 18:08:06 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (73.24%) ETA: 8m20.640913259s
2023-08-25 18:08:11 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (73.47%) ETA: 8m16.467069603s
2023-08-25 18:08:16 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (73.74%) ETA: 8m11.44694112s
2023-08-25 18:08:21 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (74.00%) ETA: 8m6.585506185s
2023-08-25 18:08:26 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.1 GiB/6.8 GiB (74.27%) ETA: 8m1.62243921s
2023-08-25 18:08:31 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.1 GiB/6.8 GiB (74.53%) ETA: 7m56.894302845s
2023-08-25 18:08:36 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.1 GiB/6.8 GiB (74.81%) ETA: 7m51.414019369s
2023-08-25 18:08:41 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.1 GiB/6.8 GiB (75.12%) ETA: 7m45.479982641s
2023-08-25 18:08:46 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.1 GiB/6.8 GiB (75.42%) ETA: 7m39.619528514s
2023-08-25 18:08:51 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.2 GiB/6.8 GiB (75.71%) ETA: 7m34.129648075s
2023-08-25 18:08:56 localagi-api-1 | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.2 GiB/6.8 GiB (76.01%) ETA: 7m28.235826132s
2023-08-25 18:09:01 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.2 GiB/6.8 GiB (76.31%) ETA: 7m22.525467308s
2023-08-25 18:09:06 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.2 GiB/6.8 GiB (76.62%) ETA: 7m16.549150124s
2023-08-25 18:09:11 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.2 GiB/6.8 GiB (76.92%) ETA: 7m10.547510408s
2023-08-25 18:09:16 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.3 GiB/6.8 GiB (77.24%) ETA: 7m4.47756304s
2023-08-25 18:09:21 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.3 GiB/6.8 GiB (77.57%) ETA: 6m57.985694452s
2023-08-25 18:09:26 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.3 GiB/6.8 GiB (77.82%) ETA: 6m53.294005846s
2023-08-25 18:09:31 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.3 GiB/6.8 GiB (78.14%) ETA: 6m47.137895265s
2023-08-25 18:09:36 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (78.46%) ETA: 6m40.88492467s
2023-08-25 18:09:41 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (78.76%) ETA: 6m35.150211654s
2023-08-25 18:09:46 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (79.05%) ETA: 6m29.631762823s
2023-08-25 18:09:51 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (79.32%) ETA: 6m24.641141372s
2023-08-25 18:09:56 localagi-api-1 | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (79.62%) ETA: 6m18.908317801s
2023-08-25 18:10:02 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (79.80%) ETA: 6m16.117367894s
2023-08-25 18:10:07 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.5 GiB/6.8 GiB (80.09%) ETA: 6m10.773735368s
2023-08-25 18:10:12 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.5 GiB/6.8 GiB (80.37%) ETA: 6m5.403021255s
2023-08-25 18:10:17 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.5 GiB/6.8 GiB (80.67%) ETA: 5m59.776270536s
2023-08-25 18:10:22 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.5 GiB/6.8 GiB (80.95%) ETA: 5m54.473322338s
2023-08-25 18:10:27 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.5 GiB/6.8 GiB (81.25%) ETA: 5m48.76248359s
2023-08-25 18:10:32 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.6 GiB/6.8 GiB (81.53%) ETA: 5m43.484782136s
2023-08-25 18:10:37 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.6 GiB/6.8 GiB (81.80%) ETA: 5m38.433378011s
2023-08-25 18:10:42 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.6 GiB/6.8 GiB (82.09%) ETA: 5m32.996178441s
2023-08-25 18:10:47 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.6 GiB/6.8 GiB (82.38%) ETA: 5m27.522223831s
2023-08-25 18:10:52 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.6 GiB/6.8 GiB (82.66%) ETA: 5m22.22272015s
2023-08-25 18:10:57 localagi-api-1 | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.7 GiB/6.8 GiB (82.95%) ETA: 5m16.755724722s
2023-08-25 18:11:02 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.7 GiB/6.8 GiB (83.24%) ETA: 5m11.281434553s
2023-08-25 18:11:07 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.7 GiB/6.8 GiB (83.53%) ETA: 5m5.880152326s
2023-08-25 18:11:12 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.7 GiB/6.8 GiB (83.82%) ETA: 5m0.511839483s
2023-08-25 18:11:17 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.7 GiB/6.8 GiB (84.11%) ETA: 4m55.045996116s
2023-08-25 18:11:22 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.8 GiB/6.8 GiB (84.40%) ETA: 4m49.485795997s
2023-08-25 18:11:27 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.8 GiB/6.8 GiB (84.71%) ETA: 4m43.634459912s
2023-08-25 18:11:32 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.8 GiB/6.8 GiB (85.01%) ETA: 4m37.994409707s
2023-08-25 18:11:37 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.8 GiB/6.8 GiB (85.30%) ETA: 4m32.622602717s
2023-08-25 18:11:42 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.8 GiB/6.8 GiB (85.60%) ETA: 4m26.913791085s
2023-08-25 18:11:47 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.9 GiB/6.8 GiB (85.90%) ETA: 4m21.161609875s
2023-08-25 18:11:52 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.9 GiB/6.8 GiB (86.21%) ETA: 4m15.356739718s
2023-08-25 18:11:57 localagi-api-1 | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.9 GiB/6.8 GiB (86.52%) ETA: 4m9.528609303s
2023-08-25 18:12:02 localagi-api-1 | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.9 GiB/6.8 GiB (86.81%) ETA: 4m4.001963542s
2023-08-25 18:12:12 localagi-api-1 | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.9 GiB/6.8 GiB (87.02%) ETA: 4m1.048926561s
2023-08-25 18:12:17 localagi-api-1 | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (87.29%) ETA: 3m55.97409621s
2023-08-25 18:12:22 localagi-api-1 | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (87.56%) ETA: 3m50.99062437s
2023-08-25 18:12:27 localagi-api-1 | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (87.84%) ETA: 3m45.771004627s
2023-08-25 18:12:32 localagi-api-1 | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (88.12%) ETA: 3m40.600449328s
2023-08-25 18:12:37 localagi-api-1 | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (88.37%) ETA: 3m35.890610589s
2023-08-25 18:12:42 localagi-api-1 | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (88.65%) ETA: 3m30.851850173s
2023-08-25 18:12:47 localagi-api-1 | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (88.91%) ETA: 3m25.999589056s
2023-08-25 18:12:52 localagi-api-1 | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (89.15%) ETA: 3m21.584694867s
2023-08-25 18:12:57 localagi-api-1 | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (89.36%) ETA: 3m17.715512412s
2023-08-25 18:13:02 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (89.60%) ETA: 3m13.358626513s
2023-08-25 18:13:07 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (89.85%) ETA: 3m8.812391493s
2023-08-25 18:13:12 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (90.07%) ETA: 3m4.808628209s
2023-08-25 18:13:17 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (90.30%) ETA: 3m0.523451918s
2023-08-25 18:13:22 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (90.50%) ETA: 2m57.008417955s
2023-08-25 18:13:27 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (90.70%) ETA: 2m53.330160972s
2023-08-25 18:13:32 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (90.91%) ETA: 2m49.582338841s
2023-08-25 18:13:37 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (91.11%) ETA: 2m46.048302309s
2023-08-25 18:13:42 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (91.29%) ETA: 2m42.702070733s
2023-08-25 18:13:47 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (91.50%) ETA: 2m38.944535936s
2023-08-25 18:13:52 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (91.70%) ETA: 2m35.236035019s
2023-08-25 18:13:57 localagi-api-1 | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (91.88%) ETA: 2m32.041828866s
2023-08-25 18:14:02 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (92.07%) ETA: 2m28.749454204s
2023-08-25 18:14:07 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (92.27%) ETA: 2m25.131856823s
2023-08-25 18:14:12 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (92.45%) ETA: 2m21.762885231s
2023-08-25 18:14:17 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (92.64%) ETA: 2m18.360025214s
2023-08-25 18:14:22 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (92.84%) ETA: 2m14.71506397s
2023-08-25 18:14:27 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (93.05%) ETA: 2m10.711225834s
2023-08-25 18:14:32 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (93.28%) ETA: 2m6.612335569s
2023-08-25 18:14:37 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (93.51%) ETA: 2m2.274872167s
2023-08-25 18:14:42 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (93.71%) ETA: 1m58.527892595s
2023-08-25 18:14:47 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (93.91%) ETA: 1m54.865448868s
2023-08-25 18:14:52 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (94.13%) ETA: 1m50.846887449s
2023-08-25 18:14:57 localagi-api-1 | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (94.37%) ETA: 1m46.340396868s
2023-08-25 18:15:02 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (94.58%) ETA: 1m42.349770137s
2023-08-25 18:15:07 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (94.81%) ETA: 1m37.970879676s
2023-08-25 18:15:12 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (95.02%) ETA: 1m34.167566185s
2023-08-25 18:15:17 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (95.26%) ETA: 1m29.612522994s
2023-08-25 18:15:22 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (95.48%) ETA: 1m25.525214221s
2023-08-25 18:15:27 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (95.68%) ETA: 1m21.681644775s
2023-08-25 18:15:32 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (95.94%) ETA: 1m16.940595383s
2023-08-25 18:15:39 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (96.20%) ETA: 1m12.058492418s
2023-08-25 18:15:44 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (96.46%) ETA: 1m7.205805865s
2023-08-25 18:15:49 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (96.68%) ETA: 1m2.893971776s
2023-08-25 18:15:54 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (96.93%) ETA: 58.324875404s
2023-08-25 18:15:59 localagi-api-1 | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (97.17%) ETA: 53.657568668s
2023-08-25 18:16:04 localagi-api-1 | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (97.43%) ETA: 48.727128035s
2023-08-25 18:16:09 localagi-api-1 | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.7 GiB/6.8 GiB (97.69%) ETA: 43.900597194s
2023-08-25 18:16:14 localagi-api-1 | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.7 GiB/6.8 GiB (97.95%) ETA: 38.847864622s
2023-08-25 18:16:19 localagi-api-1 | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.7 GiB/6.8 GiB (98.24%) ETA: 33.363225549s
2023-08-25 18:16:24 localagi-api-1 | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.7 GiB/6.8 GiB (98.51%) ETA: 28.33793103s
2023-08-25 18:16:29 localagi-api-1 | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.7 GiB/6.8 GiB (98.78%) ETA: 23.123694714s
2023-08-25 18:16:34 localagi-api-1 | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.8 GiB/6.8 GiB (99.07%) ETA: 17.705069539s
2023-08-25 18:16:39 localagi-api-1 | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.8 GiB/6.8 GiB (99.32%) ETA: 12.972167055s
2023-08-25 18:16:44 localagi-api-1 | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.8 GiB/6.8 GiB (99.57%) ETA: 8.195311872s
2023-08-25 18:16:49 localagi-api-1 | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.8 GiB/6.8 GiB (99.84%) ETA: 3.068730204s
2023-08-25 18:16:53 localagi-api-1 | 4:16PM DBG File "wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin" downloaded and verified
2023-08-25 18:16:53 localagi-api-1 | 4:16PM DBG Prompt template "wizardlm-completion" written
2023-08-25 18:16:53 localagi-api-1 | 4:16PM DBG Prompt template "wizardlm-chat" written
2023-08-25 18:16:53 localagi-api-1 | 4:16PM DBG Written config file /models/functions.yaml
2023-08-25 18:16:53 localagi-api-1 |
2023-08-25 18:16:53 localagi-api-1 | ┌───────────────────────────────────────────────────┐
2023-08-25 18:16:53 localagi-api-1 | │ Fiber v2.48.0 │
2023-08-25 18:16:53 localagi-api-1 | │ http://127.0.0.1:8080 │
2023-08-25 18:16:53 localagi-api-1 | │ (bound on host 0.0.0.0 and port 8080) │
2023-08-25 18:16:53 localagi-api-1 | │ │
2023-08-25 18:16:53 localagi-api-1 | │ Handlers ............ 59 Processes ........... 1 │
2023-08-25 18:16:53 localagi-api-1 | │ Prefork ....... Disabled PID ................ 14 │
2023-08-25 18:16:53 localagi-api-1 | └───────────────────────────────────────────────────┘
2023-08-25 18:16:53 localagi-api-1 |
2023-08-25 18:17:17 localagi-api-1 | [127.0.0.1]:42644 200 - GET /readyz
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Request received:
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Configuration read: &{PredictionOptions:{Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin Language: N:0 TopP:0.95 TopK:40 Temperature:0.1 Maxtokens:0 Echo:false Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 TypicalP:0 Seed:0 NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Name:functions F16:true Threads:14 Debug:true Roles:map[assistant:ASSISTANT: assistant_function_call:FUNCTION_CALL: function:FUNCTION CALL RESULT: system:SYSTEM:] Embeddings:false Backend:llama TemplateConfig:{Chat: ChatMessage: Completion: Edit: Functions:} PromptStrings:[] InputStrings:[] InputToken:[] functionCallString: functionCallNameString:intent FunctionsConfig:{DisableNoAction:true NoActionFunctionName: NoActionDescriptionName:} FeatureFlag:map[] LLMConfig:{SystemPrompt: TensorSplit: MainGPU: RMSNormEps:0 NGQA:0 PromptCachePath: PromptCacheAll:false PromptCacheRO:false MirostatETA:0.1 MirostatTAU:5 Mirostat:2 NGPULayers:0 MMap:true MMlock:false LowVRAM:false Grammar: StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:2048 NUMA:false} AutoGPTQ:{ModelBaseName: Device: Triton:false UseFastTokenizer:false} Diffusers:{PipelineType: SchedulerType: CUDA:false EnableParameters: CFGScale:0 IMG2IMG:false ClipSkip:0 ClipModel: ClipSubFolder:} Step:0 GRPC:{Attempts:0 AttemptsSleepTime:0}}
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Response needs to process functions
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Parameters: &{PredictionOptions:{Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin Language: N:0 TopP:0.95 TopK:40 Temperature:0.1 Maxtokens:0 Echo:false Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 TypicalP:0 Seed:0 NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Name:functions F16:true Threads:14 Debug:true Roles:map[assistant:ASSISTANT: assistant_function_call:FUNCTION_CALL: function:FUNCTION CALL RESULT: system:SYSTEM:] Embeddings:false Backend:llama TemplateConfig:{Chat: ChatMessage: Completion: Edit: Functions:} PromptStrings:[] InputStrings:[] InputToken:[] functionCallString: functionCallNameString:intent FunctionsConfig:{DisableNoAction:true NoActionFunctionName: NoActionDescriptionName:} FeatureFlag:map[] LLMConfig:{SystemPrompt: TensorSplit: MainGPU: RMSNormEps:0 NGQA:0 PromptCachePath: PromptCacheAll:false PromptCacheRO:false MirostatETA:0.1 MirostatTAU:5 Mirostat:2 NGPULayers:0 MMap:true MMlock:false LowVRAM:false Grammar:string ::= "\"" (
2023-08-25 18:17:52 localagi-api-1 | [^"\\] |
2023-08-25 18:17:52 localagi-api-1 | "\\" (["\\/bfnrt] | "u" [0-9a-fA-F] [0-9a-fA-F] [0-9a-fA-F] [0-9a-fA-F])
2023-08-25 18:17:52 localagi-api-1 | )* "\"" space
2023-08-25 18:17:52 localagi-api-1 | root-0-arguments ::= "{" space "\"action\"" space ":" space root-0-arguments-action "," space "\"confidence\"" space ":" space number "," space "\"detailed_reasoning\"" space ":" space string "}" space
2023-08-25 18:17:52 localagi-api-1 | root-0-function ::= "\"intent\""
2023-08-25 18:17:52 localagi-api-1 | root-0 ::= "{" space "\"arguments\"" space ":" space root-0-arguments "," space "\"function\"" space ":" space root-0-function "}" space
2023-08-25 18:17:52 localagi-api-1 | root ::= root-0
2023-08-25 18:17:52 localagi-api-1 | space ::= " "?
2023-08-25 18:17:52 localagi-api-1 | root-0-arguments-action ::= "\"search_internet\"" | "\"save_file\"" | "\"save_memory\"" | "\"search_memory\"" | "\"plan\"" | "\"reply\""
2023-08-25 18:17:52 localagi-api-1 | number ::= ("-"? ([0-9] | [1-9] [0-9]*)) ("." [0-9]+)? ([eE] [-+]? [0-9]+)? space StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:2048 NUMA:false} AutoGPTQ:{ModelBaseName: Device: Triton:false UseFastTokenizer:false} Diffusers:{PipelineType: SchedulerType: CUDA:false EnableParameters: CFGScale:0 IMG2IMG:false ClipSkip:0 ClipModel: ClipSubFolder:} Step:0 GRPC:{Attempts:0 AttemptsSleepTime:0}}
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Prompt (before templating): Transcript of AI assistant responding to user requests. Replies with the action to perform and the reasoning.
2023-08-25 18:17:52 localagi-api-1 | For searching the internet with a query, the assistant replies with the action "search_internet" and the query to search.
2023-08-25 18:17:52 localagi-api-1 | The assistant replies with the action "save_file", the filename and content to save for writing a file to disk permanently. This can be used to store the result of complex actions locally.
2023-08-25 18:17:52 localagi-api-1 | The assistant replies with the action "save_memory" and the string to remember or store an information that thinks it is relevant permanently.
2023-08-25 18:17:52 localagi-api-1 | The assistant replies with the action "search_memory" for searching between its memories with a query term.
2023-08-25 18:17:52 localagi-api-1 | The assistant for solving complex tasks that involves calling more functions in sequence, replies with the action "plan".
2023-08-25 18:17:52 localagi-api-1 | For replying to the user, the assistant replies with the action "reply" and the reply to the user directly when there is nothing to do.
2023-08-25 18:17:52 localagi-api-1 |
2023-08-25 18:17:52 localagi-api-1 | Request: plan a roadtrip to San Francisco
2023-08-25 18:17:52 localagi-api-1 |
2023-08-25 18:17:52 localagi-api-1 | Function call:
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Template failed loading: failed loading a template for wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Prompt (after templating): Transcript of AI assistant responding to user requests. Replies with the action to perform and the reasoning.
2023-08-25 18:17:52 localagi-api-1 | For searching the internet with a query, the assistant replies with the action "search_internet" and the query to search.
2023-08-25 18:17:52 localagi-api-1 | The assistant replies with the action "save_file", the filename and content to save for writing a file to disk permanently. This can be used to store the result of complex actions locally.
2023-08-25 18:17:52 localagi-api-1 | The assistant replies with the action "save_memory" and the string to remember or store an information that thinks it is relevant permanently.
2023-08-25 18:17:52 localagi-api-1 | The assistant replies with the action "search_memory" for searching between its memories with a query term.
2023-08-25 18:17:52 localagi-api-1 | The assistant for solving complex tasks that involves calling more functions in sequence, replies with the action "plan".
2023-08-25 18:17:52 localagi-api-1 | For replying to the user, the assistant replies with the action "reply" and the reply to the user directly when there is nothing to do.
2023-08-25 18:17:52 localagi-api-1 |
2023-08-25 18:17:52 localagi-api-1 | Request: plan a roadtrip to San Francisco
2023-08-25 18:17:52 localagi-api-1 |
2023-08-25 18:17:52 localagi-api-1 | Function call:
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Grammar: string ::= "\"" (
2023-08-25 18:17:52 localagi-api-1 | [^"\\] |
2023-08-25 18:17:52 localagi-api-1 | "\\" (["\\/bfnrt] | "u" [0-9a-fA-F] [0-9a-fA-F] [0-9a-fA-F] [0-9a-fA-F])
2023-08-25 18:17:52 localagi-api-1 | )* "\"" space
2023-08-25 18:17:52 localagi-api-1 | root-0-arguments ::= "{" space "\"action\"" space ":" space root-0-arguments-action "," space "\"confidence\"" space ":" space number "," space "\"detailed_reasoning\"" space ":" space string "}" space
2023-08-25 18:17:52 localagi-api-1 | root-0-function ::= "\"intent\""
2023-08-25 18:17:52 localagi-api-1 | root-0 ::= "{" space "\"arguments\"" space ":" space root-0-arguments "," space "\"function\"" space ":" space root-0-function "}" space
2023-08-25 18:17:52 localagi-api-1 | root ::= root-0
2023-08-25 18:17:52 localagi-api-1 | space ::= " "?
2023-08-25 18:17:52 localagi-api-1 | root-0-arguments-action ::= "\"search_internet\"" | "\"save_file\"" | "\"save_memory\"" | "\"search_memory\"" | "\"plan\"" | "\"reply\""
2023-08-25 18:17:52 localagi-api-1 | number ::= ("-"? ([0-9] | [1-9] [0-9]*)) ("." [0-9]+)? ([eE] [-+]? [0-9]+)? space
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Loading model llama from wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Loading model in memory from file: /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Loading GRPC Model llama: {backendString:llama model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin threads:14 assetDir:/tmp/localai/backend_data context:{emptyCtx:{}} gRPCOptions:0xc0030c0dc0 externalBackends:map[autogptq:/build/extra/grpc/autogptq/autogptq.py bark:/build/extra/grpc/bark/ttsbark.py diffusers:/build/extra/grpc/diffusers/backend_diffusers.py exllama:/build/extra/grpc/exllama/exllama.py huggingface-embeddings:/build/extra/grpc/huggingface/huggingface.py] grpcAttempts:20 grpcAttemptsDelay:2 singleActiveBackend:false}
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG Loading GRPC Process: /tmp/localai/backend_data/backend-assets/grpc/llama
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG GRPC Service for wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin will be running at: '127.0.0.1:45259'
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG GRPC Service state dir: /tmp/go-processmanager1416834915
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG GRPC Service Started
2023-08-25 18:17:52 localagi-api-1 | rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:45259: connect: connection refused"
2023-08-25 18:17:52 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr 2023/08/25 16:17:52 gRPC Server listening at 127.0.0.1:45259
2023-08-25 18:17:54 localagi-api-1 | 4:17PM DBG GRPC Service Ready
2023-08-25 18:17:54 localagi-api-1 | 4:17PM DBG GRPC: Loading model with options: {state:{NoUnkeyedLiterals:{} DoNotCompare:[] DoNotCopy:[] atomicMessageInfo:<nil>} sizeCache:0 unknownFields:[] Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin ContextSize:2048 Seed:0 NBatch:512 F16Memory:true MLock:false MMap:true VocabOnly:false LowVRAM:false Embeddings:false NUMA:false NGPULayers:0 MainGPU: TensorSplit: Threads:14 LibrarySearchPath: RopeFreqBase:0 RopeFreqScale:0 RMSNormEps:0 NGQA:0 ModelFile:/models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin Device: UseTriton:false ModelBaseName: UseFastTokenizer:false PipelineType: SchedulerType: CUDA:false CFGScale:0 IMG2IMG:false CLIPModel: CLIPSubfolder: CLIPSkip:0 Tokenizer:}
2023-08-25 18:17:54 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr create_gpt_params: loading model /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin
2023-08-25 18:17:54 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr gguf_init_from_file: invalid magic number 67676a74
2023-08-25 18:17:54 localagi-api-1 | [172.20.0.3]:57816 500 - POST /v1/chat/completions
2023-08-25 18:17:54 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr error loading model: llama_model_loader: failed to load model from /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin
2023-08-25 18:17:54 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr
2023-08-25 18:17:54 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr llama_load_model_from_file: failed to load model
2023-08-25 18:17:54 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr llama_init_from_gpt_params: error: failed to load model '/models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin'
2023-08-25 18:17:54 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr load_binding_model: error: unable to load model
2023-08-25 18:17:54 localagi-api-1 | 4:17PM DBG Request received:
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG Configuration read: &{PredictionOptions:{Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin Language: N:0 TopP:0.95 TopK:40 Temperature:0.1 Maxtokens:0 Echo:false Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 TypicalP:0 Seed:0 NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Name:gpt-4 F16:true Threads:14 Debug:true Roles:map[] Embeddings:false Backend:llama TemplateConfig:{Chat:wizardlm-chat ChatMessage: Completion:wizardlm-completion Edit: Functions:} PromptStrings:[] InputStrings:[] InputToken:[] functionCallString: functionCallNameString: FunctionsConfig:{DisableNoAction:false NoActionFunctionName: NoActionDescriptionName:} FeatureFlag:map[] LLMConfig:{SystemPrompt: TensorSplit: MainGPU: RMSNormEps:0 NGQA:0 PromptCachePath: PromptCacheAll:false PromptCacheRO:false MirostatETA:0.1 MirostatTAU:5 Mirostat:2 NGPULayers:0 MMap:true MMlock:false LowVRAM:false Grammar: StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:2048 NUMA:false} AutoGPTQ:{ModelBaseName: Device: Triton:false UseFastTokenizer:false} Diffusers:{PipelineType: SchedulerType: CUDA:false EnableParameters: CFGScale:0 IMG2IMG:false ClipSkip:0 ClipModel: ClipSubFolder:} Step:0 GRPC:{Attempts:0 AttemptsSleepTime:0}}
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG Parameters: &{PredictionOptions:{Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin Language: N:0 TopP:0.95 TopK:40 Temperature:0.1 Maxtokens:0 Echo:false Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 TypicalP:0 Seed:0 NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Name:gpt-4 F16:true Threads:14 Debug:true Roles:map[] Embeddings:false Backend:llama TemplateConfig:{Chat:wizardlm-chat ChatMessage: Completion:wizardlm-completion Edit: Functions:} PromptStrings:[] InputStrings:[] InputToken:[] functionCallString: functionCallNameString: FunctionsConfig:{DisableNoAction:false NoActionFunctionName: NoActionDescriptionName:} FeatureFlag:map[] LLMConfig:{SystemPrompt: TensorSplit: MainGPU: RMSNormEps:0 NGQA:0 PromptCachePath: PromptCacheAll:false PromptCacheRO:false MirostatETA:0.1 MirostatTAU:5 Mirostat:2 NGPULayers:0 MMap:true MMlock:false LowVRAM:false Grammar: StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:2048 NUMA:false} AutoGPTQ:{ModelBaseName: Device: Triton:false UseFastTokenizer:false} Diffusers:{PipelineType: SchedulerType: CUDA:false EnableParameters: CFGScale:0 IMG2IMG:false ClipSkip:0 ClipModel: ClipSubFolder:} Step:0 GRPC:{Attempts:0 AttemptsSleepTime:0}}
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG Prompt (before templating): plan a roadtrip to San Francisco
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG Template found, input modified to: plan a roadtrip to San Francisco
2023-08-25 18:17:55 localagi-api-1 |
2023-08-25 18:17:55 localagi-api-1 | ### Response:
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG Prompt (after templating): plan a roadtrip to San Francisco
2023-08-25 18:17:55 localagi-api-1 |
2023-08-25 18:17:55 localagi-api-1 | ### Response:
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG Loading model llama from wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG Loading model in memory from file: /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG Loading GRPC Model llama: {backendString:llama model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin threads:14 assetDir:/tmp/localai/backend_data context:{emptyCtx:{}} gRPCOptions:0xc0001a2dc0 externalBackends:map[autogptq:/build/extra/grpc/autogptq/autogptq.py bark:/build/extra/grpc/bark/ttsbark.py diffusers:/build/extra/grpc/diffusers/backend_diffusers.py exllama:/build/extra/grpc/exllama/exllama.py huggingface-embeddings:/build/extra/grpc/huggingface/huggingface.py] grpcAttempts:20 grpcAttemptsDelay:2 singleActiveBackend:false}
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG Loading GRPC Process: /tmp/localai/backend_data/backend-assets/grpc/llama
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG GRPC Service for wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin will be running at: '127.0.0.1:40749'
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG GRPC Service state dir: /tmp/go-processmanager3315229286
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG GRPC Service Started
2023-08-25 18:17:55 localagi-api-1 | rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:40749: connect: connection refused"
2023-08-25 18:17:55 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr 2023/08/25 16:17:55 gRPC Server listening at 127.0.0.1:40749
2023-08-25 18:17:57 localagi-api-1 | 4:17PM DBG GRPC Service Ready
2023-08-25 18:17:57 localagi-api-1 | 4:17PM DBG GRPC: Loading model with options: {state:{NoUnkeyedLiterals:{} DoNotCompare:[] DoNotCopy:[] atomicMessageInfo:<nil>} sizeCache:0 unknownFields:[] Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin ContextSize:2048 Seed:0 NBatch:512 F16Memory:true MLock:false MMap:true VocabOnly:false LowVRAM:false Embeddings:false NUMA:false NGPULayers:0 MainGPU: TensorSplit: Threads:14 LibrarySearchPath: RopeFreqBase:0 RopeFreqScale:0 RMSNormEps:0 NGQA:0 ModelFile:/models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin Device: UseTriton:false ModelBaseName: UseFastTokenizer:false PipelineType: SchedulerType: CUDA:false CFGScale:0 IMG2IMG:false CLIPModel: CLIPSubfolder: CLIPSkip:0 Tokenizer:}
2023-08-25 18:17:57 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr create_gpt_params: loading model /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin
2023-08-25 18:17:57 localagi-api-1 | [172.20.0.3]:57816 500 - POST /v1/chat/completions
2023-08-25 18:17:57 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr gguf_init_from_file: invalid magic number 67676a74
2023-08-25 18:17:57 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr error loading model: llama_model_loader: failed to load model from /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin
2023-08-25 18:17:57 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr
2023-08-25 18:17:57 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr llama_load_model_from_file: failed to load model
2023-08-25 18:17:57 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr llama_init_from_gpt_params: error: failed to load model '/models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin'
2023-08-25 18:17:57 localagi-api-1 | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr load_binding_model: error: unable to load model
1970-01-01 01:00:00 localagi-api-1 exited with code 0
1970-01-01 01:00:00