NVIDIA / ChatRTX

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

NVIDIA/ChatRTX Issues

Remote/shared link/ shared session do not allow for reference files opening
Closed 15 days ago4
Build the Mistral TRT-LLM int4 AWQ Engine not working
Updated 15 days ago1
[BUG] "Invalid session." casued by "key, value = cookie.split('=')"
Updated 15 days ago1
Unable to build from source due to missing dependency
Closed 15 days ago2
[BUG] Installing CLIP model breaks ChatRTX
Updated 15 days ago1
How to add chatRTX support for edge model minicpm
Updated 15 days ago1
Update to Llama 3 8B model
Updated a month ago2
PDF Error?
Updated a month ago2
code
Closed a month ago
Improvement suggestions
Updated a month ago1
feature request - home assistant, replace siri
Closed a month ago2
already passed the verify_install.py but cant pass the app.py "ImportError: DLL load failed while importing tensorrt: 找不到指定的模块。"
Updated a month ago2
Simplified version?
Updated a month ago
ModuleNotFoundError: No module named 'tensorrt_llm'
Closed a month ago4
Importing from langchain will no longer be supported
Closed a month ago1
⁉️ Benefit of using ChatRTX instead of LMStudio or Ollama and other similar tools❓❔
Closed a month ago2
Unable to stream results. TypeError: 'NoneType' object is not iterable
Updated 2 months ago1
Fine-tune WhereIsAI/UAE-Large-V1 embeddings for Models First ?
Closed 2 months ago1
I am building a software like this right now, and finding this is depressing
Closed 2 months ago6
Support for Markdown files
Updated 2 months ago7
Installed both models in Chat-With-RTX but can only use Mistral 7B int4
Updated 2 months ago5
invalid session error
Closed 2 months ago4
nrw
Closed 2 months ago
Can Chat with RTX support Pre-trained models as dataset input?
Updated 2 months ago2
Can i install without 8gbvram?
Closed 2 months ago1
Can it run on dual GPU ?
Closed 2 months ago2
feat: can it read repository
Closed 2 months ago1
Large amount of files get stuck before loading
Updated 2 months ago1
Connection error
Closed 2 months ago4
Not able to generate engine on RTX4060 Laptop 8GB 100% CPU being utilised
Updated 2 months ago2
How to switch language?!
Closed 2 months ago3
Dtype value read by app.py empty. Gets error message : Unsupported dtype
Updated 2 months ago2
[Question] Would it be possible for the system to use spreadsheets as Dataset as well as .txt, .pdf, .doc
Updated 2 months ago1
ModuleNotFoundError: No module named 'tensorrt'
Closed 2 months ago15
'trtllm-build' is not recognized
Closed 2 months ago1
how do I define other large language models in the configuration?
Updated 2 months ago
How to implement chat history memory and system prompt?
Updated 2 months ago1
ChatWithRTX Installer is corrupt.
Closed 2 months ago3
[TensorRT-LLM][ERROR] CUDA runtime error in cudaDeviceGetDefaultMemPool
Closed 2 months ago2
not able to debug this even with gdb
Updated 2 months ago1
default response language
Closed 2 months ago2
What version of Cuda is needed?
Closed 2 months ago5
Override stringent GPU requirements
Updated 3 months ago1
build TRT engine fail
Closed 4 months ago6
garbage output ?
Closed 4 months ago1
pycryotodome
Closed 4 months ago1
Enhancement: Support for reading PDFs with partial DRM (AES) - include PyCryptodome dependency
Updated 4 months ago4
Some questions crash the app
Closed 4 months ago2
I had to install Microsoft MPI to be able to run it otherwise it was throwing error
Closed 4 months ago1
Minimum Requirements GPU RAM
Closed 5 months ago1