infiniflow / ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

Home Page:https://ragflow.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ROADMAP 2024

writinwaters opened this issue · comments

v0.8.0

  • Support RAG graph orchestration and workflow #918
  • Support Self RAG #1069
  • Support several operators for initial agent/workflow
  • Moving files #785

v0.7.0

  • Implements RAPTOR for better chunking. #882
  • Supports ARM platform. #842
  • Supports HTML file.
  • Integrates reranker.

v0.6.0

  • Print version or commit-id when RAGFlow is started. Or showing these information on UI. #643
  • Chunks retrieval APIs #821
  • Files in knowledge base should also be found in file manager. #800
  • System components monitoring. #848
  • Supports simple document layout to speed up file parsing.#799
  • Streaming conversation output. #709
  • Default language will be given according to the browse setting and also can be configured. #801

Long-term plan

                                                 INFO:werkzeug:WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
  • Running on all addresses (0.0.0.0) [00:00<?, ?B/s]
  • Running on http://127.0.0.1:9380
  • Running on http://172.18.0.6:9380
    INFO:werkzeug:Press CTRL+C to quit
    tsr.onnx: 100%|██████████| 12.2M/12.2M [00:01<00:00, 11.3MB/s]
    layout.manual.onnx: 100%|██████████| 12.2M/12.2M [00:01<00:00, 8.83MB/s]
    layout.paper.onnx: 100%|██████████| 12.2M/12.2M [00:01<00:00, 11.6MB/s]]
    layout.onnx: 100%|██████████| 12.2M/12.2M [00:01<00:00, 7.65MB/s]3MB/s]
    Fetching 9 files: 100%|██████████| 9/9 [00:06<00:00, 1.42it/s]s]
    Fetching 9 files: 100%|██████████| 9/9 [00:06<00:00, 1.39it/s]
    INFO:werkzeug:172.18.0.1 - - [07/Apr/2024 11:35:22] "GET / HTTP/1.1" 200 -
    INFO:werkzeug:172.18.0.1 - - [07/Apr/2024 11:35:22] "GET /favicon.ico HTTP/1.1" 200 -
    WARNING:root:Realtime synonym is disabled, since no redis connection.

v0.1.0

  • URL support: Capable of web crawling and the corresponding content extration. @KevinHuSh

@KevinHuSh Hi, I wonder what's the current status? Maybe i can collaborate on it. My tech Stack is python backend and i think web crawling is essential for workflow of software development.

v0.1.0

  • URL support: Capable of web crawling and the corresponding content extration. @KevinHuSh

@KevinHuSh Hi, I wonder what's the current status? Maybe i can collaborate on it. My tech Stack is python backend and i think web crawling is essential for workflow of software development.

Crawling web page is big thing in my understanding. We do not have a clear picture for this. Here are two important points to note:
Crawling Task Dispaching
The way to execute JS on the page
Page classification which is related the structure of the data we store
The extraction of the main parts of the page

If you have any good solution to these points, please let me know....

Crawling web page is big thing in my understanding. We do not have a clear picture for this. Here are two important points to note: Crawling Task Dispaching The way to execute JS on the page Page classification which is related the structure of the data we store The extraction of the main parts of the page

If you have any good solution to these points, please let me know....

@KevinHuSh Please refer to #315

Maybe i can start with AWS Bedrock models to contribute to the project, then Support x-inference as model provider. Feel free to contact me via here or wx.

@writinwaters @KevinHuSh Hi. Requesting to look at the issue I created: #345

Maybe fixing these issues would help us adopt ragflow better.

Not supporting streaming really affects the user experience. I hope it can be supported soon, as the implementation is not complicated.

v0.6.0

Whether it can provide users with accurate answers and quick answers, one is subject to accuracy and the other is subject to quick response

v0.6.0

Whether it can provide users with accurate answers and quick answers, one is subject to accuracy and the other is subject to quick response

You can file a new issue, so we can discuss in that issue.

Are there any plans to use big language models for knowledge graphs?

Are there any plans to use big language models for knowledge graphs?

We've been thinking about this for a while, but haven't figured out how to implement it in RAGFlow. If you have any good issues, feel free to create a new issue and we'll discuss it!

Can it automatically continue when it says 'Due to length...' ? The current handling of length issues feels very rudimentary.

Postpone feature request of reranker configuration to 0.7.0.