jina-ai / langchain-serve

⚡ Langchain apps in production using Jina & FastAPI

Home Page:https://cloud.jina.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Is there any support for Data persistence?

pengxiao-song opened this issue · comments

Hey! We are the team of LaWGPT, and your work is so wonderful!

Now, We have a demand that LaWGPT needs persistent storage of user question-and-answer data (data collection) for iterative project updates. So is there any support to cope with this problem?

Thank you very much!

@pengxiao-song glad to see you here.

persistent storage of user question-and-answer data (data collection) for iterative project updates
Jina AI Cloud has support for persistent data storage. Few questions

  • What kind of data format do you use?
  • What data size do you expect?
  • Any latency expectations from the data in/out operations?

@pengxiao-song glad to see you here.

persistent storage of user question-and-answer data (data collection) for iterative project updates
Jina AI Cloud has support for persistent data storage. Few questions

  • What kind of data format do you use?
  • What data size do you expect?
  • Any latency expectations from the data in/out operations?

Thank you for your reply~

  • Data Format: Mostly, string type
  • Data Size: There is no precise estimate at the moment. For the initial stages of the project, 1G should be sufficient.
  • Sorry, I am confused of "latency expectations".

Alright. Though Jina AI Cloud supports persistent storage, right now it is not exposed via langchain-serve. I'll work on this and let you know once released.

Alright. Though Jina AI Cloud supports persistent storage, right now it is not exposed via langchain-serve. I'll work on this and let you know once released.

Thanks, very expected to your nice work!

@pengxiao-song persistent disk is now supported with the new release 0.0.36. You can find the usage in the readme.

@pengxiao-song persistent disk is now supported with the new release 0.0.36. You can find the usage in the readme.

Nice work! I will take a look carefully later. Thanks!