support streaming for GCP
Intex32 opened this issue · comments
Ron S commented
When basic functionality of GCP was implemented, GCP did not offer streaming the response.
This now appears to be available and aligns with the plan of lifting GCP to the same support level as OAI in XEF.
https://cloud.google.com/vertex-ai/docs/generative-ai/learn/streaming#text