Models web app Roadmap

[Kimonas Sotirchos]

Lets use this issue to discuss the roadmap of the newly added web app and document the next steps. Also really looking forward to hear users' feedback and what features people would like to see, so if you have something in mind feel free to chime in!

These are some of the things I was planning to work on:

1. Integration/e2e/unit tests #3 #4, which will allow us to ensure that new features won't break existing functionalities
2. Move the Angular UI framework to version 11, from 8 which is the current version for most of Kubeflow's apps kubeflow/kubeflow#5525
3. Performance improvements by replacing the current poling mechanism with a more efficient implementation
   • Use persistent connections via browser-APIs/protocols, like WebSockets, Server-Side-Events etc instead of polling
   • Have the UI perform a persistent watch operation on the API server to efficiently detect changes
4. Further integrate the app's METRICS tab with KFServing's monitoring solution
5. Support for Multi Model Architecture
   • Exposing information about the TrainedMoleds of an InferenceService when listing the InferenceServices in a namespace
   • Allow users to create/delete/manage the TrainedModels that belong to an InferenceService
6. Enhance the UX of creating a new InferenceService via the UI
   • Don't simply expect user to submit a YAML, but also provide an intuitive workflow for configuring the different parts of an InferenceService
   • Support for also launching TrainedModel CRs

cc @yuzisun @pvaneck @animeshsingh @StefanoFioravanzo @elikatsis @tasos-ale

[Gautam Kumar]

Do we plan to integrate KFServing UI with Kubeflow web UI?

[Kimonas Sotirchos]

@goswamig I missed this, thanks for pointing it out! Correct, we should add an entry in Kubeflow's CentralDashboard for this web app as well.

I'll also create a tracking issue for this.

[David van der Spek]

I've come up with a solution that will allow for namespace isolated Grafana dashboards without running multiple instances of Grafana (which also wouldn't work from an isolation standpoint). I think it will be important to explore this with multiple working groups, as I'm sure many of them would like to have integrated metrics dashboards.
@kimwnasptd Can you explain how you are implementing Grafana authentication with the current integration in the Models Web App? Or have you enabled anonymous viewing in Grafana for the integration to work?

[NongMO]

Can't deploy Model UI to local kubeflow now?

[Kimonas Sotirchos]

Hi @nongqiqin, could you create a distinct issue for this so that we can further investigate there?

[NongMO]

Hi @nongqiqin, could you create a distinct issue for this so that we can further investigate there?

Found a solution, 3Q

[Mark Winter]

Move the Angular UI framework to version 11, from 8 which is the current version for most of Kubeflow's apps

I took a look at this. I think it is currently blocked by the Ace Editor module which doesn't support a new angular version