ML Lineage UI for TFX

Question

ML Lineage UI for TFX

theadactyl opened this issue 3 years ago · comments

While all the data exists in MLMD, we currently have to rely on orchestrator to represent the executions and other metadata in a nice and organized UI. This would bring a frontend and backend to generate Web UIs from TFX metadata.

cc @casassg

Peter Boothroyd · Answer 1 · Wed Apr 07 2021 02:51:44 GMT+0800 (China Standard Time)

Would love to see this too. In case you haven't come across it there is prior art within the tfx repo, and a frontend built into the kubeflow project

Edit: I guess you have seen the kubeflow UI... Anyway might be useful for anybody else who ends up here

Robert Crowe · Answer 2 · Thu Apr 15 2021 02:40:02 GMT+0800 (China Standard Time)

Similar to KF, Airflow lineage UI but with better support for artifact exploration
Twitter has an implementation using React, has been useful
What do people want to see in it? What functionality?
KF tool has been useful for showing managers the use of lineage
Should follow the library development

Hamza Tahir · Answer 3 · Wed Dec 08 2021 04:24:36 GMT+0800 (China Standard Time)

We have a new implementation of a lineage explorer over at ZenML https://github.com/zenml-io/zenml/tree/main/examples/lineage. Would the community be interested in addition this as part of tfx-addons?

Gerard Casas Saez · Answer 4 · Thu Dec 09 2021 08:26:52 GMT+0800 (China Standard Time)

@htahir1 that would be great! I think it would be interesting first to have the lineage as a low level API from MLMD (viz can be added after we have that). I'm one of the owners for MLMD Client, so if you want to contribute it there: https://github.com/tensorflow/tfx-addons/tree/main/tfx_addons/mlmd_client I would be happy to review :D

Curious on what you think this could be implemented like?

Robert Crowe · Answer 5 · Fri Jan 07 2022 05:35:10 GMT+0800 (China Standard Time)

Coming back to this, I think it would be a nice addition! One question - I don't see an example of how lineage is displayed for components which produce multiple artifacts. Is there any issue with that? Robert Crowe | TensorFlow Developer Engineer | ***@***.*** | @robert_crowe <https://twitter.com/robert_crowe>

…

On Wed, Dec 8, 2021 at 4:27 PM Gerard Casas Saez ***@***.***> wrote: @htahir1 <https://github.com/htahir1> that would be great! I think it would be interesting first to have the lineage as a low level API from MLMD (viz can be added after we have that). I'm one of the owners for MLMD Client, so if you want to contribute it there: https://github.com/tensorflow/tfx-addons/tree/main/tfx_addons/mlmd_client I would be happy to review :D Curious on what you think this could be implemented like? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#14 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKVWSW43QU333UOMQBR6GH3UP7ZVRANCNFSM42K2S2DQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.