Can we use frozen graph(a single .pb file) for tensorflow serving

Question

Can we use frozen graph(a single .pb file) for tensorflow serving

saurabh944 opened this issue 2 years ago · comments

Due to some constraints I dont want to used saved model format. So can we use frozen graph(a single .pb file) for tensorflow serving

gaikwadrahul8 · Answer 1 · Wed Nov 02 2022 17:23:03 GMT+0800 (China Standard Time)

@saurabh944

May I know are you looking to use frozen graph ( a single .pb file) with TFX pipeline or you just want to serve your model standalone using TF serving so I'll provide you workaround accordingly ?

Thank you!

saurabh · Answer 2 · Wed Nov 02 2022 23:41:56 GMT+0800 (China Standard Time)

Hi @gaikwadrahul8
I just wanted to use frozen graph (a single .pb file) for TF serving.
Thanks

gaikwadrahul8 · Answer 3 · Thu Nov 03 2022 14:47:34 GMT+0800 (China Standard Time)

@saurabh944

Thank you for confirming and Yes you can serve model using single model .pb file with the help of Docker so please follow all the instructions mentioned in this article and also you can follow the TF serving official documentation here, I hope you'll able to serve your model

If you need any further assistance, please let us know

Thank you!

gaikwadrahul8 · Answer 4 · Mon Dec 19 2022 19:01:37 GMT+0800 (China Standard Time)

Hi, @saurabh944

Closing this due to inactivity for couple of weeks, Please feel free to re-open the issue if necessary and post your comments(if you still have queries on this). Thank you!