Giters

tensorflow / serving

A flexible, high-performance serving system for machine learning models

Home Page:https://www.tensorflow.org/serving

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Dose TF-serving docker container support TensorRT，how can I use it？

Henry-Avery opened this issue · comments

commented

Please go to Stack Overflow for help and support:

https://stackoverflow.com/questions/tagged/tensorflow-serving

If you open a GitHub issue, here is our policy:

  1. It must be a bug, a feature request, or a significant problem with
    documentation (for small docs fixes please send a PR instead).
  2. The form below must be filled out.

Here's why we have that policy: TensorFlow developers respond to issues.
We want to focus on work that benefits the whole community, e.g., fixing bugs
and adding features. Support only helps individuals. GitHub also notifies
thousands of people when issues are filed. We want them to see you communicating
an interesting problem, rather than being redirected to Stack Overflow.

Feature Request

If this is a feature request, please fill out the following form in full:

Describe the problem the feature is intended to solve

A clear and concise description of what the problem is. Ex. I'm always
frustrated when [...]

Describe the solution

A clear and concise description of what you want to happen.

Describe alternatives you've considered

A clear and concise description of any alternative solutions or features you've
considered.

Additional context

Add any other context or screenshots about the feature request here.

Bug Report

If this is a bug report, please fill out the following form in full:

System information

  • OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
  • TensorFlow Serving installed from (source or binary):
  • TensorFlow Serving version:

Describe the problem

Describe the problem clearly here. Be sure to convey here why it's a bug in
TensorFlow Serving.

Exact Steps to Reproduce

Please include all steps necessary for someone to reproduce this issue on their
own machine. If not, skip this section.

Source code / logs

Include any logs or source code that would be helpful to diagnose the problem.
If including tracebacks, please include the full traceback. Large logs and files
should be attached. Try to provide a reproducible test case that is the bare
minimum necessary to generate the problem.

commented

@Henry-Avery

Apologies for the delay and as per this release notes TF-serving docker container support TensorRT and for your references I have added one good article here and also user-guide and tutorial, I hope it will help you to resolve your issue, if issue still persists or you need any further assistance please let us know ?

Thank you!

commented

Hi, @Henry-Avery

Closing this issue due to lack of recent activity for couple of weeks. Please feel free to reopen the issue or post comments, if you need any further assistance or update. Thank you!