tensorflow-serving

There are 11 repositories under tensorflow-serving topic.

Delta-ML / delta
DELTA is a deep learning based natural language and speech processing platform. LF AI & DATA Projects: https://lfaidata.foundation/projects/delta/
nlp deep-learning tensorflow speech sequence-to-sequence seq2seq speech-recognition text-classification speaker-verification nlu text-generation emotion-recognition tensorflow-serving tensorflow-lite inference asr serving front-end custom-ops ops
Language:Python 1598
Adlik / Adlik
Adlik: Toolkit for Accelerating Deep Learning Inference
deep-learning inference tensorflow-serving openvino tensorrt compiler inference-engine model-optimizer docker-images
Language:C++ 806
DSXiangLi / ChineseNER
中文NER的那些事儿
bert-bilstm-crf crf bert-fine-tuning ner bilstm-crf adversarial-transfer-learning multitask-learning chinese-ner msra msr people-daily muti-task tf-serving tensorflow-serving tensorflow-serving-grpc bert tensorflow chinesener data-augmentation mrc
Language:Python 320
Azure / kubeflow-labs
👩‍🔬 Train and Serve TensorFlow Models at Scale with Kubernetes and Kubeflow on Azure
kubernetes kubeflow machine-learning tensorflow tensorflow-serving distributed-tensorflow docker jupyter-notebook jupyterhub
Language:Python 291
codebasics / potato-disease-classification
Potato Disease Classification - Training, Rest APIs, and Frontend to test.
deep-learning cnn-keras cnn-classification tensorflow2 keras keras-tensorflow tensorflow tensorflow-serving convolutional-neural-networks python3
Language:Jupyter Notebook 261
helmut-hoffer-von-ankershoffen / jetson
Helmut Hoffer von Ankershoffen experimenting with arm64 based NVIDIA Jetson (Nano and AGX Xavier) edge devices running Kubernetes (K8s) for machine learning (ML) including Jupyter Notebooks, TensorFlow Training and TensorFlow Serving using CUDA for smart IoT.
ansible k8s ml kubernetes cuda skaffold kustomize jupyter machine-learning smart-iot docker edge-devices tensorflow-serving nvidia-jetson-xavier nvidia-jetson-nano archiconda virtualbox kubeflow hoffer-von-ankershoffen software-engineering
Language:Python 209
recommender-system-tutorial
xei / recommender-system-tutorial
A step-by-step tutorial on developing a practical recommendation system (retrieval and ranking) using TensorFlow Recommenders and Keras.
recommender-system recommendation-system recommendation-engine information-retrieval ranking ranking-system tensorflow tensorflow-tutorials tensorflow-examples tensorflow-recommenders tensorflow-datasets tensorflow-serving keras keras-tutorials movielens movielens-movie-recommendation
Language:Jupyter Notebook 206
cap-ntu / ML-Model-CI
MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
continuous-integration convert-models deep-learning dispatcher inference mlops onnx profiler pytorch serving tensorflow-serving tensorrt tensorrt-inference-server
Language:Python 197
clearml / clearml-serving
ClearML - Model-Serving Orchestration and Repository Solution
machine-learning mlops devops deep-learning kubernetes ai clearml model-serving serving serving-pytorch-models serving-ml tensorflow-serving triton triton-inference-server
Language:Python 157
formath / tensorflow-predictor-cpp
tensorflow prediction using c++ api
tensorflow tensorflow-cmake tensorflow-prediction tensorflow-predictor-cpp tensorflow-serving tensorflow-graph deep-learning machine-learning embedding-models tfrecords freeze-model libffm
Language:Python 150
kaiwaehner / tensorflow-serving-java-grpc-kafka-streams
Kafka Streams + Java + gRPC + TensorFlow Serving => Stream Processing combined with RPC / Request-Response
apache kafka kafka-streams apache-kafka confluent grpc grpc-java tensorflow tensorflow-serving deeplearning deep-learning machine-learning machinelearning java java-platform
Language:Java 150
practicingman / bert_serving
export bert model for serving
bert-serving google-bert tensorflow-serving text-classification
Language:Python 141
himanshurawlani / keras-and-tensorflow-serving
Deploying Keras models using TensorFlow Serving and Flask
machine-learning deep-learning keras tensorflow-serving flask inceptionv3 image-classification
Language:Python 121
cmusatyalab / OpenTPOD
Open Toolkit for Painless Object Detection
dnn transfer-learning object-detection deep-neural-networks automl fine-tuning deep-neural-network deep-learning object-detection-pipelines object-detection-api object-detection-model object-detection-tutorial tensorflow tensorflow-serving tensorflow-models custom-vision custom-vision-api django django-rest-framework reactjs
Language:CSS 118
CCExtractor / Rekognition
Free and Open Source alternative to Amazon's Rekognition service. CCExtractor Development | Poor Man's Rekognition
tensorflow tensorflow-serving docker python opencv video-processing rest-api image-processing gsoc machine-learning machinelearning deep-learning computer-vision face-detection django django-rest-framework rest
Language:Python 116
peace195 / tensorflow-lite-YOLOv3
YOLOv3: convert .weights to .tflite format for tensorflow lite. Convert .weights to .pb format for tensorflow serving
convert docker pb protobuf tensorflow-lite tensorflow-serving tflite weights yolov3
Language:Python 106
icodingc / ImageRetrieval-tf
基于tensorflow & tf-servering & flask 的图像检索
image-retrieval retrieval tensorflow tensorflow-serving web-demo
Language:JavaScript 102
notAI-tech / fastDeploy
Deploy DL/ ML inference pipelines with minimal extra code.
deep-learning tensorflow-serving tf-serving pytorch serving falcon gevent docker model-deployment model-serving http-server gunicorn torchserve triton-inference-server python triton triton-server inference-server streaming-audio websocket
Language:Python 100
yu-iskw / tensorflow-serving-example
Examples to server tensorflow models with tensorflow serving
tensorflow-estimators tensorflow-serving tensorflow tensorflow-examples machine-learning
Language:Python 98
BeyonderXX / tensorflow-serving-tutorial
A tutorial of building tensorflow serving service from scratch
tensorflow-serving java python docker grpc deep-learning tensorflow savedmodel text-classification bert
Language:C++ 89
google-aai / tf-serving-k8s-tutorial
A Tutorial for Serving Tensorflow Models using Kubernetes
docker-image google-cloud keras-tensorflow kubeflow kubeflow-community kubernetes tensorflow-api tensorflow-serving tensorflow-tutorials
Language:Jupyter Notebook 88
digital-nomad-cheng / Hair_Segmentation_Keras
Implement some hair segmentation network and a color similarity calculating method.
segmentation keras computer-vision hair-segmentation coreml tensorflow-serving
Language:Python 87
MaybeShewill-CV / nsfw-classification-tensorflow
NSFW classify model implemented with tensorflow.
nsfw nsfw-recognition tensorflow-js tensorflow-serving deep-learning image-classification
Language:Python 81
carlomazzaferro / kryptoflow
Real-time analysis of bitcoin markets with Kafka and Tensorflow Serving
kafka bitcoin time-series machine-learning tensorflow-serving keras
Language:Python 72
Yulv-git / Model-Inference-Deployment
A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
inference deployment onnx openvino tensorrt mediapipe tensorflow-lite tensorflow-serving onnx-runtime libtorch ncnn tnn mnn tvm mace paddle-lite megengine-lite openppl bolt awesome
Language:Python 70
lightbend / model-serving-tutorial
Code and presentation for Strata Model Serving tutorial
model-serving kafka akka-streams flink spark pmml tensorflow tensorflow-serving
Language:Scala 68
himanshurawlani / practical_intro_to_tf2
Building an image classifier in TF2
tensorflow tensorflow-datasets tf-keras tensorflow-2 image-classifier tensorflow-serving
Language:Jupyter Notebook 56
gyang274 / visual-search
Create a visual search engine using tensorflow serving, elasticsearch, vuejs and nginx.
elasticsearch nginx tensorflow tensorflow-serving vuejs
Language:Python 50
nghuyong / bert-classification-tf-serving
Use BERT to train a classification model and deploy the model by tensorflow serving
bert tensorflow tensorflow-serving classification-model
Language:Python 50
lucko515 / image-search-engine
End-to-end image search engine based on the Deep learning techniques.
artificial-intelligence convolutional-neural-networks deep-learning end-to-end-machine-learning flask image-search tensorflow tensorflow-serving
Language:Jupyter Notebook 48
em3s / tensorflow-scala
A Scala binding of TensorFlow for Serving TensorFlow Models (Provides RESTful API)
tensorflow scala tensorflow-serving finatra restful
Language:Shell 47
wangermeng2021 / Scaled-YOLOv4-tensorflow2
A Tensorflow2.x implementation of Scaled-YOLOv4 as described in Scaled-YOLOv4: Scaling Cross Stage Partial Network
tensorflow2 scaledyolov4 yolov4 object-detection yolo tf2 tensorflow tensorflow-serving
Language:Python 47
alexellis / tensorflow-serving-openfaas
Example of using TensorFlow Serving with OpenFaaS
tensorflow machine-learning ai tf tensorflow-serving docker openfaas serverless function
Language:Dockerfile 46
fpaupier / tensorflow-serving_sidecar
Serve machine learning models using tensorflow serving
tensorflow tensorflow-tutorials tensorflow-serving object-detection object-detection-pipelines coco python docker
Language:Python 45
guillaumegenthial / tf-estimator-basics
Train, predict, export and reload a tf.estimator for inference
tensorflow tensorflow-estimator tensorflow-serving
Language:Python 45
LanderMoerkerke / camera-feed-object-detector-tf-serve
Camera feed detector using Tensorflow Detection API on a Tensorflow Serving Docker container. There is also a version using only YoloV3 to detect objects. All models are from the model zoo from Tensorflow and Darknet, these models are trained on the coco dataset.
tensorflow object-detection tensorflow-serving docker yolov3 python
Language:Python 44

tensorflow-serving

Delta-ML / delta

Adlik / Adlik

DSXiangLi / ChineseNER

Azure / kubeflow-labs

codebasics / potato-disease-classification

helmut-hoffer-von-ankershoffen / jetson

xei / recommender-system-tutorial

cap-ntu / ML-Model-CI

clearml / clearml-serving

formath / tensorflow-predictor-cpp

kaiwaehner / tensorflow-serving-java-grpc-kafka-streams

practicingman / bert_serving

himanshurawlani / keras-and-tensorflow-serving

cmusatyalab / OpenTPOD

CCExtractor / Rekognition

peace195 / tensorflow-lite-YOLOv3

icodingc / ImageRetrieval-tf

notAI-tech / fastDeploy

yu-iskw / tensorflow-serving-example

BeyonderXX / tensorflow-serving-tutorial

google-aai / tf-serving-k8s-tutorial

digital-nomad-cheng / Hair_Segmentation_Keras

MaybeShewill-CV / nsfw-classification-tensorflow

carlomazzaferro / kryptoflow

Yulv-git / Model-Inference-Deployment

lightbend / model-serving-tutorial

himanshurawlani / practical_intro_to_tf2

gyang274 / visual-search

nghuyong / bert-classification-tf-serving

lucko515 / image-search-engine

em3s / tensorflow-scala

wangermeng2021 / Scaled-YOLOv4-tensorflow2

alexellis / tensorflow-serving-openfaas

fpaupier / tensorflow-serving_sidecar

guillaumegenthial / tf-estimator-basics

LanderMoerkerke / camera-feed-object-detector-tf-serve