uschen / face-inference-rs

Rust GRPC server for face recognition, face detection and face alignment using TensorRT, Cuda on JetPack SDK (Jetson Nano, Jetson Xavier NX)

face-inference-rs

An example project to build a face recognition, face detection, and face alignment inference service using GRPC, Rust, TensorRT, CUDA, running on Jetson Nano, Jetson Xavier NX.

Architecture

Deep face analysis

• Face Detection: Retinaface by deepinsight/insightface
• Face Recognition: Arcface by deepinsight/insightface

GRPC Server

• Tonic hyperium/tonic
• Protobuf tokio-rs/prost

Project Structure

• retinaface: Rust bindings for Arcface and Retinaface C++ implementations.
  • retinaface/libretinaface: TensorRT implementation of Arcface and Retinaface. Based on wang-xinyu/tensorrtx.
• proto: Protobuf definitions for GRPC server.
• rs-genproto: library that generates rust protobuf for GRPC server.
• server: Implementation of inference GRPC server.