BasedHardware / omi

AI wearables

Home Page:https://omi.me

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Deepgram Self-hosted

beastoin opened this issue · comments

commented

currently we have the limits 100 concurrencies for DG + 100 concurrencies soniox
if we hit 10K user then we will need ~ 300 concurrencies. then if 100K ? yes 3000 concurrencies

--from Damien(DG team)
Then additional 100 concurrencies are $10k on each tier
If you self host Deepgram on your own infra there is no concurrency cost since you can scale as large as you like with your own GPUs
We have docker images and helm charts if you want to deploy on Kubernetes etc
https://developers.deepgram.com/docs/self-hosted-introduction
We will need an MNDA in place to provide access and share benchmarks for different GPUs