Realtime transcribe / streaming support?

[pax]

Hey @xenova do you think this will be supported in the future? Thanks!

[Joshua Lochner]

Hey! This is indeed possible now!

• HF Space: https://huggingface.co/spaces/Xenova/realtime-whisper-webgpu

• Source code: https://github.com/xenova/transformers.js/tree/v3/examples/webgpu-whisper

• Video:
  

  realtime-whisper-webgpu.mp4

Many optimizations still possible, but it's a good starting point!