RenderHeads / UnityPlugin-AVProLiveCamera

AVPro Live Camera is a Unity plugin for webcams, TV cards and capture cards

Home Page:https://renderheads.com/products/avpro-live-camera/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

FPS decreases on AVPro Live camera plugin

katsuwo opened this issue · comments

FPS decreases has occurred.
The camera is Logitech C 922.
Right after the start with 1920x1080 MJPG, it is fine. I got a 30fps.
However, if the camera image changes significantly, the FPS will decrease to 3-5fps, and then it will not return.

WIndows10 pro Build17763.615
Unity 2019.1.9f1
AVPro LiveCam plugin(EVA Version)
Logicool C922 Web-camera 1920 x 1080 MJPG
i7-8700K 32GBmem RADEON Vega56

https://www.youtube.com/watch?v=PJXNIxbi0dg

Thanks for posting, we'll investigate further...very odd
Does it happen in the other demos too?

I haven't managed to replicate this issue. I have a Logitech BRIO webcam and it doesn't slow down like that. If I completely cover the sensor then it slows down to 15FPS. This is normal behaviour as the camera is trying to compensate for low light levels by using a longer exposure time (which reduces frame rate). After under-covering it though, it quickly jumps back to 30FPS.

A few questions / suggestions:

  1. Does your FPS rate recover eventually if you stop waving your hand?
  2. I notice you're using an old version of the plugin - please upgrade to the latest version (2.8.0)
  3. Check if there is a new driver/firmware for your camera - this may fix the issue
  4. Try going into the camera settings and disabling things like auto exposure, "right light" etc..see if that helps.

Please let us know how you get on with this.

Thanks,

Dear andrew
Today I conducted the same test as last time.
The result was the same as last time.
Then I changed the camera connection terminal from USB3 to USB2.
As a result, the phenomenon that FPS declines does not occur.
However, even if I set it to 30 FPS, the measured value was 15 FPS.

1.Does your FPS rate recover eventually if you stop waving your hand?
2.I notice you're using an old version of the plugin - please upgrade to the latest version (2.8.0)
3.Check if there is a new driver/firmware for your camera - this may fix the issue

1:no. FPS is not recover until restart application
2;thanks. I will try 2.8.0
3:I can't find new firm and driver for C922

0df2ac97c96783f6963ae41bf089d33e

Logitech ce1000 4K,support 60fps,but plugin only display 42fps.
i have a global shutter camera,same to katsuwo's question.

your official website's dowload link is 2.7.5?
Can you provide a 2.8 test version link?

global shutter camera 1920*1080 mjpg 30fps,video test link:
https://v.qq.com/x/page/d09005i5leo.html

Logitech ce1000 1920*1080 mjpg 60fps,video test link:
https://v.qq.com/x/page/k09001kkfnv.html

use UnityPlugin-AVProLiveCamera-Latest-Trial.unitypackage,download from your official website

When I launched my UNITY-PROJECT today, FPS dropped to 5 again.
I don't know what's different from yesterday when it worked correctly.
The camera was connected to the terminal of USB2 yesterday and today.
Sometimes it becomes FPS 30, but after a while it drops to FPS 5.
I do not know the trigger

As a result of testing Ver2.8.0 and 2.7.5, I noticed that it was.
When executing UNITY-PROJECT, if AE & AF is OFF, it becomes FPS30.
When AE & AF is turned on, it becomes FPS5.
Even if AE & AF is turned off again, FPS does not return.

I changed AE / AF settings for the first time today.
I don't know why yesterday it worked with FPS 30.
This is an estimate, but I think AE / AF was on yesterday

Hmmm...thanks for the information.

I think this must be a problem with the camera/driver/firmware..Perhaps ask Logicool/Logitech?

As for:

Logitech ce1000 4K,support 60fps,but plugin only display 42fps.

To get 60fps you need to make sure the room is brightly lit. Also make sure there aren't any other CPU overheads, so try closing the list of "Modes" in the explorer demo. Try also making a standalone build.

your official website's dowload link is 2.7.5?
Can you provide a 2.8 test version link?

This link has been fixed now - thanks

win10 provide camer app, qulity and speed is better than 2.8 plugin. why?
my app is a standalone build.

Yesterday I built OpenCV as a DLL and made it a UNITY plug-in.
The same problem was confirmed there.
The only webcams I have are C922 and Intel RealSense D435,
D435 works with both OpenCV and AVProLiveCam at 1920x1080 @ 30FPS.
In addition, with CameraAPP of Windows 10, both cameras operate normally.
and Skype is too.

I think that there is no problem with the driver and the camera body because it works properly with Windows 10 camera app and Skype
The problems with OpenCV and AVProLivecam are very similar.
Does AVProLiveCam include OpenCV?

Interesting...And this was with Skype+Camera app running at the same 1920x1080 resolution?

If so, it might be an issue with using the DirectShow API (which we do, and perhaps OpenCV does too), and it must be an issue with Logitech support. You can also try to uninstall the Logitech driver - I've heard of some cases where that can help. Skype and Camera app might be using a new API like Media Foundation. Sadly I can't replicate the problem here on my Logitech BRIO webcam, so it's difficult to know.

@katsuwo can you send me your OpenCV as a DLL and made it a UNITY plug-in to me?
I want to test my camera c1000e and another camera.
thank you, my email,40595939@qq.com

Hey
puyingjie

can you send me your OpenCV as a DLL and made it a UNITY plug-in to me?

NO
I despise you
Below is a screenshot of the email you sent to me.
This content is too rude

fce23b4df03816638b91fff8d155d48d

I'm closing this thread as the issue seems related to the webcam/driver. I hope in the future we can add support for the more modern Media Foundation API to the plugin. I will create a new issue for this.